Skip to content

Variable supports container streams#564

Merged
frankmcsherry merged 2 commits into
TimelyDataflow:masterfrom
antiguru:variable_container
Feb 12, 2025
Merged

Variable supports container streams#564
frankmcsherry merged 2 commits into
TimelyDataflow:masterfrom
antiguru:variable_container

Conversation

@antiguru
Copy link
Copy Markdown
Member

Variable supports container streams. The PR achieves this by introducing two new extension traits:

  • ResultsIn applies PathSummary::results_in to every record in the stream.
  • Negate negates the diffs in a stream.

This is in support of allowing columnar data in Materialize recursive contexts.

Adds support for `Variable` for suitable container streams. By default,
support vectors, but leave the possibility for others to implement the new
`Negate` and `ResultsIn` extension traits, which are the required
interface for `Variable`.

Signed-off-by: Moritz Hoffmann <antiguru@gmail.com>
Signed-off-by: Moritz Hoffmann <antiguru@gmail.com>
Copy link
Copy Markdown
Member

@frankmcsherry frankmcsherry left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good; thank you!

@frankmcsherry frankmcsherry merged commit 4217a1c into TimelyDataflow:master Feb 12, 2025
@github-actions github-actions Bot mentioned this pull request Feb 12, 2025
@antiguru antiguru deleted the variable_container branch February 13, 2025 08:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants