Skip to content

vector: improve Apply performance on homogenous Dynamics - #7340

Merged
nwt merged 2 commits into
mainfrom
apply-perf
Sep 21, 2026
Merged

nwt merged 2 commits into
mainfrom
apply-perf

Conversation

@nwt

@nwt nwt commented Sep 21, 2026

Copy link
Copy Markdown
Member

On some workloads, Apply encounters many Dynamics whose slots all come from the same vector (i.e., all elements of Dynamic.Tags are identical). "Unwrap" these Dynamics with the goal of avoiding rip and stitch. This significantly improves performance on queries against records with nullable fields that are rarely null.

Fixes #7190. (Mostly. This claws back much but not all of the performance lost with #6633 but additional, smaller improvements are possible.)

On some workloads, Apply encounters many Dynamics whose slots all come
from the same vector (i.e., all elements of Dynamic.Tags are identical).
"Unwrap" these Dynamics with the goal of avoiding rip and stitch.  This
significantly improves performance on queries against records with
nullable fields that are rarely null.
@nwt
nwt requested a review from a team September 21, 2026 19:39
@nwt
nwt merged commit eb8b7f2 into main Sep 21, 2026
2 checks passed
@nwt
nwt deleted the apply-perf branch September 21, 2026 22:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

~2x perf drop in Parquet query performance at commit cbb4109

2 participants