Repository navigation
Introduce aggregate results and array caching - #10235
connortsui20 wants to merge 8 commits into
Performance Regression: -7.7%
⚠️ Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.
For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.
⚠️ Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.
⚡ 12 improved benchmarks
❌ 29 regressed benchmarks
✅ 2062 untouched benchmarks
⏩ 503 skipped benchmarks1
Warning
Please fix the performance issues or acknowledge them on CodSpeed.
Performance Changes
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | Simulation | null_count_run_end[(10000, 1024, 0.01)] |
6.6 µs | 11 µs | -39.92% |
| ❌ | Simulation | null_count_run_end[(32000, 256, 0.01)] |
6.6 µs | 11 µs | -39.92% |
| ❌ | Simulation | null_count_run_end[(10000, 256, 0.01)] |
6.6 µs | 10.9 µs | -39.12% |
| ❌ | Simulation | null_count_run_end[(32000, 1024, 0.01)] |
6.6 µs | 10.9 µs | -39.12% |
| ❌ | Simulation | sparse_null_count |
62 µs | 89.6 µs | -30.77% |
| ❌ | Simulation | decompress[u8, (4000, 256)] |
33.8 µs | 46.8 µs | -27.78% |
| ❌ | Simulation | slice_dict_tight_loop[10000] |
699.2 µs | 901.9 µs | -22.48% |
| ❌ | Simulation | bench_compare_sliced_dict_primitive[(2000, 10000)] |
85.6 µs | 106.4 µs | -19.59% |
| ❌ | Simulation | slice_primitive_tight_loop[10000] |
427.9 µs | 529.7 µs | -19.22% |
| ❌ | Simulation | whole_array_sum_partially_valid |
65.1 µs | 80.1 µs | -18.78% |
| ❌ | Simulation | search_index_above_max_chunked |
526.9 µs | 636.2 µs | -17.18% |
| ❌ | Simulation | search_index_in_range_chunked |
528.2 µs | 637.5 µs | -17.14% |
| ❌ | Simulation | bitpacked_compress_u32 |
36.2 µs | 43.3 µs | -16.44% |
| ❌ | Simulation | take_varbin |
332 µs | 396.4 µs | -16.24% |
| ❌ | Simulation | sequence_compress_u32 |
42.8 µs | 51 µs | -16.04% |
| ❌ | Simulation | canonicalize_sparse_list[(512, 7, 4)] |
532.3 µs | 625.1 µs | -14.84% |
| ❌ | Simulation | canonicalize_sparse_list[(1024, 17, 8)] |
458.2 µs | 535 µs | -14.36% |
| ❌ | Simulation | decompress[u16, (4000, 256)] |
50.8 µs | 59.1 µs | -14.09% |
| ❌ | Simulation | bitpacked_decompress_u32 |
51.4 µs | 59.6 µs | -13.71% |
| ❌ | Simulation | bench_compare_varbinview[(10000, 512)] |
158.6 µs | 181.9 µs | -12.82% |
| ... | ... | ... | ... | ... | ... |
ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing ct/stats-array-cache (1643e97) with ct/stats-result-scope (e457d5f)
Footnotes
-
503 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩