Exclude benchmarks and fuzzing from default builds#8364
Conversation
f3852c9 to
2837817
Compare
|
I'm not sure I agree with the first point, but the latter seems very reasonable, no reason to treat auxiliary code the same as the code crates. |
Merging this PR will degrade performance by 17.99%
|
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | Simulation | chunked_bool_canonical_into[(1000, 10)] |
20.4 µs | 35.4 µs | -42.42% |
| ❌ | Simulation | chunked_varbinview_into_canonical[(1000, 10)] |
176.8 µs | 212.9 µs | -16.98% |
| ❌ | Simulation | chunked_varbinview_canonical_into[(100, 100)] |
272.7 µs | 307.9 µs | -11.41% |
| ❌ | Simulation | encode_varbin[(1000, 8)] |
143.6 µs | 160.6 µs | -10.61% |
| ❌ | Simulation | encode_varbin[(1000, 4)] |
142.9 µs | 159.9 µs | -10.61% |
| ❌ | Simulation | encode_varbin[(1000, 32)] |
148.5 µs | 165.2 µs | -10.09% |
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing myrrc/faster-ci-builds (862eff4) with develop (c6a0b7b)
Footnotes
-
10 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩
AdamGS
left a comment
There was a problem hiding this comment.
debug info is a feature of dev builds. If you don't want it, you can build the specific crates you care about or use ci profile.
2837817 to
fee14ce
Compare
fee14ce to
862eff4
Compare
|
you have a conflict in CI |
862eff4 to
8be14a7
Compare
8be14a7 to
df4edba
Compare
This PR adds default-members in Cargo.toml which exclude benchmarks and fuzzing
from the default build. This should have an impact on CI as well.