saulshanabrook:benchmark-serialization - Branch - egraphs-good/egglog

Include serialization in benchmarking

#521

Comparing

saulshanabrook:benchmark-serialization

(

e5a43ea

) with

main

(

215714e

)

-99%

Improvements: 0

Regressions: 5

Untouched: 5

New: 0

Dropped: 0

Ignored: 86

Benchmarks

Passed

typeinfer

benches/example_benchmarks.rs::benches::criterion_benchmark::typeinfer

436.1 ms

435 ms

lambda

benches/example_benchmarks.rs::benches::criterion_benchmark::lambda

121.6 ms

herbie

benches/example_benchmarks.rs::benches::criterion_benchmark::herbie

286.3 ms

rat-pow-eval

benches/example_benchmarks.rs::benches::criterion_benchmark::rat-pow-eval

2.5 ms

stresstest_large_expr

benches/example_benchmarks.rs::benches::criterion_benchmark::stresstest_large_expr

-3%

2.1 s

2.2 s

math-microbenchmarkRegression

benches/example_benchmarks.rs::benches::criterion_benchmark::math-microbenchmark

-92%

4.3 s

55.7 s

eggcc-extractionRegression

benches/example_benchmarks.rs::benches::criterion_benchmark::eggcc-extraction

-93%

2.2 s

29.6 s

python_array_optimizeRegression

benches/example_benchmarks.rs::benches::criterion_benchmark::python_array_optimize

-94%

3.9 s

60.9 s

cykjsonRegression

benches/example_benchmarks.rs::benches::criterion_benchmark::cykjson

-95%

378.1 ms

8,065.9 ms

extract-vec-benchRegression

benches/example_benchmarks.rs::benches::criterion_benchmark::extract-vec-bench

-99%

74 ms

9,050.1 ms

Ignored

antiunifyIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::antiunify

-28%

1.8 ms

2.6 ms

arrayIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::array

26.1 ms

bddIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::bdd

16.6 ms

before-proofsIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::before-proofs

-10%

1.2 ms

1.4 ms

bignumIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::bignum

-6%

578.6 µs

616.1 µs

birewriteIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::birewrite

-19%

1 ms

1.3 ms

bitwiseIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::bitwise

564.9 µs

564.1 µs

boolIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::bool

-2%

1.1 ms

1.2 ms

calcIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::calc

-1%

5.1 ms

5.2 ms

combinatorsIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::combinators

-94%

18.8 ms

334.8 ms

combined-nestedIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::combined-nested

-5%

622.5 µs

653 µs

container-rebuildIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::container-rebuild

+1%

1.6 ms

1.5 ms

cykIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::cyk

-2%

11.4 ms

11.6 ms

datatypesIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::datatypes

-10%

380.8 µs

420.8 µs

deleteIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::delete

-2%

388.5 µs

395.2 µs

eqsat-basicIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::eqsat-basic

-11%

1.3 ms

1.5 ms

eqsat-basic-multisetIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::eqsat-basic-multiset

-9%

3.5 ms

3.9 ms

eqsolveIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::eqsolve

-61%

31.1 ms

79.2 ms

f64Ignored

benches/example_benchmarks.rs::benches::criterion_benchmark::f64

-1%

784.5 µs

791 µs

fail_wrong_assertionIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::fail_wrong_assertion

-2%

979.4 µs

1,001.7 µs

fibonacciIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::fibonacci

-9%

942.8 µs

1,040.2 µs

fibonacci-demandIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::fibonacci-demand

-22%

1.8 ms

2.3 ms

fusionIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::fusion

-9%

36.6 ms

40.2 ms

herbie-tutorialIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::herbie-tutorial

-13%

8.7 ms

10 ms

i64Ignored

benches/example_benchmarks.rs::benches::criterion_benchmark::i64

-9%

222.8 µs

243.5 µs

includeIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::include

-11%

793.3 µs

887.5 µs

integer_mathIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::integer_math

-90%

12.2 ms

119.1 ms

intersectionIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::intersection

-19%

1.5 ms

1.8 ms

intervalIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::interval

-5%

1.4 ms

1.5 ms

knapsackIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::knapsack

-79%

5.8 ms

28.3 ms

levenshtein-distanceIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::levenshtein-distance

-41%

17.3 ms

29.5 ms

listIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::list

-22%

4.1 ms

5.3 ms

looking_up_globalIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::looking_up_global

-5%

277.2 µs

291.7 µs

looking_up_nonconstructor_in_rewrite_goodIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::looking_up_nonconstructor_in_rewrite_good

422.1 µs

423.2 µs

mapIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::map

-1%

417 µs

423.1 µs

mathIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::math

-90%

35.1 ms

354.1 ms

matrixIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::matrix

-7%

11 ms

11.7 ms

merge-during-rebuildIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::merge-during-rebuild

-11%

612 µs

684.2 µs

merge-saturatesIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::merge-saturates

-17%

2 ms

2.4 ms

merge_readIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::merge_read

-5%

260.8 µs

273.4 µs

multisetIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::multiset

-5%

2.5 ms

2.6 ms

name-resolutionIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::name-resolution

-13%

720.1 µs

829.7 µs

pathIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::path

-12%

768.8 µs

870 µs

path-unionIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::path-union

-19%

896.6 µs

1,105.7 µs

pathproofIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::pathproof

-51%

1.1 ms

2.2 ms

points-toIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::points-to

-21%

1.7 ms

2.1 ms

primitivesIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::primitives

-1%

457 µs

460.4 µs

primsIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::prims

-23%

3.6 ms

4.7 ms

push-popIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::push-pop

-1%

448.7 µs

455.2 µs

repro-defineIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-define

-4%

480.5 µs

502.3 µs

repro-desugar-143Ignored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-desugar-143

-49%

8.6 ms

16.8 ms

repro-empty-queryIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-empty-query

-4%

407.5 µs

422.5 µs

repro-equal-constantIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-equal-constant

-3%

450 µs

462.5 µs

repro-equal-constant2Ignored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-equal-constant2

-3%

435.4 µs

450.1 µs

repro-noteqbugIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-noteqbug

-5%

553.2 µs

581.3 µs

repro-primitive-queryIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-primitive-query

-6%

486.8 µs

518 µs

repro-querybugIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-querybug

-7%

628.3 µs

672.9 µs

repro-querybug2Ignored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-querybug2

-7%

441.1 µs

473.4 µs

repro-querybug3Ignored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-querybug3

-19%

1.3 ms

1.5 ms

repro-querybug4Ignored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-querybug4

-5%

472 µs

498.9 µs

repro-should-saturateIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-should-saturate

-2%

413.9 µs

422 µs

repro-silly-panicIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-silly-panic

-3%

556.1 µs

571.7 µs

repro-typechecking-scheduleIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-typechecking-schedule

249.5 µs

250.2 µs

repro-unsoundIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-unsound

-77%

247.8 ms

1,088.7 ms

repro-unsound-htutorialIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-unsound-htutorial

-9%

599.4 µs

659.6 µs

repro-vec-unequalIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::repro-vec-unequal

-7%

567 µs

609.4 µs

resolutionIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::resolution

-2%

3.9 ms

4 ms

rw-analysisIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::rw-analysis

-11%

38.7 ms

43.5 ms

schedule-demoIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::schedule-demo

-8%

2.1 ms

2.2 ms

setIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::set

-7%

2 ms

2.1 ms

set_sort_functionIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::set_sort_function

-6%

339 µs

360 µs

stratifiedIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::stratified

-14%

700.4 µs

815.8 µs

stringIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::string

-2%

355.6 µs

362.1 µs

string_quotesIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::string_quotes

-5%

278.8 µs

292.3 µs

subsumeIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::subsume

-7%

1.1 ms

1.2 ms

test-combinedIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::test-combined

-14%

903.2 µs

1,053.5 µs

test-combined-stepsIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::test-combined-steps

-9%

2.7 ms

3 ms

towers-of-hanoiIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::towers-of-hanoi

-44%

3.4 ms

5.9 ms

tricky-type-checkingIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::tricky-type-checking

12.5 ms

type-constraints-testsIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::type-constraints-tests

-2%

375.3 µs

381.4 µs

typecheckIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::typecheck

-21%

5.8 ms

7.4 ms

unification-points-toIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::unification-points-to

-55%

8.1 ms

17.9 ms

unifyIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::unify

-8%

794.6 µs

865.8 µs

unstable-fnIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::unstable-fn

-38%

6.1 ms

9.8 ms

untilIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::until

-15%

2.6 ms

3 ms

vecIgnored

benches/example_benchmarks.rs::benches::criterion_benchmark::vec

826 µs

826.2 µs

Commits

Click on a commit to change the comparison range

Base

main

215714e

-99%

Include serialization in benchmarking

e5a43ea

23 days ago

by saulshanabrook

Home Terms Privacy Docs