Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[EXPERIMENT] [Builtins] 10x more builtins #6502

Draft
wants to merge 12 commits into
base: master
Choose a base branch
from
Draft

[EXPERIMENT] [Builtins] 10x more builtins #6502

wants to merge 12 commits into from
+10,513 −27

Conversation

effectfully
Copy link
Contributor

@effectfully effectfully commented Sep 19, 2024 •
edited
Loading

This replicates the existing builtins so that there are 10x of them now. This is just to check whether it results in any evaluation slowdown.

@effectfully effectfully added Do not merge Builtins EXPERIMENT Experiments that we probably don't want to merge No Changelog Required Add this to skip the Changelog Check labels Sep 19, 2024
@effectfully effectfully self-assigned this Sep 19, 2024
@effectfully
Copy link
Contributor Author

/benchmark validation

@effectfully
Copy link
Contributor Author

/benchmark nofib

@effectfully
Copy link
Contributor Author

/benchmark lists

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
auction_1-1 251.1 μs 307.2 μs +22.3%
auction_1-2 893.9 μs 703.2 μs -21.3%
auction_1-3 886.5 μs 683.4 μs -22.9%
auction_1-4 321.7 μs 302.7 μs -5.9%
auction_2-1 251.4 μs 307.3 μs +22.2%
auction_2-2 893.5 μs 1.014 ms +13.5%
auction_2-3 1.168 ms 1.325 ms +13.4%
auction_2-4 887.1 μs 968.6 μs +9.2%
auction_2-5 322.1 μs 411.7 μs +27.8%
crowdfunding-success-1 293.7 μs 372.6 μs +26.9%
crowdfunding-success-2 292.8 μs 373.7 μs +27.6%
crowdfunding-success-3 294.0 μs 277.2 μs -5.7%
currency-1 344.5 μs 354.6 μs +2.9%
escrow-redeem_1-1 485.4 μs 582.6 μs +20.0%
escrow-redeem_1-2 485.8 μs 416.5 μs -14.3%
escrow-redeem_2-1 568.6 μs 471.7 μs -17.0%
escrow-redeem_2-2 568.3 μs 682.3 μs +20.1%
escrow-redeem_2-3 569.0 μs 677.9 μs +19.1%
escrow-refund-1 217.0 μs 273.4 μs +26.0%
future-increase-margin-1 345.8 μs 407.5 μs +17.8%
future-increase-margin-2 755.6 μs 881.8 μs +16.7%
future-increase-margin-3 755.0 μs 876.8 μs +16.1%
future-increase-margin-4 679.6 μs 785.9 μs +15.6%
future-increase-margin-5 1.141 ms 1.267 ms +11.0%
future-pay-out-1 345.6 μs 406.3 μs +17.6%
future-pay-out-2 754.6 μs 883.1 μs +17.0%
future-pay-out-3 751.7 μs 610.5 μs -18.8%
future-pay-out-4 1.136 ms 884.2 μs -22.2%
future-settle-early-1 345.7 μs 281.7 μs -18.5%
future-settle-early-2 515.7 μs 613.9 μs +19.0%
future-settle-early-3 529.1 μs 619.6 μs +17.1%
future-settle-early-4 599.6 μs 671.9 μs +12.1%
game-sm-success_1-1 486.4 μs 503.2 μs +3.5%
game-sm-success_1-2 278.5 μs 357.5 μs +28.4%
game-sm-success_1-3 897.6 μs 1.032 ms +15.0%
game-sm-success_1-4 315.9 μs 307.0 μs -2.8%
game-sm-success_2-1 410.1 μs 638.7 μs +55.7%
game-sm-success_2-2 194.6 μs 357.2 μs +83.6%
game-sm-success_2-3 638.0 μs 1.024 ms +60.5%
game-sm-success_2-4 275.1 μs 407.6 μs +48.2%
game-sm-success_2-5 631.2 μs 1.024 ms +62.2%
game-sm-success_2-6 291.1 μs 407.2 μs +39.9%
multisig-sm-1 557.6 μs 646.1 μs +15.9%
multisig-sm-2 377.9 μs 630.3 μs +66.8%
multisig-sm-3 509.5 μs 637.5 μs +25.1%
multisig-sm-4 551.7 μs 644.3 μs +16.8%
multisig-sm-5 783.0 μs 894.8 μs +14.3%
multisig-sm-6 555.5 μs 647.2 μs +16.5%
multisig-sm-7 542.4 μs 631.0 μs +16.3%
multisig-sm-8 547.7 μs 636.6 μs +16.2%
multisig-sm-9 553.9 μs 526.8 μs -4.9%
multisig-sm-10 782.6 μs 891.4 μs +13.9%
ping-pong-1 313.6 μs 368.0 μs +17.3%
ping-pong-2 319.8 μs 373.8 μs +16.9%
ping-pong_2-1 194.9 μs 237.9 μs +22.1%
prism-1 164.5 μs 210.8 μs +28.1%
prism-2 402.5 μs 479.3 μs +19.1%
prism-3 357.2 μs 432.6 μs +21.1%
pubkey-1 196.7 μs 181.0 μs -8.0%
stablecoin_1-1 1.002 ms 1.018 ms +1.6%
stablecoin_1-2 236.8 μs 244.9 μs +3.4%
stablecoin_1-3 1.017 ms 1.180 ms +16.0%
stablecoin_1-4 254.5 μs 319.2 μs +25.4%
stablecoin_1-5 1.863 ms 2.164 ms +16.2%
stablecoin_1-6 354.1 μs 457.6 μs +29.2%
stablecoin_2-1 1.266 ms 1.456 ms +15.0%
stablecoin_2-2 271.7 μs 351.3 μs +29.3%
stablecoin_2-3 1.451 ms 1.674 ms +15.4%
stablecoin_2-4 287.0 μs 369.3 μs +28.7%
token-account-1 264.6 μs 250.6 μs -5.3%
token-account-2 470.3 μs 395.4 μs -15.9%
uniswap-1 573.0 μs 464.2 μs -19.0%
uniswap-2 307.3 μs 263.0 μs -14.4%
uniswap-3 2.461 ms 1.966 ms -20.1%
uniswap-4 465.2 μs 417.7 μs -10.2%
uniswap-5 1.619 ms 1.324 ms -18.2%
uniswap-6 447.3 μs 400.4 μs -10.5%
vesting-1 485.7 μs 398.0 μs -18.1%
4b372ec 9fbb994 Change
TOTAL 45.88 ms 49.94 ms +8.9%

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@effectfully
Copy link
Contributor Author

That doesn't make any sense:

image

@effectfully
Copy link
Contributor Author

/benchmark validation

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'nofib' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
clausify/formula1 4.003 ms -100.0%
clausify/formula2 5.809 ms -100.0%
clausify/formula3 15.92 ms -100.0%
clausify/formula4 36.51 ms -100.0%
clausify/formula5 76.93 ms -100.0%
knights/4x4 24.86 ms -100.0%
knights/6x6 65.24 ms -100.0%
knights/8x8 73.26 ms -100.0%
primetest/05digits 10.36 ms -100.0%
primetest/10digits 20.20 ms -100.0%
primetest/30digits 82.37 ms -100.0%
primetest/50digits 144.6 ms -100.0%
queens4x4/bt 7.506 ms -100.0%
queens4x4/bm 9.578 ms -100.0%
queens4x4/bjbt1 9.159 ms -100.0%
queens4x4/bjbt2 8.084 ms -100.0%
queens4x4/fc 13.67 ms -100.0%
queens5x5/bt 72.64 ms -100.0%
queens5x5/bm 110.6 ms -100.0%
queens5x5/bjbt1 119.8 ms -100.0%
queens5x5/bjbt2 91.60 ms -100.0%
queens5x5/fc 173.3 ms -100.0%
4b372ec 9fbb994 Change
TOTAL 1.176 s 0.000 ps -100.0%

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'lists' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
sort/ghcSort/50 229.0 μs -100.0%
sort/ghcSort/100 538.3 μs -100.0%
sort/ghcSort/150 932.8 μs -100.0%
sort/ghcSort/200 1.252 ms -100.0%
sort/ghcSort/250 1.628 ms -100.0%
sort/ghcSort/300 2.134 ms -100.0%
sort/insertionSort/50 780.2 μs -100.0%
sort/insertionSort/100 3.096 ms -100.0%
sort/insertionSort/150 7.008 ms -100.0%
sort/insertionSort/200 13.64 ms -100.0%
sort/insertionSort/250 19.61 ms -100.0%
sort/insertionSort/300 28.35 ms -100.0%
sort/mergeSort/50 674.5 μs -100.0%
sort/mergeSort/100 1.556 ms -100.0%
sort/mergeSort/150 2.502 ms -100.0%
sort/mergeSort/200 3.513 ms -100.0%
sort/mergeSort/250 4.602 ms -100.0%
sort/mergeSort/300 5.623 ms -100.0%
sort/quickSort/50 1.905 ms -100.0%
sort/quickSort/100 7.687 ms -100.0%
sort/quickSort/150 24.64 ms -100.0%
sort/quickSort/200 43.42 ms -100.0%
sort/quickSort/250 68.23 ms -100.0%
sort/quickSort/300 98.67 ms -100.0%
sum/compiled-from-Haskell/sum-right-builtin/100 129.3 μs -100.0%
sum/compiled-from-Haskell/sum-right-builtin/500 680.3 μs -100.0%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.479 ms -100.0%
sum/compiled-from-Haskell/sum-right-builtin/2500 4.533 ms -100.0%
sum/compiled-from-Haskell/sum-right-builtin/5000 9.706 ms -100.0%
sum/compiled-from-Haskell/sum-right-Scott/100 87.70 μs -100.0%
sum/compiled-from-Haskell/sum-right-Scott/500 459.2 μs -100.0%
sum/compiled-from-Haskell/sum-right-Scott/1000 921.6 μs -100.0%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.341 ms -100.0%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.351 ms -100.0%
sum/compiled-from-Haskell/sum-right-data/100 243.7 μs -100.0%
sum/compiled-from-Haskell/sum-right-data/500 1.334 ms -100.0%
sum/compiled-from-Haskell/sum-right-data/1000 3.029 ms -100.0%
sum/compiled-from-Haskell/sum-right-data/2500 11.63 ms -100.0%
sum/compiled-from-Haskell/sum-right-data/5000 24.19 ms -100.0%
sum/compiled-from-Haskell/sum-left-builtin/100 126.2 μs -100.0%
sum/compiled-from-Haskell/sum-left-builtin/500 658.5 μs -100.0%
sum/compiled-from-Haskell/sum-left-builtin/1000 985.3 μs -100.0%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.084 ms -100.0%
sum/compiled-from-Haskell/sum-left-builtin/5000 6.773 ms -100.0%
sum/compiled-from-Haskell/sum-left-Scott/100 59.30 μs -100.0%
sum/compiled-from-Haskell/sum-left-Scott/500 311.5 μs -100.0%
sum/compiled-from-Haskell/sum-left-Scott/1000 673.9 μs -100.0%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.188 ms -100.0%
sum/compiled-from-Haskell/sum-left-Scott/5000 4.998 ms -100.0%
sum/compiled-from-Haskell/sum-left-data/100 245.0 μs -100.0%
sum/compiled-from-Haskell/sum-left-data/500 1.341 ms -100.0%
sum/compiled-from-Haskell/sum-left-data/1000 3.021 ms -100.0%
sum/compiled-from-Haskell/sum-left-data/2500 8.256 ms -100.0%
sum/compiled-from-Haskell/sum-left-data/5000 17.09 ms -100.0%
sum/hand-written-PLC/sum-right-builtin/100 89.29 μs -100.0%
sum/hand-written-PLC/sum-right-builtin/500 451.9 μs -100.0%
sum/hand-written-PLC/sum-right-builtin/1000 935.0 μs -100.0%
sum/hand-written-PLC/sum-right-builtin/2500 2.621 ms -100.0%
sum/hand-written-PLC/sum-right-builtin/5000 5.509 ms -100.0%
sum/hand-written-PLC/sum-right-Scott/100 49.67 μs -100.0%
sum/hand-written-PLC/sum-right-Scott/500 253.6 μs -100.0%
sum/hand-written-PLC/sum-right-Scott/1000 530.1 μs -100.0%
sum/hand-written-PLC/sum-right-Scott/2500 1.619 ms -100.0%
sum/hand-written-PLC/sum-right-Scott/5000 3.802 ms -100.0%
sum/hand-written-PLC/sum-left-builtin/100 94.13 μs -100.0%
sum/hand-written-PLC/sum-left-builtin/500 464.0 μs -100.0%
sum/hand-written-PLC/sum-left-builtin/1000 921.2 μs -100.0%
sum/hand-written-PLC/sum-left-builtin/2500 2.290 ms -100.0%
sum/hand-written-PLC/sum-left-builtin/5000 6.756 ms -100.0%
sum/hand-written-PLC/sum-left-Scott/100 80.85 μs -100.0%
sum/hand-written-PLC/sum-left-Scott/500 402.7 μs -100.0%
sum/hand-written-PLC/sum-left-Scott/1000 818.9 μs -100.0%
sum/hand-written-PLC/sum-left-Scott/2500 2.268 ms -100.0%
sum/hand-written-PLC/sum-left-Scott/5000 4.786 ms -100.0%
4b372ec 9fbb994 Change
TOTAL 492.9 ms 0.000 ps -100.0%

@effectfully effectfully mentioned this pull request Sep 19, 2024
Merged
@effectfully
Copy link
Contributor Author

/benchmark validation

2 similar comments
@effectfully
Copy link
Contributor Author

/benchmark validation

@effectfully
Copy link
Contributor Author

/benchmark validation

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
auction_1-1 251.3 μs 314.1 μs +25.0%
auction_1-2 895.0 μs 1.006 ms +12.4%
auction_1-3 885.9 μs 999.2 μs +12.8%
auction_1-4 320.4 μs 320.1 μs -0.1%
auction_2-1 251.2 μs 313.9 μs +25.0%
auction_2-2 894.3 μs 1.003 ms +12.2%
auction_2-3 1.169 ms 1.155 ms -1.2%
auction_2-4 886.2 μs 705.6 μs -20.4%
auction_2-5 320.3 μs 282.7 μs -11.7%
crowdfunding-success-1 293.5 μs 263.9 μs -10.1%
crowdfunding-success-2 293.5 μs 261.0 μs -11.1%
crowdfunding-success-3 210.4 μs 338.0 μs +60.6%
currency-1 241.9 μs 282.0 μs +16.6%
escrow-redeem_1-1 341.9 μs 404.8 μs +18.4%
escrow-redeem_1-2 341.4 μs 404.5 μs +18.5%
escrow-redeem_2-1 401.4 μs 470.3 μs +17.2%
escrow-redeem_2-2 402.0 μs 471.7 μs +17.3%
escrow-redeem_2-3 402.1 μs 471.0 μs +17.1%
escrow-refund-1 153.2 μs 188.0 μs +22.7%
future-increase-margin-1 243.4 μs 282.3 μs +16.0%
future-increase-margin-2 531.6 μs 614.1 μs +15.5%
future-increase-margin-3 531.3 μs 833.2 μs +56.8%
future-increase-margin-4 483.8 μs 777.2 μs +60.6%
future-increase-margin-5 802.8 μs 869.5 μs +8.3%
future-pay-out-1 243.4 μs 405.0 μs +66.4%
future-pay-out-2 532.1 μs 865.9 μs +62.7%
future-pay-out-3 533.1 μs 866.0 μs +62.4%
future-pay-out-4 804.5 μs 1.256 ms +56.1%
future-settle-early-1 243.5 μs 401.8 μs +65.0%
future-settle-early-2 532.0 μs 870.1 μs +63.6%
future-settle-early-3 532.6 μs 865.6 μs +62.5%
future-settle-early-4 733.1 μs 949.8 μs +29.6%
game-sm-success_1-1 543.4 μs 634.4 μs +16.7%
game-sm-success_1-2 278.0 μs 350.0 μs +25.9%
game-sm-success_1-3 896.4 μs 1.016 ms +13.3%
game-sm-success_1-4 315.4 μs 399.0 μs +26.5%
game-sm-success_2-1 491.4 μs 633.1 μs +28.8%
game-sm-success_2-2 276.9 μs 350.5 μs +26.6%
game-sm-success_2-3 628.8 μs 766.6 μs +21.9%
game-sm-success_2-4 222.5 μs 278.9 μs +25.3%
game-sm-success_2-5 632.2 μs 1.037 ms +64.0%
game-sm-success_2-6 223.1 μs 399.7 μs +79.2%
multisig-sm-1 393.4 μs 640.0 μs +62.7%
multisig-sm-2 381.7 μs 625.1 μs +63.8%
multisig-sm-3 387.2 μs 631.1 μs +63.0%
multisig-sm-4 425.8 μs 647.9 μs +52.2%
multisig-sm-5 781.5 μs 884.5 μs +13.2%
multisig-sm-6 553.5 μs 639.4 μs +15.5%
multisig-sm-7 543.2 μs 625.1 μs +15.1%
multisig-sm-8 546.9 μs 639.9 μs +17.0%
multisig-sm-9 553.9 μs 638.8 μs +15.3%
multisig-sm-10 782.8 μs 891.1 μs +13.8%
ping-pong-1 455.1 μs 529.8 μs +16.4%
ping-pong-2 454.8 μs 473.9 μs +4.2%
ping-pong_2-1 277.5 μs 335.5 μs +20.9%
prism-1 233.2 μs 296.5 μs +27.1%
prism-2 572.1 μs 675.2 μs +18.0%
prism-3 511.6 μs 415.4 μs -18.8%
pubkey-1 197.8 μs 194.0 μs -1.9%
stablecoin_1-1 1.263 ms 1.363 ms +7.9%
stablecoin_1-2 271.7 μs 344.2 μs +26.7%
stablecoin_1-3 1.450 ms 1.658 ms +14.3%
stablecoin_1-4 286.9 μs 363.9 μs +26.8%
stablecoin_1-5 1.867 ms 2.112 ms +13.1%
stablecoin_1-6 353.7 μs 449.7 μs +27.1%
stablecoin_2-1 1.264 ms 1.435 ms +13.5%
stablecoin_2-2 272.2 μs 344.7 μs +26.6%
stablecoin_2-3 1.448 ms 1.665 ms +15.0%
stablecoin_2-4 286.1 μs 364.8 μs +27.5%
token-account-1 264.7 μs 314.5 μs +18.8%
token-account-2 469.1 μs 383.6 μs -18.2%
uniswap-1 572.7 μs 452.2 μs -21.0%
uniswap-2 308.1 μs 257.9 μs -16.3%
uniswap-3 2.455 ms 1.920 ms -21.8%
uniswap-4 464.8 μs 584.6 μs +25.8%
uniswap-5 1.615 ms 1.682 ms +4.1%
uniswap-6 447.7 μs 389.8 μs -12.9%
vesting-1 483.9 μs 391.2 μs -19.2%
4b372ec 9fbb994 Change
TOTAL 44.11 ms 51.64 ms +17.1%

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
auction_1-1 250.7 μs 217.5 μs -13.2%
auction_1-2 893.4 μs 1.003 ms +12.3%
auction_1-3 886.8 μs 997.5 μs +12.5%
auction_1-4 321.0 μs 404.9 μs +26.1%
auction_2-1 251.3 μs 313.9 μs +24.9%
auction_2-2 895.0 μs 1.000 ms +11.7%
auction_2-3 1.170 ms 1.304 ms +11.5%
auction_2-4 886.8 μs 999.8 μs +12.7%
auction_2-5 320.7 μs 404.9 μs +26.3%
crowdfunding-success-1 293.1 μs 263.2 μs -10.2%
crowdfunding-success-2 293.6 μs 368.4 μs +25.5%
crowdfunding-success-3 293.1 μs 258.0 μs -12.0%
currency-1 344.3 μs 281.4 μs -18.3%
escrow-redeem_1-1 486.4 μs 406.6 μs -16.4%
escrow-redeem_1-2 485.3 μs 584.4 μs +20.4%
escrow-redeem_2-1 567.3 μs 669.4 μs +18.0%
escrow-redeem_2-2 568.7 μs 667.1 μs +17.3%
escrow-redeem_2-3 568.0 μs 668.7 μs +17.7%
escrow-refund-1 215.8 μs 268.1 μs +24.2%
future-increase-margin-1 345.6 μs 279.8 μs -19.0%
future-increase-margin-2 754.4 μs 884.4 μs +17.2%
future-increase-margin-3 754.7 μs 868.6 μs +15.1%
future-increase-margin-4 474.4 μs 777.4 μs +63.9%
future-increase-margin-5 802.6 μs 1.076 ms +34.1%
future-pay-out-1 340.6 μs 298.1 μs -12.5%
future-pay-out-2 751.9 μs 612.4 μs -18.6%
future-pay-out-3 753.5 μs 610.4 μs -19.0%
future-pay-out-4 1.134 ms 882.6 μs -22.2%
future-settle-early-1 346.1 μs 281.8 μs -18.6%
future-settle-early-2 754.1 μs 613.5 μs -18.6%
future-settle-early-3 754.0 μs 610.6 μs -19.0%
future-settle-early-4 848.0 μs 669.3 μs -21.1%
game-sm-success_1-1 523.4 μs 503.9 μs -3.7%
game-sm-success_1-2 277.8 μs 351.0 μs +26.3%
game-sm-success_1-3 894.9 μs 1.015 ms +13.4%
game-sm-success_1-4 316.4 μs 400.0 μs +26.4%
game-sm-success_2-1 456.9 μs 633.6 μs +38.7%
game-sm-success_2-2 194.4 μs 351.4 μs +80.8%
game-sm-success_2-3 627.8 μs 1.017 ms +62.0%
game-sm-success_2-4 221.7 μs 401.4 μs +81.1%
game-sm-success_2-5 628.3 μs 1.013 ms +61.2%
game-sm-success_2-6 222.7 μs 388.3 μs +74.4%
multisig-sm-1 392.0 μs 459.0 μs +17.1%
multisig-sm-2 381.6 μs 600.5 μs +57.4%
multisig-sm-3 387.1 μs 630.8 μs +63.0%
multisig-sm-4 387.9 μs 636.2 μs +64.0%
multisig-sm-5 555.5 μs 893.2 μs +60.8%
multisig-sm-6 555.2 μs 638.4 μs +15.0%
multisig-sm-7 543.3 μs 625.3 μs +15.1%
multisig-sm-8 548.2 μs 628.2 μs +14.6%
multisig-sm-9 554.4 μs 635.8 μs +14.7%
multisig-sm-10 542.6 μs 884.7 μs +63.0%
ping-pong-1 321.2 μs 531.2 μs +65.4%
ping-pong-2 320.9 μs 530.3 μs +65.3%
ping-pong_2-1 278.0 μs 335.4 μs +20.6%
prism-1 234.1 μs 296.0 μs +26.4%
prism-2 572.2 μs 673.8 μs +17.8%
prism-3 512.6 μs 606.8 μs +18.4%
pubkey-1 198.5 μs 252.3 μs +27.1%
stablecoin_1-1 1.267 ms 1.423 ms +12.3%
stablecoin_1-2 271.4 μs 343.8 μs +26.7%
stablecoin_1-3 1.450 ms 1.660 ms +14.5%
stablecoin_1-4 286.8 μs 363.1 μs +26.6%
stablecoin_1-5 1.864 ms 1.787 ms -4.1%
stablecoin_1-6 354.3 μs 313.5 μs -11.5%
stablecoin_2-1 1.265 ms 1.444 ms +14.2%
stablecoin_2-2 271.6 μs 342.6 μs +26.1%
stablecoin_2-3 1.452 ms 1.191 ms -18.0%
stablecoin_2-4 286.4 μs 254.5 μs -11.1%
token-account-1 264.6 μs 219.6 μs -17.0%
token-account-2 471.4 μs 556.2 μs +18.0%
uniswap-1 572.5 μs 647.9 μs +13.2%
uniswap-2 307.5 μs 369.3 μs +20.1%
uniswap-3 2.452 ms 2.740 ms +11.7%
uniswap-4 465.2 μs 560.7 μs +20.5%
uniswap-5 1.613 ms 1.842 ms +14.2%
uniswap-6 447.2 μs 558.8 μs +25.0%
vesting-1 483.6 μs 559.2 μs +15.6%
4b372ec 9fbb994 Change
TOTAL 46.30 ms 52.65 ms +13.7%

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
auction_1-1 176.7 μs 314.4 μs +77.9%
auction_1-2 630.5 μs 1.008 ms +59.9%
auction_1-3 626.7 μs 1.001 ms +59.7%
auction_1-4 226.4 μs 281.0 μs +24.1%
auction_2-1 177.1 μs 220.6 μs +24.6%
auction_2-2 628.5 μs 921.3 μs +46.6%
auction_2-3 1.172 ms 1.134 ms -3.2%
auction_2-4 884.4 μs 706.0 μs -20.2%
auction_2-5 320.6 μs 285.2 μs -11.0%
crowdfunding-success-1 204.9 μs 258.5 μs +26.2%
crowdfunding-success-2 207.0 μs 295.8 μs +42.9%
crowdfunding-success-3 207.0 μs 366.4 μs +77.0%
currency-1 243.5 μs 401.6 μs +64.9%
escrow-redeem_1-1 343.6 μs 576.3 μs +67.7%
escrow-redeem_1-2 342.2 μs 572.7 μs +67.4%
escrow-redeem_2-1 575.5 μs 668.7 μs +16.2%
escrow-redeem_2-2 398.6 μs 483.1 μs +21.2%
escrow-redeem_2-3 492.5 μs 471.0 μs -4.4%
escrow-refund-1 216.5 μs 189.2 μs -12.6%
future-increase-margin-1 243.3 μs 283.6 μs +16.6%
future-increase-margin-2 532.5 μs 614.3 μs +15.4%
future-increase-margin-3 529.9 μs 610.1 μs +15.1%
future-increase-margin-4 481.6 μs 547.2 μs +13.6%
future-increase-margin-5 802.5 μs 1.284 ms +60.0%
future-pay-out-1 243.2 μs 401.8 μs +65.2%
future-pay-out-2 530.5 μs 870.5 μs +64.1%
future-pay-out-3 530.9 μs 866.7 μs +63.3%
future-pay-out-4 802.4 μs 1.253 ms +56.2%
future-settle-early-1 244.0 μs 402.4 μs +64.9%
future-settle-early-2 530.3 μs 869.9 μs +64.0%
future-settle-early-3 531.1 μs 869.6 μs +63.7%
future-settle-early-4 601.9 μs 952.8 μs +58.3%
game-sm-success_1-1 384.1 μs 631.4 μs +64.4%
game-sm-success_1-2 224.7 μs 352.4 μs +56.8%
game-sm-success_1-3 894.8 μs 1.021 ms +14.1%
game-sm-success_1-4 316.0 μs 281.8 μs -10.8%
game-sm-success_2-1 543.8 μs 446.8 μs -17.8%
game-sm-success_2-2 277.0 μs 305.6 μs +10.3%
game-sm-success_2-3 893.9 μs 1.014 ms +13.4%
game-sm-success_2-4 221.0 μs 401.8 μs +81.8%
game-sm-success_2-5 909.9 μs 1.014 ms +11.4%
game-sm-success_2-6 313.2 μs 401.8 μs +28.3%
multisig-sm-1 556.4 μs 475.6 μs -14.5%
multisig-sm-2 542.8 μs 624.3 μs +15.0%
multisig-sm-3 549.1 μs 629.9 μs +14.7%
multisig-sm-4 552.7 μs 639.3 μs +15.7%
multisig-sm-5 784.2 μs 882.9 μs +12.6%
multisig-sm-6 554.8 μs 637.4 μs +14.9%
multisig-sm-7 543.8 μs 622.6 μs +14.5%
multisig-sm-8 547.7 μs 628.4 μs +14.7%
multisig-sm-9 554.6 μs 637.5 μs +14.9%
multisig-sm-10 783.5 μs 798.5 μs +1.9%
ping-pong-1 455.6 μs 374.2 μs -17.9%
ping-pong-2 455.1 μs 374.0 μs -17.8%
ping-pong_2-1 277.1 μs 236.5 μs -14.7%
prism-1 233.4 μs 208.6 μs -10.6%
prism-2 573.5 μs 476.5 μs -16.9%
prism-3 513.1 μs 426.2 μs -16.9%
pubkey-1 198.4 μs 178.1 μs -10.2%
stablecoin_1-1 1.267 ms 1.005 ms -20.7%
stablecoin_1-2 271.7 μs 244.2 μs -10.1%
stablecoin_1-3 1.455 ms 1.160 ms -20.3%
stablecoin_1-4 286.5 μs 257.1 μs -10.3%
stablecoin_1-5 1.867 ms 1.512 ms -19.0%
stablecoin_1-6 354.9 μs 316.5 μs -10.8%
stablecoin_2-1 883.3 μs 1.334 ms +51.0%
stablecoin_2-2 189.1 μs 244.7 μs +29.4%
stablecoin_2-3 1.454 ms 1.156 ms -20.5%
stablecoin_2-4 269.9 μs 257.0 μs -4.8%
token-account-1 264.2 μs 316.0 μs +19.6%
token-account-2 470.6 μs 557.2 μs +18.4%
uniswap-1 572.7 μs 450.7 μs -21.3%
uniswap-2 308.1 μs 260.7 μs -15.4%
uniswap-3 2.452 ms 2.264 ms -7.7%
uniswap-4 465.5 μs 587.0 μs +26.1%
uniswap-5 1.612 ms 1.847 ms +14.6%
uniswap-6 446.8 μs 397.1 μs -11.1%
vesting-1 483.5 μs 394.8 μs -18.3%
4b372ec 9fbb994 Change
TOTAL 43.71 ms 49.26 ms +12.7%

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
auction_1-1 251.3 μs 312.8 μs +24.5%
auction_1-2 894.0 μs 1.000 ms +11.9%
auction_1-3 887.7 μs 998.8 μs +12.5%
auction_1-4 321.1 μs 403.7 μs +25.7%
auction_2-1 251.6 μs 312.3 μs +24.1%
auction_2-2 893.9 μs 999.1 μs +11.8%
auction_2-3 1.165 ms 1.312 ms +12.6%
auction_2-4 888.1 μs 1.002 ms +12.8%
auction_2-5 321.2 μs 405.3 μs +26.2%
crowdfunding-success-1 293.8 μs 264.8 μs -9.9%
crowdfunding-success-2 293.9 μs 342.3 μs +16.5%
crowdfunding-success-3 294.3 μs 257.5 μs -12.5%
currency-1 345.4 μs 283.8 μs -17.8%
escrow-redeem_1-1 487.8 μs 405.7 μs -16.8%
escrow-redeem_1-2 488.4 μs 405.9 μs -16.9%
escrow-redeem_2-1 568.5 μs 471.2 μs -17.1%
escrow-redeem_2-2 569.3 μs 674.9 μs +18.5%
escrow-redeem_2-3 569.4 μs 476.5 μs -16.3%
escrow-refund-1 152.5 μs 251.3 μs +64.8%
future-increase-margin-1 243.4 μs 399.5 μs +64.1%
future-increase-margin-2 727.0 μs 867.5 μs +19.3%
future-increase-margin-3 751.9 μs 864.8 μs +15.0%
future-increase-margin-4 681.4 μs 774.8 μs +13.7%
future-increase-margin-5 1.144 ms 1.269 ms +10.9%
future-pay-out-1 345.4 μs 401.6 μs +16.3%
future-pay-out-2 754.9 μs 869.6 μs +15.2%
future-pay-out-3 754.3 μs 865.8 μs +14.8%
future-pay-out-4 1.135 ms 1.262 ms +11.2%
future-settle-early-1 240.7 μs 400.7 μs +66.5%
future-settle-early-2 760.6 μs 865.8 μs +13.8%
future-settle-early-3 756.0 μs 871.8 μs +15.3%
future-settle-early-4 848.4 μs 946.3 μs +11.5%
game-sm-success_1-1 397.4 μs 631.2 μs +58.8%
game-sm-success_1-2 195.7 μs 349.6 μs +78.6%
game-sm-success_1-3 633.6 μs 1.010 ms +59.4%
game-sm-success_1-4 255.6 μs 397.6 μs +55.6%
game-sm-success_2-1 383.2 μs 630.7 μs +64.6%
game-sm-success_2-2 277.2 μs 348.4 μs +25.7%
game-sm-success_2-3 893.7 μs 921.1 μs +3.1%
game-sm-success_2-4 316.8 μs 399.2 μs +26.0%
game-sm-success_2-5 894.9 μs 693.7 μs -22.5%
game-sm-success_2-6 316.6 μs 279.4 μs -11.7%
multisig-sm-1 392.4 μs 629.4 μs +60.4%
multisig-sm-2 382.6 μs 437.8 μs +14.4%
multisig-sm-3 385.4 μs 442.9 μs +14.9%
multisig-sm-4 390.4 μs 447.8 μs +14.7%
multisig-sm-5 550.9 μs 619.7 μs +12.5%
multisig-sm-6 391.9 μs 450.7 μs +15.0%
multisig-sm-7 381.5 μs 568.7 μs +49.1%
multisig-sm-8 385.5 μs 637.1 μs +65.3%
multisig-sm-9 391.9 μs 640.1 μs +63.3%
multisig-sm-10 550.9 μs 877.1 μs +59.2%
ping-pong-1 320.9 μs 528.6 μs +64.7%
ping-pong-2 321.3 μs 528.0 μs +64.3%
ping-pong_2-1 195.7 μs 335.4 μs +71.4%
prism-1 165.1 μs 304.2 μs +84.3%
prism-2 404.8 μs 668.8 μs +65.2%
prism-3 360.8 μs 604.6 μs +67.6%
pubkey-1 139.5 μs 253.4 μs +81.6%
stablecoin_1-1 939.9 μs 1.418 ms +50.9%
stablecoin_1-2 272.1 μs 342.3 μs +25.8%
stablecoin_1-3 1.015 ms 1.656 ms +63.2%
stablecoin_1-4 202.6 μs 361.5 μs +78.4%
stablecoin_1-5 1.905 ms 2.137 ms +12.2%
stablecoin_1-6 272.4 μs 450.2 μs +65.3%
stablecoin_2-1 894.0 μs 1.416 ms +58.4%
stablecoin_2-2 191.8 μs 343.0 μs +78.8%
stablecoin_2-3 1.028 ms 1.132 ms +10.1%
stablecoin_2-4 202.3 μs 260.8 μs +28.9%
token-account-1 186.5 μs 281.8 μs +51.1%
token-account-2 471.7 μs 554.2 μs +17.5%
uniswap-1 572.7 μs 649.6 μs +13.4%
uniswap-2 307.5 μs 368.9 μs +20.0%
uniswap-3 2.454 ms 2.742 ms +11.7%
uniswap-4 465.8 μs 583.3 μs +25.2%
uniswap-5 1.540 ms 1.842 ms +19.6%
uniswap-6 452.3 μs 386.2 μs -14.6%
vesting-1 485.9 μs 391.6 μs -19.4%
4b372ec 9fbb994 Change
TOTAL 43.62 ms 53.19 ms +22.0%

@effectfully
Copy link
Contributor Author

That doesn't make any sense:

Yup, the benchmarking machine is cooked as it turns out (confirmed elsewhere). Well, gotta wait for it to recover.

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@effectfully
Copy link
Contributor Author

/benchmark validation

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'validation-full' on 'edcb89629b' (base) and '68ee184f47' (PR)

Results table
Script edcb896 68ee184 Change
auction_1-1 627.2 μs 688.8 μs +9.8%
auction_1-2 2.133 ms 2.222 ms +4.2%
auction_1-3 2.132 ms 2.226 ms +4.4%
auction_1-4 708.5 μs 795.2 μs +12.2%
auction_2-1 631.1 μs 690.1 μs +9.3%
auction_2-2 2.133 ms 2.223 ms +4.2%
auction_2-3 2.489 ms 2.605 ms +4.7%
auction_2-4 2.138 ms 2.226 ms +4.1%
auction_2-5 708.1 μs 794.3 μs +12.2%
crowdfunding-success-1 761.5 μs 834.5 μs +9.6%
crowdfunding-success-2 762.3 μs 834.8 μs +9.5%
crowdfunding-success-3 760.9 μs 835.0 μs +9.7%
currency-1 826.3 μs 884.8 μs +7.1%
escrow-redeem_1-1 1.149 ms 1.236 ms +7.6%
escrow-redeem_1-2 1.149 ms 1.236 ms +7.6%
escrow-redeem_2-1 1.247 ms 1.346 ms +7.9%
escrow-redeem_2-2 1.244 ms 1.346 ms +8.2%
escrow-redeem_2-3 1.245 ms 1.346 ms +8.1%
escrow-refund-1 828.7 μs 877.7 μs +5.9%
future-increase-margin-1 826.2 μs 877.2 μs +6.2%
future-increase-margin-2 1.470 ms 1.587 ms +8.0%
future-increase-margin-3 1.473 ms 1.586 ms +7.7%
future-increase-margin-4 2.139 ms 2.218 ms +3.7%
future-increase-margin-5 2.731 ms 2.828 ms +3.6%
future-pay-out-1 826.4 μs 886.5 μs +7.3%
future-pay-out-2 1.471 ms 1.588 ms +8.0%
future-pay-out-3 1.472 ms 1.586 ms +7.7%
future-pay-out-4 2.728 ms 2.830 ms +3.7%
future-settle-early-1 825.9 μs 878.3 μs +6.3%
future-settle-early-2 1.470 ms 1.589 ms +8.1%
future-settle-early-3 1.472 ms 1.588 ms +7.9%
future-settle-early-4 2.339 ms 2.424 ms +3.6%
game-sm-success_1-1 1.627 ms 1.714 ms +5.3%
game-sm-success_1-2 606.5 μs 680.0 μs +12.1%
game-sm-success_1-3 2.095 ms 2.205 ms +5.3%
game-sm-success_1-4 655.1 μs 740.7 μs +13.1%
game-sm-success_2-1 1.628 ms 1.713 ms +5.2%
game-sm-success_2-2 606.0 μs 679.2 μs +12.1%
game-sm-success_2-3 2.094 ms 2.203 ms +5.2%
game-sm-success_2-4 656.3 μs 739.7 μs +12.7%
game-sm-success_2-5 2.094 ms 2.203 ms +5.2%
game-sm-success_2-6 655.9 μs 739.9 μs +12.8%
multisig-sm-1 1.768 ms 1.839 ms +4.0%
multisig-sm-2 1.748 ms 1.823 ms +4.3%
multisig-sm-3 1.760 ms 1.833 ms +4.1%
multisig-sm-4 1.764 ms 1.838 ms +4.2%
multisig-sm-5 2.065 ms 2.152 ms +4.2%
multisig-sm-6 1.767 ms 1.841 ms +4.2%
multisig-sm-7 1.750 ms 1.821 ms +4.1%
multisig-sm-8 1.758 ms 1.839 ms +4.6%
multisig-sm-9 1.761 ms 1.837 ms +4.3%
multisig-sm-10 2.061 ms 2.152 ms +4.4%
ping-pong-1 1.459 ms 1.524 ms +4.5%
ping-pong-2 1.460 ms 1.521 ms +4.2%
ping-pong_2-1 1.234 ms 1.298 ms +5.2%
prism-1 550.3 μs 604.6 μs +9.9%
prism-2 1.660 ms 1.753 ms +5.6%
prism-3 1.022 ms 1.117 ms +9.3%
pubkey-1 513.8 μs 563.0 μs +9.6%
stablecoin_1-1 3.316 ms 3.463 ms +4.4%
stablecoin_1-2 600.4 μs 670.8 μs +11.7%
stablecoin_1-3 3.574 ms 3.753 ms +5.0%
stablecoin_1-4 615.1 μs 690.3 μs +12.2%
stablecoin_1-5 4.176 ms 4.423 ms +5.9%
stablecoin_1-6 688.6 μs 783.0 μs +13.7%
stablecoin_2-1 3.313 ms 3.462 ms +4.5%
stablecoin_2-2 599.7 μs 671.7 μs +12.0%
stablecoin_2-3 3.576 ms 3.755 ms +5.0%
stablecoin_2-4 614.9 μs 690.8 μs +12.3%
token-account-1 729.7 μs 781.6 μs +7.1%
token-account-2 927.6 μs 1.006 ms +8.5%
uniswap-1 1.098 ms 1.169 ms +6.5%
uniswap-2 785.1 μs 850.7 μs +8.4%
uniswap-3 4.550 ms 4.837 ms +6.3%
uniswap-4 845.1 μs 965.3 μs +14.2%
uniswap-5 3.377 ms 3.605 ms +6.8%
uniswap-6 823.2 μs 936.3 μs +13.7%
vesting-1 1.173 ms 1.238 ms +5.5%
edcb896 68ee184 Change
TOTAL 119.1 ms 126.4 ms +6.1%

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'validation' on 'edcb89629b' (base) and '4847cfe133' (PR)

Results table
Script edcb896 4847cfe Change
auction_1-1 256.4 μs 317.2 μs +23.7%
auction_1-2 911.8 μs 1.016 ms +11.4%
auction_1-3 902.9 μs 998.7 μs +10.6%
auction_1-4 332.0 μs 413.9 μs +24.7%
auction_2-1 257.8 μs 322.9 μs +25.3%
auction_2-2 912.7 μs 1.018 ms +11.5%
auction_2-3 1.192 ms 1.305 ms +9.5%
auction_2-4 902.9 μs 1.007 ms +11.5%
auction_2-5 331.7 μs 414.2 μs +24.9%
crowdfunding-success-1 300.9 μs 371.9 μs +23.6%
crowdfunding-success-2 300.2 μs 372.8 μs +24.2%
crowdfunding-success-3 301.7 μs 379.3 μs +25.7%
currency-1 359.0 μs 406.1 μs +13.1%
escrow-redeem_1-1 501.0 μs 584.5 μs +16.7%
escrow-redeem_1-2 500.7 μs 584.8 μs +16.8%
escrow-redeem_2-1 584.0 μs 681.6 μs +16.7%
escrow-redeem_2-2 586.0 μs 678.1 μs +15.7%
escrow-redeem_2-3 584.6 μs 677.3 μs +15.9%
escrow-refund-1 224.2 μs 274.1 μs +22.3%
future-increase-margin-1 356.5 μs 407.1 μs +14.2%
future-increase-margin-2 769.9 μs 894.7 μs +16.2%
future-increase-margin-3 771.1 μs 881.7 μs +14.3%
future-increase-margin-4 692.9 μs 778.8 μs +12.4%
future-increase-margin-5 1.160 ms 1.257 ms +8.4%
future-pay-out-1 358.7 μs 407.4 μs +13.6%
future-pay-out-2 771.5 μs 881.9 μs +14.3%
future-pay-out-3 771.5 μs 881.0 μs +14.2%
future-pay-out-4 1.153 ms 1.257 ms +9.0%
future-settle-early-1 358.6 μs 406.8 μs +13.4%
future-settle-early-2 772.1 μs 881.2 μs +14.1%
future-settle-early-3 770.1 μs 882.9 μs +14.6%
future-settle-early-4 858.3 μs 951.7 μs +10.9%
game-sm-success_1-1 554.5 μs 637.2 μs +14.9%
game-sm-success_1-2 288.4 μs 357.7 μs +24.0%
game-sm-success_1-3 910.1 μs 1.020 ms +12.1%
game-sm-success_1-4 337.0 μs 418.0 μs +24.0%
game-sm-success_2-1 552.5 μs 634.1 μs +14.8%
game-sm-success_2-2 289.3 μs 358.0 μs +23.7%
game-sm-success_2-3 909.8 μs 1.016 ms +11.7%
game-sm-success_2-4 338.3 μs 416.3 μs +23.1%
game-sm-success_2-5 913.4 μs 1.013 ms +10.9%
game-sm-success_2-6 337.7 μs 416.5 μs +23.3%
multisig-sm-1 562.6 μs 636.2 μs +13.1%
multisig-sm-2 551.0 μs 624.0 μs +13.2%
multisig-sm-3 554.7 μs 626.3 μs +12.9%
multisig-sm-4 563.7 μs 637.8 μs +13.1%
multisig-sm-5 792.3 μs 881.8 μs +11.3%
multisig-sm-6 563.1 μs 635.2 μs +12.8%
multisig-sm-7 548.7 μs 623.7 μs +13.7%
multisig-sm-8 554.9 μs 631.2 μs +13.8%
multisig-sm-9 563.2 μs 634.9 μs +12.7%
multisig-sm-10 795.3 μs 885.0 μs +11.3%
ping-pong-1 465.9 μs 532.5 μs +14.3%
ping-pong-2 467.4 μs 530.7 μs +13.5%
ping-pong_2-1 287.5 μs 339.6 μs +18.1%
prism-1 244.3 μs 302.2 μs +23.7%
prism-2 588.8 μs 678.7 μs +15.3%
prism-3 529.9 μs 619.2 μs +16.9%
pubkey-1 203.8 μs 253.0 μs +24.1%
stablecoin_1-1 1.286 ms 1.442 ms +12.1%
stablecoin_1-2 283.1 μs 351.1 μs +24.0%
stablecoin_1-3 1.484 ms 1.642 ms +10.6%
stablecoin_1-4 301.7 μs 372.3 μs +23.4%
stablecoin_1-5 1.915 ms 2.161 ms +12.8%
stablecoin_1-6 370.9 μs 458.7 μs +23.7%
stablecoin_2-1 1.287 ms 1.442 ms +12.0%
stablecoin_2-2 283.7 μs 351.2 μs +23.8%
stablecoin_2-3 1.483 ms 1.657 ms +11.7%
stablecoin_2-4 301.8 μs 372.6 μs +23.5%
token-account-1 270.1 μs 314.6 μs +16.5%
token-account-2 479.3 μs 552.8 μs +15.3%
uniswap-1 588.7 μs 652.8 μs +10.9%
uniswap-2 317.0 μs 371.8 μs +17.3%
uniswap-3 2.510 ms 2.761 ms +10.0%
uniswap-4 488.4 μs 607.5 μs +24.4%
uniswap-5 1.651 ms 1.859 ms +12.6%
uniswap-6 460.1 μs 568.7 μs +23.6%
vesting-1 494.8 μs 560.3 μs +13.2%
edcb896 4847cfe Change
TOTAL 50.33 ms 57.45 ms +14.1%

@effectfully
Copy link
Contributor Author

Welllll... that's not the end of the world, but not nice either. Will look into it, maybe there's something we don't have optimized properly.

@effectfully
Copy link
Contributor Author

/benchmark validation-decode

@effectfully
Copy link
Contributor Author

/benchmark validation-full

1 similar comment
@effectfully
Copy link
Contributor Author

/benchmark validation-full

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@effectfully
Copy link
Contributor Author

/benchmark validation-full

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'validation-decode' on 'edcb89629b' (base) and 'c5bb3ac926' (PR)

Results table
Script edcb896 c5bb3ac Change
auction_1-1 275.5 μs 278.9 μs +1.2%
auction_1-2 779.1 μs 762.6 μs -2.1%
auction_1-3 779.1 μs 760.1 μs -2.4%
auction_1-4 276.3 μs 278.2 μs +0.7%
auction_2-1 275.4 μs 278.1 μs +1.0%
auction_2-2 780.7 μs 758.8 μs -2.8%
auction_2-3 778.9 μs 762.3 μs -2.1%
auction_2-4 779.1 μs 761.5 μs -2.3%
auction_2-5 274.7 μs 278.5 μs +1.4%
crowdfunding-success-1 338.1 μs 338.0 μs -0.0%
crowdfunding-success-2 336.6 μs 337.6 μs +0.3%
crowdfunding-success-3 336.9 μs 336.6 μs -0.1%
currency-1 331.6 μs 333.4 μs +0.5%
escrow-redeem_1-1 449.1 μs 447.8 μs -0.3%
escrow-redeem_1-2 448.3 μs 447.6 μs -0.2%
escrow-redeem_2-1 448.1 μs 449.0 μs +0.2%
escrow-redeem_2-2 447.0 μs 446.2 μs -0.2%
escrow-redeem_2-3 448.3 μs 447.7 μs -0.1%
escrow-refund-1 448.9 μs 448.4 μs -0.1%
future-increase-margin-1 339.9 μs 333.6 μs -1.9%
future-increase-margin-2 453.5 μs 452.5 μs -0.2%
future-increase-margin-3 453.6 μs 452.7 μs -0.2%
future-increase-margin-4 976.6 μs 960.6 μs -1.6%
future-increase-margin-5 975.7 μs 957.1 μs -1.9%
future-pay-out-1 331.6 μs 335.5 μs +1.2%
future-pay-out-2 452.3 μs 453.6 μs +0.3%
future-pay-out-3 453.4 μs 453.9 μs +0.1%
future-pay-out-4 959.9 μs 959.2 μs -0.1%
future-settle-early-1 339.8 μs 334.9 μs -1.4%
future-settle-early-2 453.9 μs 452.9 μs -0.2%
future-settle-early-3 450.4 μs 453.5 μs +0.7%
future-settle-early-4 973.4 μs 961.1 μs -1.3%
game-sm-success_1-1 738.1 μs 738.5 μs +0.1%
game-sm-success_1-2 235.7 μs 235.9 μs +0.1%
game-sm-success_1-3 756.4 μs 738.1 μs -2.4%
game-sm-success_1-4 234.4 μs 236.2 μs +0.8%
game-sm-success_2-1 754.9 μs 737.8 μs -2.3%
game-sm-success_2-2 234.0 μs 236.1 μs +0.9%
game-sm-success_2-3 756.2 μs 736.9 μs -2.6%
game-sm-success_2-4 234.6 μs 236.2 μs +0.7%
game-sm-success_2-5 755.2 μs 734.5 μs -2.7%
game-sm-success_2-6 234.9 μs 235.8 μs +0.4%
multisig-sm-1 838.7 μs 821.5 μs -2.1%
multisig-sm-2 838.8 μs 821.1 μs -2.1%
multisig-sm-3 838.3 μs 820.5 μs -2.1%
multisig-sm-4 837.7 μs 820.3 μs -2.1%
multisig-sm-5 838.8 μs 818.5 μs -2.4%
multisig-sm-6 819.0 μs 820.0 μs +0.1%
multisig-sm-7 825.3 μs 819.5 μs -0.7%
multisig-sm-8 817.3 μs 820.3 μs +0.4%
multisig-sm-9 838.3 μs 820.0 μs -2.2%
multisig-sm-10 823.9 μs 821.8 μs -0.3%
ping-pong-1 686.1 μs 687.9 μs +0.3%
ping-pong-2 690.3 μs 685.2 μs -0.7%
ping-pong_2-1 705.9 μs 686.6 μs -2.7%
prism-1 229.8 μs 231.3 μs +0.7%
prism-2 748.7 μs 727.8 μs -2.8%
prism-3 333.6 μs 335.5 μs +0.6%
pubkey-1 235.7 μs 237.0 μs +0.6%
stablecoin_1-1 1.257 ms 1.227 ms -2.4%
stablecoin_1-2 234.4 μs 236.9 μs +1.1%
stablecoin_1-3 1.257 ms 1.227 ms -2.4%
stablecoin_1-4 234.2 μs 236.5 μs +1.0%
stablecoin_1-5 1.256 ms 1.227 ms -2.3%
stablecoin_1-6 234.5 μs 236.0 μs +0.6%
stablecoin_2-1 1.255 ms 1.226 ms -2.3%
stablecoin_2-2 234.6 μs 235.9 μs +0.6%
stablecoin_2-3 1.256 ms 1.224 ms -2.5%
stablecoin_2-4 234.6 μs 236.6 μs +0.9%
token-account-1 339.8 μs 332.8 μs -2.1%
token-account-2 304.7 μs 304.4 μs -0.1%
uniswap-1 335.2 μs 337.8 μs +0.8%
uniswap-2 338.0 μs 330.1 μs -2.3%
uniswap-3 1.052 ms 1.034 ms -1.7%
uniswap-4 254.1 μs 256.8 μs +1.1%
uniswap-5 1.051 ms 1.034 ms -1.6%
uniswap-6 254.1 μs 256.8 μs +1.1%
vesting-1 457.8 μs 455.2 μs -0.6%
edcb896 c5bb3ac Change
TOTAL 45.37 ms 44.83 ms -1.2%

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'validation-full' on 'edcb89629b' (base) and 'c5bb3ac926' (PR)

Results table
Script edcb896 c5bb3ac Change
auction_1-1 628.1 μs 720.5 μs +14.7%
auction_1-2 2.137 ms 2.281 ms +6.7%
auction_1-3 2.133 ms 2.282 ms +7.0%
auction_1-4 707.8 μs 834.8 μs +17.9%
auction_2-1 627.9 μs 722.9 μs +15.1%
auction_2-2 2.134 ms 2.279 ms +6.8%
auction_2-3 2.492 ms 2.670 ms +7.1%
auction_2-4 2.133 ms 2.283 ms +7.0%
auction_2-5 707.2 μs 834.4 μs +18.0%
crowdfunding-success-1 761.5 μs 872.1 μs +14.5%
crowdfunding-success-2 761.9 μs 871.9 μs +14.4%
crowdfunding-success-3 761.9 μs 871.4 μs +14.4%
currency-1 827.1 μs 917.0 μs +10.9%
escrow-redeem_1-1 1.150 ms 1.280 ms +11.3%
escrow-redeem_1-2 1.150 ms 1.280 ms +11.3%
escrow-redeem_2-1 1.246 ms 1.393 ms +11.8%
escrow-redeem_2-2 1.247 ms 1.393 ms +11.7%
escrow-redeem_2-3 1.248 ms 1.393 ms +11.6%
escrow-refund-1 826.7 μs 909.1 μs +10.0%
future-increase-margin-1 825.8 μs 908.4 μs +10.0%
future-increase-margin-2 1.471 ms 1.641 ms +11.6%
future-increase-margin-3 1.473 ms 1.640 ms +11.3%
future-increase-margin-4 2.139 ms 2.272 ms +6.2%
future-increase-margin-5 2.747 ms 2.893 ms +5.3%
future-pay-out-1 826.5 μs 908.4 μs +9.9%
future-pay-out-2 1.472 ms 1.641 ms +11.5%
future-pay-out-3 1.472 ms 1.641 ms +11.5%
future-pay-out-4 2.728 ms 2.893 ms +6.0%
future-settle-early-1 826.5 μs 909.5 μs +10.0%
future-settle-early-2 1.473 ms 1.641 ms +11.4%
future-settle-early-3 1.473 ms 1.641 ms +11.4%
future-settle-early-4 2.344 ms 2.480 ms +5.8%
game-sm-success_1-1 1.629 ms 1.762 ms +8.2%
game-sm-success_1-2 607.4 μs 713.6 μs +17.5%
game-sm-success_1-3 2.097 ms 2.260 ms +7.8%
game-sm-success_1-4 656.1 μs 778.7 μs +18.7%
game-sm-success_2-1 1.630 ms 1.759 ms +7.9%
game-sm-success_2-2 606.4 μs 713.8 μs +17.7%
game-sm-success_2-3 2.096 ms 2.260 ms +7.8%
game-sm-success_2-4 656.5 μs 778.9 μs +18.6%
game-sm-success_2-5 2.096 ms 2.261 ms +7.9%
game-sm-success_2-6 656.9 μs 779.0 μs +18.6%
multisig-sm-1 1.769 ms 1.892 ms +7.0%
multisig-sm-2 1.748 ms 1.868 ms +6.9%
multisig-sm-3 1.758 ms 1.877 ms +6.8%
multisig-sm-4 1.764 ms 1.885 ms +6.9%
multisig-sm-5 2.066 ms 2.202 ms +6.6%
multisig-sm-6 1.770 ms 1.885 ms +6.5%
multisig-sm-7 1.751 ms 1.871 ms +6.9%
multisig-sm-8 1.759 ms 1.884 ms +7.1%
multisig-sm-9 1.763 ms 1.901 ms +7.8%
multisig-sm-10 2.065 ms 2.203 ms +6.7%
ping-pong-1 1.461 ms 1.562 ms +6.9%
ping-pong-2 1.461 ms 1.562 ms +6.9%
ping-pong_2-1 1.234 ms 1.314 ms +6.5%
prism-1 550.8 μs 635.0 μs +15.3%
prism-2 1.661 ms 1.809 ms +8.9%
prism-3 1.021 ms 1.158 ms +13.4%
pubkey-1 512.4 μs 593.1 μs +15.7%
stablecoin_1-1 3.317 ms 3.544 ms +6.8%
stablecoin_1-2 604.6 μs 703.5 μs +16.4%
stablecoin_1-3 3.593 ms 3.841 ms +6.9%
stablecoin_1-4 615.0 μs 727.1 μs +18.2%
stablecoin_1-5 4.184 ms 4.538 ms +8.5%
stablecoin_1-6 688.6 μs 825.7 μs +19.9%
stablecoin_2-1 3.315 ms 3.545 ms +6.9%
stablecoin_2-2 600.1 μs 704.1 μs +17.3%
stablecoin_2-3 3.584 ms 3.845 ms +7.3%
stablecoin_2-4 615.5 μs 725.7 μs +17.9%
token-account-1 729.3 μs 800.6 μs +9.8%
token-account-2 928.9 μs 1.044 ms +12.4%
uniswap-1 1.099 ms 1.211 ms +10.2%
uniswap-2 785.2 μs 882.2 μs +12.4%
uniswap-3 4.552 ms 4.977 ms +9.3%
uniswap-4 844.7 μs 1.017 ms +20.4%
uniswap-5 3.379 ms 3.717 ms +10.0%
uniswap-6 822.9 μs 986.3 μs +19.9%
vesting-1 1.168 ms 1.274 ms +9.1%
edcb896 c5bb3ac Change
TOTAL 119.2 ms 130.3 ms +9.3%

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'validation-full' on 'edcb89629b' (base) and 'c5bb3ac926' (PR)

Results table
Script edcb896 c5bb3ac Change
auction_1-1 628.1 μs 690.6 μs +10.0%
auction_1-2 2.136 ms 2.227 ms +4.3%
auction_1-3 2.133 ms 2.227 ms +4.4%
auction_1-4 709.4 μs 795.6 μs +12.2%
auction_2-1 629.4 μs 692.3 μs +10.0%
auction_2-2 2.135 ms 2.226 ms +4.3%
auction_2-3 2.492 ms 2.607 ms +4.6%
auction_2-4 2.137 ms 2.230 ms +4.4%
auction_2-5 709.0 μs 796.0 μs +12.3%
crowdfunding-success-1 762.8 μs 836.3 μs +9.6%
crowdfunding-success-2 763.3 μs 836.1 μs +9.5%
crowdfunding-success-3 762.8 μs 837.5 μs +9.8%
currency-1 828.2 μs 889.9 μs +7.4%
escrow-redeem_1-1 1.154 ms 1.238 ms +7.3%
escrow-redeem_1-2 1.152 ms 1.238 ms +7.5%
escrow-redeem_2-1 1.251 ms 1.346 ms +7.6%
escrow-redeem_2-2 1.247 ms 1.346 ms +7.9%
escrow-redeem_2-3 1.247 ms 1.346 ms +7.9%
escrow-refund-1 828.6 μs 880.1 μs +6.2%
future-increase-margin-1 827.7 μs 881.1 μs +6.5%
future-increase-margin-2 1.472 ms 1.587 ms +7.8%
future-increase-margin-3 1.474 ms 1.587 ms +7.7%
future-increase-margin-4 2.145 ms 2.222 ms +3.6%
future-increase-margin-5 2.733 ms 2.833 ms +3.7%
future-pay-out-1 827.5 μs 880.6 μs +6.4%
future-pay-out-2 1.474 ms 1.588 ms +7.7%
future-pay-out-3 1.473 ms 1.588 ms +7.8%
future-pay-out-4 2.731 ms 2.831 ms +3.7%
future-settle-early-1 827.3 μs 888.3 μs +7.4%
future-settle-early-2 1.473 ms 1.587 ms +7.7%
future-settle-early-3 1.473 ms 1.587 ms +7.7%
future-settle-early-4 2.347 ms 2.428 ms +3.5%
game-sm-success_1-1 1.633 ms 1.718 ms +5.2%
game-sm-success_1-2 607.1 μs 680.0 μs +12.0%
game-sm-success_1-3 2.096 ms 2.207 ms +5.3%
game-sm-success_1-4 655.9 μs 742.2 μs +13.2%
game-sm-success_2-1 1.631 ms 1.717 ms +5.3%
game-sm-success_2-2 607.0 μs 680.8 μs +12.2%
game-sm-success_2-3 2.095 ms 2.206 ms +5.3%
game-sm-success_2-4 664.4 μs 741.8 μs +11.6%
game-sm-success_2-5 2.096 ms 2.206 ms +5.2%
game-sm-success_2-6 664.2 μs 742.2 μs +11.7%
multisig-sm-1 1.771 ms 1.844 ms +4.1%
multisig-sm-2 1.751 ms 1.845 ms +5.4%
multisig-sm-3 1.759 ms 1.840 ms +4.6%
multisig-sm-4 1.768 ms 1.841 ms +4.1%
multisig-sm-5 2.070 ms 2.155 ms +4.1%
multisig-sm-6 1.771 ms 1.841 ms +4.0%
multisig-sm-7 1.751 ms 1.824 ms +4.2%
multisig-sm-8 1.760 ms 1.838 ms +4.4%
multisig-sm-9 1.766 ms 1.840 ms +4.2%
multisig-sm-10 2.064 ms 2.153 ms +4.3%
ping-pong-1 1.462 ms 1.524 ms +4.2%
ping-pong-2 1.463 ms 1.526 ms +4.3%
ping-pong_2-1 1.237 ms 1.284 ms +3.8%
prism-1 546.5 μs 606.6 μs +11.0%
prism-2 1.664 ms 1.769 ms +6.3%
prism-3 1.022 ms 1.117 ms +9.3%
pubkey-1 513.2 μs 564.9 μs +10.1%
stablecoin_1-1 3.317 ms 3.465 ms +4.5%
stablecoin_1-2 601.2 μs 673.4 μs +12.0%
stablecoin_1-3 3.580 ms 3.753 ms +4.8%
stablecoin_1-4 616.4 μs 691.5 μs +12.2%
stablecoin_1-5 4.183 ms 4.425 ms +5.8%
stablecoin_1-6 689.2 μs 784.4 μs +13.8%
stablecoin_2-1 3.317 ms 3.468 ms +4.6%
stablecoin_2-2 602.2 μs 672.6 μs +11.7%
stablecoin_2-3 3.578 ms 3.755 ms +4.9%
stablecoin_2-4 616.0 μs 692.7 μs +12.5%
token-account-1 730.7 μs 777.2 μs +6.4%
token-account-2 928.8 μs 1.007 ms +8.4%
uniswap-1 1.101 ms 1.167 ms +6.0%
uniswap-2 787.1 μs 852.4 μs +8.3%
uniswap-3 4.550 ms 4.836 ms +6.3%
uniswap-4 855.9 μs 965.8 μs +12.8%
uniswap-5 3.380 ms 3.604 ms +6.6%
uniswap-6 823.3 μs 937.0 μs +13.8%
vesting-1 1.169 ms 1.239 ms +6.0%
edcb896 c5bb3ac Change
TOTAL 119.3 ms 126.6 ms +6.1%

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'validation-full' on 'edcb89629b' (base) and 'c5bb3ac926' (PR)

Results table
Script edcb896 c5bb3ac Change
auction_1-1 624.3 μs 683.2 μs +9.4%
auction_1-2 2.124 ms 2.209 ms +4.0%
auction_1-3 2.122 ms 2.213 ms +4.3%
auction_1-4 703.5 μs 787.5 μs +11.9%
auction_2-1 623.3 μs 684.0 μs +9.7%
auction_2-2 2.126 ms 2.210 ms +4.0%
auction_2-3 2.480 ms 2.588 ms +4.4%
auction_2-4 2.125 ms 2.212 ms +4.1%
auction_2-5 703.5 μs 788.1 μs +12.0%
crowdfunding-success-1 757.4 μs 828.2 μs +9.3%
crowdfunding-success-2 758.1 μs 827.7 μs +9.2%
crowdfunding-success-3 756.3 μs 828.5 μs +9.5%
currency-1 822.1 μs 880.6 μs +7.1%
escrow-redeem_1-1 1.145 ms 1.228 ms +7.2%
escrow-redeem_1-2 1.146 ms 1.227 ms +7.1%
escrow-redeem_2-1 1.242 ms 1.335 ms +7.5%
escrow-redeem_2-2 1.239 ms 1.337 ms +7.9%
escrow-redeem_2-3 1.240 ms 1.335 ms +7.7%
escrow-refund-1 821.7 μs 870.4 μs +5.9%
future-increase-margin-1 821.6 μs 873.1 μs +6.3%
future-increase-margin-2 1.466 ms 1.575 ms +7.4%
future-increase-margin-3 1.467 ms 1.574 ms +7.3%
future-increase-margin-4 2.128 ms 2.203 ms +3.5%
future-increase-margin-5 2.718 ms 2.812 ms +3.5%
future-pay-out-1 821.9 μs 872.6 μs +6.2%
future-pay-out-2 1.467 ms 1.575 ms +7.4%
future-pay-out-3 1.465 ms 1.574 ms +7.4%
future-pay-out-4 2.716 ms 2.811 ms +3.5%
future-settle-early-1 821.9 μs 872.0 μs +6.1%
future-settle-early-2 1.466 ms 1.574 ms +7.4%
future-settle-early-3 1.465 ms 1.574 ms +7.4%
future-settle-early-4 2.325 ms 2.404 ms +3.4%
game-sm-success_1-1 1.622 ms 1.700 ms +4.8%
game-sm-success_1-2 603.3 μs 673.9 μs +11.7%
game-sm-success_1-3 2.086 ms 2.187 ms +4.8%
game-sm-success_1-4 653.1 μs 733.5 μs +12.3%
game-sm-success_2-1 1.620 ms 1.699 ms +4.9%
game-sm-success_2-2 603.5 μs 672.6 μs +11.4%
game-sm-success_2-3 2.086 ms 2.187 ms +4.8%
game-sm-success_2-4 652.0 μs 732.7 μs +12.4%
game-sm-success_2-5 2.085 ms 2.189 ms +5.0%
game-sm-success_2-6 652.7 μs 733.1 μs +12.3%
multisig-sm-1 1.759 ms 1.829 ms +4.0%
multisig-sm-2 1.739 ms 1.809 ms +4.0%
multisig-sm-3 1.750 ms 1.817 ms +3.8%
multisig-sm-4 1.756 ms 1.824 ms +3.9%
multisig-sm-5 2.058 ms 2.141 ms +4.0%
multisig-sm-6 1.762 ms 1.825 ms +3.6%
multisig-sm-7 1.741 ms 1.806 ms +3.7%
multisig-sm-8 1.750 ms 1.818 ms +3.9%
multisig-sm-9 1.754 ms 1.824 ms +4.0%
multisig-sm-10 2.053 ms 2.136 ms +4.0%
ping-pong-1 1.451 ms 1.514 ms +4.3%
ping-pong-2 1.452 ms 1.510 ms +4.0%
ping-pong_2-1 1.227 ms 1.269 ms +3.4%
prism-1 547.6 μs 599.3 μs +9.4%
prism-2 1.652 ms 1.740 ms +5.3%
prism-3 1.017 ms 1.107 ms +8.8%
pubkey-1 509.9 μs 560.5 μs +9.9%
stablecoin_1-1 3.299 ms 3.439 ms +4.2%
stablecoin_1-2 596.9 μs 664.4 μs +11.3%
stablecoin_1-3 3.562 ms 3.724 ms +4.5%
stablecoin_1-4 617.7 μs 684.5 μs +10.8%
stablecoin_1-5 4.161 ms 4.391 ms +5.5%
stablecoin_1-6 686.1 μs 775.8 μs +13.1%
stablecoin_2-1 3.300 ms 3.439 ms +4.2%
stablecoin_2-2 596.3 μs 664.7 μs +11.5%
stablecoin_2-3 3.560 ms 3.723 ms +4.6%
stablecoin_2-4 613.6 μs 684.2 μs +11.5%
token-account-1 724.9 μs 766.6 μs +5.8%
token-account-2 926.6 μs 996.7 μs +7.6%
uniswap-1 1.096 ms 1.158 ms +5.7%
uniswap-2 780.9 μs 838.3 μs +7.4%
uniswap-3 4.532 ms 4.808 ms +6.1%
uniswap-4 841.2 μs 956.6 μs +13.7%
uniswap-5 3.364 ms 3.581 ms +6.5%
uniswap-6 819.2 μs 926.8 μs +13.1%
vesting-1 1.163 ms 1.227 ms +5.5%
edcb896 c5bb3ac Change
TOTAL 118.6 ms 125.5 ms +5.8%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@effectfully effectfully

Labels
Builtins Do not merge EXPERIMENT Experiments that we probably don't want to merge No Changelog Required Add this to skip the Changelog Check
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@effectfully