Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Don't report benchmarks on main branch commits #450

Merged
merged 1 commit into from
Oct 4, 2024
Merged

Conversation

christiangnrd
Copy link
Contributor

I don't know if this'll work, we'll have to commit and see :)

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Metal Benchmarks

Benchmark suite Current: 3cc67a9 Previous: da83511 Ratio
private array/construct 23500 ns 26465.25 ns 0.89
private array/broadcast 457709 ns 461042 ns 0.99
private array/random/randn/Float32 1012208 ns 1011750 ns 1.00
private array/random/randn!/Float32 638334 ns 641708 ns 0.99
private array/random/rand!/Int64 577250 ns 573459 ns 1.01
private array/random/rand!/Float32 604333 ns 602667 ns 1.00
private array/random/rand/Int64 878750 ns 861583.5 ns 1.02
private array/random/rand/Float32 948625 ns 878333 ns 1.08
private array/copyto!/gpu_to_gpu 440791.5 ns 473041 ns 0.93
private array/copyto!/cpu_to_gpu 730625 ns 713958 ns 1.02
private array/copyto!/gpu_to_cpu 574625 ns 442208.5 ns 1.30
private array/accumulate/1d 1447500 ns 1437271 ns 1.01
private array/accumulate/2d 1485041.5 ns 1483417 ns 1.00
private array/iteration/findall/int 2242333 ns 2255250 ns 0.99
private array/iteration/findall/bool 2052770.5 ns 2046124.5 ns 1.00
private array/iteration/findfirst/int 1692187.5 ns 1680458 ns 1.01
private array/iteration/findfirst/bool 1673541.5 ns 1669021 ns 1.00
private array/iteration/scalar 2386000 ns 2356917 ns 1.01
private array/iteration/logical 3448917 ns 3450375 ns 1.00
private array/iteration/findmin/1d 1786458.5 ns 1770125 ns 1.01
private array/iteration/findmin/2d 1369729.5 ns 1371417 ns 1.00
private array/reductions/reduce/1d 718417 ns 750333.5 ns 0.96
private array/reductions/reduce/2d 715166 ns 723583 ns 0.99
private array/reductions/mapreduce/1d 764479.5 ns 791625 ns 0.97
private array/reductions/mapreduce/2d 714708 ns 713708 ns 1.00
private array/permutedims/4d 955791.5 ns 957895.5 ns 1.00
private array/permutedims/2d 948854 ns 944583 ns 1.00
private array/permutedims/3d 1009916 ns 994792 ns 1.02
private array/copy 862167 ns 861917 ns 1.00
latency/precompile 4415202250 ns 4407307208 ns 1.00
latency/ttfp 6917821083.5 ns 6930583500 ns 1.00
latency/import 727725417 ns 723401145.5 ns 1.01
integration/metaldevrt 759000 ns 746250 ns 1.02
integration/byval/slices=1 1572291.5 ns 1556458 ns 1.01
integration/byval/slices=3 8910375 ns 8821042 ns 1.01
integration/byval/reference 1545500 ns 1563958 ns 0.99
integration/byval/slices=2 2619145.5 ns 2552084 ns 1.03
kernel/indexing 466375 ns 470917 ns 0.99
kernel/indexing_checked 445104 ns 446250 ns 1.00
kernel/launch 12125 ns 11791 ns 1.03
metal/synchronization/stream 18500 ns 19541 ns 0.95
metal/synchronization/context 19750 ns 19833 ns 1.00
shared array/construct 23684.083333333336 ns 23930.5 ns 0.99
shared array/broadcast 460146 ns 453646 ns 1.01
shared array/random/randn/Float32 1024625 ns 1017833 ns 1.01
shared array/random/randn!/Float32 634250 ns 649500 ns 0.98
shared array/random/rand!/Int64 578792 ns 572417 ns 1.01
shared array/random/rand!/Float32 595500 ns 613583 ns 0.97
shared array/random/rand/Int64 830229 ns 813417 ns 1.02
shared array/random/rand/Float32 942104.5 ns 847083 ns 1.11
shared array/copyto!/gpu_to_gpu 655542 ns 658542 ns 1.00
shared array/copyto!/cpu_to_gpu 84416 ns 84500 ns 1.00
shared array/copyto!/gpu_to_cpu 85333 ns 85916 ns 0.99
shared array/accumulate/1d 1451937.5 ns 1449250 ns 1.00
shared array/accumulate/2d 1490395.5 ns 1494791 ns 1.00
shared array/iteration/findall/int 1986042 ns 2003708 ns 0.99
shared array/iteration/findall/bool 1784938 ns 1778291.5 ns 1.00
shared array/iteration/findfirst/int 1420479 ns 1418958.5 ns 1.00
shared array/iteration/findfirst/bool 1374146 ns 1386270.5 ns 0.99
shared array/iteration/scalar 193167 ns 193750 ns 1.00
shared array/iteration/logical 3215687.5 ns 3214083 ns 1.00
shared array/iteration/findmin/1d 1483270.5 ns 1474146 ns 1.01
shared array/iteration/findmin/2d 1394333 ns 1391229 ns 1.00
shared array/reductions/reduce/1d 647208 ns 680375 ns 0.95
shared array/reductions/reduce/2d 715000 ns 711146 ns 1.01
shared array/reductions/mapreduce/1d 681333.5 ns 673729 ns 1.01
shared array/reductions/mapreduce/2d 707562.5 ns 714021 ns 0.99
shared array/permutedims/4d 952500 ns 958167 ns 0.99
shared array/permutedims/2d 949833 ns 947375 ns 1.00
shared array/permutedims/3d 1006542 ns 999917 ns 1.01
shared array/copy 850437.5 ns 856125 ns 0.99

This comment was automatically generated by workflow using github-action-benchmark.

@christiangnrd
Copy link
Contributor Author

Merging now to see if this fixes it.

@christiangnrd christiangnrd merged commit cd9e68a into main Oct 4, 2024
2 checks passed
@christiangnrd christiangnrd deleted the bench branch October 4, 2024 18:05
christiangnrd added a commit that referenced this pull request Oct 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant