-
Notifications
You must be signed in to change notification settings - Fork 40
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Don't report benchmarks on main branch commits #450
Merged
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Metal Benchmarks
Benchmark suite | Current: 3cc67a9 | Previous: da83511 | Ratio |
---|---|---|---|
private array/construct |
23500 ns |
26465.25 ns |
0.89 |
private array/broadcast |
457709 ns |
461042 ns |
0.99 |
private array/random/randn/Float32 |
1012208 ns |
1011750 ns |
1.00 |
private array/random/randn!/Float32 |
638334 ns |
641708 ns |
0.99 |
private array/random/rand!/Int64 |
577250 ns |
573459 ns |
1.01 |
private array/random/rand!/Float32 |
604333 ns |
602667 ns |
1.00 |
private array/random/rand/Int64 |
878750 ns |
861583.5 ns |
1.02 |
private array/random/rand/Float32 |
948625 ns |
878333 ns |
1.08 |
private array/copyto!/gpu_to_gpu |
440791.5 ns |
473041 ns |
0.93 |
private array/copyto!/cpu_to_gpu |
730625 ns |
713958 ns |
1.02 |
private array/copyto!/gpu_to_cpu |
574625 ns |
442208.5 ns |
1.30 |
private array/accumulate/1d |
1447500 ns |
1437271 ns |
1.01 |
private array/accumulate/2d |
1485041.5 ns |
1483417 ns |
1.00 |
private array/iteration/findall/int |
2242333 ns |
2255250 ns |
0.99 |
private array/iteration/findall/bool |
2052770.5 ns |
2046124.5 ns |
1.00 |
private array/iteration/findfirst/int |
1692187.5 ns |
1680458 ns |
1.01 |
private array/iteration/findfirst/bool |
1673541.5 ns |
1669021 ns |
1.00 |
private array/iteration/scalar |
2386000 ns |
2356917 ns |
1.01 |
private array/iteration/logical |
3448917 ns |
3450375 ns |
1.00 |
private array/iteration/findmin/1d |
1786458.5 ns |
1770125 ns |
1.01 |
private array/iteration/findmin/2d |
1369729.5 ns |
1371417 ns |
1.00 |
private array/reductions/reduce/1d |
718417 ns |
750333.5 ns |
0.96 |
private array/reductions/reduce/2d |
715166 ns |
723583 ns |
0.99 |
private array/reductions/mapreduce/1d |
764479.5 ns |
791625 ns |
0.97 |
private array/reductions/mapreduce/2d |
714708 ns |
713708 ns |
1.00 |
private array/permutedims/4d |
955791.5 ns |
957895.5 ns |
1.00 |
private array/permutedims/2d |
948854 ns |
944583 ns |
1.00 |
private array/permutedims/3d |
1009916 ns |
994792 ns |
1.02 |
private array/copy |
862167 ns |
861917 ns |
1.00 |
latency/precompile |
4415202250 ns |
4407307208 ns |
1.00 |
latency/ttfp |
6917821083.5 ns |
6930583500 ns |
1.00 |
latency/import |
727725417 ns |
723401145.5 ns |
1.01 |
integration/metaldevrt |
759000 ns |
746250 ns |
1.02 |
integration/byval/slices=1 |
1572291.5 ns |
1556458 ns |
1.01 |
integration/byval/slices=3 |
8910375 ns |
8821042 ns |
1.01 |
integration/byval/reference |
1545500 ns |
1563958 ns |
0.99 |
integration/byval/slices=2 |
2619145.5 ns |
2552084 ns |
1.03 |
kernel/indexing |
466375 ns |
470917 ns |
0.99 |
kernel/indexing_checked |
445104 ns |
446250 ns |
1.00 |
kernel/launch |
12125 ns |
11791 ns |
1.03 |
metal/synchronization/stream |
18500 ns |
19541 ns |
0.95 |
metal/synchronization/context |
19750 ns |
19833 ns |
1.00 |
shared array/construct |
23684.083333333336 ns |
23930.5 ns |
0.99 |
shared array/broadcast |
460146 ns |
453646 ns |
1.01 |
shared array/random/randn/Float32 |
1024625 ns |
1017833 ns |
1.01 |
shared array/random/randn!/Float32 |
634250 ns |
649500 ns |
0.98 |
shared array/random/rand!/Int64 |
578792 ns |
572417 ns |
1.01 |
shared array/random/rand!/Float32 |
595500 ns |
613583 ns |
0.97 |
shared array/random/rand/Int64 |
830229 ns |
813417 ns |
1.02 |
shared array/random/rand/Float32 |
942104.5 ns |
847083 ns |
1.11 |
shared array/copyto!/gpu_to_gpu |
655542 ns |
658542 ns |
1.00 |
shared array/copyto!/cpu_to_gpu |
84416 ns |
84500 ns |
1.00 |
shared array/copyto!/gpu_to_cpu |
85333 ns |
85916 ns |
0.99 |
shared array/accumulate/1d |
1451937.5 ns |
1449250 ns |
1.00 |
shared array/accumulate/2d |
1490395.5 ns |
1494791 ns |
1.00 |
shared array/iteration/findall/int |
1986042 ns |
2003708 ns |
0.99 |
shared array/iteration/findall/bool |
1784938 ns |
1778291.5 ns |
1.00 |
shared array/iteration/findfirst/int |
1420479 ns |
1418958.5 ns |
1.00 |
shared array/iteration/findfirst/bool |
1374146 ns |
1386270.5 ns |
0.99 |
shared array/iteration/scalar |
193167 ns |
193750 ns |
1.00 |
shared array/iteration/logical |
3215687.5 ns |
3214083 ns |
1.00 |
shared array/iteration/findmin/1d |
1483270.5 ns |
1474146 ns |
1.01 |
shared array/iteration/findmin/2d |
1394333 ns |
1391229 ns |
1.00 |
shared array/reductions/reduce/1d |
647208 ns |
680375 ns |
0.95 |
shared array/reductions/reduce/2d |
715000 ns |
711146 ns |
1.01 |
shared array/reductions/mapreduce/1d |
681333.5 ns |
673729 ns |
1.01 |
shared array/reductions/mapreduce/2d |
707562.5 ns |
714021 ns |
0.99 |
shared array/permutedims/4d |
952500 ns |
958167 ns |
0.99 |
shared array/permutedims/2d |
949833 ns |
947375 ns |
1.00 |
shared array/permutedims/3d |
1006542 ns |
999917 ns |
1.01 |
shared array/copy |
850437.5 ns |
856125 ns |
0.99 |
This comment was automatically generated by workflow using github-action-benchmark.
Merging now to see if this fixes it. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
I don't know if this'll work, we'll have to commit and see :)