Skip to content

[Perf] Windows/arm64: 23 Improvements on 8/30/2022 9:25:07 PM #8428

@performanceautofiler

Description

@performanceautofiler

Run Information

Architecture arm64
OS Windows 10.0.19041
Baseline a17dcda94f1a2e6ad0f20e77aa68cef5eaf131a8
Compare 4190ef878368d552380329348129a03008fc57cc
Diff Diff

Improvements in System.Numerics.Tests.Perf_Vector3

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
TransformNormalByMatrix4x4Benchmark - Duration of single invocation 9.43 ns 8.16 ns 0.87 0.03 False
TransformByMatrix4x4Benchmark - Duration of single invocation 10.32 ns 8.74 ns 0.85 0.02 False

graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Vector3*'
Details

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Vector3.TransformNormalByMatrix4x4Benchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.164532222154508 < 8.87744778816995.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 64.75053760163132 (T) = (0 -8.113181183113058) / Math.Sqrt((0.04881610915694219 / (299)) + (0.00812880644986649 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.136010277638474 = (9.390367701293322 - 8.113181183113058) / 9.390367701293322 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector3.TransformByMatrix4x4Benchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.741483609107458 < 9.832994512161177.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 58.2271015946297 (T) = (0 -8.70698645760729) / Math.Sqrt((0.11251415236843954 / (299)) + (0.012647802357090477 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.1528223576999276 = (10.277639567975347 - 8.70698645760729) / 10.277639567975347 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture arm64
OS Windows 10.0.19041
Baseline a17dcda94f1a2e6ad0f20e77aa68cef5eaf131a8
Compare 4190ef878368d552380329348129a03008fc57cc
Diff Diff

Improvements in System.Numerics.Tests.Perf_Matrix3x2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
NegationOperatorBenchmark - Duration of single invocation 11.05 ns 9.55 ns 0.86 0.05 False
MultiplyByScalarBenchmark - Duration of single invocation 11.35 ns 9.55 ns 0.84 0.08 False
MultiplyByScalarOperatorBenchmark - Duration of single invocation 11.36 ns 9.61 ns 0.85 0.04 False
NegateBenchmark - Duration of single invocation 11.45 ns 9.51 ns 0.83 0.08 False
SubtractOperatorBenchmark - Duration of single invocation 12.61 ns 11.17 ns 0.89 0.38 False
AddBenchmark - Duration of single invocation 12.54 ns 11.25 ns 0.90 0.37 False
SubtractBenchmark - Duration of single invocation 12.38 ns 10.86 ns 0.88 0.37 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Matrix3x2*'
Details

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Matrix3x2.NegationOperatorBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 9.546444652965615 < 10.595842996801101.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 57.76285661645878 (T) = (0 -9.44488236761585) / Math.Sqrt((0.10571638029289797 / (299)) + (0.020568934742237154 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.15682742928279025 = (11.201600592369784 - 9.44488236761585) / 11.201600592369784 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByScalarBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 9.55190520834904 < 10.784003817036924.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 39.05623200185212 (T) = (0 -9.589028802389656) / Math.Sqrt((0.28544890264888695 / (299)) + (0.04508514811930593 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.1606138513141378 = (11.423858753688252 - 9.589028802389656) / 11.423858753688252 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByScalarOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 9.60921139467871 < 10.805826576284312.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 48.95870750396557 (T) = (0 -9.611539312458298) / Math.Sqrt((0.14918797278143472 / (299)) + (0.028874918276820427 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.15521331176439396 = (11.377474865912774 - 9.611539312458298) / 11.377474865912774 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.NegateBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 9.513153025099182 < 10.740391199237099.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 67.50902878644965 (T) = (0 -9.396192961741441) / Math.Sqrt((0.06147604430098269 / (299)) + (0.019030285757692708 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.16295672723133417 = (11.225456636981148 - 9.396192961741441) / 11.225456636981148 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.SubtractOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.168343229319637 < 11.983335675956758.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 18.784525020166242 (T) = (0 -11.087114123385238) / Math.Sqrt((1.0462497199410439 / (299)) + (0.3512602299515892 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.16323015179479222 = (13.249896787230144 - 11.087114123385238) / 13.249896787230144 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.AddBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.249874177550822 < 11.981453619816689.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 31.292421093128848 (T) = (0 -11.188893716972858) / Math.Sqrt((0.8135156274081786 / (299)) + (0.0382279911649667 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.1467643634318401 = (13.113486166583765 - 11.188893716972858) / 13.113486166583765 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.SubtractBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.856736871960491 < 12.001364272155213.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 29.99192989514012 (T) = (0 -11.16513760940662) / Math.Sqrt((1.0891972934143057 / (299)) + (0.02566167610883223 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.15058610986151838 = (13.14451969650078 - 11.16513760940662) / 13.14451969650078 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture arm64
OS Windows 10.0.19041
Baseline a17dcda94f1a2e6ad0f20e77aa68cef5eaf131a8
Compare 4190ef878368d552380329348129a03008fc57cc
Diff Diff

Improvements in System.Numerics.Tests.Perf_Quaternion

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EqualsBenchmark - Duration of single invocation 10.26 ns 7.26 ns 0.71 0.08 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Quaternion*'
Details

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Quaternion.EqualsBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.26339111790901 < 9.588725457457729.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 51.14883733892859 (T) = (0 -7.642843601721675) / Math.Sqrt((0.03508055306978644 / (299)) + (0.0764246498199523 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.24055893211417775 = (10.063774432160066 - 7.642843601721675) / 10.063774432160066 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture arm64
OS Windows 10.0.19041
Baseline a17dcda94f1a2e6ad0f20e77aa68cef5eaf131a8
Compare 4190ef878368d552380329348129a03008fc57cc
Diff Diff

Improvements in System.Threading.Tasks.ValueTaskPerfTest

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Copy_PassAsArgumentAndReturn_FromValueTaskSource - Duration of single invocation 16.21 ns 13.96 ns 0.86 0.05 False
Copy_PassAsArgumentAndReturn_FromResult - Duration of single invocation 7.98 ns 6.38 ns 0.80 0.08 False
CreateAndAwait_FromResult - Duration of single invocation 24.09 ns 18.41 ns 0.76 0.27 False
Copy_PassAsArgumentAndReturn_FromTask - Duration of single invocation 13.58 ns 10.90 ns 0.80 0.02 False

graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tasks.ValueTaskPerfTest*'
Details

Payloads

Baseline
Compare

Histogram

System.Threading.Tasks.ValueTaskPerfTest.Copy_PassAsArgumentAndReturn_FromValueTaskSource


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.962589543351129 < 15.262484550070283.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 20.3696394343275 (T) = (0 -14.259119550526062) / Math.Sqrt((0.2408784504505382 / (299)) + (0.17125657800809474 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.0962865820611641 = (15.778364321565414 - 14.259119550526062) / 15.778364321565414 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Threading.Tasks.ValueTaskPerfTest.Copy_PassAsArgumentAndReturn_FromResult

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.384677320019656 < 7.5409709606292195.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 19.775319789883422 (T) = (0 -6.107528205446418) / Math.Sqrt((0.12544490626467156 / (299)) + (0.30825527588197066 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.23481081268654594 = (7.981723091108598 - 6.107528205446418) / 7.981723091108598 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Threading.Tasks.ValueTaskPerfTest.CreateAndAwait_FromResult

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 18.41338729485066 < 23.020156463553302.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 5.500806609139071 (T) = (0 -21.78062450413459) / Math.Sqrt((4.767973589067036 / (299)) + (5.813314754487365 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.0961526863759424 = (24.097681296195045 - 21.78062450413459) / 24.097681296195045 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Threading.Tasks.ValueTaskPerfTest.Copy_PassAsArgumentAndReturn_FromTask

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.89973000467912 < 12.671678316380836.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 85.07179604020106 (T) = (0 -11.145125478957617) / Math.Sqrt((0.06585121330072899 / (299)) + (0.01592441239685619 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.16421579597025948 = (13.334931942026783 - 11.145125478957617) / 13.334931942026783 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture arm64
OS Windows 10.0.19041
Baseline a17dcda94f1a2e6ad0f20e77aa68cef5eaf131a8
Compare 4190ef878368d552380329348129a03008fc57cc
Diff Diff

Improvements in System.Numerics.Tests.Perf_Vector4

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
TransformByMatrix4x4Benchmark - Duration of single invocation 12.60 ns 10.39 ns 0.82 0.02 False
TransformVector2ByMatrix4x4Benchmark - Duration of single invocation 11.88 ns 10.08 ns 0.85 0.41 False
TransformVector3ByMatrix4x4Benchmark - Duration of single invocation 12.45 ns 10.41 ns 0.84 0.01 False

graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Vector4*'
Details

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Vector4.TransformByMatrix4x4Benchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.394302926366064 < 11.94201188313273.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 93.12832851111068 (T) = (0 -10.523929122346416) / Math.Sqrt((0.04888506349161543 / (299)) + (0.010483713607016026 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.1587445365927698 = (12.509789927215072 - 10.523929122346416) / 12.509789927215072 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector4.TransformVector2ByMatrix4x4Benchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.075269161723636 < 10.926933918612953.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 17.421986058427652 (T) = (0 -9.757664477727625) / Math.Sqrt((0.161873707681767 / (299)) + (0.3411335282664573 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.15160856038986925 = (11.501370737794874 - 9.757664477727625) / 11.501370737794874 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector4.TransformVector3ByMatrix4x4Benchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.406988554217275 < 11.887787020476065.
IsChangePoint: Marked as a change because one of 8/30/2022 2:13:40 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 92.25467483857074 (T) = (0 -10.52767983978417) / Math.Sqrt((0.05036368589544604 / (299)) + (0.01080684245779097 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.15828621734183435 = (12.507434304494026 - 10.52767983978417) / 12.507434304494026 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture arm64
OS Windows 10.0.19041
Baseline a17dcda94f1a2e6ad0f20e77aa68cef5eaf131a8
Compare 4190ef878368d552380329348129a03008fc57cc
Diff Diff

Improvements in System.Numerics.Tests.Perf_Vector2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
TransformByMatrix3x2Benchmark - Duration of single invocation 7.45 ns 6.04 ns 0.81 0.09 False
TransformByMatrix4x4Benchmark - Duration of single invocation 9.72 ns 6.87 ns 0.71 0.46 False
TransformNormalByMatrix4x4Benchmark - Duration of single invocation 9.14 ns 5.69 ns 0.62 0.23 False
TransformNormalByMatrix3x2Benchmark - Duration of single invocation 6.14 ns 1.89 ns 0.31 0.17 False

graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Vector2*'
Details

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Vector2.TransformByMatrix3x2Benchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.041540136983409 < 7.073152796285739.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 56.14187568987755 (T) = (0 -6.021941015930831) / Math.Sqrt((0.117416468962175 / (299)) + (0.005629911477437225 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.17929112995460314 = (7.337487427908184 - 6.021941015930831) / 7.337487427908184 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.TransformByMatrix4x4Benchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.871451288969709 < 8.831933509558207.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 16.223800204578815 (T) = (0 -7.02952135774663) / Math.Sqrt((0.22062492241329806 / (299)) + (0.547151542890844 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.22562010032750188 = (9.077613404892825 - 7.02952135774663) / 9.077613404892825 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.TransformNormalByMatrix4x4Benchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.693543056128837 < 8.584067289288454.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 102.68565115971911 (T) = (0 -5.627817050635669) / Math.Sqrt((0.20115236965736627 / (299)) + (0.01334689533745219 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.3708346421058849 = (8.94489338935091 - 5.627817050635669) / 8.94489338935091 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.TransformNormalByMatrix3x2Benchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.8939795498885472 < 6.060026996415921.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 10.450558272083054 (T) = (0 -5.009451172982963) / Math.Sqrt((0.09337230000422471 / (299)) + (0.5918858760784153 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.212613490477824 = (6.3621247156278296 - 5.009451172982963) / 6.3621247156278296 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture arm64
OS Windows 10.0.19041
Baseline a17dcda94f1a2e6ad0f20e77aa68cef5eaf131a8
Compare 4190ef878368d552380329348129a03008fc57cc
Diff Diff

Improvements in System.Collections.IterateForEach<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ImmutableDictionary - Duration of single invocation 19.90 μs 17.55 μs 0.88 0.00 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEach&lt;Int32&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Collections.IterateForEach<Int32>.ImmutableDictionary(Size: 512)


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 17.548694349315067 < 18.933079812713622.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 106.79259479060822 (T) = (0 -17838.677946110798) / Math.Sqrt((14714.716279005626 / (299)) + (11868.543144385218 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.10436801444438089 = (19917.419468939912 - 17838.677946110798) / 19917.419468939912 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture arm64
OS Windows 10.0.19041
Baseline a17dcda94f1a2e6ad0f20e77aa68cef5eaf131a8
Compare 4190ef878368d552380329348129a03008fc57cc
Diff Diff

Improvements in System.IO.Tests.Perf_RandomAccess

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
WriteAsync - Duration of single invocation 219.42 ms 193.14 ms 0.88 0.36 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_RandomAccess*'
Details

Payloads

Baseline
Compare

Histogram

System.IO.Tests.Perf_RandomAccess.WriteAsync(fileSize: 104857600, bufferSize: 16384, options: Asynchronous)


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 193.1419142857143 < 207.1439155.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 13.375752861884731 (T) = (0 -200825676.97573265) / Math.Sqrt((116173321384964.05 / (299)) + (42083494602144.125 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.076743067779846 = (217518731.74979317 - 200825676.97573265) / 217518731.74979317 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Metadata

Metadata

Assignees

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions