Run Information
Improvements in System.Numerics.Tests.Perf_Vector3


Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Vector3*'
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Vector3.TransformNormalByMatrix4x4Benchmark
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.164532222154508 < 8.87744778816995.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 64.75053760163132 (T) = (0 -8.113181183113058) / Math.Sqrt((0.04881610915694219 / (299)) + (0.00812880644986649 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.136010277638474 = (9.390367701293322 - 8.113181183113058) / 9.390367701293322 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Vector3.TransformByMatrix4x4Benchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.741483609107458 < 9.832994512161177.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 58.2271015946297 (T) = (0 -8.70698645760729) / Math.Sqrt((0.11251415236843954 / (299)) + (0.012647802357090477 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.1528223576999276 = (10.277639567975347 - 8.70698645760729) / 10.277639567975347 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
### Run Information
Improvements in System.Numerics.Tests.Perf_Matrix3x2







Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Matrix3x2*'
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Matrix3x2.NegationOperatorBenchmark
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 9.546444652965615 < 10.595842996801101.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 57.76285661645878 (T) = (0 -9.44488236761585) / Math.Sqrt((0.10571638029289797 / (299)) + (0.020568934742237154 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.15682742928279025 = (11.201600592369784 - 9.44488236761585) / 11.201600592369784 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByScalarBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 9.55190520834904 < 10.784003817036924.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 39.05623200185212 (T) = (0 -9.589028802389656) / Math.Sqrt((0.28544890264888695 / (299)) + (0.04508514811930593 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.1606138513141378 = (11.423858753688252 - 9.589028802389656) / 11.423858753688252 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByScalarOperatorBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 9.60921139467871 < 10.805826576284312.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 48.95870750396557 (T) = (0 -9.611539312458298) / Math.Sqrt((0.14918797278143472 / (299)) + (0.028874918276820427 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.15521331176439396 = (11.377474865912774 - 9.611539312458298) / 11.377474865912774 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix3x2.NegateBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 9.513153025099182 < 10.740391199237099.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 67.50902878644965 (T) = (0 -9.396192961741441) / Math.Sqrt((0.06147604430098269 / (299)) + (0.019030285757692708 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.16295672723133417 = (11.225456636981148 - 9.396192961741441) / 11.225456636981148 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix3x2.SubtractOperatorBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.168343229319637 < 11.983335675956758.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 18.784525020166242 (T) = (0 -11.087114123385238) / Math.Sqrt((1.0462497199410439 / (299)) + (0.3512602299515892 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.16323015179479222 = (13.249896787230144 - 11.087114123385238) / 13.249896787230144 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix3x2.AddBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.249874177550822 < 11.981453619816689.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 31.292421093128848 (T) = (0 -11.188893716972858) / Math.Sqrt((0.8135156274081786 / (299)) + (0.0382279911649667 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.1467643634318401 = (13.113486166583765 - 11.188893716972858) / 13.113486166583765 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix3x2.SubtractBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.856736871960491 < 12.001364272155213.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 29.99192989514012 (T) = (0 -11.16513760940662) / Math.Sqrt((1.0891972934143057 / (299)) + (0.02566167610883223 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.15058610986151838 = (13.14451969650078 - 11.16513760940662) / 13.14451969650078 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_Quaternion

Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Quaternion*'
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Quaternion.EqualsBenchmark
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.26339111790901 < 9.588725457457729.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 51.14883733892859 (T) = (0 -7.642843601721675) / Math.Sqrt((0.03508055306978644 / (299)) + (0.0764246498199523 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.24055893211417775 = (10.063774432160066 - 7.642843601721675) / 10.063774432160066 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Threading.Tasks.ValueTaskPerfTest




Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tasks.ValueTaskPerfTest*'
Details
Payloads
Baseline
Compare
Histogram
System.Threading.Tasks.ValueTaskPerfTest.Copy_PassAsArgumentAndReturn_FromValueTaskSource
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.962589543351129 < 15.262484550070283.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 20.3696394343275 (T) = (0 -14.259119550526062) / Math.Sqrt((0.2408784504505382 / (299)) + (0.17125657800809474 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.0962865820611641 = (15.778364321565414 - 14.259119550526062) / 15.778364321565414 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Threading.Tasks.ValueTaskPerfTest.Copy_PassAsArgumentAndReturn_FromResult
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.384677320019656 < 7.5409709606292195.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 19.775319789883422 (T) = (0 -6.107528205446418) / Math.Sqrt((0.12544490626467156 / (299)) + (0.30825527588197066 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.23481081268654594 = (7.981723091108598 - 6.107528205446418) / 7.981723091108598 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Threading.Tasks.ValueTaskPerfTest.CreateAndAwait_FromResult
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 18.41338729485066 < 23.020156463553302.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 5.500806609139071 (T) = (0 -21.78062450413459) / Math.Sqrt((4.767973589067036 / (299)) + (5.813314754487365 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.0961526863759424 = (24.097681296195045 - 21.78062450413459) / 24.097681296195045 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Threading.Tasks.ValueTaskPerfTest.Copy_PassAsArgumentAndReturn_FromTask
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.89973000467912 < 12.671678316380836.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 85.07179604020106 (T) = (0 -11.145125478957617) / Math.Sqrt((0.06585121330072899 / (299)) + (0.01592441239685619 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.16421579597025948 = (13.334931942026783 - 11.145125478957617) / 13.334931942026783 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_Vector4



Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Vector4*'
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Vector4.TransformByMatrix4x4Benchmark
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.394302926366064 < 11.94201188313273.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 93.12832851111068 (T) = (0 -10.523929122346416) / Math.Sqrt((0.04888506349161543 / (299)) + (0.010483713607016026 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.1587445365927698 = (12.509789927215072 - 10.523929122346416) / 12.509789927215072 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Vector4.TransformVector2ByMatrix4x4Benchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.075269161723636 < 10.926933918612953.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 17.421986058427652 (T) = (0 -9.757664477727625) / Math.Sqrt((0.161873707681767 / (299)) + (0.3411335282664573 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.15160856038986925 = (11.501370737794874 - 9.757664477727625) / 11.501370737794874 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Vector4.TransformVector3ByMatrix4x4Benchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.406988554217275 < 11.887787020476065.
IsChangePoint: Marked as a change because one of 8/30/2022 2:13:40 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 92.25467483857074 (T) = (0 -10.52767983978417) / Math.Sqrt((0.05036368589544604 / (299)) + (0.01080684245779097 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.15828621734183435 = (12.507434304494026 - 10.52767983978417) / 12.507434304494026 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_Vector2




Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Vector2*'
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Vector2.TransformByMatrix3x2Benchmark
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.041540136983409 < 7.073152796285739.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 56.14187568987755 (T) = (0 -6.021941015930831) / Math.Sqrt((0.117416468962175 / (299)) + (0.005629911477437225 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.17929112995460314 = (7.337487427908184 - 6.021941015930831) / 7.337487427908184 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Vector2.TransformByMatrix4x4Benchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.871451288969709 < 8.831933509558207.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 16.223800204578815 (T) = (0 -7.02952135774663) / Math.Sqrt((0.22062492241329806 / (299)) + (0.547151542890844 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.22562010032750188 = (9.077613404892825 - 7.02952135774663) / 9.077613404892825 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Vector2.TransformNormalByMatrix4x4Benchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.693543056128837 < 8.584067289288454.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 102.68565115971911 (T) = (0 -5.627817050635669) / Math.Sqrt((0.20115236965736627 / (299)) + (0.01334689533745219 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.3708346421058849 = (8.94489338935091 - 5.627817050635669) / 8.94489338935091 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Vector2.TransformNormalByMatrix3x2Benchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.8939795498885472 < 6.060026996415921.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 10.450558272083054 (T) = (0 -5.009451172982963) / Math.Sqrt((0.09337230000422471 / (299)) + (0.5918858760784153 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.212613490477824 = (6.3621247156278296 - 5.009451172982963) / 6.3621247156278296 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Collections.IterateForEach<Int32>

Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEach<Int32>*'
Details
Payloads
Baseline
Compare
Histogram
System.Collections.IterateForEach<Int32>.ImmutableDictionary(Size: 512)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 17.548694349315067 < 18.933079812713622.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 106.79259479060822 (T) = (0 -17838.677946110798) / Math.Sqrt((14714.716279005626 / (299)) + (11868.543144385218 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.10436801444438089 = (19917.419468939912 - 17838.677946110798) / 19917.419468939912 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.IO.Tests.Perf_RandomAccess

Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_RandomAccess*'
Details
Payloads
Baseline
Compare
Histogram
System.IO.Tests.Perf_RandomAccess.WriteAsync(fileSize: 104857600, bufferSize: 16384, options: Asynchronous)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 193.1419142857143 < 207.1439155.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 13.375752861884731 (T) = (0 -200825676.97573265) / Math.Sqrt((116173321384964.05 / (299)) + (42083494602144.125 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.076743067779846 = (217518731.74979317 - 200825676.97573265) / 217518731.74979317 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_Vector3
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Vector3.TransformNormalByMatrix4x4Benchmark
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Improvements in System.Numerics.Tests.Perf_Matrix3x2
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Matrix3x2.NegationOperatorBenchmark
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_Quaternion
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Quaternion.EqualsBenchmark
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Threading.Tasks.ValueTaskPerfTest
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Threading.Tasks.ValueTaskPerfTest.Copy_PassAsArgumentAndReturn_FromValueTaskSource
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_Vector4
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Vector4.TransformByMatrix4x4Benchmark
Description of detection logic
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_Vector2
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Vector2.TransformByMatrix3x2Benchmark
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Collections.IterateForEach<Int32>
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Collections.IterateForEach<Int32>.ImmutableDictionary(Size: 512)
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.IO.Tests.Perf_RandomAccess
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.IO.Tests.Perf_RandomAccess.WriteAsync(fileSize: 104857600, bufferSize: 16384, options: Asynchronous)
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository