Run Information
Improvements in System.Numerics.Tests.Perf_Quaternion






Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Quaternion*'
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionOperatorBenchmark
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.350053162316314 < 13.489344533941802.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 80.1130261063532 (T) = (0 -6.504748659704328) / Math.Sqrt((0.0010544722486559538 / (299)) + (0.29298222478444247 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.5410098975728342 = (14.171871300289151 - 6.504748659704328) / 14.171871300289151 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Quaternion.SlerpBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.769631804865143 < 12.877971972168554.
IsChangePoint: Marked as a change because one of 8/29/2022 8:26:03 AM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 240.18147077852254 (T) = (0 -7.778724602873054) / Math.Sqrt((0.00021817287106918037 / (299)) + (0.02421560719487227 / (42))) is greater than 1.9669864608404333 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (42) - 2, .975) and 0.4259048906501044 = (13.549539921497798 - 7.778724602873054) / 13.549539921497798 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Quaternion.ConcatenateBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.3200791584056635 < 13.491731617058795.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 182.97884933632548 (T) = (0 -6.405999955213871) / Math.Sqrt((0.0012345834385364663 / (299)) + (0.05752142080598791 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.5480056324540667 = (14.172742881719362 - 6.405999955213871) / 14.172742881719362 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Quaternion.DivisionOperatorBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.937266789136466 < 13.536883326672351.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 503.6272799142587 (T) = (0 -8.946453092607562) / Math.Sqrt((0.016540838676795268 / (299)) + (0.00175021601098182 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.37124753423302204 = (14.22889543931142 - 8.946453092607562) / 14.22889543931142 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Quaternion.LerpBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.71006264166594 < 12.879066847150249.
IsChangePoint: Marked as a change because one of 8/29/2022 8:26:03 AM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 736.8147117487397 (T) = (0 -7.748537452952754) / Math.Sqrt((0.00011887414032666733 / (299)) + (0.002588289979541812 / (42))) is greater than 1.9669864608404333 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (42) - 2, .975) and 0.42820803953627895 = (13.551322838937296 - 7.748537452952754) / 13.551322838937296 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.4088539595964615 < 13.489319284828461.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 311.31425396584933 (T) = (0 -6.5416609199206075) / Math.Sqrt((0.0006665857433457291 / (137)) + (0.019081543308997955 / (32))) is greater than 1.974270957027852 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (137) + (32) - 2, .975) and 0.538496218334916 = (14.17466374017262 - 6.5416609199206075) / 14.17466374017262 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
### Run Information
Improvements in System.Threading.Tasks.ValueTaskPerfTest






Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tasks.ValueTaskPerfTest*'
Details
Payloads
Baseline
Compare
Histogram
System.Threading.Tasks.ValueTaskPerfTest.CreateAndAwait_FromResult_ConfigureAwait
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 12.680888547356187 < 16.946077063626507.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 48.25663201980171 (T) = (0 -13.090687423990051) / Math.Sqrt((0.023067015480335785 / (137)) + (0.2769534947260609 / (32))) is greater than 1.974270957027852 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (137) + (32) - 2, .975) and 0.25720342542190944 = (17.623516144276216 - 13.090687423990051) / 17.623516144276216 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Threading.Tasks.ValueTaskPerfTest.CreateAndAwait_FromCompletedValueTaskSource
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 24.656117779423813 < 27.985133602756694.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 34.25484093296554 (T) = (0 -23.85586348687775) / Math.Sqrt((0.9430989385011255 / (299)) + (0.8432237998739313 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.19784765176612984 = (29.739816307216614 - 23.85586348687775) / 29.739816307216614 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Threading.Tasks.ValueTaskPerfTest.CreateAndAwait_FromCompletedValueTaskSource_ConfigureAwait
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 22.618575747626476 < 28.015601980422613.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 41.947946383353205 (T) = (0 -23.654807796346255) / Math.Sqrt((0.6275076187434483 / (299)) + (0.6020723658264582 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.20410733600604938 = (29.721102940742835 - 23.654807796346255) / 29.721102940742835 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Threading.Tasks.ValueTaskPerfTest.CreateAndAwait_FromCompletedTask_ConfigureAwait
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 17.79044944545342 < 19.014480309968725.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 14.52350018769286 (T) = (0 -17.83639493715934) / Math.Sqrt((0.16894832746917496 / (299)) + (0.67673673458228 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.10713042560818678 = (19.976484190659956 - 17.83639493715934) / 19.976484190659956 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Threading.Tasks.ValueTaskPerfTest.CreateAndAwait_FromCompletedTask
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 18.20420411483121 < 19.058122007002527.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 16.089040235430755 (T) = (0 -18.382895993218682) / Math.Sqrt((0.15328573842027207 / (299)) + (0.27136538583042086 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.07663673328661161 = (19.908628224567142 - 18.382895993218682) / 19.908628224567142 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Threading.Tasks.ValueTaskPerfTest.Await_FromResult
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.623648307766132 < 16.63571865801737.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 52.47616674262791 (T) = (0 -13.156894883566345) / Math.Sqrt((0.009981371894831012 / (299)) + (0.22145255276428677 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.24958587749395092 = (17.532845516856977 - 13.156894883566345) / 17.532845516856977 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Tests.Perf_Double

Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Double*'
Details
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_Double.ToStringWithFormat(value: -1.7976931348623157E+308, format: "R")
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 189.24179289796453 < 197.32544588368333.
IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 23.450855271003366 (T) = (0 -190.91671334032495) / Math.Sqrt((28.457977435033918 / (299)) + (7.539132200620008 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.06598354509156647 = (204.40401487256614 - 190.91671334032495) / 204.40401487256614 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_Matrix3x2


Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Matrix3x2*'
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Matrix3x2.AddOperatorBenchmark
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.75431611594875 < 11.24026123321478.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 22.323622530587585 (T) = (0 -10.76086145758774) / Math.Sqrt((0.08875257133072882 / (299)) + (0.04524751734890295 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.0790254443956414 = (11.684211460680677 - 10.76086145758774) / 11.684211460680677 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix3x2.AddBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.622805032091545 < 11.240787280817372.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 27.70902488652062 (T) = (0 -10.746476550656883) / Math.Sqrt((0.07444876651342376 / (299)) + (0.0315933499720472 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.08312374882579347 = (11.720749159872232 - 10.746476550656883) / 11.720749159872232 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_Vector4



Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Vector4*'
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Vector4.TransformVector2ByMatrix4x4Benchmark
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 4.297949524932844 < 5.099825752748224.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 46.01684558333103 (T) = (0 -4.395377212014201) / Math.Sqrt((0.015880336825292104 / (262)) + (0.012202106514585895 / (32))) is greater than 1.9681214070095314 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (262) + (32) - 2, .975) and 0.18038698521727092 = (5.362746970507014 - 4.395377212014201) / 5.362746970507014 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Vector4.TransformVector3ByMatrix4x4Benchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.419423454796435 < 6.41255338055265.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 113.91046999304213 (T) = (0 -5.4638190877729285) / Math.Sqrt((0.011759591445414143 / (299)) + (0.001962694448387929 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.1729880415490008 = (6.606699010745516 - 5.4638190877729285) / 6.606699010745516 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Vector4.TransformByMatrix4x4Benchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.405905244601523 < 6.2872314535890315.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 76.16481244119876 (T) = (0 -5.472511461623022) / Math.Sqrt((0.04171258388623002 / (299)) + (0.002954621470547902 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.17485933843286441 = (6.6322164408059106 - 5.472511461623022) / 6.6322164408059106 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Text.Json.Tests.Perf_Reader


Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Reader*'
Details
Payloads
Baseline
Compare
Histogram
System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: HelloWorld)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 106.67951693012762 < 114.45599394888467.
IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 109.34720269435611 (T) = (0 -106.83020702104702) / Math.Sqrt((2.633684945332585 / (299)) + (0.24397353388881807 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.11599043515089465 = (120.84734291227068 - 106.83020702104702) / 120.84734291227068 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: HelloWorld)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 95.96056826706676 < 105.79945322694087.
IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 24.86787806945581 (T) = (0 -96.03319964541473) / Math.Sqrt((6.079190500044311 / (299)) + (8.896278089329426 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.12391393767110837 = (109.61617103019599 - 96.03319964541473) / 109.61617103019599 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Collections.IterateForEach<Int32>

Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEach<Int32>*'
Details
Payloads
Baseline
Compare
Histogram
System.Collections.IterateForEach<Int32>.ImmutableDictionary(Size: 512)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 16.7728410311493 < 17.284805469623052.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 56.23875832240878 (T) = (0 -16809.356638700152) / Math.Sqrt((48160.26836130668 / (299)) + (9908.378857587331 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.06767492353020306 = (18029.501793889267 - 16809.356638700152) / 18029.501793889267 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_Vector3


Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Vector3*'
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Vector3.TransformByMatrix4x4Benchmark
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 4.649358172773837 < 5.422574810263595.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 85.89574202749007 (T) = (0 -4.759031620688317) / Math.Sqrt((0.008857068987883179 / (299)) + (0.0022396787747015175 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.15264269734654584 = (5.61632218874572 - 4.759031620688317) / 5.61632218874572 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Vector3.TransformNormalByMatrix4x4Benchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 4.055128330380066 < 5.162626016391384.
IsChangePoint: Marked as a change because one of 8/1/2022 6:03:22 PM, 8/30/2022 6:17:03 PM, 9/5/2022 11:32:52 PM falls between 8/28/2022 2:29:57 AM and 9/5/2022 11:32:52 PM.
IsImprovementStdDev: Marked as improvement because 31.153206120733916 (T) = (0 -4.189765235709243) / Math.Sqrt((0.04044653534306904 / (299)) + (0.027418188819353217 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.18975923641517772 = (5.171012647119952 - 4.189765235709243) / 5.171012647119952 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_Quaternion
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionOperatorBenchmark
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Improvements in System.Threading.Tasks.ValueTaskPerfTest
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Threading.Tasks.ValueTaskPerfTest.CreateAndAwait_FromResult_ConfigureAwait
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Tests.Perf_Double
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_Double.ToStringWithFormat(value: -1.7976931348623157E+308, format: "R")
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_Matrix3x2
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Matrix3x2.AddOperatorBenchmark
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_Vector4
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Vector4.TransformVector2ByMatrix4x4Benchmark
Description of detection logic
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Text.Json.Tests.Perf_Reader
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: HelloWorld)
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Collections.IterateForEach<Int32>
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Collections.IterateForEach<Int32>.ImmutableDictionary(Size: 512)
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_Vector3
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Vector3.TransformByMatrix4x4Benchmark
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository