Run Information
Improvements in PerfLabTests.CastingPerf


Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.CastingPerf*'
Details
Payloads
Baseline
Compare
Histogram
PerfLabTests.CastingPerf.ObjScalarValueType
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.117080033482143 < 1.5001351619583334.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 7.883389527918186 (T) = (0 -1226951.5642512238) / Math.Sqrt((27913551305.772415 / (299)) + (42684405999.926346 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.18685147908052935 = (1508889.867823708 - 1226951.5642512238) / 1508889.867823708 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.CastingPerf.FooObjIsFoo2
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.402628877083333 < 1.6989447919444443.
IsChangePoint: Marked as a change because one of 8/20/2022 7:42:33 PM, 8/25/2022 4:02:22 AM, 9/4/2022 3:57:42 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 3.031089039659782 (T) = (0 -1547184.9732933128) / Math.Sqrt((27823238096.458324 / (299)) + (44053684309.315506 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.09734166538864532 = (1714031.6706425396 - 1547184.9732933128) / 1714031.6706425396 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
### Run Information
Improvements in System.Numerics.Tests.Perf_Matrix3x2




Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Matrix3x2*'
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Matrix3x2.NegateBenchmark
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.550077748747801 < 18.974892672347526.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 13.931545441333482 (T) = (0 -13.453157206559924) / Math.Sqrt((1.643398208284182 / (299)) + (3.827916826736746 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.2572219971687954 = (18.111948866661763 - 13.453157206559924) / 18.111948866661763 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix3x2.SubtractBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 20.480739704635443 < 23.97522949956443.
IsChangePoint: Marked as a change because one of 8/31/2022 10:21:55 AM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 10.97989767733679 (T) = (0 -21.595147259132705) / Math.Sqrt((4.558812814248239 / (299)) + (2.852653087930012 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.14109773753292984 = (25.142729508132657 - 21.595147259132705) / 25.142729508132657 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix3x2.NegationOperatorBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.647898615910067 < 18.911300897308845.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 20.03075415397304 (T) = (0 -12.48561681491153) / Math.Sqrt((2.1032658738171857 / (299)) + (2.640639583837623 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.31264776424796453 = (18.164801342721983 - 12.48561681491153) / 18.164801342721983 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByScalarOperatorBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 12.707620461422321 < 17.963728856191892.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 16.35195025138139 (T) = (0 -14.379495137538754) / Math.Sqrt((2.458118357993808 / (299)) + (3.532444669872601 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.2705189275242159 = (19.71195097459653 - 14.379495137538754) / 19.71195097459653 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_Quaternion

Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Quaternion*'
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Quaternion.EqualsBenchmark
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.472131678044937 < 9.145590770458565.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 24.887414558519247 (T) = (0 -4.963312666459794) / Math.Sqrt((1.9617641317190944 / (299)) + (1.2862130167621555 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.5076687352336141 = (10.0812461479872 - 4.963312666459794) / 10.0812461479872 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Threading.Tests.Perf_CancellationToken

Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tests.Perf_CancellationToken*'
Details
Payloads
Baseline
Compare
Histogram
System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource1
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 314.84349447404253 < 361.7568360797649.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 5.558012111383666 (T) = (0 -332.8865953962951) / Math.Sqrt((880.1856864018545 / (299)) + (915.3747555954097 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.08166922386479092 = (362.49094993554155 - 332.8865953962951) / 362.49094993554155 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Threading.Tasks.ValueTaskPerfTest

Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tasks.ValueTaskPerfTest*'
Details
Payloads
Baseline
Compare
Histogram
System.Threading.Tasks.ValueTaskPerfTest.Copy_PassAsArgumentAndReturn_FromResult
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 22.8357145134597 < 24.1222367254773.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 9.873201504186643 (T) = (0 -17.99277453716331) / Math.Sqrt((10.415318722583745 / (299)) + (26.325212472646395 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.32445474743688807 = (26.6344474613599 - 17.99277453716331) / 26.6344474613599 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Collections.CtorDefaultSize<String>

Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorDefaultSize<String>*'
Details
Payloads
Baseline
Compare
Histogram
System.Collections.CtorDefaultSize<String>.ConcurrentDictionary
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.4955473967901796 < 1.6793608015142512.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 9/8/2022 4:04:25 AM falls between 8/30/2022 2:13:40 PM and 9/8/2022 4:04:25 AM.
IsImprovementStdDev: Marked as improvement because 6.7440167708066205 (T) = (0 -1588.0098800966673) / Math.Sqrt((6475.917031766745 / (299)) + (11752.365642843197 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.0734190946819609 = (1713.8383394071775 - 1588.0098800966673) / 1713.8383394071775 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in PerfLabTests.CastingPerf
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
PerfLabTests.CastingPerf.ObjScalarValueType
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Improvements in System.Numerics.Tests.Perf_Matrix3x2
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Matrix3x2.NegateBenchmark
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_Quaternion
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Quaternion.EqualsBenchmark
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Threading.Tests.Perf_CancellationToken
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource1
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Threading.Tasks.ValueTaskPerfTest
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Threading.Tasks.ValueTaskPerfTest.Copy_PassAsArgumentAndReturn_FromResult
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Collections.CtorDefaultSize<String>
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Collections.CtorDefaultSize<String>.ConcurrentDictionary
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository