Skip to content

Commit de9c56a

Browse files
committed
DEV: Use perf_ratio for comparison
1 parent 0fe853b commit de9c56a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

CompareAndParseMarkdownResults.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,7 @@ def compare_results(file1, file2, threshold):
4444
mean2 = dict2[bench][kernel]["mean"]
4545
spread2 = dict2[bench][kernel]["spread"]
4646
perf_ratio2 = dict2[bench][kernel]["perf_ratio"]
47-
if abs(mean2 - mean1)/mean1 > threshold:
47+
if abs(perf_ratio2 - perf_ratio1)/perf_ratio1 > threshold:
4848
archs.append(kernel)
4949
means.append((mean1, mean2))
5050
spreads.append((spread1, spread2))

0 commit comments

Comments
 (0)