Bug 1527153 [wpt PR 15330] - Make stability checks provide an explicit message for duplicate test names, a=testonly
☠☠ backed out by 749b314d6c28 ☠ ☠
authorJames Graham <james@hoppipolla.co.uk>
Tue, 19 Feb 2019 14:39:06 +0000
changeset 460334 a9a12335f51646b904893d16990de9ea0f7802eb
parent 460333 3294c6e7ac26d46ca5f7ae40aeba130c100c62a2
child 460335 4ca9dfb6c9bf4be40d5dffa6816520f2e0620e08
push id112074
push userwptsync@mozilla.com
push dateThu, 21 Feb 2019 19:59:15 +0000
treeherdermozilla-inbound@a15983fcecca [default view] [failures only]
perfherder[talos] [build metrics] [platform microbench] (compared to previous push)
reviewerstestonly
bugs1527153, 15330
milestone67.0a1
first release with
nightly linux32
nightly linux64
nightly mac
nightly win32
nightly win64
last release without
nightly linux32
nightly linux64
nightly mac
nightly win32
nightly win64
Bug 1527153 [wpt PR 15330] - Make stability checks provide an explicit message for duplicate test names, a=testonly Automatic update from web-platform-tests Make stability checks provide an explicit message for duplicate test names -- wpt-commits: 23008e948bff4c245148cfcda2ebaa72149a2bb1 wpt-pr: 15330
testing/web-platform/tests/tools/wptrunner/wptrunner/stability.py
--- a/testing/web-platform/tests/tools/wptrunner/wptrunner/stability.py
+++ b/testing/web-platform/tests/tools/wptrunner/wptrunner/stability.py
@@ -158,19 +158,22 @@ def process_results(log, iterations):
 
     return results, inconsistent, slow
 
 
 def err_string(results_dict, iterations):
     """Create and return string with errors from test run."""
     rv = []
     total_results = sum(results_dict.values())
-    for key, value in sorted(results_dict.items()):
-        rv.append("%s%s" %
-                  (key, ": %s/%s" % (value, iterations) if value != iterations else ""))
+    if total_results > iterations:
+        rv.append("Duplicate subtest name")
+    else:
+        for key, value in sorted(results_dict.items()):
+            rv.append("%s%s" %
+                      (key, ": %s/%s" % (value, iterations) if value != iterations else ""))
     if total_results < iterations:
         rv.append("MISSING: %s/%s" % (iterations - total_results, iterations))
     rv = ", ".join(rv)
     if is_inconsistent(results_dict, iterations):
         rv = "**%s**" % rv
     return rv