Bug 1391662 - Disable pytest cache provider in WPT. r=jgraham
authorAndreas Tolfsen <ato@sny.no>
Fri, 18 Aug 2017 16:16:45 +0100
changeset 375702 d0892f7190ef458c7e6d4712e787d11975f3a545
parent 375701 a08bb8b25b9bc881bda34314160d4e224111bcf8
child 375703 b57b8a2f06c7e67b438e750c179c02c70f5e812f
push id32361
push userphilringnalda@gmail.com
push dateSat, 19 Aug 2017 22:28:34 +0000
treeherdermozilla-central@c40774ced661 [default view] [failures only]
perfherder[talos] [build metrics] [platform microbench] (compared to previous push)
reviewersjgraham
bugs1391662
milestone57.0a1
first release with
nightly linux32
nightly linux64
nightly mac
nightly win32
nightly win64
last release without
nightly linux32
nightly linux64
nightly mac
nightly win32
nightly win64
Bug 1391662 - Disable pytest cache provider in WPT. r=jgraham The pytest cache provider lets you have access to --last-failed and --failed-first based on a cache file it puts in .cache/v/lastfailed. This can be useful for iterating on a set of failures, but not a feature we want to support through wptrunner. This patch disables the cache provider so that these files are not generated. When calling wptrunner with --manifest-update, these temporary files have had a tedency to be included in MANIFEST.json, and this change will effectively prevent that from happening. MozReview-Commit-ID: EU7zXAdxsfY
testing/web-platform/tests/tools/wptrunner/wptrunner/executors/pytestrunner/runner.py
--- a/testing/web-platform/tests/tools/wptrunner/wptrunner/executors/pytestrunner/runner.py
+++ b/testing/web-platform/tests/tools/wptrunner/wptrunner/executors/pytestrunner/runner.py
@@ -51,17 +51,18 @@ def run(path, server_config, session_con
 
     # TODO(ato): Deal with timeouts
 
     with TemporaryDirectory() as cache:
         pytest.main(["--strict",  # turn warnings into errors
                      "--verbose",  # show each individual subtest
                      "--capture", "no",  # enable stdout/stderr from tests
                      "--basetemp", cache,  # temporary directory
-                     "-p", "no:mozlog",
+                     "-p", "no:mozlog",  # use the WPT result recorder
+                     "-p", "no:cacheprovider",  # disable state preservation across invocations
                      path],
                     plugins=plugins)
 
     return recorder.results
 
 
 class SubtestResultRecorder(object):
     def __init__(self):