Bug 1540252 [wpt PR 16107] - Run full Edge runs every 6 hours, a=testonly
authorPhilip Jägenstedt <philip@foolip.org>
Thu, 18 Apr 2019 11:56:44 +0000
changeset 471015 bcdf27a511f57c52d34e19f63c81973a4c580e3f
parent 471014 c7539ad6abb37d3a30cf2232dc9b433e68917e58
child 471016 5661b4c78d9b6a359b65d79b961030e64b932e6b
push id112883
push userjames@hoppipolla.co.uk
push dateWed, 24 Apr 2019 10:45:08 +0000
treeherdermozilla-inbound@a9e8bb1d8a16 [default view] [failures only]
perfherder[talos] [build metrics] [platform microbench] (compared to previous push)
reviewerstestonly
bugs1540252, 16107
milestone68.0a1
first release with
nightly linux32
nightly linux64
nightly mac
nightly win32
nightly win64
last release without
nightly linux32
nightly linux64
nightly mac
nightly win32
nightly win64
Bug 1540252 [wpt PR 16107] - Run full Edge runs every 6 hours, a=testonly Automatic update from web-platform-tests Run full Edge runs every 6 hours (#16107) This will end up in the same build as the Safari TP run. The wpt.fyi integration should ensure that one failing doesn't affect the other, but there is some risk here and it will need to be monitored. -- wpt-commits: b53840ae8e05244f694a32d411251c009c249a26 wpt-pr: 16107
testing/web-platform/tests/.azure-pipelines.yml
--- a/testing/web-platform/tests/.azure-pipelines.yml
+++ b/testing/web-platform/tests/.azure-pipelines.yml
@@ -158,21 +158,24 @@ jobs:
     displayName: 'Run tests (Edge)'
   - task: PublishBuildArtifacts@1
     displayName: 'Publish results'
     inputs:
       artifactName: 'infrastructure'
     condition: always()
   - template: tools/ci/azure/cleanup_win10.yml
 
+# All `./wpt run` tests are run from epochs/* branches on a schedule. See
+# documentation at the top of this file for required setup.
 - job: results_edge
   displayName: 'all tests (Edge)'
-  # This job is only triggered manually until it has been shown to be robust.
-  condition: and(eq(variables['Build.Reason'], 'Manual'), variables['run_all_edge'])
-  # There are 5 agents in the pool, but use more jobs so that each takes <1h.
+  condition: |
+    or(eq(variables['Build.Reason'], 'Schedule'),
+       and(eq(variables['Build.Reason'], 'Manual'), variables['run_all_edge']))
+  # There are 12 agents in the pool, but use more jobs so that each takes <1h.
   strategy:
     parallel: 20
   timeoutInMinutes: 360
   pool:
     name: 'Hosted Windows Client'
   steps:
   - template: tools/ci/azure/system_info.yml
   - template: tools/ci/azure/checkout.yml
@@ -190,18 +193,16 @@ jobs:
     inputs:
       artifactName: 'edge-results'
   - template: tools/ci/azure/cleanup_win10.yml
 - template: tools/ci/azure/fyi_hook.yml
   parameters:
     dependsOn: results_edge
     artifactName: edge-results
 
-# All `./wpt run` tests are run from epochs/* branches on a schedule. See
-# documentation at the top of this file for required setup.
 - job: results_safari_preview
   displayName: 'all tests (Safari Technology Preview)'
   condition: |
     or(eq(variables['Build.Reason'], 'Schedule'),
        and(eq(variables['Build.Reason'], 'Manual'), variables['run_all_safari_preview']))
   strategy:
     parallel: 4 # chosen to make runtime ~2h
   timeoutInMinutes: 360