Bug 1604714 - mark flaky screen-orientation tests on ubuntu1804 webrender/asan with expectation of [OK, ERROR] r=jmaher
authorEdwin Takahashi <egao@mozilla.com>
Fri, 10 Jan 2020 18:44:39 +0000
changeset 509794 d937344edc7569a8e8cdc3bd7b08d59f61a251c7
parent 509793 2595bcd8ce0c23f371aa5ac9bc9c0c02a7fa73db
child 509795 aedb120b6e18ce4674a6ea1b5be8c61fd460848f
push id37004
push usershindli@mozilla.com
push dateSat, 11 Jan 2020 09:48:29 +0000
treeherdermozilla-central@fb64636dad2c [default view] [failures only]
perfherder[talos] [build metrics] [platform microbench] (compared to previous push)
reviewersjmaher
bugs1604714
milestone74.0a1
first release with
nightly linux32
nightly linux64
nightly mac
nightly win32
nightly win64
last release without
nightly linux32
nightly linux64
nightly mac
nightly win32
nightly win64
Bug 1604714 - mark flaky screen-orientation tests on ubuntu1804 webrender/asan with expectation of [OK, ERROR] r=jmaher Changes: Several tests in `screen-orientation` subsuite are flaky when run on ubuntu1804 with either `webrender` or `asan`. Mark them with expectation of ["OK", "ERROR"] to compensate. Differential Revision: https://phabricator.services.mozilla.com/D57651
testing/web-platform/meta/screen-orientation/event-before-promise.html.ini
testing/web-platform/meta/screen-orientation/lock-unlock-check.html.ini
testing/web-platform/meta/screen-orientation/onchange-event.html.ini
testing/web-platform/meta/screen-orientation/orientation-reading.html.ini
--- a/testing/web-platform/meta/screen-orientation/event-before-promise.html.ini
+++ b/testing/web-platform/meta/screen-orientation/event-before-promise.html.ini
@@ -1,11 +1,12 @@
 [event-before-promise.html]
   expected:
     if (os == "linux") and not debug and not webrender and not fission and (processor == "x86_64"): ["ERROR", "OK"]
+    if (asan or webrender) and (os == 'linux' and os_version == '18.04'): ["OK", "ERROR"] # Bug 1604714
     if (os == "win") and (processor == "x86_64"): OK
     if (os == "win") and (processor == "aarch64"): OK
     if (os == "mac") and not debug: ["ERROR", "OK"]
     if os == "android": TIMEOUT
     ERROR
   [The 'change' event must fire before the [[orientationPendingPromise\]\] is resolved.]
     expected:
       if os == "android": TIMEOUT
--- a/testing/web-platform/meta/screen-orientation/lock-unlock-check.html.ini
+++ b/testing/web-platform/meta/screen-orientation/lock-unlock-check.html.ini
@@ -1,13 +1,14 @@
 [lock-unlock-check.html]
   expected:
     if (os == "win") and (processor == "x86_64") and not webrender: OK
     if (os == "win") and (processor == "x86_64") and webrender: ["OK", "ERROR"]
     if (os == "linux") and webrender: ["ERROR", "OK"]
+    if (asan or webrender) and (os == 'linux' and os_version == '18.04'): ["OK", "ERROR"] # Bug 1604714
     if (os == "win") and (processor == "aarch64"): OK
     if (os == "mac") and debug: ["ERROR", "OK"]
     if (os == "mac") and not debug: ["ERROR", "OK"]
     if os == "android": TIMEOUT
     ERROR
   [Re-locking orientation during event dispatch must reject existing orientationPendingPromise]
     expected:
       if os == "android": TIMEOUT
--- a/testing/web-platform/meta/screen-orientation/onchange-event.html.ini
+++ b/testing/web-platform/meta/screen-orientation/onchange-event.html.ini
@@ -1,16 +1,17 @@
 [onchange-event.html]
   expected:
     if (os == "win") and (processor == "x86_64") and not webrender: OK
     if (os == "win") and (processor == "x86_64") and webrender: ["OK", "ERROR"]
     if (os == "mac") and debug: ["ERROR", "OK"]
     if (os == "mac") and not debug: ["OK", "ERROR"]
     if (os == "win") and (processor == "aarch64"): OK
     if (os == "linux") and webrender: ["ERROR", "OK"]
+    if (asan or webrender) and (os == 'linux' and os_version == '18.04'): ["OK", "ERROR"] # Bug 1604714
     if os == "android": TIMEOUT
     ERROR
   [Test that orientationchange event is fired when the orientation changes.]
     expected:
       if os == "android": TIMEOUT
       FAIL
 
   [Test that orientationchange event is not fired when the orientation does not change.]
--- a/testing/web-platform/meta/screen-orientation/orientation-reading.html.ini
+++ b/testing/web-platform/meta/screen-orientation/orientation-reading.html.ini
@@ -1,11 +1,12 @@
 [orientation-reading.html]
   expected:
     if (os == "linux") and not debug and not webrender and not fission and (processor == "x86_64"): ["ERROR", "OK"]
+    if (asan or webrender) and (os == 'linux' and os_version == '18.04'): ["OK", "ERROR"] # Bug 1604714
     if (os == "win") and (processor == "aarch64"): OK
     if (os == "win") and (processor == "x86_64"): OK
     if os == "android": TIMEOUT
     if os == "mac": ["ERROR", "OK"]
     ERROR
   [Test that screen.orientation values change if the orientation changes]
     expected:
       if os == "android": NOTRUN