Bug 1604714 - mark flaky screen-orientation tests on ubuntu1804 webrender/asan with expectation of [OK, ERROR] r=jmaher
authorEdwin Takahashi <egao@mozilla.com>
Thu, 19 Dec 2019 11:13:58 +0000
changeset 507899 9ef604df43ae64ebbb52d2671976f9d0631bb57e
parent 507898 8a36d9f679745d3a40a5a021a92a85dfba0c5a29
child 507900 42a0445eebdbe7a1f37f8d22305e00d787d2328b
push id36933
push useraciure@mozilla.com
push dateFri, 20 Dec 2019 04:15:17 +0000
treeherdermozilla-central@c8ce8b91465a [default view] [failures only]
perfherder[talos] [build metrics] [platform microbench] (compared to previous push)
reviewersjmaher
bugs1604714
milestone73.0a1
first release with
nightly linux32
nightly linux64
nightly mac
nightly win32
nightly win64
last release without
nightly linux32
nightly linux64
nightly mac
nightly win32
nightly win64
Bug 1604714 - mark flaky screen-orientation tests on ubuntu1804 webrender/asan with expectation of [OK, ERROR] r=jmaher Changes: Several tests in `screen-orientation` subsuite are flaky when run on ubuntu1804 with either `webrender` or `asan`. Mark them with expectation of ["OK", "ERROR"] to compensate. Differential Revision: https://phabricator.services.mozilla.com/D57651
testing/web-platform/meta/screen-orientation/event-before-promise.html.ini
testing/web-platform/meta/screen-orientation/lock-unlock-check.html.ini
testing/web-platform/meta/screen-orientation/onchange-event.html.ini
testing/web-platform/meta/screen-orientation/orientation-reading.html.ini
--- a/testing/web-platform/meta/screen-orientation/event-before-promise.html.ini
+++ b/testing/web-platform/meta/screen-orientation/event-before-promise.html.ini
@@ -1,12 +1,13 @@
 [event-before-promise.html]
   expected:
     if (os == "mac") and not debug: ["ERROR", "OK"]
     if (os == "win") and (processor == "aarch64"): OK
     if (os == "win") and (processor == "x86_64"): OK
     if os == "android": TIMEOUT
+    if (asan or webrender) and (os == 'linux' and os_version == '18.04'): ["OK", "ERROR"] # Bug 1604714
     ERROR
   [The 'change' event must fire before the [[orientationPendingPromise\]\] is resolved.]
     expected:
       if os == "android": TIMEOUT
       FAIL
 
--- a/testing/web-platform/meta/screen-orientation/lock-unlock-check.html.ini
+++ b/testing/web-platform/meta/screen-orientation/lock-unlock-check.html.ini
@@ -1,13 +1,14 @@
 [lock-unlock-check.html]
   expected:
     if (os == "mac") and debug: ["ERROR", "OK"]
     if (os == "mac") and not debug: ["OK", "ERROR"]
     if (os == "win") and (processor == "aarch64"): OK
     if (os == "win") and (processor == "x86_64"): OK
     if os == "android": TIMEOUT
+    if (webrender or asan) and (os == 'linux' and os_version == '18.04'): ["ERROR", "OK"] # Bug 1604714
     ERROR
   [Re-locking orientation during event dispatch must reject existing orientationPendingPromise]
     expected:
       if os == "android": TIMEOUT
       FAIL
 
--- a/testing/web-platform/meta/screen-orientation/onchange-event.html.ini
+++ b/testing/web-platform/meta/screen-orientation/onchange-event.html.ini
@@ -1,15 +1,16 @@
 [onchange-event.html]
   expected:
     if (os == "win") and (processor == "aarch64"): OK
     if (os == "win") and (processor == "x86_64"): OK
     if (os == "mac") and not debug: ["ERROR", "OK"]
     if (os == "mac") and debug: ["ERROR", "OK"]
     if os == "android": TIMEOUT
+    if (webrender or asan) and (os == 'linux' and os_version == '18.04'): ["ERROR", "OK"] # Bug 1604714
     ERROR
   [Test that orientationchange event is fired when the orientation changes.]
     expected:
       if os == "android": TIMEOUT
       FAIL
 
   [Test that orientationchange event is not fired when the orientation does not change.]
     expected:
--- a/testing/web-platform/meta/screen-orientation/orientation-reading.html.ini
+++ b/testing/web-platform/meta/screen-orientation/orientation-reading.html.ini
@@ -1,15 +1,16 @@
 [orientation-reading.html]
   expected:
     if (os == "mac") and debug: ["ERROR", "OK"]
     if (os == "mac") and not debug: ["OK", "ERROR"]
     if (os == "win") and (processor == "aarch64"): OK
     if (os == "win") and (processor == "x86_64"): OK
     if os == "android": TIMEOUT
+    if (asan or webrender) and (os == 'linux' and os_version == '18.04'): ["ERROR", "OK"] # Bug 1604714
     ERROR
   [Test that screen.orientation values change if the orientation changes]
     expected:
       if os == "android": NOTRUN
       FAIL
 
   [Test the orientations and associated angles]
     expected: