Bug 1486788 - make sunspider lower_is_better and indicate it is a 'ms' benchmark. r=ahal
authorJoel Maher <jmaher@mozilla.com>
Tue, 28 Aug 2018 16:30:58 +0000
changeset 488693 b0b8164bd25a5f750464ea7ce7555d477fa99c87
parent 488692 2a94f63cc2f89533b4f591e972c601f564b72560
child 488694 6d95f23e7ea20ff6b2a5dbd0af8627c60d3b1d1c
push id9734
push usershindli@mozilla.com
push dateThu, 30 Aug 2018 12:18:07 +0000
treeherdermozilla-beta@71c71ab3afae [default view] [failures only]
perfherder[talos] [build metrics] [platform microbench] (compared to previous push)
reviewersahal
bugs1486788
milestone63.0a1
first release with
nightly linux32
nightly linux64
nightly mac
nightly win32
nightly win64
last release without
nightly linux32
nightly linux64
nightly mac
nightly win32
nightly win64
Bug 1486788 - make sunspider lower_is_better and indicate it is a 'ms' benchmark. r=ahal Adjust sunspider raptor test to make lower_is_better=true and treat it as 'ms' and not a 'score' Differential Revision: https://phabricator.services.mozilla.com/D4454
testing/raptor/raptor/tests/raptor-sunspider.ini
--- a/testing/raptor/raptor/tests/raptor-sunspider.ini
+++ b/testing/raptor/raptor/tests/raptor-sunspider.ini
@@ -4,17 +4,17 @@
 
 # sunspider benchmark for firefox and chrome
 
 [DEFAULT]
 type =  benchmark
 test_url = http://localhost:<port>/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor
 page_cycles = 5
 page_timeout = 35000
-unit = score
-lower_is_better = false
+unit = ms
+lower_is_better = true
 alert_threshold = 2.0
 
 [raptor-sunspider-firefox]
 apps = firefox
 
 [raptor-sunspider-chrome]
 apps = chrome