build/tests/test_testmanifest.txt
author Myk Melez <myk@mozilla.org>
Tue, 14 Aug 2012 15:27:26 -0700
changeset 102430 07b53bdc212ac3876cea6c2c7906e3106985043e
parent 71959 4edf5956780be0ab7bc2268adea9c87034c265e7
permissions -rw-r--r--
bug 770770: refactor webapp runtime test harness to reduce complexity/special-casing; r=adw

Test the Test Manifest
======================

Boilerplate::

    >>> import os

Test filtering based on platform::

    >>> from manifestparser import TestManifest
    >>> manifest = TestManifest(manifests=('filter-example.ini',))
    >>> [i['name'] for i in manifest.active_tests(os='win', disabled=False, exists=False)]
    ['windowstest', 'fleem']
    >>> [i['name'] for i in manifest.active_tests(os='linux', disabled=False, exists=False)]
    ['fleem', 'linuxtest']

Look for existing tests.  There is only one::

    >>> [i['name'] for i in manifest.active_tests()]
    ['fleem']

You should be able to expect failures::

    >>> last_test = manifest.active_tests(exists=False, toolkit='gtk2')[-1]
    >>> last_test['name']
    'linuxtest'
    >>> last_test['expected']
    'pass'
    >>> last_test = manifest.active_tests(exists=False, toolkit='cocoa')[-1]
    >>> last_test['expected']
    'fail'