Bug 1595982 - make mozharness::base::log.py and errors.py python3 compatible r=aki Changes: Reorder imports and general code style fixes. Change reference to `basestring` to `six.string_types`. Explicitly cast potential view object. Depends on D52791 Differential Revision: https://phabricator.services.mozilla.com/D53119

Bug 1595982 - make mozharness::base::vcs python3 compatible r=aki Changes: Run `isort` and `autopep8` to fix formatting mistakes. Replace deprecated imports with `try/except` block to make it compatible with Python2 and 3. Differential Revision: https://phabricator.services.mozilla.com/D53727

Bug 1595982 - make mozharness::base::transfer.py python3 compatible r=aki Changes: Run `isort` to fix the import ordering. Change import of `urllib2` module to import just `urlopen` which eliminates the need for an `if/else` or `try/except ` block in the main code section. Depends on D52791 Differential Revision: https://phabricator.services.mozilla.com/D53097

Bug 1595982 - make mozharness::base::python.py python3 compatible r=aki Changes: Run `isort` to fix the import ordering. Run `autopep8` to fix code formatting issues. Import `six.string_types` to replace the `basestring` comparison. Depends on D52791 Differential Revision: https://phabricator.services.mozilla.com/D53093

Bug 1595982 - make mozharness::base::script.py python3 compatible r=aki Changes: Run `isort` and `autopep8` for automatic fixes of import and code formatting. Replace deprecated imports with updated imports for python3 and wrap the attempt in a `try/except` clause for backwards compatibility. Wherever possible, directly import the object with same name between python2/python3 versions to simplify the main code (eg. HTTPError). Differential Revision: https://phabricator.services.mozilla.com/D52791

No bug: [taskgraph] Sort soft-dependencies output to make diffing easier; r=aki Differential Revision: https://phabricator.services.mozilla.com/D49772

No bug: [taskgraph] Simplify release_notifications transform slightly; r=aki Differential Revision: https://phabricator.services.mozilla.com/D49770

Bug 1579940 - Setup WNP for users coming from <70.0 and receiving the 70.0 release, DONTBUILD NPOTB, r=aki, a=release Differential Revision: https://phabricator.services.mozilla.com/D49008

No bug: [taskgraph] Be more explict about the type of config in taskgraph.decision; r=aki Differential Revision: https://phabricator.services.mozilla.com/D48001

Bug 1576707 - Allow "absolute" fetch artifacts to ignore `artifact_prefix`. r=aki The way that `artifact-prefix` works is that it applies to the _consuming_ task's fetches... meaning that changing the prefix requires working out the new paths for every fetch in the consuming task. This allows to "opt-out" of the artifact prefix mechanism for individual fetches. Differential Revision: https://phabricator.services.mozilla.com/D43535

Bug 1576707 - Allow "absolute" fetch artifacts to ignore `artifact_prefix`. r=aki The way that `artifact-prefix` works is that it applies to the _consuming_ task's fetches... meaning that changing the prefix requires working out the new paths for every fetch in the consuming task. This allows to "opt-out" of the artifact prefix mechanism for individual fetches. Depends on D43534 Differential Revision: https://phabricator.services.mozilla.com/D43535

Bug 1572102 - deprioritize partner-repack tasks as they don't block QE, r=aki Lower the priority of partner-repack jobs and downstreams to medium, so that tasks which do block QE work are not impeded. Differential Revision: https://phabricator.services.mozilla.com/D43399

Bug 1567235 - notarize 5 partner & eme-free builds per task instead of individually, r=aki Differential Revision: https://phabricator.services.mozilla.com/D39482

Bug 1562287: [taskgraph] `try_task_config` parameter is now always a `dict`; r=aki Differential Revision: https://phabricator.services.mozilla.com/D38591

Bug 1538995 - update bouncer aliases for partner products when shipping, r=aki Pass partner aliases down to the bouncer scriptworker so it can update those too. Matching change to bouncerscript at https://github.com/mozilla-releng/bouncerscript/pull/57. Differential Revision: https://phabricator.services.mozilla.com/D35483

Bug 1538995 - pass list of partners to beetmover for pushing to releases/partners/, r=aki This passes partner data on to the beetmover scriptworker, so it can publish enabled partners. There is beetmover change at https://github.com/mozilla-releng/beetmoverscript/pull/227 to complete this support. Depends on D35481 Differential Revision: https://phabricator.services.mozilla.com/D35482

Bug 1538995 - submit partner products to bouncer when we'll host the files, r=aki Adds a new release-partner-repack-bouncer-sub-firefox task to add the partner products. This is forked from the main bouncer submission because it diverges sufficiently that this is a cleaner approach. The get_partners_to_be_published helper is used by aliases too. Depends on D34950 Differential Revision: https://phabricator.services.mozilla.com/D35481

Bug 1538995 - adjust beetmover to copy partner stub installers into candidates dir, r=aki Appends the customized stub installer and it's gpg signature to the list of artifacts to beetmove to candidates. Differential Revision: https://phabricator.services.mozilla.com/D34950

Bug 1538995 - adjust repackage-signing jobs to sign partner stub installers, r=aki Differential Revision: https://phabricator.services.mozilla.com/D34948

Bug 1538995 - adjust repackage jobs to create partner stub installers, r=aki On win32, where repack_stub_installer is enabled, extend the inputs to the partner repackage task so that it donwloads the upstream artifacts and creates the stub installer. Differential Revision: https://phabricator.services.mozilla.com/D34946

Bug 1538995 - support repacking stub installers for partners, r=aki Pay attention to the new repack_stub_installer param, and fix config parsing to split on the first =. Differential Revision: https://phabricator.services.mozilla.com/D34945

Bug 1520010: switch wv to autograph r=aki,Callek Differential Revision: https://phabricator.services.mozilla.com/D31433

Bug 1520010: Remove signing format scopes r=aki Differential Revision: https://phabricator.services.mozilla.com/D31432

Bug 1533818 - Don't try to expand from a 'cose.manifest' file when repacking the l10n copy of omni.ja. r=aki Differential Revision: https://phabricator.services.mozilla.com/D34697

Bug 1533818 - Start signing omni.ja files. r=aki Differential Revision: https://phabricator.services.mozilla.com/D34541

Bug 1520591: switch gpg signing to autograph r=aki Differential Revision: https://phabricator.services.mozilla.com/D31135

Bug 1520591: switch gpg signing to autograph r=aki Differential Revision: https://phabricator.services.mozilla.com/D31135

Bug 1551208 - Update obsolete bug component. r=aki Differential Revision: https://phabricator.services.mozilla.com/D30962

Bug 1550816: Enforce consistent indenting in taskcluster yaml; r=aki Differential Revision: https://phabricator.services.mozilla.com/D30684

Bug 1427849 - Digitally sign geckodriver binaries on Windows and Linux r=aki Digitally sign geckodriver binaries on Windows and Linux Differential Revision: https://phabricator.services.mozilla.com/D28185

Bug 1541122: [try-staging] Support bouncer-check in staging; r=aki Differential Revision: https://phabricator.services.mozilla.com/D25835

Bug 1533589: Add win64-aarch64 update verify configuration; r=aki Differential Revision: https://phabricator.services.mozilla.com/D25834

Bug 1533589: Support generating update-verify-config for new configuration; r=aki When adding a new platform, the first release will be at the watershed, and there will be no update paths. Rather than failing in this case (requiring the update-verify setup happen after the first release), generate an empty config which will allow the later tasks to turn green. Differential Revision: https://phabricator.services.mozilla.com/D25833

Bug 1541121: [try-staging] Allow staging release to not have partials; r=aki We check that partials as a safety check. But we don't need that for staging builds, and it is often useful to be able to test things that don't depend on partials. The shipit UI currently still requires partials, but that can be worked around using the react dev tools. Differential Revision: https://phabricator.services.mozilla.com/D24834

Bug 1541121: [try-staging] Simplify the logic for getting partial update configration; r=aki The original code was converting to json, then comparing against `{}`. This switches things around so that json is only generated where it is directly used a json. Differential Revision: https://phabricator.services.mozilla.com/D24833

No bug: [mozharness] Remove obsolete push-candidate-to-releases script; r=aki This functionality has been replaced by beetmover. Also remove `mozharness.mozilla.aws`, of which this was the only consumer. Differential Revision: https://phabricator.services.mozilla.com/D25676

No bug: [taskgraph] Remove unused code for varying build-tools repo to use; r=aki We don't actually use the build-tools repo in-tree anymore, so remove the support code for it. Differential Revision: https://phabricator.services.mozilla.com/D25631

Bug 1488313: [taskgraph] Add options to reuse on-push tasks in cron graphs; r=dustin,aki Differential Revision: https://phabricator.services.mozilla.com/D13151

Bug 1488313: [taskgraph] Move some functions for interacting with existing taskgraph to a more generic location; r=aki Differential Revision: https://phabricator.services.mozilla.com/D13150

Bug 1352113 - Shippable Builds - Don't use enable-full-crashsymbols attribute when we explicitly disable symbols for a job. r=aki Differential Revision: https://phabricator.services.mozilla.com/D24999

Bug 1352113 - Shippable Builds - Update index routes for shippable. Try to be backwards compat where possible. r=aki Differential Revision: https://phabricator.services.mozilla.com/D24829

Bug 1352113 - Remove nightly build types replaced by shippable. r=aki Differential Revision: https://phabricator.services.mozilla.com/D24700

Bug 1352113 - Shippable Builds - Support shippable where 'nightly' is used. r=aki Makes most kinds that reference nightly attribute reference the shippable attribute. Also makes most transforms that use nightly use shippable Transfers dependencies/ownership for some things to shippable from nightly where it was harder to support both. In no particular order, full list: Send shippable attribute down to dep tasks. Set tests as shippable attribute Add new signing routes Add shippable routes to repackage_routes transform Adjust target tasks Add shippable nightly-l10n Add nightly-signing and as a side affect add repackage and repackage-signing Add support for proper balrog platforms for shippable Add shippable to the nightly sccache guard Fix TC_PLATFORM_PER_FTP in partners.py to use shippable Add shippable to mozharness_test variants Only actually used for android which doesn't have shippable at this time. Add shippable variant to beetmover transforms Do nightly signing for mars on shippable Support shippable in partner-repack transform Support shippable in amo langpacks transform Use proper signing for shippable tasks in repackage transforms Set upload symbols to use shippable too Use shippable as deps for geckodriver extraction Use shippable as dep for autograph-stage signing Do not run beetmover-l10n for shippable Run shippable style jobs for repackage signing Set build_platform for update verify and uvc to be shippable Run repackage-msi for shippable Add shippable to osx partner repack signing add shippable to emefree repackage add shippable to emefree repackage signing add shippable to beetmover checksums Add shippable to partner repack repackage signing add partner repack beetmover Add shippable to mar signing Add shippable to mar-signing-l10n add shippable to eme free beetmover checksums Add shippable to upload-generated-sources Add beetmover langpacks to shippable Add repackage-l10n to shippable Add shippable to partner repack chunk-dummy Do eme free builds with shippable Add signing of language packs to shippable Add snap repackage for shippable Add shippable for release-eme-free repack signing Add partials for shippable Add partner repack repackage for shippable Add emefree beetmover for shippable Add checksums-signing to shippable Switch partner repacks to shippable Add shippable to beetmover-repackage Add secondary update verify configs for shippable secondary update verify for shippable Differential Revision: https://phabricator.services.mozilla.com/D24699

Bug 1352113 - Shippable Builds - make only-for-attributes accept any() instead of all() in the set. r=aki Differential Revision: https://phabricator.services.mozilla.com/D23130

Bug 1352113 - Shippable Builds - Don't run OSX opt builds by default on integration trees. r=aki Differential Revision: https://phabricator.services.mozilla.com/D23128

Bug 1352113 - Shippable Builds - Do not do linux pgo either. r=jmaher,aki Differential Revision: https://phabricator.services.mozilla.com/D23126

Bug 1352113 - Shippable Builds - Do not do linux32/opt build on integration. r=aki Differential Revision: https://phabricator.services.mozilla.com/D23248

Bug 1352113 - Shippable Builds - Remove windows pgo entirely. r=jmaher,aki Differential Revision: https://phabricator.services.mozilla.com/D23125

Bug 1352113 - Shippable Builds - Make source-test depend on shippable instead of pgo. r=aki This is useful in order to not have to run linux64/opt on push, especially on autoland/inbound when we need a source test. It is also required if we remove the linux64-pgo build type entirely. Differential Revision: https://phabricator.services.mozilla.com/D23124

Bug 1352113 - Shippable Builds - Switch l10n jobs to be based on shippable builds. r=aki Differential Revision: https://phabricator.services.mozilla.com/D23123