cccdde2d9f45aff35ac583701de64f8567c0adfc: hgmo: optimize Docker image generation
Gregory Szorc <gps@mozilla.com> - Tue, 10 Mar 2015 11:45:51 -0700 - rev 360525
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
hgmo: optimize Docker image generation We use the new feature to limit which files are added to the context. We also consolidate the number of instructions in the Dockerfiles to make image building faster. The images still don't build as quickly as I would like. We may have to move instructions into a shell script that is executed inside the container.
2931ea56d7c4b5a4fc901d87ff3a181d3633196c: docker: support adding a subset of files to the tar archive
Gregory Szorc <gps@mozilla.com> - Tue, 10 Mar 2015 11:44:29 -0700 - rev 360524
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
docker: support adding a subset of files to the tar archive Profiling revealed that adding all files from v-c-t to the tar archive used for the build context slowed down image generation. This patch adds support for specifying a subset of files to include in the archive.
b35135180867b933cbad788600bda52607a95afc: testing: suppress stderr from hg invocation
Gregory Szorc <gps@mozilla.com> - Tue, 10 Mar 2015 10:55:09 -0700 - rev 360523
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
testing: suppress stderr from hg invocation This was resulting in a warning about obsolescence markers being present since HGRCPATH was set to /dev/null and evolution wasn't enabled.
ac4845c73decbc81c892207a33e13760fdb61194: hgmo: add create-repo script
Gregory Szorc <gps@mozilla.com> - Tue, 10 Mar 2015 10:25:19 -0700 - rev 360522
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
hgmo: add create-repo script This should have been added in a previous commit.
1d67fcbc3561343faf71ea33b50092a2a7ecc712: pash: add a test verifying that `hg serve` is handled
Gregory Szorc <gps@mozilla.com> - Tue, 10 Mar 2015 00:04:32 -0700 - rev 360521
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
pash: add a test verifying that `hg serve` is handled Currently only testing clone/pull only. Tests for push will be added later.
299fd047cb119c765c407331fb579c850ca32a4d: hgmo: ability to create repositories on the cluster
Gregory Szorc <gps@mozilla.com> - Tue, 10 Mar 2015 00:04:01 -0700 - rev 360520
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
hgmo: ability to create repositories on the cluster This is extremely simple. I haven't verified replication is working yet. But it unblocks the next round of tests.
bf268031a889c770e3d47e3ba7074f65a17e8b63: hgmaster: add missing extension files to Docker image
Gregory Szorc <gps@mozilla.com> - Tue, 10 Mar 2015 00:03:14 -0700 - rev 360519
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
hgmaster: add missing extension files to Docker image pushlog-legacy and serverlog were failing to load due to missing files. Correct that.
9e587707cc03ffa979b0a17541322f18019bb79a: hgmo: fix creating SSH keys when creating LDAP users
Gregory Szorc <gps@mozilla.com> - Mon, 09 Mar 2015 23:55:00 -0700 - rev 360518
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
hgmo: fix creating SSH keys when creating LDAP users The LDAP package is very sensitive about types. We must pass str or it barfs. Before this patch, we were passing unicode.
7671c97d9d96e48316a92eba2dea3ebd01d89a59: hgmaster: add vct files towards the end of the Dockerfile
Gregory Szorc <gps@mozilla.com> - Mon, 09 Mar 2015 23:30:54 -0700 - rev 360517
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
hgmaster: add vct files towards the end of the Dockerfile For performance reasons. These files likely change more than others, invalidating the cache.
c55e7bb85db0a0ecc7fe29fa6297c5db51bb20bd: pash: add basic tests for pash using hgmo Docker cluster
Gregory Szorc <gps@mozilla.com> - Mon, 09 Mar 2015 23:21:11 -0700 - rev 360516
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
pash: add basic tests for pash using hgmo Docker cluster Now that we have a Docker cluster for hg.mozilla.org, let's put it to use by testing pash. The implemented test covers basic SSH auth behavior. We have to start somewhere.
730b73fe730425ff5c016c73fdad98dc69d38cba: hgmo: forcefully shut down containers during clean()
Gregory Szorc <gps@mozilla.com> - Mon, 09 Mar 2015 23:04:02 -0700 - rev 360515
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
hgmo: forcefully shut down containers during clean() Since clean() will remove the containers, it doesn't matter if they shut down gracefully or not. Force the shutdown and enable a quicker shutdown. This will make tests faster once we start testing hgmo clusters.
c37c95c6f29ce399dae9705be5be1f9139e0d543: hgmo: grab Docker images from environment
Gregory Szorc <gps@mozilla.com> - Mon, 09 Mar 2015 22:59:20 -0700 - rev 360514
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
hgmo: grab Docker images from environment Similar to how mozreview works, we want the images generated by run-mercurial-tests.py to be automatically used in tests without having to incur semi-expensive and redundant image generation.
1f913281068e233bbde3a8b49c21ecbd855438ed: testing: build all Docker images when running tests
Gregory Szorc <gps@mozilla.com> - Mon, 09 Mar 2015 22:53:26 -0700 - rev 360513
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
testing: build all Docker images when running tests
6945fa3be1f1596146bae266123cc2d471b43bab: docker: add an API to build all images for all projects
Gregory Szorc <gps@mozilla.com> - Mon, 09 Mar 2015 22:51:46 -0700 - rev 360512
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
docker: add an API to build all images for all projects
f4acefded15df7555086cc703f3efdc0b9db48ac: hgmo: ability to specify which port the master SSH server listens on
Gregory Szorc <gps@mozilla.com> - Mon, 09 Mar 2015 22:51:17 -0700 - rev 360511
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
hgmo: ability to specify which port the master SSH server listens on
b6aded8e5fada0248b593d2e6de65ca3daf935cd: testing: vastly improve support for running hg.mozilla.org clusters
Gregory Szorc <gps@mozilla.com> - Mon, 09 Mar 2015 22:20:17 -0700 - rev 360510
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
testing: vastly improve support for running hg.mozilla.org clusters Support for running an hg.mozilla.org has been vastly improved. An "hgmo" mach driver for controlling hg.mozilla.org instances has been created. There is a new API behind it for controlling instances. The hgmaster Docker environment has been greatly improved. It now integrates with an OpenLDAP server. OpenSSH LPK is installed and SSH logins are processed through LDAP lookups. It "just works." SSH requests into the container result in pash successfully being invoked. Support for running hgweb containers has been added. It isn't super well-tested right now. But the master container can SSH into hgweb containers as the hg user and get the desired mirror-pull behavior. Although, things have not been tested to verify mirror-pull and other various SSH connectivity works as expected. Things are probably significantly broken.
d65b53c26da2d2663a97608f720b65dfbbf5fbe8: pash: replace doc_root with DOC_ROOT; r=bkero
Gregory Szorc <gps@mozilla.com> - Thu, 05 Mar 2015 18:02:00 -0800 - rev 360509
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
pash: replace doc_root with DOC_ROOT; r=bkero We no longer need a dictionary to hold document root instances because we only support 1 server (since we dropped hg.ecmascript.org). This patch replaces doc_root with DOC_ROOT.
530e3df7c659f8fb0d3c994d22670162ea030197: pash: remove hg.ecmascript.org support; r=bkero
Gregory Szorc <gps@mozilla.com> - Thu, 05 Mar 2015 17:54:46 -0800 - rev 360508
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
pash: remove hg.ecmascript.org support; r=bkero hg.ecmascript.org is no more. Remove the code referencing it.
a61eb8576df98cc86b4f12d581ceeedaa097778f: pash: move non-root login code path to isolated function (bug 1140214); r=bkero
Gregory Szorc <gps@mozilla.com> - Thu, 05 Mar 2015 17:47:16 -0800 - rev 360507
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
pash: move non-root login code path to isolated function (bug 1140214); r=bkero We want the root login code path to be clean so that things like import errors don't result in root login being denied. This commit moves the non-root login code path to a separate function. We also move imports into this function so they aren't evaluated until a non-root login is performed. With this commit, the root login code path is now only requires a pash.py file with proper Python syntax and a working Python installation (since all we import are modules from the core Python distribution).
ec8d27a40f2d89444a86923acd6682dc2b0f3f85: pash: move QuoteForPOSIX into pash.py; r=bkero
Gregory Szorc <gps@mozilla.com> - Thu, 05 Mar 2015 17:35:44 -0800 - rev 360506
Push 16998 by rwood@mozilla.com at Mon, 02 May 2016 19:42:03 +0000
pash: move QuoteForPOSIX into pash.py; r=bkero QuoteForPOSIX is only used by pash.py. Since the system can get borked if pash.py ever gets borked, dropping the import dependency on sh_helper.py helps mitigate our risk that bad code in sh_helper.py will result in a locked out system.
(0) -300000 -100000 -30000 -10000 -3000 -1000 -300 -100 -50 -20 +20 +50 +100 +300 +1000 +3000 +10000 +30000 +100000 +300000 tip