2c28e52a991f039f32dbaa1d63c507e285022381: Bug 1291821 - Post: remove unused files r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Tue, 29 Nov 2016 13:36:26 -0800 - rev 445753
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Post: remove unused files r=rnewman MozReview-Commit-ID: 4qM5vx4AQyQ
7fb9f3be33549ee0f78ed0661e280702a2afb792: Bug 1291821 - Allow BatchingDownloader to resume downloads using offset or high water mark r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Tue, 29 Nov 2016 21:53:03 -0800 - rev 445752
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Allow BatchingDownloader to resume downloads using offset or high water mark r=rnewman BatchingDownloader uses provided RepositoryStateProvider instance in order to track offset and high water mark as it performs batching. These objects are initialized by individual ServerSyncStages, and prefixes are used to ensure keys won't clash. Two RepositoryStateProvider implementations are used: persistent and non-persistent. Non-persistent state provider does not allow for resuming after a sync restart, while persistent one does. Persistent state provider is used by history stage. It is fetched oldest-first, and records are applied to live storage as they're downloaded. These conditions let use resume downloads. It's also possible to resume downloads for stages which use a persistent buffer, but currently we don't have any. Offset value is reset if we hit a 412 error; it is maintained if we hit a sync deadline, allowing us to minimize number of records we'll redownload. High water mark is maintained across syncs and used instead of stage's "last-synced" timestamp. MozReview-Commit-ID: IH28YrDU4vW
c49abe8e93423cd3c52de26a6cb8ab3419e0aed0: Bug 1291821 - Track incomplete stages and re-sync them r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Tue, 29 Nov 2016 20:38:17 -0800 - rev 445751
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Track incomplete stages and re-sync them r=rnewman Stage re-sync is requested if: - We hit a 412 either during batching download or batching upload - We hit a sync deadline either during batching download or when merging records from the buffer SessionStoreDelegate interface was expanded with onStoreFailed, indicating that not just a particular record failed, but the whole operation did. onFetchFailed is used to inform delegates of 412/deadline failures during downloads. Three new exception types were added, to facilitated messaging between different layers. MozReview-Commit-ID: Ltdi5noEvdV
b5365e77e4af402bd45f646e2df34387d1fff2d2: Bug 1291821 - Move bulk insert logic for new history to BrowserProvider r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Tue, 29 Nov 2016 13:42:53 -0800 - rev 445750
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Move bulk insert logic for new history to BrowserProvider r=rnewman This commit does two things: 1) It simplifies history insertion logic, which wrongly assumed that history which was being inserted might be not new. As such, it was necessary to check for collisions of visit inserts, record number of visits actually inserted, and update remote visit counts correspondingly in a separate step, making history insert a three step operation (insert history record, insert its visits, update history record with a count). However, bulkInsert runs only for records which were determined to be entirely new, so it's possible to drop the third step. 2) Makes all of the insertions (history records and their visits) run in one transaction. Prepared statements for both history and visit inserts are used are used as a performance optimization measure. MozReview-Commit-ID: 48T4G5IsQNS
1f6424ba1c1a7190a67231c8da4428830fd3840e: Bug 1291821 - Rename repositories/sessions r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Tue, 01 Nov 2016 18:56:38 -0700 - rev 445749
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Rename repositories/sessions r=rnewman We're at Sync 1.5 now, so might as well rename the files. Also, renamed the ConstrainedRepository... to a name that's more reflective of that session's role after the changes. MozReview-Commit-ID: 96XCzoBzD5D
b9d2c8a69fe194ee856621bc8db203d53d55eb72: Bug 1291821 - Get tests to work after sync changes r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Tue, 11 Oct 2016 20:02:02 -0700 - rev 445748
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Get tests to work after sync changes r=rnewman MozReview-Commit-ID: 3djnmEmzndU
4d2cb5b99c63354176f8da4e1a392f0e1d0fe822: Bug 1291821 - Ensure sink repository is aware of new events coming from the source r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Tue, 11 Oct 2016 20:00:09 -0700 - rev 445747
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Ensure sink repository is aware of new events coming from the source r=rnewman MozReview-Commit-ID: DgqGzfoJxhj
a92e9a723ac2b859de488c35eba1bace0d77a7d6: Bug 1291821 - Split history stage into recent and full history stages r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Wed, 16 Nov 2016 14:53:07 -0800 - rev 445746
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Split history stage into recent and full history stages r=rnewman Recent history stage will only run if full history stage did not complete yet. Bug 1316110 tracks follow up work to make this more efficient. MozReview-Commit-ID: 7dtbfEFUMGB
1862bd8b73b2e8fd4e170a9c086978a216801e67: Bug 1291821 - Wrap local repositories in buffering middleware r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Thu, 20 Oct 2016 16:31:31 -0700 - rev 445745
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Wrap local repositories in buffering middleware r=rnewman MozReview-Commit-ID: FS1swml2bIC
4e3302271fb345d69650fd37225abd5397adf653: Bug 1291821 - Use sync deadline to decide of batching downloader should proceed r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Tue, 01 Nov 2016 18:52:18 -0700 - rev 445744
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Use sync deadline to decide of batching downloader should proceed r=rnewman MozReview-Commit-ID: IDgIj9lBt61
2c3c6212559a414d2dae978d4f6e9d6be2c8d974: Bug 1291821 - Keep track of sync deadline r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Tue, 08 Nov 2016 12:38:00 -0800 - rev 445743
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Keep track of sync deadline r=rnewman MozReview-Commit-ID: Fvuc05K1arV
0e460d712743d8c35491f4d5d7bd2e912c0902be: Bug 1291821 - Remove total sync limits, refactor batching downloader r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Thu, 20 Oct 2016 13:34:06 -0700 - rev 445742
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Remove total sync limits, refactor batching downloader r=rnewman MozReview-Commit-ID: 2SYxemfTv9V
97e6f795e33169ba8c468608771370f4a852dbaa: Bug 1291821 - Decouple BatchingUploader from Server11Repository r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Tue, 01 Nov 2016 18:55:15 -0700 - rev 445741
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Decouple BatchingUploader from Server11Repository r=rnewman MozReview-Commit-ID: 7mPy1cmr3vq
6b0f48e83e033d42521c46fa61b143bcd27100c0: Bug 1291821 - Simplify onFetchFailed, clean up some exception code r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Tue, 11 Oct 2016 19:29:46 -0700 - rev 445740
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Simplify onFetchFailed, clean up some exception code r=rnewman MozReview-Commit-ID: 11sIAPCfLWk
b7e43e0f442111a135cdbd4615437f272717f296: Bug 1291821 - Add onBatchComplete to a FetchRecordsDelegate r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Tue, 11 Oct 2016 19:29:02 -0700 - rev 445739
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Add onBatchComplete to a FetchRecordsDelegate r=rnewman Intended to signal that a group of records have been fetched, and more are to come after a pause. MozReview-Commit-ID: 8ozZTc6aNdA
a3d16c7dcf730acbbbc8dd7263e92070a1836e19: Bug 1291821 - Rename RepositorySession's delegate to storeDelegate, for clarity r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Sat, 08 Oct 2016 17:03:38 -0700 - rev 445738
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Rename RepositorySession's delegate to storeDelegate, for clarity r=rnewman Otherwise we often end up with delegate meaning both fetch delegate and store delegate in extending classes, which gets a little confusing. MozReview-Commit-ID: L4Sd79jLr88
2434497fc8cf7be1e44d0c3a4dcf653dd6dde566: Bug 1291821 - Switch stage duration interval counting to use elapsedRealtime r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Sat, 08 Oct 2016 15:28:14 -0700 - rev 445737
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Switch stage duration interval counting to use elapsedRealtime r=rnewman It is a better fit for interval counting. MozReview-Commit-ID: LCF0U24MAwF
4c31e9ca7d6604029c63e7f3de25c501ed4d6e07: Bug 1291821 - Buffering repository middleware r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Thu, 24 Nov 2016 12:15:55 -0800 - rev 445736
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Buffering repository middleware r=rnewman MozReview-Commit-ID: GS3M7k670Po
aabc07252c2a79abcef69ad9407d3f346d5e324e: Bug 1291821 - Add storeIncomplete to RepositorySession interface r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Wed, 02 Nov 2016 16:40:15 -0700 - rev 445735
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Add storeIncomplete to RepositorySession interface r=rnewman MozReview-Commit-ID: 68ty7KlP5NR
e3faf834578cee7d605e49574d462473fd4682e4: Bug 1291821 - Pre: remove unused SerialRecordConsumer r=rnewman draft
Grisha Kruglov <gkruglov@mozilla.com> - Sat, 08 Oct 2016 14:49:46 -0700 - rev 445734
Push 37599 by gkruglov@mozilla.com at Wed, 30 Nov 2016 06:33:43 +0000
Bug 1291821 - Pre: remove unused SerialRecordConsumer r=rnewman MozReview-Commit-ID: 3fiHVErUA1g
(0) -300000 -100000 -30000 -10000 -3000 -1000 -300 -100 -50 -20 +20 +50 +100 +300 +1000 +3000 +10000 +30000 +100000 +300000 tip