This has been deployed now.
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Jun 4 2018
Jun 4 2018
olasd closed T1046: Stripe local contents between uffizi and banco, a subtask of T1045: Implement a striping object storage, as Resolved.
olasd closed T1046: Stripe local contents between uffizi and banco, a subtask of T1043: handle the uffizi content store being full, as Resolved.
May 7 2018
May 7 2018
olasd closed T1045: Implement a striping object storage as Resolved by committing rDOBJS60fb5a0c5611: Add a striping objstorage which will distribute objects across backends.
olasd closed T1045: Implement a striping object storage, a subtask of T1043: handle the uffizi content store being full, as Resolved.
May 3 2018
May 3 2018
olasd closed T1044: Write all contents synchronously to azure as Resolved by committing rSPSITE259ed288cf76: uffizi: write objects synchronously to azure.
olasd closed T1044: Write all contents synchronously to azure, a subtask of T1043: handle the uffizi content store being full, as Resolved.
zack added a comment to T1048: Clean striped object storages from objects they should not be containing.
FWIW, the proposed policy looks good to me. Green light!
olasd triaged T1048: Clean striped object storages from objects they should not be containing as High priority.
olasd added a parent task for T1046: Stripe local contents between uffizi and banco: T1045: Implement a striping object storage.
olasd changed the status of T1045: Implement a striping object storage from Open to Work in Progress.
olasd changed the status of T1043: handle the uffizi content store being full from Open to Work in Progress.
Feb 28 2018
Feb 28 2018
So, that was a beast of a puppet refactoring, but the end result is: all our RPC servers are now nicely tucked behind an instance of nginx.
Feb 16 2018
Feb 16 2018
Here is a pcap of the issue observed while a Vault cooker was calling set_progress on the Vault backend. The BadStatusLine packet that only contains "\r\n" is packet 306.
wat.pcap46 KBDownload
The BadStatusLine error reared back its ugly head on the vault backend. It was reproducible. Putting a nginx in front of the vault backend fixed it. I guess it's time to puppetize the configuration of a http frontend to all our RPC servers.
Dec 12 2017
Dec 12 2017
Nov 6 2017
Nov 6 2017
Oct 13 2017
Oct 13 2017
seirl triaged T805: objstorage: allow use of file-like objects for streaming methods as Normal priority.
Oct 10 2017
Oct 10 2017
Sep 18 2017
Sep 18 2017
As a proof of concept nginx has been manually deployed to uffizi on port 15003. It does alleviate the BadStatusLine issues the archiver encountered before under high load. This "just" needs to be properly deployed.
Sep 15 2017
Sep 15 2017
zack closed T746: Objstorage: add a way to delete items (with a filter for production environments) as Resolved.
this has been fixed in rDOBJS350c2e7bc94e
Sep 13 2017
Sep 13 2017
Aug 4 2017
Aug 4 2017
Mar 27 2017
Mar 27 2017
I agree that metadata exports need to keep meaningful intrinsic identifiers as well.
Mar 6 2017
Mar 6 2017
Ack on the principle. But noting down a caveat for use case (3).
zack updated the task description for T698: Migrate the content store to a new (internal) primary key scheme.
Mar 3 2017
Mar 3 2017
Mar 1 2017
Mar 1 2017
Jan 26 2017
Jan 26 2017
ardumont renamed T646: Unify duplicated code about client/server code from Remove duplicated code about client/server code to Unify duplicated code about client/server code.
Oct 10 2016
Oct 10 2016
ardumont added a parent task for T564: clean up bogus python object references from the archiver DB table: Unknown Object (Maniphest Task).
Oct 5 2016
Oct 5 2016
Updated the 8008 lines that were still to be fixed.
Apparently some entries are left in the database...
Sep 20 2016
Sep 20 2016
All cleaned up.
olasd changed the status of T564: clean up bogus python object references from the archiver DB table from Open to Work in Progress.
The update query is running on the archiver database to fix this up.
Sep 15 2016
Sep 15 2016
ardumont added a comment to T564: clean up bogus python object references from the archiver DB table.
we cannot assume that's the only object reference that has been around.
ardumont added a comment to T564: clean up bogus python object references from the archiver DB table.
New archiver is indeed fixed (after package, deploy and task restarted), using pg_activity, we can glimpse equivalent queries with:
zack triaged T564: clean up bogus python object references from the archiver DB table as High priority.
Aug 26 2016
Aug 26 2016
ardumont closed T545: Create puppet manifests for the content integrity checkers as Resolved by committing rSPSITEa1117f018a99: Revert profile tryout on grandpalais.
ardumont changed the status of T545: Create puppet manifests for the content integrity checkers from Open to Work in Progress.
Aug 25 2016
Aug 25 2016
Debian packages have been reworked since swh.objstorage needed a dependency on swh.storage.archiver (but only python3-swh.storage was available).
Aug 24 2016
Aug 24 2016
ardumont renamed T545: Create puppet manifests for the content integrity checkers from Create puppet manifest for the content integrity checker to Create puppet manifests for the content integrity checkers.
ardumont updated the task description for T545: Create puppet manifests for the content integrity checkers.
ardumont renamed T545: Create puppet manifests for the content integrity checkers from Deploy content integrity checker via puppet to Create puppet manifest for the content integrity checker.
Jul 21 2016
Jul 21 2016
ardumont changed the status of T485: Synchronously catchup backup from uffizi to banco from Resolved to Invalid.
ardumont changed the status of T485: Synchronously catchup backup from uffizi to banco from Invalid to Resolved by committing rDOBJS84bc789758a6: Revert "Client to backup contents to an objstorage server instance".
Jul 20 2016
Jul 20 2016
Jul 12 2016
Jul 12 2016
ardumont renamed T485: Synchronously catchup backup from uffizi to banco from Synchroneously catchup backup from uffizi to banco to Synchronously catchup backup from uffizi to banco.
Currently running in uffizi in a tmux session
Jun 27 2016
Jun 27 2016
Jun 23 2016
Jun 23 2016
qcampos renamed T460: Extract the objstorage component from storage module to an independent module from Extract the objstorage component from storage module to an independant module to Extract the objstorage component from storage module to an independent module.
Jun 22 2016
Jun 22 2016