Page MenuHomeSoftware Heritage
Feed All Stories

Nov 18 2021

anlambert created P1219 SvnLoaderFromRemoteDump optimization.
Nov 18 2021, 4:54 PM
ardumont accepted D6657: logstash: puppetize the closed indexes management script.

\o/

Nov 18 2021, 4:51 PM
vsellier added a revision to T3705: Upgrade the ELK stack: D6657: logstash: puppetize the closed indexes management script.
Nov 18 2021, 4:48 PM · System administration (Component upgrades)
vsellier requested review of D6657: logstash: puppetize the closed indexes management script.
Nov 18 2021, 4:48 PM
ardumont moved T3374: Ingest sourceforge repositories (origins of type git, svn, hg) from code-review/await-feedback/pause to done on the System administration board.
Nov 18 2021, 3:17 PM · System administration, Archive coverage, Origin-SourceForge
ardumont moved T3599: List and ingest heptapod instances from code-review/await-feedback/pause to done on the System administration board.
Nov 18 2021, 3:17 PM · System administration, Archive coverage
ardumont moved T3455: Make bitbucket origins ingestion concurrent from code-review/await-feedback/pause to done on the System administration board.
Nov 18 2021, 3:17 PM · System administration, Mercurial loader
ardumont moved T3338: Load the archived bitbucket mercurial repositories from deployed/landed/monitoring to done on the System administration board.
Nov 18 2021, 3:16 PM · System administration, Mercurial loader
ardumont moved T3507: prod: vault: Deploy v1.0.0 from deployed/landed/monitoring to done on the System administration board.
Nov 18 2021, 3:16 PM · System administration, Vault, Web app
ardumont closed T3717: Ingest opam instance https://coq.inria.fr/opam/released/ as Resolved.
Nov 18 2021, 3:16 PM · System administration, Archive coverage, Opam
ardumont moved T3717: Ingest opam instance https://coq.inria.fr/opam/released/ from code-review/await-feedback/pause to deployed/landed/monitoring on the System administration board.
Nov 18 2021, 3:16 PM · System administration, Archive coverage, Opam
ardumont closed D6647: changelog: Reference the opam coq repository ingestion.
Nov 18 2021, 3:16 PM
ardumont committed rDDOC218bf86a289e: changelog: Reference the opam coq repository ingestion (authored by ardumont).
changelog: Reference the opam coq repository ingestion
Nov 18 2021, 3:15 PM
ardumont added a comment to D6647: changelog: Reference the opam coq repository ingestion.

First round done [1]

Nov 18 2021, 3:15 PM
anlambert accepted D6647: changelog: Reference the opam coq repository ingestion.
Nov 18 2021, 3:08 PM
swh-public-ci added a comment to D6647: changelog: Reference the opam coq repository ingestion.

Build is green

Nov 18 2021, 2:36 PM
ardumont updated the diff for D6647: changelog: Reference the opam coq repository ingestion.

Rebase

Nov 18 2021, 2:26 PM
anlambert closed T3737: documentation sidebar: group swh.* module doc under a "API reference" heading as Resolved by committing rDDOC23b479e750d7: docs/index: Group swh.* entries under a top level "API reference" entry.
Nov 18 2021, 2:16 PM · Documentation
anlambert closed D6656: docs/index: Group swh.* entries under a top level "API reference" entry.
Nov 18 2021, 2:16 PM
anlambert committed rDDOC23b479e750d7: docs/index: Group swh.* entries under a top level "API reference" entry (authored by anlambert).
docs/index: Group swh.* entries under a top level "API reference" entry
Nov 18 2021, 2:16 PM
zack accepted D6656: docs/index: Group swh.* entries under a top level "API reference" entry.

<3

Nov 18 2021, 2:15 PM
ardumont accepted D6656: docs/index: Group swh.* entries under a top level "API reference" entry.

lgtm

Nov 18 2021, 2:13 PM
anlambert requested review of D6656: docs/index: Group swh.* entries under a top level "API reference" entry.
Nov 18 2021, 2:05 PM
dachary updated the diff for D6545: base-buster: add valgrind and googletest for swh.perfecthash.

rebase

Nov 18 2021, 2:04 PM
anlambert added a revision to T3737: documentation sidebar: group swh.* module doc under a "API reference" heading: D6656: docs/index: Group swh.* entries under a top level "API reference" entry.
Nov 18 2021, 1:54 PM · Documentation
olasd added a comment to D6545: base-buster: add valgrind and googletest for swh.perfecthash.

@dachary please rebase and push this

Nov 18 2021, 1:28 PM
olasd accepted D6650: git_bare: Fetch directories concurrently, using threads..

In general I'm a bit uneasy about parallelism for individual workers, as it's hidden and multiplies by the "exogeneous" parallelism of having multiple workers.

Nov 18 2021, 1:26 PM
anlambert closed D6654: ra: Prevent erroneous removing of file state.
Nov 18 2021, 12:40 PM
anlambert committed rDLDSVN631a2b9d7f7e: ra: Prevent erroneous removing of file state (authored by anlambert).
ra: Prevent erroneous removing of file state
Nov 18 2021, 12:40 PM
olasd closed D6655: Stop freezing elasticsearch indexes..
Nov 18 2021, 12:32 PM
olasd committed rSPSITE7a87a7a09bc5: Stop freezing elasticsearch indexes. (authored by olasd).
Stop freezing elasticsearch indexes.
Nov 18 2021, 12:32 PM
ardumont accepted D6655: Stop freezing elasticsearch indexes..
Nov 18 2021, 12:26 PM
olasd updated the diff for D6655: Stop freezing elasticsearch indexes..

*poke*

Nov 18 2021, 12:25 PM
ardumont added a comment to T3716: Migrate giverny from stretch to buster.
  • Check if mongo services still running, there are some:
Nov 18 2021, 12:25 PM · System administration (Component upgrades)
olasd requested review of D6655: Stop freezing elasticsearch indexes..
Nov 18 2021, 12:23 PM
ardumont accepted D6654: ra: Prevent erroneous removing of file state.
Nov 18 2021, 12:19 PM
anlambert requested review of D6654: ra: Prevent erroneous removing of file state.
Nov 18 2021, 12:00 PM
ardumont accepted D6629: Package loader: Uniformize author and message.
Nov 18 2021, 11:53 AM
ardumont moved T3716: Migrate giverny from stretch to buster from Backlog to In progress on the System administration (Component upgrades) board.
Nov 18 2021, 11:41 AM · System administration (Component upgrades)
ardumont moved T3716: Migrate giverny from stretch to buster from in-progress to Component upgrades on the System administration board.
Nov 18 2021, 11:41 AM · System administration (Component upgrades)
ardumont closed T3734: Deploy latest swh.vault v1.3.0 as Resolved.
Nov 18 2021, 11:40 AM · Vault, System administration
anlambert closed T3736: Add `,` separator in numbers on the archive's home as Resolved by committing rDWAPPS8722d9aa4d6d: misc/coverage: Fix some origin counts formatting.
Nov 18 2021, 11:05 AM · Web app
anlambert committed rDWAPPS8722d9aa4d6d: misc/coverage: Fix some origin counts formatting (authored by anlambert).
misc/coverage: Fix some origin counts formatting
Nov 18 2021, 11:05 AM
anlambert closed T3735: Add "you" in the Vault browsing page as Resolved by committing rDWAPPSadc197792243: templates/vault-ui: Fix introduction sentence.
Nov 18 2021, 11:05 AM · Web app, Easy hack
anlambert committed rDWAPPSadc197792243: templates/vault-ui: Fix introduction sentence (authored by anlambert).
templates/vault-ui: Fix introduction sentence
Nov 18 2021, 11:05 AM
zack triaged T3737: documentation sidebar: group swh.* module doc under a "API reference" heading as Low priority.
Nov 18 2021, 10:54 AM · Documentation
anlambert closed D6649: pytest_plugin: Increase poll timeout in consume_messages.
Nov 18 2021, 10:32 AM
anlambert committed rDJNLbac6b474b229: pytest_plugin: Increase poll timeout in consume_messages (authored by anlambert).
pytest_plugin: Increase poll timeout in consume_messages
Nov 18 2021, 10:32 AM
swh-public-ci added a comment to D6649: pytest_plugin: Increase poll timeout in consume_messages.

Build is green

Nov 18 2021, 10:32 AM
anlambert closed T3724: Browsing snapshot with only releases does not show anything in the webapp as Resolved.

Fix is now deployed to production, closing this.

Nov 18 2021, 10:31 AM · Web app
anlambert updated the diff for D6649: pytest_plugin: Increase poll timeout in consume_messages.

Rebase

Nov 18 2021, 10:28 AM
olasd accepted D6649: pytest_plugin: Increase poll timeout in consume_messages.
Nov 18 2021, 10:22 AM

Nov 17 2021

moranegg added a comment to T3437: Review guided tour and collect feedback from testers.

Feedback is collected here:
https://docs.google.com/document/d/1V35FMNcOvT6YUeiSXYse1g_0PqEoQFIc2GtPWPQHIOw/edit?usp=sharing

Nov 17 2021, 10:50 PM · Web app
moranegg added a comment to T3036: Create features/services page on the website connecting to archive/docs.

The page is now reviewed and updated.

Nov 17 2021, 10:49 PM · Documentation
moranegg updated subscribers of T3673: Define and document workflow for "save requests" for tarballs.

With @rdicosmo, we have decided that the "save archives now" which is only open to ambassadors today, should be opened to the public and that ambassadors will receive access to moderate the "save code now" requests.

Nov 17 2021, 10:38 PM · Ambassadors
moranegg triaged T3736: Add `,` separator in numbers on the archive's home as Normal priority.
Nov 17 2021, 10:34 PM · Web app
moranegg created T3736: Add `,` separator in numbers on the archive's home.
Nov 17 2021, 10:34 PM · Web app
moranegg triaged T3735: Add "you" in the Vault browsing page as Normal priority.
Nov 17 2021, 9:56 PM · Web app, Easy hack
andrey-star abandoned D6594: Add parameter to load a single graph direction in memory..
Nov 17 2021, 8:02 PM
ardumont moved T3734: Deploy latest swh.vault v1.3.0 from in-progress to deployed/landed/monitoring on the System administration board.
Nov 17 2021, 6:52 PM · Vault, System administration
ardumont updated the task description for T3734: Deploy latest swh.vault v1.3.0.
Nov 17 2021, 6:52 PM · Vault, System administration
vlorentz requested review of D6650: git_bare: Fetch directories concurrently, using threads..
Nov 17 2021, 6:24 PM
swh-public-ci added a comment to D6650: git_bare: Fetch directories concurrently, using threads..

Build is green

Nov 17 2021, 6:24 PM
vsellier committed rSPSITE00e991357ac3: fix nagios sudo for check_journal (authored by vsellier).
fix nagios sudo for check_journal
Nov 17 2021, 6:20 PM
vsellier closed D6635: elk: upgrade journalbeat and filebeat.
Nov 17 2021, 5:11 PM
vsellier committed rSPSITE0ec2231d6929: elk: upgrade journalbeat and filebeat (authored by vsellier).
elk: upgrade journalbeat and filebeat
Nov 17 2021, 5:11 PM
vsellier updated the diff for D6635: elk: upgrade journalbeat and filebeat.

rebase

Nov 17 2021, 5:03 PM
anlambert requested review of D6649: pytest_plugin: Increase poll timeout in consume_messages.
Nov 17 2021, 4:40 PM
vsellier added a comment to T3705: Upgrade the ELK stack.
  • The 3 esnodes are updated to version 7.15.2:

for each node:

puppet agent --disable

for each node:

apt update
apt dist-upgrade
Nov 17 2021, 4:38 PM · System administration (Component upgrades)
ardumont added a comment to T3719: loader svn fails to clean up properly disk when it crashes.

Deployed ^ as part of the v0.9 package.
Let's see if that defiintely fixes that wrong pattern.

Nov 17 2021, 3:42 PM · SVN Loader
ardumont updated the task description for T3734: Deploy latest swh.vault v1.3.0.
Nov 17 2021, 3:09 PM · Vault, System administration
ardumont updated the task description for T3734: Deploy latest swh.vault v1.3.0.
Nov 17 2021, 3:08 PM · Vault, System administration
ardumont updated the task description for T3716: Migrate giverny from stretch to buster.
Nov 17 2021, 3:06 PM · System administration (Component upgrades)
anlambert closed D6648: loader: Create temp folder with pattern in SvnLoaderFromRemoteDump.
Nov 17 2021, 3:04 PM
anlambert committed rDLDSVNfdf526eceaea: loader: Create temp folder with pattern in SvnLoaderFromRemoteDump (authored by anlambert).
loader: Create temp folder with pattern in SvnLoaderFromRemoteDump
Nov 17 2021, 3:04 PM
swh-public-ci added a comment to D6648: loader: Create temp folder with pattern in SvnLoaderFromRemoteDump.

Build is green

Nov 17 2021, 3:00 PM
ardumont moved T3717: Ingest opam instance https://coq.inria.fr/opam/released/ from in-progress to code-review/await-feedback/pause on the System administration board.
Nov 17 2021, 3:00 PM · System administration, Archive coverage, Opam
ardumont changed the status of T3734: Deploy latest swh.vault v1.3.0 from Open to Work in Progress.
Nov 17 2021, 3:00 PM · Vault, System administration
ardumont updated the task description for T3734: Deploy latest swh.vault v1.3.0.
Nov 17 2021, 3:00 PM · Vault, System administration
anlambert updated the diff for D6648: loader: Create temp folder with pattern in SvnLoaderFromRemoteDump.

Update: Wrap temporary folder creation in a private method

Nov 17 2021, 2:58 PM
jayeshv closed T3689: Deprecate /browse/origin/content URLs, a subtask of T3608: Deprecate most of the /browse/origin/.* URLs, as Resolved.
Nov 17 2021, 2:58 PM · Web app
jayeshv closed T3689: Deprecate /browse/origin/content URLs as Resolved.
Nov 17 2021, 2:58 PM · Web app
ardumont added projects to T3734: Deploy latest swh.vault v1.3.0: System administration, Vault.
Nov 17 2021, 2:51 PM · Vault, System administration
ardumont triaged T3734: Deploy latest swh.vault v1.3.0 as Normal priority.
Nov 17 2021, 2:51 PM · Vault, System administration
jayeshv closed T3697: Deprecate origin content routes as Resolved by committing rDWAPPSc491d4e46a3f: Deprecate /origin/content and /snapshot/content routes.
Nov 17 2021, 2:41 PM · Web app
jayeshv closed T3697: Deprecate origin content routes, a subtask of T3608: Deprecate most of the /browse/origin/.* URLs, as Resolved.
Nov 17 2021, 2:41 PM · Web app
jayeshv closed D6615: Deprecate /origin/content route.
Nov 17 2021, 2:41 PM
jayeshv committed rDWAPPSc491d4e46a3f: Deprecate /origin/content and /snapshot/content routes (authored by jayeshv).
Deprecate /origin/content and /snapshot/content routes
Nov 17 2021, 2:41 PM
anlambert added inline comments to D6648: loader: Create temp folder with pattern in SvnLoaderFromRemoteDump.
Nov 17 2021, 2:40 PM
anlambert accepted D6615: Deprecate /origin/content route.

Bye bye duplicated code related to browsing contents, thanks a lot for that !

Nov 17 2021, 2:38 PM
ardumont accepted D6648: loader: Create temp folder with pattern in SvnLoaderFromRemoteDump.

That's what i was trying to fix last week without finding where (since i was unable to reproduce in tests).
I think you nailed it!

Nov 17 2021, 2:38 PM
ardumont added inline comments to D6648: loader: Create temp folder with pattern in SvnLoaderFromRemoteDump.
Nov 17 2021, 2:35 PM
anlambert requested review of D6648: loader: Create temp folder with pattern in SvnLoaderFromRemoteDump.
Nov 17 2021, 2:33 PM
anlambert added a revision to T3719: loader svn fails to clean up properly disk when it crashes: D6648: loader: Create temp folder with pattern in SvnLoaderFromRemoteDump.
Nov 17 2021, 2:32 PM · SVN Loader
swh-public-ci added a comment to D6615: Deprecate /origin/content route.

Build is green

Nov 17 2021, 2:24 PM
ardumont requested review of D6647: changelog: Reference the opam coq repository ingestion.
Nov 17 2021, 2:19 PM
anlambert added inline comments to D6615: Deprecate /origin/content route.
Nov 17 2021, 2:19 PM
jayeshv added inline comments to D6615: Deprecate /origin/content route.
Nov 17 2021, 2:14 PM
ardumont added a revision to T3717: Ingest opam instance https://coq.inria.fr/opam/released/: D6647: changelog: Reference the opam coq repository ingestion.
Nov 17 2021, 2:08 PM · System administration, Archive coverage, Opam
jayeshv updated the diff for D6615: Deprecate /origin/content route.

cypress test fix

Nov 17 2021, 2:08 PM