Page MenuHomeSoftware Heritage
Feed All Stories

Nov 23 2021

ardumont closed D6670: cvs.tasks: Fix type.
Nov 23 2021, 12:09 PM
ardumont committed rDLDCVS1f6580c4c8e3: cvs.tasks: Fix type (authored by ardumont).
cvs.tasks: Fix type
Nov 23 2021, 12:09 PM
ardumont added a comment to D6395: lister: Add new maven lister.

Heads up, I was correct and that'd be D6666 for the fix.

Thanks @ardumont for the update. I'll do that Thursday (I'm busy until then).

Nov 23 2021, 12:08 PM
swh-public-ci added a comment to D6670: cvs.tasks: Fix type.

Build is green

Nov 23 2021, 12:08 PM
ardumont closed D6666: sourceforge lister: Fix type.
Nov 23 2021, 12:07 PM
ardumont committed rDLS3ffea8f525cd: lister: Fix type (authored by ardumont).
lister: Fix type
Nov 23 2021, 12:07 PM
ardumont added inline comments to D6666: sourceforge lister: Fix type.
Nov 23 2021, 12:06 PM
ardumont updated the diff for D6670: cvs.tasks: Fix type.

Rebase

Nov 23 2021, 12:05 PM
ardumont closed D6669: swh.search.utils: Fix type.
Nov 23 2021, 12:04 PM
ardumont committed rDSEAc201e3236e54: swh.search.utils: Fix type (authored by ardumont).
swh.search.utils: Fix type
Nov 23 2021, 12:04 PM
borisbaldassari added a comment to D6395: lister: Add new maven lister.

Heads up, I was correct and that'd be D6666 for the fix.

Nov 23 2021, 11:03 AM
ardumont requested review of D6670: cvs.tasks: Fix type.
Nov 23 2021, 11:01 AM
ardumont requested review of D6669: swh.search.utils: Fix type.
Nov 23 2021, 11:00 AM
ardumont added inline comments to D6666: sourceforge lister: Fix type.
Nov 23 2021, 10:53 AM
ardumont closed D6667: svn.tasks: Fix type.
Nov 23 2021, 10:48 AM
ardumont committed rDLDSVN36ada262d437: svn.tasks: Fix type (authored by ardumont).
svn.tasks: Fix type
Nov 23 2021, 10:48 AM
swh-public-ci added a comment to D6667: svn.tasks: Fix type.

Build is green

Nov 23 2021, 10:47 AM
ardumont updated the diff for D6667: svn.tasks: Fix type.

Fix test

Nov 23 2021, 10:46 AM
ardumont requested review of D6667: svn.tasks: Fix type.
Nov 23 2021, 10:34 AM
vlorentz accepted D6666: sourceforge lister: Fix type.
Nov 23 2021, 10:32 AM
vlorentz added inline comments to D6666: sourceforge lister: Fix type.
Nov 23 2021, 10:31 AM
vlorentz added inline comments to D6396: Implement maven jar source files loader.
Nov 23 2021, 10:27 AM
ardumont added a comment to D6395: lister: Add new maven lister.

It's a type issue unrelated to your diff, the master build must be broken as well. Since
nothing changed on the lister for a while, I guess a new mypy release (with some
internal change) make that type now break.

Don't worry about it, I'll have a look to fix master, push and then you can rebase so
your build gets green again.

Nov 23 2021, 10:26 AM
ardumont added inline comments to D6666: sourceforge lister: Fix type.
Nov 23 2021, 10:23 AM
ardumont retitled D6666: sourceforge lister: Fix type from lister: Fix type to sourceforge lister: Fix type.
Nov 23 2021, 10:20 AM
ardumont requested review of D6666: sourceforge lister: Fix type.
Nov 23 2021, 10:18 AM
ardumont added a comment to D6395: lister: Add new maven lister.

Thanks for the update.

Nov 23 2021, 9:56 AM
borisbaldassari added a comment to T1724: Maven Central repository support.

Hi there,

Nov 23 2021, 9:21 AM · Maven loader, Maven lister, GSoC 2019, Archive coverage
borisbaldassari added a comment to D6395: lister: Add new maven lister.

Hum. I don't understand why the tests fail on the sourceforge lister when it's not listed in my diff. Any idea please?

Nov 23 2021, 8:20 AM
Harbormaster failed remote builds in B25106: Diff 24230 for D6395: lister: Add new maven lister!
Nov 23 2021, 8:15 AM
swh-public-ci added a comment to D6395: lister: Add new maven lister.

Build has FAILED

Nov 23 2021, 8:15 AM
borisbaldassari updated the diff for D6395: lister: Add new maven lister.
  • maven-lister: Add maven lister with review D6133.
  • maven-lister: Add statefulness
  • maven-lister: Fix README, 88 chars, minor typos
  • maven-lister: Split parsing and processing
  • maven-lister: Fix groupId bug, add tests.
  • maven-loader: fix last_update
Nov 23 2021, 8:13 AM
swh-public-ci added a comment to D6396: Implement maven jar source files loader.

Build is green

Nov 23 2021, 8:02 AM
borisbaldassari updated the diff for D6396: Implement maven jar source files loader.
  • maven-loader: fix tests for snapshot-append
Nov 23 2021, 7:59 AM
Harbormaster failed remote builds in B25104: Diff 24228 for D6395: lister: Add new maven lister!
Nov 23 2021, 7:53 AM
swh-public-ci added a comment to D6395: lister: Add new maven lister.

Build has FAILED

Nov 23 2021, 7:53 AM
borisbaldassari updated the diff for D6395: lister: Add new maven lister.
  • maven-loader: fix last_update
Nov 23 2021, 7:52 AM

Nov 22 2021

Harbormaster failed remote builds in B25103: Diff 24227 for D6396: Implement maven jar source files loader!
Nov 22 2021, 10:33 PM
swh-public-ci added a comment to D6396: Implement maven jar source files loader.

Build has FAILED

Nov 22 2021, 10:33 PM
borisbaldassari updated the diff for D6396: Implement maven jar source files loader.
  • maven-loader: various fixes for vlorentz' review
  • maven-loader: remove snapshot_append carryover
  • maven-loader: final udpate after vlorentz review
Nov 22 2021, 10:31 PM
olasd added a comment to T3748: Date overflow error in scheduler journal client for some visit type.
diff --git a/swh/scheduler/journal_client.py b/swh/scheduler/journal_client.py
index c001a48..e2a18ad 100644
--- a/swh/scheduler/journal_client.py
+++ b/swh/scheduler/journal_client.py
@@ -4,7 +4,7 @@
 # See top-level LICENSE file for more information
Nov 22 2021, 8:35 PM · Scheduling utilities
Harbormaster failed to build B25102: rDLDCVS34f46486f4a4: preserve empty lines in CVS log messages over pserver for rDLDCVS34f46486f4a4: preserve empty lines in CVS log messages over pserver!
Nov 22 2021, 7:52 PM
stsp closed D6638: preserve empty lines in CVS log messages over pserver.
Nov 22 2021, 7:51 PM
stsp committed rDLDCVS34f46486f4a4: preserve empty lines in CVS log messages over pserver (authored by stsp).
preserve empty lines in CVS log messages over pserver
Nov 22 2021, 7:51 PM
olasd added a comment to T3748: Date overflow error in scheduler journal client for some visit type.

I had hot-patched this to clamp dates to datetime.datetime.max, if an overflow was detected. Of course I never actually committed the change. D'oh.

Nov 22 2021, 7:26 PM · Scheduling utilities
olasd added a project to T3748: Date overflow error in scheduler journal client for some visit type: Scheduling utilities.
Nov 22 2021, 7:25 PM · Scheduling utilities
ardumont added a comment to T3748: Date overflow error in scheduler journal client for some visit type.

The stacktrace error is the same but in the end, it's the current position (/ default_queue_position)
of the queue (so per visit type) which are too far ahead in the future... [1]
Hence adding any offset creates the overflow problem.

Nov 22 2021, 5:42 PM · Scheduling utilities
ardumont renamed T3748: Date overflow error in scheduler journal client for some visit type from Date overflow error in scheduler journal client ("with a revenge") to Date overflow error in scheduler journal client for some visit type.
Nov 22 2021, 5:40 PM · Scheduling utilities
ardumont triaged T3748: Date overflow error in scheduler journal client for some visit type as High priority.
Nov 22 2021, 5:16 PM · Scheduling utilities
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH3d366b1b3e8b: Updated backport on buster-swh from debian/0.20.0-1_swh1 (unstable-swh) (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated backport on buster-swh from debian/0.20.0-1_swh1 (unstable-swh)
Nov 22 2021, 4:19 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH26d32c963641: Merge tag 'debian/0.20.0-1_swh1' into debian/buster-swh (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Merge tag 'debian/0.20.0-1_swh1' into debian/buster-swh
Nov 22 2021, 4:19 PM
vsellier committed rSPRE08c54f245ea9: staging: Increase memory of objstorage0 to avoid OOM (authored by vsellier).
staging: Increase memory of objstorage0 to avoid OOM
Nov 22 2021, 4:18 PM
vsellier committed rSPRE927d01960123: Match the reality (authored by vsellier).
Match the reality
Nov 22 2021, 4:18 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH0a348e2ee4bf: pristine-tar data for swh-scheduler_0.20.0.orig.tar.gz (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
pristine-tar data for swh-scheduler_0.20.0.orig.tar.gz
Nov 22 2021, 4:15 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH377716e4a6c7: Updated debian changelog for version 0.20.0 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated debian changelog for version 0.20.0
Nov 22 2021, 4:15 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH3a9bdba6aeb2: Update upstream source from tag 'debian/upstream/0.20.0' (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Update upstream source from tag 'debian/upstream/0.20.0'
Nov 22 2021, 4:15 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCHa42dbf8429f9: New upstream version 0.20.0 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
New upstream version 0.20.0
Nov 22 2021, 4:15 PM
vlorentz closed D6664: Fix CardinalityViolation in grab_next_visits on duplicate origins.
Nov 22 2021, 3:52 PM
vlorentz committed rDSCH2abb39368405: Fix CardinalityViolation in grab_next_visits on duplicate origins (authored by vlorentz).
Fix CardinalityViolation in grab_next_visits on duplicate origins
Nov 22 2021, 3:51 PM
vsellier committed rSPSITE1dce10672503: logstash: explicitely match not number facility ids (authored by vsellier).
logstash: explicitely match not number facility ids
Nov 22 2021, 3:46 PM
vlorentz closed T3636: Make the opam loader write extrinsic metadata, a subtask of T3638: Make package loaders create releases objects instead of revisions, as Resolved.
Nov 22 2021, 2:44 PM · Package Loader, Data Model, Archive content
vlorentz closed T3636: Make the opam loader write extrinsic metadata as Resolved.
Nov 22 2021, 2:44 PM · Extrinsic metadata, Opam
vlorentz closed T3638: Make package loaders create releases objects instead of revisions, a subtask of T1258: Synthesize release objects for all upstream things that match the concept of a release, as Resolved.
Nov 22 2021, 2:44 PM · Archive content
vlorentz closed T3638: Make package loaders create releases objects instead of revisions as Resolved.
Nov 22 2021, 2:43 PM · Package Loader, Data Model, Archive content
ardumont renamed T3746: staging: Deploy maven indexer/lister/loader from staging: Deploy maven exporter/lister/loader to staging: Deploy maven indexer/lister/loader.
Nov 22 2021, 2:38 PM · Maven loader, Maven lister, System administration, Archive coverage
vsellier closed D6665: logstash: rename syslog facility to facility_name when it's a string.
Nov 22 2021, 2:37 PM
vsellier committed rSPSITEae1e994eabc5: logstash: rename syslog facility to facility_name when it's a string (authored by vsellier).
logstash: rename syslog facility to facility_name when it's a string
Nov 22 2021, 2:37 PM
ardumont closed T3745: production: Deploy package loader v1.1, deposit server v0.16, lister v2.3, a subtask of T3638: Make package loaders create releases objects instead of revisions, as Resolved.
Nov 22 2021, 2:29 PM · Package Loader, Data Model, Archive content
ardumont closed T3745: production: Deploy package loader v1.1, deposit server v0.16, lister v2.3 as Resolved.
Nov 22 2021, 2:29 PM · System administration, Package Loader, Data Model, Archive content
ardumont moved T3745: production: Deploy package loader v1.1, deposit server v0.16, lister v2.3 from deployed/landed/monitoring to Component upgrades on the System administration board.
Nov 22 2021, 2:29 PM · System administration, Package Loader, Data Model, Archive content
ardumont accepted D6665: logstash: rename syslog facility to facility_name when it's a string.

lgtm

Nov 22 2021, 2:29 PM
ardumont accepted D6664: Fix CardinalityViolation in grab_next_visits on duplicate origins.

Thanks.

Nov 22 2021, 2:28 PM
vsellier requested review of D6665: logstash: rename syslog facility to facility_name when it's a string.
Nov 22 2021, 2:28 PM
vsellier added a revision to T3705: Upgrade the ELK stack: D6665: logstash: rename syslog facility to facility_name when it's a string.
Nov 22 2021, 2:28 PM · System administration (Component upgrades)
vlorentz triaged T3747: svn: FileExistsError when creating directory as Normal priority.
Nov 22 2021, 2:16 PM · SVN Loader
ardumont moved T3745: production: Deploy package loader v1.1, deposit server v0.16, lister v2.3 from in-progress to deployed/landed/monitoring on the System administration board.
Nov 22 2021, 2:05 PM · System administration, Package Loader, Data Model, Archive content
ardumont changed the status of T3745: production: Deploy package loader v1.1, deposit server v0.16, lister v2.3, a subtask of T3638: Make package loaders create releases objects instead of revisions, from Open to Work in Progress.
Nov 22 2021, 2:05 PM · Package Loader, Data Model, Archive content
ardumont changed the status of T3745: production: Deploy package loader v1.1, deposit server v0.16, lister v2.3 from Open to Work in Progress.
Nov 22 2021, 2:05 PM · System administration, Package Loader, Data Model, Archive content
ardumont added a project to T3745: production: Deploy package loader v1.1, deposit server v0.16, lister v2.3: System administration.
Nov 22 2021, 2:04 PM · System administration, Package Loader, Data Model, Archive content
ardumont updated the task description for T3745: production: Deploy package loader v1.1, deposit server v0.16, lister v2.3.
Nov 22 2021, 2:02 PM · System administration, Package Loader, Data Model, Archive content
ardumont updated the task description for T3745: production: Deploy package loader v1.1, deposit server v0.16, lister v2.3.
Nov 22 2021, 1:59 PM · System administration, Package Loader, Data Model, Archive content
ardumont updated the task description for T3745: production: Deploy package loader v1.1, deposit server v0.16, lister v2.3.
Nov 22 2021, 1:56 PM · System administration, Package Loader, Data Model, Archive content
ardumont updated the task description for T3745: production: Deploy package loader v1.1, deposit server v0.16, lister v2.3.
Nov 22 2021, 1:52 PM · System administration, Package Loader, Data Model, Archive content
vlorentz requested review of D6664: Fix CardinalityViolation in grab_next_visits on duplicate origins.
Nov 22 2021, 1:40 PM
ardumont created P1220 vagrant up sadness.
Nov 22 2021, 1:34 PM
olasd closed T1844: make archive.s.o point to the Azure-hosted webapp as Wontfix.

We haven't had the capacity of making the azure infrastructure perform as well as the in-house one, to the point where the web frontend wasn't really useable.

Nov 22 2021, 1:31 PM · System administration
olasd closed T1844: make archive.s.o point to the Azure-hosted webapp, a subtask of T1843: make sure front-end services work when the Inria infra is down, as Wontfix.
Nov 22 2021, 1:31 PM · System administration
ardumont requested changes to D6395: lister: Add new maven lister.

I had another round.
I've added suggestions about docs, fixing log instructions, etc...

Nov 22 2021, 1:27 PM
olasd closed T2543: Some messages in the (azure) kafka cluster are too large for rdkafka clients to be able to decompress them as Invalid.

There is no azure kafka cluster anymore...

Nov 22 2021, 1:16 PM · System administration, Journal
ardumont updated the task description for T3745: production: Deploy package loader v1.1, deposit server v0.16, lister v2.3.
Nov 22 2021, 1:15 PM · System administration, Package Loader, Data Model, Archive content
ardumont renamed T3745: production: Deploy package loader v1.1, deposit server v0.16, lister v2.3 from production: Deploy package loader v1.0, deposit server v0.16, lister v2.3 to production: Deploy package loader v1.1, deposit server v0.16, lister v2.3.
Nov 22 2021, 1:06 PM · System administration, Package Loader, Data Model, Archive content
vlorentz placed T1260: Extend the release object model to allow synthetic objects up for grabs.
Nov 22 2021, 12:05 PM · Archive content
ardumont triaged T3746: staging: Deploy maven indexer/lister/loader as Normal priority.
Nov 22 2021, 12:01 PM · Maven loader, Maven lister, System administration, Archive coverage
ardumont added a comment to D6395: lister: Add new maven lister.

@borisbaldassari I've renamed T1724 and gave a rather succinct summary

Nov 22 2021, 11:58 AM
ardumont updated the task description for T1724: Maven Central repository support.
Nov 22 2021, 11:56 AM · Maven loader, Maven lister, GSoC 2019, Archive coverage
ardumont updated the task description for T1724: Maven Central repository support.
Nov 22 2021, 11:56 AM · Maven loader, Maven lister, GSoC 2019, Archive coverage
ardumont renamed T1724: Maven Central repository support from Maven Central repository Lister to Maven Central repository support.
Nov 22 2021, 11:54 AM · Maven loader, Maven lister, GSoC 2019, Archive coverage
vlorentz committed rDVAU1c83b82b4984: Remove irrelevant comment (authored by vlorentz).
Remove irrelevant comment
Nov 22 2021, 11:54 AM
vlorentz closed D6650: git_bare: Fetch directories concurrently, using threads..
Nov 22 2021, 11:53 AM
vlorentz committed rDVAU5fcbeb0be2e3: git_bare: Fetch directories concurrently, using threads. (authored by vlorentz).
git_bare: Fetch directories concurrently, using threads.
Nov 22 2021, 11:53 AM