Page MenuHomeSoftware Heritage
Feed All Stories

Apr 18 2021

aastha1999 requested review of D5551: Fix swh-scanner for python 3.7 and >= 3.8.
Apr 18 2021, 3:43 PM
KShivendu closed D5529: Add test to ensure that an exception is raised if unique_key isn't implemented.
Apr 18 2021, 3:17 PM
KShivendu committed rDJNL236a00262e4f: test: Catch errors in write_addition if unique_key isn't implemented (authored by KShivendu).
test: Catch errors in write_addition if unique_key isn't implemented
Apr 18 2021, 3:17 PM
dachary added a comment to T3149: Benchmark software for the object storage.

rbd bench on the images created

Apr 18 2021, 3:15 PM · Object storage

Apr 17 2021

dachary added a comment to T3149: Benchmark software for the object storage.

There is a 3% space overhead on the RBD data pool. 6TB data, 3TB parity = 9TB. Actual 9.3TB, i.e. ~+3%.

Apr 17 2021, 10:19 PM · Object storage
dachary added a comment to T3108: Grid5000 for benchmarking.

https://www.grid5000.fr/w/Grenoble:Network shows the network topology

Apr 17 2021, 5:26 PM · Object storage
dachary added a comment to T3149: Benchmark software for the object storage.

Complete rewrite to:

Apr 17 2021, 5:24 PM · Object storage
ardumont added a comment to T3260: publish swh.dataset to pypi.

This should help:

12:08 <+ardumont> fwiw, i don't see swh-dataset in the jenkins ci declaration so that won't get published
12:08 <+ardumont> https://forge.softwareheritage.org/source/swh-jenkins-jobs/browse/master/jobs/swh-packages.yaml
12:10 <+ardumont> (relatedly without ^ that won't show up in jenkins)
12:10 <+ardumont> related docs https://wiki.softwareheritage.org/wiki/Debian_packaging#Setting_up_the_repository_on_Phabricator and https://wiki.softwareheritage.org/wiki/Debian_packaging#Setting_up_the_repository_on_Phabricator
Apr 17 2021, 3:23 PM · Continuous Integration, Datasets
zack triaged T3260: publish swh.dataset to pypi as Low priority.
Apr 17 2021, 12:31 PM · Continuous Integration, Datasets
zack committed rDDATASET34da22d6d14e: doc: fix sphinx line continuation glitches in schema.rst (authored by zack).
doc: fix sphinx line continuation glitches in schema.rst
Apr 17 2021, 11:23 AM
zack added a comment to T2265: Building the documentation should not show any warning..

I'm confused about the status of this task. I've just rebuilt the docs for docs.s.o and it says "build succeeded, 83 warnings.". So is the fix for this not yet "deployed" somehow? Also, why is the build succeeding even with all those warnings? Because as long as that's the case, we will for sure keep reintroducing warnings as time goes by.

Apr 17 2021, 11:17 AM · Easy hack, Documentation
ardumont added a comment to D5529: Add test to ensure that an exception is raised if unique_key isn't implemented.

Should I add the names of other contributors as well?

Apr 17 2021, 9:23 AM
KShivendu added a comment to D5529: Add test to ensure that an exception is raised if unique_key isn't implemented.

Should I add the names of other contributors as well?

Apr 17 2021, 7:29 AM

Apr 16 2021

ardumont moved T2117: Save Code Now: End to End monitoring from in-progress to deployed/landed/monitoring on the System administration board.
Apr 16 2021, 8:24 PM · System administration, Monitoring, Roadmap 2021
ardumont added a comment to T2117: Save Code Now: End to End monitoring.

There is no hg origin for now but this is configurable so as soon as one one is found, this will be checked as well.

Apr 16 2021, 8:03 PM · System administration, Monitoring, Roadmap 2021
ardumont added a comment to T2117: Save Code Now: End to End monitoring.

In the mean time, this error should not be too blocking on pergamon.

Apr 16 2021, 8:00 PM · System administration, Monitoring, Roadmap 2021
ardumont committed rSPSITE76a3713f1c83: save code now check: Fix typo in the actual command to use (authored by ardumont).
save code now check: Fix typo in the actual command to use
Apr 16 2021, 7:55 PM
ardumont committed rSPSITE81d4deaa347f: save code now check: Fix missing check command (authored by ardumont).
save code now check: Fix missing check command
Apr 16 2021, 7:48 PM
olasd added inline comments to D5550: tox: Add a sphinx environment to check sane doc build.
Apr 16 2021, 7:46 PM
seirl committed rDDATASETdffb127c5a3b: athena: pass database name as an attribute (authored by seirl).
athena: pass database name as an attribute
Apr 16 2021, 7:43 PM
seirl closed D5540: docs: Update for new schema.
Apr 16 2021, 7:39 PM
seirl committed rDDATASET01ba5d14ef21: docs: Update for new schema (authored by seirl).
docs: Update for new schema
Apr 16 2021, 7:39 PM
vlorentz added a revision to T3258: Build documentation on every diff: D5550: tox: Add a sphinx environment to check sane doc build.
Apr 16 2021, 7:27 PM · Continuous Integration, Development environment, Documentation
vlorentz added a task to D5550: tox: Add a sphinx environment to check sane doc build: T3258: Build documentation on every diff.
Apr 16 2021, 7:27 PM
ardumont committed rSPSITE952cd2b23ea7: Deactivate exported duplicated resources on secondaries webapps (authored by ardumont).
Deactivate exported duplicated resources on secondaries webapps
Apr 16 2021, 7:21 PM
anlambert requested review of D5550: tox: Add a sphinx environment to check sane doc build.
Apr 16 2021, 7:17 PM
ardumont added a comment to T2117: Save Code Now: End to End monitoring.

Damn, I tried to deploy the end to end save code now check but computer says no [1]

Apr 16 2021, 7:13 PM · System administration, Monitoring, Roadmap 2021
ardumont committed rSPSITE0d4c2d7bb553: Actually the new end to end checks collected (authored by ardumont).
Actually the new end to end checks collected
Apr 16 2021, 7:07 PM
ardumont committed rSPSITEc6ec3347ba9c: Make the new end to end checks collected (authored by ardumont).
Make the new end to end checks collected
Apr 16 2021, 7:03 PM
olasd triaged T3259: Gracefully handle a client closing the connection in the middle of a response being streamed as Normal priority.
Apr 16 2021, 6:34 PM · Compressed graph service
ardumont committed rSPSITEc20830858ae9: deposit e2e check: Fix variables typo (authored by ardumont).
deposit e2e check: Fix variables typo
Apr 16 2021, 6:16 PM
ardumont closed D5549: Deploy check save code now end to end check.
Apr 16 2021, 6:16 PM
ardumont committed rSPSITEffe24c7f6dfd: Deploy check save code now end to end check (authored by ardumont).
Deploy check save code now end to end check
Apr 16 2021, 6:16 PM
ardumont updated the diff for D5549: Deploy check save code now end to end check.

Adapt according to suggestion

Apr 16 2021, 6:11 PM
ardumont added inline comments to D5549: Deploy check save code now end to end check.
Apr 16 2021, 6:01 PM
vsellier accepted D5549: Deploy check save code now end to end check.

just one question inline regarding the icinga test name.
Otherwise, looks good

Apr 16 2021, 6:00 PM
ardumont added inline comments to D5549: Deploy check save code now end to end check.
Apr 16 2021, 5:43 PM
ardumont added a revision to T2117: Save Code Now: End to End monitoring: D5549: Deploy check save code now end to end check.
Apr 16 2021, 5:40 PM · System administration, Monitoring, Roadmap 2021
ardumont requested review of D5549: Deploy check save code now end to end check.
Apr 16 2021, 5:40 PM
swh-public-ci added a comment to D5501: add an anti-Dos limit for edges traversed as a query parameter.

Build is green

Apr 16 2021, 5:40 PM
Hakimb updated the diff for D5501: add an anti-Dos limit for edges traversed as a query parameter.

squashing of commits

Apr 16 2021, 5:38 PM
vlorentz triaged T3258: Build documentation on every diff as Normal priority.
Apr 16 2021, 5:33 PM · Continuous Integration, Development environment, Documentation
vlorentz closed T2265: Building the documentation should not show any warning. as Resolved.
Apr 16 2021, 5:26 PM · Easy hack, Documentation
vlorentz closed D5545: phabricator: Emphasize the 'arc diff --update' message should not be the default one..
Apr 16 2021, 5:24 PM
vlorentz committed rDDOCbfeba3d7dee9: phabricator: Emphasize the 'arc diff --update' message should not be the… (authored by vlorentz).
phabricator: Emphasize the 'arc diff --update' message should not be the…
Apr 16 2021, 5:24 PM
vlorentz updated the diff for D5545: phabricator: Emphasize the 'arc diff --update' message should not be the default one..

rebase

Apr 16 2021, 5:24 PM
anlambert closed D5547: docs/Makefile: Remove no longer needed target.
Apr 16 2021, 4:34 PM
anlambert committed rDLDBASE227c78ca28c7: docs/Makefile: Remove no longer needed target (authored by anlambert).
docs/Makefile: Remove no longer needed target
Apr 16 2021, 4:34 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDICPdb1a40d683a6: Merge tag 'debian/0.3.0-1_swh1' into debian/buster-swh (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Merge tag 'debian/0.3.0-1_swh1' into debian/buster-swh
Apr 16 2021, 3:59 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDICP5cd42cf319a3: Updated backport on buster-swh from debian/0.3.0-1_swh1 (unstable-swh) (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated backport on buster-swh from debian/0.3.0-1_swh1 (unstable-swh)
Apr 16 2021, 3:59 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDICP26c127841699: Updated debian changelog for version 0.3.0 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated debian changelog for version 0.3.0
Apr 16 2021, 3:58 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDICPe50a9fae1611: Update upstream source from tag 'debian/upstream/0.3.0' (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Update upstream source from tag 'debian/upstream/0.3.0'
Apr 16 2021, 3:58 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDICP54b405252540: pristine-tar data for swh.icingaplugins_0.3.0.orig.tar.gz (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
pristine-tar data for swh.icingaplugins_0.3.0.orig.tar.gz
Apr 16 2021, 3:58 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDICP6cf81256f199: New upstream version 0.3.0 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
New upstream version 0.3.0
Apr 16 2021, 3:58 PM
ardumont closed D5541: Add end to end save code now check.
Apr 16 2021, 3:56 PM
ardumont committed rDICPd65fd19afd04: Add end to end save code now check (authored by ardumont).
Add end to end save code now check
Apr 16 2021, 3:56 PM
swh-public-ci added a comment to D5541: Add end to end save code now check.

Build is green

Apr 16 2021, 3:55 PM
ardumont updated the diff for D5541: Add end to end save code now check.

For the fun, 100% coverage on the module now ;)

Apr 16 2021, 3:54 PM
vsellier accepted D5541: Add end to end save code now check.

lgtm

Apr 16 2021, 3:52 PM
swh-public-ci added a comment to D5541: Add end to end save code now check.

Build is green

Apr 16 2021, 3:47 PM
ardumont updated the diff for D5541: Add end to end save code now check.

Rework failed scenario docstring

Apr 16 2021, 3:46 PM
swh-public-ci added a comment to D5541: Add end to end save code now check.

Build is green

Apr 16 2021, 3:42 PM
ardumont updated the diff for D5541: Add end to end save code now check.

Rework commit message

Apr 16 2021, 3:41 PM
ardumont updated the summary of D5541: Add end to end save code now check.
Apr 16 2021, 3:41 PM
ardumont updated the diff for D5541: Add end to end save code now check.

Rework commit message

Apr 16 2021, 3:40 PM
swh-public-ci added a comment to D5541: Add end to end save code now check.

Build is green

Apr 16 2021, 3:32 PM
ardumont added a comment to T3252: Better handling of erroneous origins submitted to save code now.

yes, great ;)

Apr 16 2021, 3:32 PM · System administration, Save Code Now, Web app
ardumont updated the diff for D5541: Add end to end save code now check.

Reuse variable instead of duplicating (i forgot to reuse it)

Apr 16 2021, 3:31 PM
zack added a comment to T3252: Better handling of erroneous origins submitted to save code now.

@rdicosmo great summary, I'm certainly on that page :)

Apr 16 2021, 3:30 PM · System administration, Save Code Now, Web app
ardumont retitled D5541: Add end to end save code now check from wip: Add end to end save code now check to Add end to end save code now check.
Apr 16 2021, 3:26 PM
swh-public-ci added a comment to D5541: Add end to end save code now check.

Build is green

Apr 16 2021, 3:26 PM
anlambert requested review of D5548: exporters/edges: Fix sphinx warning.
Apr 16 2021, 3:26 PM
anlambert added a revision to T2265: Building the documentation should not show any warning.: D5548: exporters/edges: Fix sphinx warning.
Apr 16 2021, 3:26 PM · Easy hack, Documentation
ardumont updated the diff for D5541: Add end to end save code now check.

Reformat assertion a bit

Apr 16 2021, 3:25 PM
swh-public-ci added a comment to D5541: Add end to end save code now check.

Build is green

Apr 16 2021, 3:24 PM
ardumont updated the diff for D5541: Add end to end save code now check.

Last conditional scenario, plain failure

Apr 16 2021, 3:23 PM
swh-public-ci added a comment to D5541: Add end to end save code now check.

Build is green

Apr 16 2021, 3:17 PM
ardumont updated the diff for D5541: Add end to end save code now check.

Exceeding threshold scenario

Apr 16 2021, 3:16 PM
swh-public-ci added a comment to D5541: Add end to end save code now check.

Build is green

Apr 16 2021, 2:58 PM
ardumont updated the diff for D5541: Add end to end save code now check.

Update conditional paths

Apr 16 2021, 2:57 PM
anlambert added a comment to T2265: Building the documentation should not show any warning..

\o/ https://jenkins.softwareheritage.org/job/DDOC/job/dev/5528/

Apr 16 2021, 2:54 PM · Easy hack, Documentation
swh-public-ci added a comment to D5501: add an anti-Dos limit for edges traversed as a query parameter.

Build is green

Apr 16 2021, 2:51 PM
Hakimb updated the diff for D5501: add an anti-Dos limit for edges traversed as a query parameter.

I fixed the unit tests that didn't work because of the default argument value of max_edges (it was None instead of 0) in graph.py

Apr 16 2021, 2:49 PM
swh-public-ci added a comment to D5541: Add end to end save code now check.

Build is green

Apr 16 2021, 2:45 PM
ardumont updated the diff for D5541: Add end to end save code now check.

Start testing

Apr 16 2021, 2:44 PM
anlambert closed D5546: cli: Fix sphinx warning.
Apr 16 2021, 2:38 PM
anlambert committed rDGRPH04a1656c104e: cli: Fix sphinx warning (authored by anlambert).
cli: Fix sphinx warning
Apr 16 2021, 2:38 PM
swh-public-ci added a comment to D5546: cli: Fix sphinx warning.

Build is green

Apr 16 2021, 2:37 PM
Harbormaster failed remote builds in B20810: Diff 19797 for D5546: cli: Fix sphinx warning!
Apr 16 2021, 2:36 PM
swh-public-ci added a comment to D5546: cli: Fix sphinx warning.

Build has FAILED

Apr 16 2021, 2:35 PM
anlambert updated the diff for D5546: cli: Fix sphinx warning.

Use :file: role instead of escaping *.

Apr 16 2021, 2:34 PM
ardumont accepted D5547: docs/Makefile: Remove no longer needed target.
Apr 16 2021, 2:27 PM
anlambert requested review of D5546: cli: Fix sphinx warning.
Apr 16 2021, 2:26 PM
swh-public-ci added a comment to D5501: add an anti-Dos limit for edges traversed as a query parameter.

Build was aborted

Apr 16 2021, 2:25 PM
Harbormaster failed remote builds in B20805: Diff 19792 for D5501: add an anti-Dos limit for edges traversed as a query parameter!
Apr 16 2021, 2:25 PM
anlambert requested review of D5547: docs/Makefile: Remove no longer needed target.
Apr 16 2021, 2:24 PM
vsellier closed T3254: Outboarding of tenma as Resolved.
Apr 16 2021, 2:23 PM · System administration
vsellier added a comment to T3254: Outboarding of tenma.
  • he was not in the list of members of the swh-team (thanks @ardumont for adding me to the owners of the list)
Apr 16 2021, 2:23 PM · System administration
anlambert added a comment to D5544: docs/cli: Fix sphinx warning.

Arf, still two warnings remaining but no clear indication where they come from: https://jenkins.softwareheritage.org/job/DDOC/job/dev/5526/artifact/swh-docs/docs/errors.log/*view*/

Apr 16 2021, 2:16 PM
vlorentz updated the diff for D5545: phabricator: Emphasize the 'arc diff --update' message should not be the default one..

reword in a clearer way

Apr 16 2021, 2:15 PM