Page MenuHomeSoftware Heritage
Feed All Stories

May 6 2021

Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCHeb8602255378: Updated debian changelog for version 0.14.1 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated debian changelog for version 0.14.1
May 6 2021, 4:17 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH8981a70a9c8c: New upstream version 0.14.1 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
New upstream version 0.14.1
May 6 2021, 4:17 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCHeacdf09197da: Update upstream source from tag 'debian/upstream/0.14.1' (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Update upstream source from tag 'debian/upstream/0.14.1'
May 6 2021, 4:17 PM
anlambert accepted D5701: swh-vault: Use swh.core 0.14.
May 6 2021, 4:15 PM
vlorentz requested review of D5701: swh-vault: Use swh.core 0.14.
May 6 2021, 4:13 PM
vsellier added a comment to T3222: Monitor daily indexes are present on the log cluster and logs are correctly ingested.

after searching how it can be integrated with the inciga checks, the simplest way I have found is to create a script that periodically query logstash to get the statistics and return this status in this cases:

  • GREEN: neither non_retryable_failures, with_errors or failures fields founds on the json
  • WARNING: failures field found
  • CRITICAL: non_retryable_failures or with_errors field found
May 6 2021, 4:09 PM · System administration
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTOf269f28c11fb: Updated debian changelog for version 0.28.0 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated debian changelog for version 0.28.0
May 6 2021, 4:07 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTOda5305095fff: Update upstream source from tag 'debian/upstream/0.28.0' (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Update upstream source from tag 'debian/upstream/0.28.0'
May 6 2021, 4:06 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTO455191b9bdb7: New upstream version 0.28.0 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
New upstream version 0.28.0
May 6 2021, 4:06 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTO42dd05cf7755: pristine-tar data for swh-storage_0.28.0.orig.tar.gz (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
pristine-tar data for swh-storage_0.28.0.orig.tar.gz
May 6 2021, 4:06 PM
anlambert closed D5704: keycloak: Set SSO Session Idle to one week, Session Max to one month.
May 6 2021, 3:57 PM
anlambert committed rSPSITE09c766391ec2: keycloak: Set SSO Session Idle to one week, Session Max to one month (authored by anlambert).
keycloak: Set SSO Session Idle to one week, Session Max to one month
May 6 2021, 3:57 PM
vlorentz closed D5700: swh-scheduler: Use swh.core 0.14.
May 6 2021, 3:55 PM
vlorentz committed rDSCH8a892e2f8694: Use swh.core 0.14 (authored by vlorentz).
Use swh.core 0.14
May 6 2021, 3:55 PM
Harbormaster failed remote builds in B21340: Diff 20358 for D5700: swh-scheduler: Use swh.core 0.14!
May 6 2021, 3:52 PM
swh-public-ci added a comment to D5700: swh-scheduler: Use swh.core 0.14.

Build has FAILED

May 6 2021, 3:52 PM
vlorentz closed D5698: swh-storage: Use swh.core 0.14.
May 6 2021, 3:51 PM
vlorentz committed rDSTO35ae94a42d83: Use swh.core 0.14 (authored by vlorentz).
Use swh.core 0.14
May 6 2021, 3:51 PM
ardumont accepted D5698: swh-storage: Use swh.core 0.14.
May 6 2021, 3:50 PM
vlorentz updated the diff for D5700: swh-scheduler: Use swh.core 0.14.

rebase

May 6 2021, 3:49 PM
vlorentz requested review of D5698: swh-storage: Use swh.core 0.14.
May 6 2021, 3:47 PM
ardumont accepted D5700: swh-scheduler: Use swh.core 0.14.
May 6 2021, 3:46 PM
vlorentz requested review of D5700: swh-scheduler: Use swh.core 0.14.
May 6 2021, 3:43 PM
anlambert retitled D5704: keycloak: Set SSO Session Idle to one week, Session Max to one month from keycloak: Set SSO Session Idle to 6 hours to keycloak: Set SSO Session Idle to one week, Session Max to one month.
May 6 2021, 3:41 PM
anlambert updated the diff for D5704: keycloak: Set SSO Session Idle to one week, Session Max to one month.
  • Set SSO Session Idle to one week
May 6 2021, 3:39 PM
vlorentz closed D5702: Rename pytest_postgresql_get_config; names starting with 'pytest_' in pytest plugins are reserved.
May 6 2021, 3:33 PM
vlorentz committed rDCOREbc87604addf7: Rename pytest_postgresql_get_config; names starting with 'pytest_' in pytest… (authored by vlorentz).
Rename pytest_postgresql_get_config; names starting with 'pytest_' in pytest…
May 6 2021, 3:33 PM
douardda accepted D5702: Rename pytest_postgresql_get_config; names starting with 'pytest_' in pytest plugins are reserved.
May 6 2021, 3:32 PM
vsellier added a comment to T3222: Monitor daily indexes are present on the log cluster and logs are correctly ingested.

I have simulated different situations locally on the vagrant environment:

root@logstash0:~# curl -s http://localhost:9600/_node/stats/pipelines | jq '.pipelines.main.plugins.outputs'
[
  {
    "id": "c49a6902391a456022af4c89f0972781900d01d70cd5f312b292cb20c0d345eb",
    "documents": {
      "non_retryable_failures": 112,
      "successes": 103692
    },
    "events": {
      "out": 103804,
      "in": 103804,
      "duration_in_millis": 3529049
    },
    "name": "elasticsearch",
    "bulk_requests": {
      "responses": {
        "200": 2028
      },
      "failures": 3,
      "with_errors": 110,
      "successes": 1918
    }
  }
]
May 6 2021, 3:30 PM · System administration
ardumont added a comment to T3310: Deploy sourceforge lister on staging.

It starts well. The build is stuck [1]

May 6 2021, 3:29 PM · System administration, Origin-SourceForge
ardumont moved T3310: Deploy sourceforge lister on staging from Backlog to Weekly backlog on the System administration board.
May 6 2021, 3:19 PM · System administration, Origin-SourceForge
ardumont added a project to T3310: Deploy sourceforge lister on staging: System administration.
May 6 2021, 3:11 PM · System administration, Origin-SourceForge
ardumont triaged T3310: Deploy sourceforge lister on staging as High priority.
May 6 2021, 3:10 PM · System administration, Origin-SourceForge
anlambert planned changes to D5704: keycloak: Set SSO Session Idle to one week, Session Max to one month.
May 6 2021, 3:07 PM
anlambert added a comment to D5704: keycloak: Set SSO Session Idle to one week, Session Max to one month.
In D5704#144807, @zack wrote:

Why 6 hours and not, say, 1 week or even 1 month?
It is very common these days to remain connected for that long, and the UX in having to relogin often is a lot worse.

May 6 2021, 3:02 PM
zack added a comment to D5704: keycloak: Set SSO Session Idle to one week, Session Max to one month.

Why 6 hours and not, say, 1 week or even 1 month?
It is very common these days to remain connected for that long, and the UX in having to relogin often is a lot worse.

May 6 2021, 3:00 PM
ardumont accepted D5704: keycloak: Set SSO Session Idle to one week, Session Max to one month.
May 6 2021, 2:57 PM
anlambert added a reviewer for D5704: keycloak: Set SSO Session Idle to one week, Session Max to one month: Reviewers.
May 6 2021, 2:54 PM
anlambert requested review of D5704: keycloak: Set SSO Session Idle to one week, Session Max to one month.
May 6 2021, 2:54 PM
anlambert added a revision to T3272: Authenticated users should be able to browse their save code now requests: D5704: keycloak: Set SSO Session Idle to one week, Session Max to one month.
May 6 2021, 2:54 PM · Web app
Harbormaster failed remote builds in B21336: Diff 20354 for D5680: Make the TenaciousProxyStorage retry when a single object add fails!
May 6 2021, 2:49 PM
swh-public-ci added a comment to D5680: Make the TenaciousProxyStorage retry when a single object add fails.

Build has FAILED

May 6 2021, 2:49 PM
douardda updated the diff for D5680: Make the TenaciousProxyStorage retry when a single object add fails.

rebase

May 6 2021, 2:48 PM
Harbormaster failed remote builds in B21335: Diff 20353 for D5680: Make the TenaciousProxyStorage retry when a single object add fails!
May 6 2021, 2:48 PM
swh-public-ci added a comment to D5680: Make the TenaciousProxyStorage retry when a single object add fails.

Build has FAILED

May 6 2021, 2:48 PM
ardumont edited P1038 deposit (request of type metadata) staging for hal-preprod.
May 6 2021, 2:47 PM · SWORD deposit
douardda updated the diff for D5680: Make the TenaciousProxyStorage retry when a single object add fails.

Make the number of (single-object insertion) retries configurable

May 6 2021, 2:47 PM
vlorentz requested review of D5703: Run all directory tests on the gitfast cooker.
May 6 2021, 2:46 PM
ardumont updated the title for P1038 deposit (request of type metadata) staging for hal-preprod from deposit (request of type metadata ) staging for hal-preprod to deposit (request of type metadata) staging for hal-preprod.
May 6 2021, 2:40 PM · SWORD deposit
ardumont created P1038 deposit (request of type metadata) staging for hal-preprod.
May 6 2021, 2:39 PM · SWORD deposit
anlambert accepted D5696: tests: Add new ambassador user for frontend tests.

LGTM

May 6 2021, 2:33 PM
vlorentz requested review of D5702: Rename pytest_postgresql_get_config; names starting with 'pytest_' in pytest plugins are reserved.
May 6 2021, 2:32 PM
douardda added inline comments to D5680: Make the TenaciousProxyStorage retry when a single object add fails.
May 6 2021, 2:31 PM
vlorentz closed D5697: Blacklist attr 21.1.0.
May 6 2021, 2:30 PM
vlorentz committed rDMOD31cb72e9f059: Blacklist attr 21.1.0 (authored by vlorentz).
Blacklist attr 21.1.0
May 6 2021, 2:30 PM
ardumont accepted D5697: Blacklist attr 21.1.0.
May 6 2021, 2:30 PM
swh-public-ci added a comment to D5696: tests: Add new ambassador user for frontend tests.

Build is green

May 6 2021, 2:29 PM
vlorentz closed D5694: Add support for pytest-postgresql 3.0.0.
May 6 2021, 2:29 PM
vlorentz committed rDCORE927cff85968f: Add support for pytest-postgresql 3.0.0 (authored by vlorentz).
Add support for pytest-postgresql 3.0.0
May 6 2021, 2:29 PM
ardumont added a comment to D5696: tests: Add new ambassador user for frontend tests.

thanks, adapted.

May 6 2021, 2:27 PM
Harbormaster failed to build B21327: rDSTO652e3d5c07ce: tenacious: Document potential issues about objects being dropped for rDSTO652e3d5c07ce: tenacious: Document potential issues about objects being dropped!
May 6 2021, 2:21 PM
vlorentz requested review of D5697: Blacklist attr 21.1.0.
May 6 2021, 2:21 PM
vlorentz closed D5693: tenacious: Document potential issues about objects being dropped.
May 6 2021, 2:20 PM
vlorentz committed rDSTO652e3d5c07ce: tenacious: Document potential issues about objects being dropped (authored by vlorentz).
tenacious: Document potential issues about objects being dropped
May 6 2021, 2:20 PM
ardumont updated the diff for D5696: tests: Add new ambassador user for frontend tests.

Adapt according to review

May 6 2021, 2:20 PM
ardumont requested review of D5696: tests: Add new ambassador user for frontend tests.
May 6 2021, 2:18 PM
swh-public-ci added a comment to D5694: Add support for pytest-postgresql 3.0.0.

Build is green

May 6 2021, 2:16 PM
vlorentz updated the diff for D5694: Add support for pytest-postgresql 3.0.0.

rebase

May 6 2021, 2:13 PM
anlambert committed rDDOC3d546edd5564: requirements-swh: Add missing logging extra for swh.core (authored by anlambert).
requirements-swh: Add missing logging extra for swh.core
May 6 2021, 2:09 PM
ardumont added a revision to T3213: Enable save code now of software source code archives for specific users: D5696: tests: Add new ambassador user for frontend tests.
May 6 2021, 2:09 PM · Save Code Now, Web app
anlambert committed rDCIDXebbd5f78361f: tox: Add sphinx environments to check sane doc build (authored by anlambert).
tox: Add sphinx environments to check sane doc build
May 6 2021, 2:05 PM
anlambert closed D5695: docs/cli: Remove nested option for root swh command.
May 6 2021, 1:55 PM
anlambert committed rDCORE5f9527f0bffa: docs/cli: Remove nested option for root swh command (authored by anlambert).
docs/cli: Remove nested option for root swh command
May 6 2021, 1:55 PM
ardumont accepted D5693: tenacious: Document potential issues about objects being dropped.
May 6 2021, 1:51 PM
ardumont accepted D5695: docs/cli: Remove nested option for root swh command.
May 6 2021, 1:50 PM
anlambert accepted D5694: Add support for pytest-postgresql 3.0.0.

Looks good to me.

May 6 2021, 1:48 PM
anlambert requested review of D5695: docs/cli: Remove nested option for root swh command.
May 6 2021, 1:45 PM
vlorentz requested review of D5694: Add support for pytest-postgresql 3.0.0.
May 6 2021, 1:05 PM
vlorentz requested review of D5693: tenacious: Document potential issues about objects being dropped.

failures are unrelated

May 6 2021, 12:22 PM
vsellier updated the diff for D5692: document the firewalls upgrade procedure.
  • split procedure per firewall
  • clarify the initial status before each section
  • fix minor typos
May 6 2021, 12:17 PM
vlorentz accepted D5680: Make the TenaciousProxyStorage retry when a single object add fails.
May 6 2021, 11:51 AM
Harbormaster failed to build B21315: rDWAPPS43636f47d562: origin_save: Enable to filter user submitted save requests in Web UI for rDWAPPS43636f47d562: origin_save: Enable to filter user submitted save requests in Web UI!
May 6 2021, 11:43 AM
swh-public-ci added a comment to D5685: Add new bundle type to list only when connected as privileged user.

Build is green

May 6 2021, 11:41 AM
Alphare added inline comments to D5687: Make the Mercurial loader incremental.
May 6 2021, 11:38 AM
ardumont updated the diff for D5685: Add new bundle type to list only when connected as privileged user.

Rebase

May 6 2021, 11:32 AM
vsellier closed T3306: Upgrade the firewalls to version 21.5.1 as Resolved.

upgrade done without any problem:

  • CARP maintenance activated on pushkin -> glyptotek elected as primary
  • pushkin upgrade done
  • CARP maintenance deactivated on pushkin -> pushkin re-elected as primary
  • nothing wrong detected after a safety period of 1 hour
  • CARP maintenance mode activated on glyptotek to avoid an unexpected rebalance during the upgrade
  • glyptotek upgrade done
  • CARP maintenance mode deactivated on glyptotek
May 6 2021, 11:31 AM · System administration
Harbormaster failed to build B21315: rDWAPPS43636f47d562: origin_save: Enable to filter user submitted save requests in Web UI for rDWAPPS43636f47d562: origin_save: Enable to filter user submitted save requests in Web UI!
May 6 2021, 11:29 AM
anlambert closed D5673: origin_save: Enable to filter user submitted save requests in Web UI.
May 6 2021, 11:21 AM
anlambert committed rDWAPPS43636f47d562: origin_save: Enable to filter user submitted save requests in Web UI (authored by anlambert).
origin_save: Enable to filter user submitted save requests in Web UI
May 6 2021, 11:21 AM
swh-public-ci added a comment to D5673: origin_save: Enable to filter user submitted save requests in Web UI.

Build is green

May 6 2021, 11:16 AM
vsellier planned changes to D5692: document the firewalls upgrade procedure.
May 6 2021, 11:15 AM
vsellier requested review of D5692: document the firewalls upgrade procedure.
May 6 2021, 11:12 AM
vsellier added a revision to T3203: docs: Document the firewall installation and procedures: D5692: document the firewalls upgrade procedure.
May 6 2021, 11:12 AM · Documentation, System administration
vlorentz added inline comments to D5687: Make the Mercurial loader incremental.
May 6 2021, 11:11 AM
anlambert updated the diff for D5673: origin_save: Enable to filter user submitted save requests in Web UI.

Rebase and improve if condition

May 6 2021, 11:08 AM
anlambert accepted D5685: Add new bundle type to list only when connected as privileged user.

Looks good to me !

May 6 2021, 11:03 AM
vlorentz accepted D5673: origin_save: Enable to filter user submitted save requests in Web UI.

thanks

May 6 2021, 10:52 AM
vlorentz closed D5689: Make test_directory_bogus_perms/test_revision_bogus_perms actually test the cookers.
May 6 2021, 10:47 AM
vlorentz committed rDVAU3c14013bc7ee: Make test_directory_bogus_perms/test_revision_bogus_perms/ actually test the… (authored by vlorentz).
Make test_directory_bogus_perms/test_revision_bogus_perms/ actually test the…
May 6 2021, 10:47 AM
swh-public-ci added a comment to D5689: Make test_directory_bogus_perms/test_revision_bogus_perms actually test the cookers.

Build is green

May 6 2021, 10:47 AM