Page MenuHomeSoftware Heritage
Feed Advanced Search

Jan 8 2023

gitlab-migration closed T2533: CRAN loader: set revision dates as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:22 PM · Origin-CRAN
gitlab-migration closed T2241: lister/loader: Ingest archived artifacts from cran mirror as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:22 PM · Core Loader, Lister, Origin-CRAN
gitlab-migration changed the status of T2536: Investigate CRAN revisions without an origin from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:00 PM · Origin-CRAN
gitlab-migration changed the status of T2098: Deploy package loaders from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:00 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
gitlab-migration changed the status of T2029: cran lister: Align lister to output list of tarballs per origin, a subtask of T2026: Implement cran loader with package manager mechanism, from Resolved to Migrated.
Jan 8 2023, 9:59 PM · Origin-CRAN, Archive coverage
gitlab-migration changed the status of T2029: cran lister: Align lister to output list of tarballs per origin from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:59 PM · Origin-CRAN, Archive coverage
gitlab-migration changed the status of T2026: Implement cran loader with package manager mechanism from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:59 PM · Origin-CRAN, Archive coverage
gitlab-migration changed the status of T2023: Re-implement gnu loader with package loader, a subtask of T1389: Implement a base "package" loader for package managers, from Resolved to Migrated.
Jan 8 2023, 9:59 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
gitlab-migration changed the status of T2022: Re-implement npm loader with base loader, a subtask of T1389: Implement a base "package" loader for package managers, from Resolved to Migrated.
Jan 8 2023, 9:59 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
gitlab-migration changed the status of T2021: Re-implement pypi loader with package loader, a subtask of T1389: Implement a base "package" loader for package managers, from Resolved to Migrated.
Jan 8 2023, 9:59 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
gitlab-migration changed the status of T1389: Implement a base "package" loader for package managers from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:58 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
gitlab-migration changed the status of T3002: Current next-gen lister cran failing to list from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:33 PM · Origin-CRAN, Lister
gitlab-migration changed the status of T2025: Re-implement debian loader with package loader mechanism, a subtask of T1389: Implement a base "package" loader for package managers, from Resolved to Migrated.
Jan 8 2023, 4:28 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
gitlab-migration changed the status of T2024: Re-implement deposit loader with package loader mechanism, a subtask of T1389: Implement a base "package" loader for package managers, from Resolved to Migrated.
Jan 8 2023, 4:28 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
gitlab-migration changed the status of T2017: package loader: Discuss revision metadata normalization, a subtask of T1389: Implement a base "package" loader for package managers, from Resolved to Migrated.
Jan 8 2023, 4:28 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage

Oct 19 2022

gitlab-migration closed T2548: Restore CRAN visits deleted in january 2020 from backups as Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 5:57 PM · Storage manager, System administration, Origin-CRAN

Jan 28 2021

ardumont closed T3002: Current next-gen lister cran failing to list as Resolved.

It's ok now.

Jan 28 2021, 5:27 PM · Origin-CRAN, Lister
ardumont added a comment to T3002: Current next-gen lister cran failing to list.

Yes, I completely forgot about your diff that fixed it.

Jan 28 2021, 5:25 PM · Origin-CRAN, Lister
anlambert added a comment to T3002: Current next-gen lister cran failing to list.

My guess is that swh-scheduler 0.9.2 is not installed on staging, issue has been fixed in rDSCH2906b4e8a08517f5e3d86272232ad8ba926a43d7.

Jan 28 2021, 4:22 PM · Origin-CRAN, Lister
ardumont triaged T3002: Current next-gen lister cran failing to list as Normal priority.
Jan 28 2021, 3:55 PM · Origin-CRAN, Lister
ardumont created T3002: Current next-gen lister cran failing to list.
Jan 28 2021, 3:55 PM · Origin-CRAN, Lister

Oct 26 2020

ardumont added a comment to T2548: Restore CRAN visits deleted in january 2020 from backups.

And now it's here

;)

Oct 26 2020, 3:27 PM · Storage manager, System administration, Origin-CRAN
olasd added a comment to T2548: Restore CRAN visits deleted in january 2020 from backups.

We don't have database backups going back 10 months (nor 8 months, which was the horizon we would have needed at the time the task was submitted).

Oct 26 2020, 11:44 AM · Storage manager, System administration, Origin-CRAN

Aug 31 2020

vlorentz closed T2536: Investigate CRAN revisions without an origin as Resolved.

closing in favor of T2548 (and T2549)

Aug 31 2020, 4:37 PM · Origin-CRAN
vlorentz raised the priority of T2548: Restore CRAN visits deleted in january 2020 from backups from Normal to High.
Aug 31 2020, 4:37 PM · Storage manager, System administration, Origin-CRAN

Aug 28 2020

vlorentz added a project to T2548: Restore CRAN visits deleted in january 2020 from backups: Storage manager.
Aug 28 2020, 4:09 PM · Storage manager, System administration, Origin-CRAN
vlorentz added a project to T2548: Restore CRAN visits deleted in january 2020 from backups: System administration.
Aug 28 2020, 4:09 PM · Storage manager, System administration, Origin-CRAN
vlorentz updated subscribers of T2548: Restore CRAN visits deleted in january 2020 from backups.
Aug 28 2020, 4:06 PM · Storage manager, System administration, Origin-CRAN
vlorentz triaged T2548: Restore CRAN visits deleted in january 2020 from backups as Normal priority.
Aug 28 2020, 4:06 PM · Storage manager, System administration, Origin-CRAN
vlorentz updated the task description for T2536: Investigate CRAN revisions without an origin.
Aug 28 2020, 3:18 PM · Origin-CRAN
ardumont added a comment to T2536: Investigate CRAN revisions without an origin.

and what happened to the visits?

Aug 28 2020, 2:53 PM · Origin-CRAN
vlorentz added a comment to T2536: Investigate CRAN revisions without an origin.

and what happened to the visits?

Aug 28 2020, 2:48 PM · Origin-CRAN
ardumont added a comment to T2536: Investigate CRAN revisions without an origin.

This comment seems to back up my hypothesis on what happened [1]

Aug 28 2020, 2:46 PM · Origin-CRAN
ardumont added a comment to T2536: Investigate CRAN revisions without an origin.

I don't find data to back me up right now but i would think something like that happened:
...

Aug 28 2020, 2:40 PM · Origin-CRAN
ardumont added a comment to T2536: Investigate CRAN revisions without an origin.

I don't find data to back me up right now but i would think something like that happened:

Aug 28 2020, 2:32 PM · Origin-CRAN
ardumont added a comment to T2536: Investigate CRAN revisions without an origin.

Looks like a previous version of the cran loader which did not yet unify the origins, most likely.

Aug 28 2020, 2:18 PM · Origin-CRAN
ardumont added a comment to T2536: Investigate CRAN revisions without an origin.

Nice! Thanks. One confusing point down, cool.

Aug 28 2020, 1:21 PM · Origin-CRAN
vlorentz added a comment to T2536: Investigate CRAN revisions without an origin.
softwareheritage-scheduler=> select task, type, arguments from task where type='load-cran' and arguments->'kwargs'->>'url' like '%mljar%';
                                                                                                      task                                                                                                       |   type    |                                                    arguments                                                     
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------+------------------------------------------------------------------------------------------------------------------
 (251148056,load-cran,"{""args"": [], ""kwargs"": {""url"": ""https://cran.r-project.org/src/contrib/mljar_0.1.1.tar.gz"", ""version"": ""0.1.1""}}","2020-01-09 12:45:08.56447+00","1 day",disabled,oneshot,3,) | load-cran | {"args": [], "kwargs": {"url": "https://cran.r-project.org/src/contrib/mljar_0.1.1.tar.gz", "version": "0.1.1"}}
Aug 28 2020, 12:56 PM · Origin-CRAN
ardumont added a comment to T2536: Investigate CRAN revisions without an origin.

Hmmmm... so it could mean that earlier versions of the CRAN lister/loader didn't create origins?

Aug 28 2020, 12:50 PM · Origin-CRAN
vlorentz added a comment to T2536: Investigate CRAN revisions without an origin.

Hmmmm... so it could mean that earlier versions of the CRAN lister/loader didn't create origins?

Aug 28 2020, 12:39 PM · Origin-CRAN
ardumont added a comment to T2536: Investigate CRAN revisions without an origin.

I don't think it matters but still. I checked all the packages listed (up to bclust) and they are no longer listed over the html listing page reached from the r-project site [1].

Aug 28 2020, 12:36 PM · Origin-CRAN
vlorentz updated the task description for T2536: Investigate CRAN revisions without an origin.
Aug 28 2020, 12:33 PM · Origin-CRAN
ardumont added a comment to T2536: Investigate CRAN revisions without an origin.

So far, i'm confused by this.

Aug 28 2020, 12:27 PM · Origin-CRAN
vlorentz updated the task description for T2536: Investigate CRAN revisions without an origin.
Aug 28 2020, 11:46 AM · Origin-CRAN
vlorentz updated the task description for T2536: Investigate CRAN revisions without an origin.
Aug 28 2020, 8:12 AM · Origin-CRAN

Aug 27 2020

vlorentz updated the task description for T2536: Investigate CRAN revisions without an origin.
Aug 27 2020, 11:35 PM · Origin-CRAN
vlorentz updated the task description for T2536: Investigate CRAN revisions without an origin.
Aug 27 2020, 9:18 PM · Origin-CRAN
vlorentz updated the task description for T2536: Investigate CRAN revisions without an origin.
Aug 27 2020, 7:46 PM · Origin-CRAN
vlorentz updated the task description for T2536: Investigate CRAN revisions without an origin.
Aug 27 2020, 10:59 AM · Origin-CRAN
vlorentz updated the task description for T2536: Investigate CRAN revisions without an origin.
Aug 27 2020, 9:49 AM · Origin-CRAN
vlorentz updated the task description for T2536: Investigate CRAN revisions without an origin.
Aug 27 2020, 12:08 AM · Origin-CRAN

Aug 26 2020

vlorentz updated the task description for T2536: Investigate CRAN revisions without an origin.
Aug 26 2020, 9:27 PM · Origin-CRAN
vlorentz updated the task description for T2536: Investigate CRAN revisions without an origin.
Aug 26 2020, 6:14 PM · Origin-CRAN
vlorentz updated the task description for T2536: Investigate CRAN revisions without an origin.
Aug 26 2020, 6:03 PM · Origin-CRAN
vlorentz renamed T2536: Investigate CRAN revisions without an origin from Investigate origin https://cran.r-project.org/package=mljar to Investigate CRAN revisions without an origin.
Aug 26 2020, 6:02 PM · Origin-CRAN
vlorentz updated the task description for T2536: Investigate CRAN revisions without an origin.
Aug 26 2020, 1:55 PM · Origin-CRAN
vlorentz triaged T2536: Investigate CRAN revisions without an origin as High priority.
Aug 26 2020, 1:53 PM · Origin-CRAN

Aug 24 2020

vlorentz added a comment to T2533: CRAN loader: set revision dates.

tbh, I only used one data point to claim it "always" sets it to None (0000d4ef5e166122aee6862ad38a18ce5386cc3e, which is the first CRAN commit in id order)

Aug 24 2020, 7:24 PM · Origin-CRAN
zack added a project to T2533: CRAN loader: set revision dates: Origin-CRAN.

(tag removed by mistake, adding it back)

Aug 24 2020, 5:49 PM · Origin-CRAN
ardumont added a comment to T2533: CRAN loader: set revision dates.

the CRAN loader always sets revision dates to None.

Aug 24 2020, 5:41 PM · Origin-CRAN
vlorentz updated the task description for T2533: CRAN loader: set revision dates.
Aug 24 2020, 5:28 PM · Origin-CRAN
vlorentz triaged T2533: CRAN loader: set revision dates as Normal priority.
Aug 24 2020, 5:10 PM · Origin-CRAN

Jan 22 2020

ardumont renamed T2241: lister/loader: Ingest archived artifacts from cran mirror from lister/loader: Ingest all known artifacts from cran mirror to lister/loader: Ingest archived artifacts from cran mirror.
Jan 22 2020, 10:46 AM · Core Loader, Lister, Origin-CRAN

Jan 21 2020

ardumont added a comment to T2241: lister/loader: Ingest archived artifacts from cran mirror.

This should take care of [1]

Jan 21 2020, 12:18 PM · Core Loader, Lister, Origin-CRAN
ardumont updated the task description for T2241: lister/loader: Ingest archived artifacts from cran mirror.
Jan 21 2020, 11:52 AM · Core Loader, Lister, Origin-CRAN
ardumont triaged T2241: lister/loader: Ingest archived artifacts from cran mirror as Normal priority.
Jan 21 2020, 11:52 AM · Core Loader, Lister, Origin-CRAN
ardumont closed T2029: cran lister: Align lister to output list of tarballs per origin as Resolved.

Deployed.

Jan 21 2020, 11:45 AM · Origin-CRAN, Archive coverage
ardumont closed T2029: cran lister: Align lister to output list of tarballs per origin, a subtask of T2026: Implement cran loader with package manager mechanism, as Resolved.
Jan 21 2020, 11:45 AM · Origin-CRAN, Archive coverage

Jan 17 2020

ardumont added a comment to T2029: cran lister: Align lister to output list of tarballs per origin.

The original description of this task was adapted by D2531 D2532 D2524.
A sample of what's been listed and ingested can be seen through the staging webapp instance [1].

Jan 17 2020, 12:35 PM · Origin-CRAN, Archive coverage
ardumont renamed T2029: cran lister: Align lister to output list of tarballs per origin from cran lister: Align lister to output list of tarballs per origin (if possible) to cran lister: Align lister to output list of tarballs per origin.
Jan 17 2020, 12:25 PM · Origin-CRAN, Archive coverage

Jan 16 2020

ardumont added a comment to P585 clean up obsolete cran visits and origins.

Dumps [1] stored on belvedere on file format:

Jan 16 2020, 3:17 PM · Origin-CRAN, Lister
ardumont added projects to P585 clean up obsolete cran visits and origins: Lister, Origin-CRAN.
Jan 16 2020, 3:02 PM · Origin-CRAN, Lister
ardumont added a comment to T2029: cran lister: Align lister to output list of tarballs per origin.

In the [2] page, there is an archive link (or something) which lists the old associated artifacts (so apriori, no more need for the mran mirror).

Jan 16 2020, 1:47 PM · Origin-CRAN, Archive coverage
olasd added a comment to T2029: cran lister: Align lister to output list of tarballs per origin.
Jan 16 2020, 1:44 PM · Origin-CRAN, Archive coverage
ardumont added a comment to T2029: cran lister: Align lister to output list of tarballs per origin.

Heads up.

Jan 16 2020, 11:27 AM · Origin-CRAN, Archive coverage

Jan 9 2020

ardumont closed T2026: Implement cran loader with package manager mechanism as Resolved.

Deployed.

Jan 9 2020, 1:48 PM · Origin-CRAN, Archive coverage

Jan 6 2020

ardumont closed D2463: cran loader: Add implementation.
Jan 6 2020, 3:11 PM · Origin-CRAN
swh-public-ci added a comment to D2463: cran loader: Add implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/302/ for more details.

Jan 6 2020, 3:03 PM · Origin-CRAN
ardumont updated the diff for D2463: cran loader: Add implementation.

Rebase to master

Jan 6 2020, 3:02 PM · Origin-CRAN
swh-public-ci added a comment to D2463: cran loader: Add implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/301/ for more details.

Jan 6 2020, 2:40 PM · Origin-CRAN
ardumont updated the diff for D2463: cran loader: Add implementation.

Rebase to latest origin/master

Jan 6 2020, 2:38 PM · Origin-CRAN
ardumont added a comment to D2463: cran loader: Add implementation.

Build has FAILED

Jan 6 2020, 2:36 PM · Origin-CRAN
swh-public-ci added a comment to D2463: cran loader: Add implementation.

Build has FAILED

Jan 6 2020, 2:32 PM · Origin-CRAN
swh-public-ci added a comment to D2463: cran loader: Add implementation.

Build has FAILED

Jan 6 2020, 2:31 PM · Origin-CRAN
Harbormaster failed remote builds in B9958: Diff 8862 for D2463: cran loader: Add implementation!
Jan 6 2020, 2:31 PM · Origin-CRAN
ardumont updated the diff for D2463: cran loader: Add implementation.
  • cran.loader: Simplify filename computation
Jan 6 2020, 2:30 PM · Origin-CRAN
ardumont added inline comments to D2463: cran loader: Add implementation.
Jan 6 2020, 2:26 PM · Origin-CRAN
ardumont added inline comments to D2463: cran loader: Add implementation.
Jan 6 2020, 2:23 PM · Origin-CRAN
douardda accepted D2463: cran loader: Add implementation.

did only a quick review, lgtm. Note however my comment on using path.basename() instead of path.split()[-1]

Jan 6 2020, 2:00 PM · Origin-CRAN

Dec 20 2019

ardumont updated the summary of D2463: cran loader: Add implementation.
Dec 20 2019, 11:01 AM · Origin-CRAN
swh-public-ci added a comment to D2463: cran loader: Add implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/291/ for more details.

Dec 20 2019, 10:51 AM · Origin-CRAN
ardumont updated the diff for D2463: cran loader: Add implementation.
  • Resolve revision from already seen artifacts
  • Improve loading tests
Dec 20 2019, 10:49 AM · Origin-CRAN
ardumont retitled D2463: cran loader: Add implementation from cran: Add loader implementation to cran loader: Add implementation.
Dec 20 2019, 10:00 AM · Origin-CRAN

Nov 26 2019

ardumont closed T2098: Deploy package loaders as Resolved.
Nov 26 2019, 5:28 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont updated the task description for T2098: Deploy package loaders.
Nov 26 2019, 5:28 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont closed T1389: Implement a base "package" loader for package managers as Resolved.
Nov 26 2019, 12:25 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont removed a parent task for T2098: Deploy package loaders: T1389: Implement a base "package" loader for package managers.
Nov 26 2019, 12:24 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont removed a subtask for T1389: Implement a base "package" loader for package managers: T2098: Deploy package loaders.
Nov 26 2019, 12:24 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont updated the task description for T2098: Deploy package loaders.
Nov 26 2019, 12:13 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont updated the task description for T2026: Implement cran loader with package manager mechanism.
Nov 26 2019, 11:39 AM · Origin-CRAN, Archive coverage