Page MenuHomeSoftware Heritage
Feed Advanced Search

Advanced Search
Use Results
Hide Query

Dec 3 2021

anlambert added a comment to T2400: Ingest current and historical Ubuntu releases.

I also tested the listing of Linux Mint source packages. Apart a small fix to add to the lister (D6741), the listing went fine:

(swh) ✘-1 ~/swh/swh-environment/docker [master|✚ 1⚑ 41] 
14:22 $ docker-compose exec swh-scheduler swh scheduler task add list-debian-distribution -p oneshot distribution=LinuxMint mirror_url=https://mirror.crexio.com/linuxmint/packages/ suites="[betsy, cindy, debbie, debian, elyssa, felicia, gloria, helena, helena-fluxbox, helena-kde, helena-lxde, helena-xfce, isadora, isadora-fluxbox, isadora-kde, isadora-lxde, isadora-xfce, julia, julia-fluxbox, julia-kde, julia-lxde, julia-xfce, katya, katya-fluxbox, katya-kde, katya-lxde, lisa, lisa-kde, lisa-lxde, maya, nadia, olivia, petra, qiana, rafaela, rebecca, romeo, rosa, sarah, serena, sonya, sylvia, tara, tessa, tina, tricia, ulyana, ulyssa, uma, una]" components="[backport, debian, import, incoming, main, romeo, upstream]"
Dec 3 2021, 2:36 PM · System administration, Debian loader, Package Loader, Archive coverage
anlambert requested review of D6741: debian: Do not raise when a component cannot be found for a suite.
Dec 3 2021, 2:34 PM
anlambert added a comment to T2400: Ingest current and historical Ubuntu releases.

After trying to list and load ubuntu packages in the docker environment, I found a couple of issues in the debian lister and loader that were preventing succcessful listing and loading.
Those issues have been fixed in D6735, D6737 and D6738.

Dec 3 2021, 1:58 PM · System administration, Debian loader, Package Loader, Archive coverage
anlambert closed D6738: debian: Update extra_loader_arguments dict produced ListedOrigin models.
Dec 3 2021, 11:39 AM
anlambert closed D6735: debian: Add missing file URIs in lister output.
Dec 3 2021, 11:39 AM
anlambert committed rDLS46425917c25e: debian: Add missing file URIs in lister output (authored by anlambert).
debian: Add missing file URIs in lister output
Dec 3 2021, 11:39 AM
anlambert committed rDLS4ff3e44643f3: debian: Update extra_loader_arguments dict produced ListedOrigin models (authored by anlambert).
debian: Update extra_loader_arguments dict produced ListedOrigin models
Dec 3 2021, 11:39 AM
anlambert committed rDLDBASE3e675d0d70c5: debian/tasks: Rename loading task function to fix scheduling (authored by anlambert).
debian/tasks: Rename loading task function to fix scheduling
Dec 3 2021, 11:38 AM
anlambert committed rDLDBASE22478fa8a0a4: package/debian: Handle extra sha1 sum in source package metadata (authored by anlambert).
package/debian: Handle extra sha1 sum in source package metadata
Dec 3 2021, 11:38 AM
anlambert closed D6737: debian: Fix a couple of issues in the loader.
Dec 3 2021, 11:38 AM
anlambert committed rDLDBASEb423b682df36: debian: Remove unused date parameter of DebianLoader (authored by anlambert).
debian: Remove unused date parameter of DebianLoader
Dec 3 2021, 11:38 AM
anlambert requested review of D6737: debian: Fix a couple of issues in the loader.
Dec 3 2021, 11:24 AM
anlambert requested review of D6738: debian: Update extra_loader_arguments dict produced ListedOrigin models.
Dec 3 2021, 11:22 AM
anlambert added a revision to T2400: Ingest current and historical Ubuntu releases: D6738: debian: Update extra_loader_arguments dict produced ListedOrigin models.
Dec 3 2021, 11:19 AM · System administration, Debian loader, Package Loader, Archive coverage
anlambert added a revision to T2400: Ingest current and historical Ubuntu releases: D6737: debian: Fix a couple of issues in the loader.
Dec 3 2021, 11:18 AM · System administration, Debian loader, Package Loader, Archive coverage

Dec 2 2021

anlambert requested review of D6735: debian: Add missing file URIs in lister output.
Dec 2 2021, 5:34 PM
anlambert added a revision to T2400: Ingest current and historical Ubuntu releases: D6735: debian: Add missing file URIs in lister output.
Dec 2 2021, 5:31 PM · System administration, Debian loader, Package Loader, Archive coverage
anlambert committed rDENV3f70e3870faa: docker/conf/loader: Add missing LoadNixguix task (authored by anlambert).
docker/conf/loader: Add missing LoadNixguix task
Dec 2 2021, 4:58 PM
anlambert accepted D6731: api: Specify date formats more precisely.
Dec 2 2021, 4:19 PM
anlambert accepted D6730: api: Fix documentation of the format used for git date fields.
Dec 2 2021, 4:19 PM
anlambert created P1228 (An Untitled Masterwork).
Dec 2 2021, 2:46 PM
anlambert closed D6726: ra: Fix error when processing svn link on directory.
Dec 2 2021, 2:31 PM
anlambert committed rDLDSVNd8c5e8095fd4: ra: Fix error when processing svn link on directory (authored by anlambert).
ra: Fix error when processing svn link on directory
Dec 2 2021, 2:31 PM
anlambert requested review of D6726: ra: Fix error when processing svn link on directory.
Dec 2 2021, 1:41 PM
anlambert closed D6725: ra: Add typing.
Dec 2 2021, 11:29 AM
anlambert committed rDLDSVN90decdc13411: ra: Add typing (authored by anlambert).
ra: Add typing
Dec 2 2021, 11:29 AM
anlambert requested review of D6725: ra: Add typing.
Dec 2 2021, 11:13 AM
anlambert closed D6722: ra: Rework export of non link file with svn:special property set.
Dec 2 2021, 10:56 AM
anlambert committed rDLDSVN50e87d1d028d: ra: Rework export of non link file with svn:special property set (authored by anlambert).
ra: Rework export of non link file with svn:special property set
Dec 2 2021, 10:56 AM
anlambert closed D6721: loader: Clean replay directory before post_load operation.
Dec 2 2021, 10:55 AM
anlambert committed rDLDSVN5cbfe6d03fe0: loader: Clean replay directory before post_load operation (authored by anlambert).
loader: Clean replay directory before post_load operation
Dec 2 2021, 10:55 AM
anlambert added inline comments to D6721: loader: Clean replay directory before post_load operation.
Dec 2 2021, 10:55 AM
anlambert added inline comments to D6722: ra: Rework export of non link file with svn:special property set.
Dec 2 2021, 10:52 AM

Dec 1 2021

anlambert added inline comments to D6722: ra: Rework export of non link file with svn:special property set.
Dec 1 2021, 8:01 PM
anlambert requested review of D6722: ra: Rework export of non link file with svn:special property set.
Dec 1 2021, 8:00 PM
anlambert added a revision to T3695: Investigate revision reconstruction discrepancy with subversion export: D6722: ra: Rework export of non link file with svn:special property set.
Dec 1 2021, 7:58 PM · SVN Loader
anlambert requested review of D6721: loader: Clean replay directory before post_load operation.
Dec 1 2021, 6:56 PM
anlambert committed rDWAPPS284eec7e758c: tests: Fix failures since pytest-django 4.5.0 release (authored by anlambert).
tests: Fix failures since pytest-django 4.5.0 release
Dec 1 2021, 6:47 PM
anlambert closed D6718: tests: Fix failures since pytest-django 4.5.0 release.
Dec 1 2021, 6:47 PM
anlambert requested review of D6718: tests: Fix failures since pytest-django 4.5.0 release.
Dec 1 2021, 5:31 PM
anlambert closed D6711: browse: Fix issues when context is a release targeting a directory.
Dec 1 2021, 4:02 PM
anlambert committed rDWAPPS5d3515436646: browse: Fix issues when context is a release targeting a directory (authored by anlambert).
browse: Fix issues when context is a release targeting a directory
Dec 1 2021, 4:02 PM
anlambert requested review of D6711: browse: Fix issues when context is a release targeting a directory.
Dec 1 2021, 2:56 PM
anlambert committed rDWAPPS3ff49a05ce9b: templates/fundraising-banner: Improve banner rendering (authored by anlambert).
templates/fundraising-banner: Improve banner rendering
Dec 1 2021, 12:06 PM
anlambert committed rDAUTHfc767b791979: django/backends: Add missing exception capture by sentry (authored by anlambert).
django/backends: Add missing exception capture by sentry
Dec 1 2021, 11:57 AM

Nov 29 2021

anlambert committed rDWAPPS98cc00e5d9f4: templates/fundraising-banner: Polish banner rendering (authored by anlambert).
templates/fundraising-banner: Polish banner rendering
Nov 29 2021, 7:18 PM
anlambert closed D6707: webapp: Add give API credentials in configuration.
Nov 29 2021, 5:33 PM
anlambert committed rSPSITEe9707c0887b0: webapp: Add give API credentials in configuration (authored by anlambert).
webapp: Add give API credentials in configuration
Nov 29 2021, 5:33 PM
anlambert requested review of D6707: webapp: Add give API credentials in configuration.
Nov 29 2021, 5:29 PM
anlambert committed rDWAPPS1da1be1bfa42: misc: Add a fundraising banner that can be integrated through an iframe (authored by anlambert).
misc: Add a fundraising banner that can be integrated through an iframe
Nov 29 2021, 4:01 PM
anlambert committed rDWAPPS29397e83a859: package.json: Upgrade dependencies (authored by anlambert).
package.json: Upgrade dependencies
Nov 29 2021, 4:01 PM
anlambert closed D6704: ra: Fix parsing of svn link with multiple lines.
Nov 29 2021, 2:37 PM
anlambert committed rDLDSVNd0b14d9d08c8: ra: Fix parsing of svn link with multiple lines (authored by anlambert).
ra: Fix parsing of svn link with multiple lines
Nov 29 2021, 2:37 PM
anlambert added inline comments to D6704: ra: Fix parsing of svn link with multiple lines.
Nov 29 2021, 2:35 PM
anlambert requested review of D6704: ra: Fix parsing of svn link with multiple lines.
Nov 29 2021, 1:31 PM
anlambert added a revision to T3695: Investigate revision reconstruction discrepancy with subversion export: D6704: ra: Fix parsing of svn link with multiple lines.
Nov 29 2021, 1:27 PM · SVN Loader
anlambert closed D6702: ra: Persist link flag in FileState when replaying revisions.
Nov 29 2021, 1:21 PM
anlambert committed rDLDSVNc2c27f1de847: ra: Persist link flag in FileState when replaying revisions (authored by anlambert).
ra: Persist link flag in FileState when replaying revisions
Nov 29 2021, 1:21 PM
anlambert updated the diff for D6702: ra: Persist link flag in FileState when replaying revisions.

Use variable to store if path is a link

Nov 29 2021, 1:16 PM
anlambert added inline comments to D6702: ra: Persist link flag in FileState when replaying revisions.
Nov 29 2021, 12:29 PM
anlambert requested review of D6702: ra: Persist link flag in FileState when replaying revisions.
Nov 29 2021, 11:54 AM
anlambert closed D6691: common/archive: Add lookup_origin_snapshots function.
Nov 29 2021, 11:48 AM
anlambert committed rDWAPPSd7f3a3a4f8ce: common/archive: Add lookup_origin_snapshots function (authored by anlambert).
common/archive: Add lookup_origin_snapshots function
Nov 29 2021, 11:47 AM
anlambert added a revision to T3695: Investigate revision reconstruction discrepancy with subversion export: D6702: ra: Persist link flag in FileState when replaying revisions.
Nov 29 2021, 11:43 AM · SVN Loader
anlambert updated the diff for D6691: common/archive: Add lookup_origin_snapshots function.

Rebase

Nov 29 2021, 11:27 AM
anlambert updated the diff for D6691: common/archive: Add lookup_origin_snapshots function.

Update docstring

Nov 29 2021, 10:59 AM

Nov 26 2021

anlambert closed D6698: ra: Persist path executable flag in FileState when replaying revisions.
Nov 26 2021, 5:14 PM
anlambert committed rDLDSVN4bae0f9315d8: ra: Persist path executable flag in FileState when replaying revisions (authored by anlambert).
ra: Persist path executable flag in FileState when replaying revisions
Nov 26 2021, 5:14 PM
anlambert requested review of D6698: ra: Persist path executable flag in FileState when replaying revisions.
Nov 26 2021, 5:10 PM
anlambert added a revision to T3695: Investigate revision reconstruction discrepancy with subversion export: D6698: ra: Persist path executable flag in FileState when replaying revisions.
Nov 26 2021, 5:08 PM · SVN Loader
anlambert accepted D6694: Fix for snapshot content redirection.
Nov 26 2021, 3:10 PM
anlambert added a comment to D6691: common/archive: Add lookup_origin_snapshots function.
In D6691#174048, @vlorentz wrote:

Where is it called from?

Nov 26 2021, 1:37 PM

Nov 25 2021

anlambert requested review of D6691: common/archive: Add lookup_origin_snapshots function.
Nov 25 2021, 4:19 PM
anlambert added a revision to T3631: Make snapshot query parameter mandatory when browsing objects in an origin context: D6691: common/archive: Add lookup_origin_snapshots function.
Nov 25 2021, 4:01 PM · Web app
anlambert closed D6690: svn: Use a temporary directory when checking if history got altered.
Nov 25 2021, 3:22 PM
anlambert committed rDLDSVNed3c0c986bfb: svn: Use a temporary directory when checking if history got altered (authored by anlambert).
svn: Use a temporary directory when checking if history got altered
Nov 25 2021, 3:22 PM
anlambert updated the diff for D6690: svn: Use a temporary directory when checking if history got altered.

Update: Address @ardumont comments

Nov 25 2021, 3:19 PM
anlambert added inline comments to D6690: svn: Use a temporary directory when checking if history got altered.
Nov 25 2021, 3:17 PM
anlambert requested review of D6690: svn: Use a temporary directory when checking if history got altered.
Nov 25 2021, 2:35 PM
anlambert added a revision to T3747: svn: FileExistsError when creating directory: D6690: svn: Use a temporary directory when checking if history got altered.
Nov 25 2021, 2:33 PM · SVN Loader
anlambert closed D6688: test_serializers: Fix failing test since msgpack-python 1.0.3 release.
Nov 25 2021, 11:12 AM
anlambert committed rDCORE51fd3073f938: test_serializers: Fix failing test since msgpack-python 1.0.3 release (authored by anlambert).
test_serializers: Fix failing test since msgpack-python 1.0.3 release
Nov 25 2021, 11:12 AM
anlambert updated the diff for D6688: test_serializers: Fix failing test since msgpack-python 1.0.3 release.

Remove debian folder added by mistake

Nov 25 2021, 11:05 AM
anlambert requested review of D6688: test_serializers: Fix failing test since msgpack-python 1.0.3 release.
Nov 25 2021, 11:04 AM

Nov 24 2021

anlambert closed D6681: misc/iframe: Fix archive link when there is no snapshot context.
Nov 24 2021, 3:35 PM
anlambert committed rDWAPPS20a9d1855929: misc/iframe: Fix archive link when there is no snapshot context (authored by anlambert).
misc/iframe: Fix archive link when there is no snapshot context
Nov 24 2021, 3:35 PM
anlambert requested changes to D6640: Add a button to the deposit admin UI to show deposit metadata.

Looks good but some cosmetic improvements can be added, notably:

  • use a dedicated column in the table to display the "Show metadata" button
  • highlight metadata xml code
  • restrain the height of of the popover dialog to avoid overflow when metadata file is large
Nov 24 2021, 2:55 PM
anlambert requested review of D6681: misc/iframe: Fix archive link when there is no snapshot context.
Nov 24 2021, 12:17 PM

Nov 23 2021

anlambert committed rDWAPPS2a646e0e19fe: assets/guided_tour: Improve some sentences based on tester feedbacks (authored by anlambert).
assets/guided_tour: Improve some sentences based on tester feedbacks
Nov 23 2021, 3:53 PM

Nov 19 2021

anlambert closed D6662: loader: Apply SvnLoaderFromRemoteDump optimization only for stale repos.
Nov 19 2021, 12:00 PM
anlambert closed D6661: svn: Ensure proper incremental loading of a repository.
Nov 19 2021, 12:00 PM
anlambert committed rDLDSVNed0728c8b02e: svn: Ensure proper incremental loading of a repository (authored by anlambert).
svn: Ensure proper incremental loading of a repository
Nov 19 2021, 12:00 PM
anlambert committed rDLDSVN0e725edbc31a: loader: Apply SvnLoaderFromRemoteDump optimization only for stale repos (authored by anlambert).
loader: Apply SvnLoaderFromRemoteDump optimization only for stale repos
Nov 19 2021, 12:00 PM
anlambert closed D6660: loader: Ensure to reload from first revision when history got altered.
Nov 19 2021, 12:00 PM
anlambert committed rDLDSVNc9aaa314df27: loader: Ensure to reload from first revision when history got altered (authored by anlambert).
loader: Ensure to reload from first revision when history got altered
Nov 19 2021, 12:00 PM
anlambert requested review of D6662: loader: Apply SvnLoaderFromRemoteDump optimization only for stale repos.
Nov 19 2021, 10:55 AM
anlambert requested review of D6661: svn: Ensure proper incremental loading of a repository.
Nov 19 2021, 10:54 AM
anlambert requested review of D6660: loader: Ensure to reload from first revision when history got altered.
Nov 19 2021, 10:53 AM

Nov 18 2021

anlambert closed D6658: loader: Optimize SvnLoaderFromRemoteDump use on stale repository.
Nov 18 2021, 7:03 PM
anlambert committed rDLDSVN0237d07b1747: loader: Optimize SvnLoaderFromRemoteDump use on stale repository (authored by anlambert).
loader: Optimize SvnLoaderFromRemoteDump use on stale repository
Nov 18 2021, 7:03 PM
First
Prev
Next
About · Developer information · Legal