Page MenuHomeSoftware Heritage

Cannot ingest git repositories with (too) large packfiles
Closed, MigratedEdits Locked

Description

There exists origins whose packfiles when ingested would fail ingestion because the packfiles retrieved is too big.

One example si the chromium repository: https://github.com/chromium/chromium

We need to be able to ingest those as well.

We should consider fetching the missing data into packfiles instead of a large one.

Event Timeline

ardumont triaged this task as Normal priority.Oct 14 2021, 10:29 AM
ardumont created this task.
zack renamed this task from Ingest git loader origins with smaller packfiles to Cannot ingest git repositories with (too) large packfiles.Apr 29 2022, 4:00 PM
zack updated the task description. (Show Details)