Page MenuHomeSoftware Heritage
Create Task
Maniphest T1964

Timeout reached while assembling the requested bundle (Rocrail)
Closed, MigratedEdits Locked
Actions

Description

Hi,

today, I wanted to obtain a copy of Rocrail (formerly licensed under the GPL, now
closed source).

https://archive.softwareheritage.org/browse/origin/https://github.com/rocrail/Rocrail/directory/

Unfortunately, I received the following error:

You have requested the following bundle from the Software Heritage
Vault:

Object Type: revision_gitfast
Object ID: 85678b0d6c52d6fd0af50c8e493c74dd15a7115d

This bundle could not be cooked for the following reason:

Timeout reached while assembling the requested bundle

We apologize for the inconvenience.

-- 
The Software Heritage Developers

Anything you can do about this? I'd love to get a copy (git repo) of that project.

Thanks,
Mike

Related Objects

Event Timeline

sunweaver created this task.Aug 22 2019, 10:18 PM
sunweaver created this object in space S1 Public.
nahimilega added a subscriber: nahimilega.Aug 22 2019, 11:09 PM

I don't reproduce this error.

zack triaged this task as Normal priority.Aug 23 2019, 8:52 AM
zack added a project: Vault.
zack added a subscriber: zack.Aug 23 2019, 9:23 AM

I can totally reproduce this issue.

Mike: apologies, the gitfast download isn't really reliable ATM. However, I managed to find the most recent commit where the top-level license file was still GPL and cook it with the directory downloader. It's available here: https://archive.softwareheritage.org/api/1/vault/directory/d9d76591c8adc41d1c1ab9b7bc4d880653955d84/raw (You can also re-cook it yourself, it will either hit the cache or prepare it again, which should work.)

I hope this is enough to solve your immediate need. We'll keep this task open for the general unreliability of the gitfast downloader.

sunweaver added a comment.Aug 23 2019, 10:49 AM

Hi,

sunweaver added a comment.Aug 23 2019, 10:50 AM

Hi,

zack added a comment.Aug 23 2019, 10:59 AM

@sunweaver: did you see my answer above?

sunweaver added a comment.Aug 23 2019, 12:45 PM

@zack: Thanks for providing the tarball. However, I in fact need a tarred up Git repo until the moment that GPL was revoked, as I want to re-pulish it via GitLab (or Github). Do you think it is possible to get a copy of that git repo any time soon?

sunweaver added a comment.Aug 23 2019, 12:46 PM

@zack: the point about rocrail is that GPL was revoked without copyright holders' consent. And there is no most recent version public anymore these days.

zack added a comment.Aug 23 2019, 2:29 PM
In T1964#36396, @sunweaver wrote:

@zack: Thanks for providing the tarball. However, I in fact need a tarred up Git repo until the moment that GPL was revoked, as I want to re-pulish it via GitLab (or Github). Do you think it is possible to get a copy of that git repo any time soon?

I think so, yes, we'll do it ad-hoc for you.

zack added a subscriber: seirl.EditedSep 18 2019, 3:10 PM

So, this is now actually working (@rdicosmo just tried it again) *but* the bundle stops being assembled shortly before finishing due to a maximum size limit of ~500 MB:

You have requested the following bundle from the Software Heritage
Vault:

Object Type: revision_gitfast
Object ID: 85678b0d6c52d6fd0af50c8e493c74dd15a7115d

This bundle could not be cooked for the following reason:

The requested bundle exceeds the maximum allowed size of 536870912 bytes.

@seirl: can you bump the limit to, say, 1 GB ? That will most definitely be enough for this case, will help in many others, and it doesn't seem too crazy to have.

zack added a subscriber: rdicosmo.Sep 18 2019, 3:10 PM
olasd mentioned this in rSPSITE64aecec9df95: Make the max size for vault bundles 1GiB.Sep 18 2019, 6:15 PM
olasd added a subscriber: olasd.Sep 18 2019, 6:21 PM

I've bumped the limit to 1GB and sent a cook request again.

zack mentioned this in T885: Vault: use objstorage streaming to store and fetch bundles.Sep 19 2019, 12:15 PM
zack closed this task as Resolved.EditedSep 19 2019, 12:18 PM
zack claimed this task.

@sunweaver: the bundle is ready, in theory you should be able to obtain it like this:

$ wget https://archive.softwareheritage.org/api/1/vault/revision/85678b0d6c52d6fd0af50c8e493c74dd15a7115d/gitfast/raw/ -O 85678b0d6c52d6fd0af50c8e493c74dd15a7115d.gitfast.gz
$ git init
$ zcat 85678b0d6c52d6fd0af50c8e493c74dd15a7115d.gitfast.gz | git fast-import

I say in theory because (due to T885) download of large bundles is a bit flaky right now.

But we do have the bundle ready, it's "just" a streaming problem to retrieve it from the outside. So if you have trouble downloading, just let us know here and we'll make it available to you by some other means.

sunweaver added a comment.Sep 19 2019, 12:42 PM

Hi Zack,

sunweaver added a comment.Sep 19 2019, 12:52 PM

The previous mail reply got truncated...

The download process is stuck with this...

[mike@minobo rocrail-upstream]$ wget https://archive.softwareheritage.org/api/1/vault/revision/85678b0d6c52d6fd0af50c8e493c74dd15a7115d/gitfast/raw/ -O 85678b0d6c52d6fd0af50c8e493c74dd15a7115d.gitfast.gz
--2019-09-19 12:40:44--  https://archive.softwareheritage.org/api/1/vault/revision/85678b0d6c52d6fd0af50c8e493c74dd15a7115d/gitfast/raw/
Resolving archive.softwareheritage.org (archive.softwareheritage.org)... 128.93.193.31
Connecting to archive.softwareheritage.org (archive.softwareheritage.org)|128.93.193.31|:443... connected.
HTTP request sent, awaiting response...

Mike

zack added a comment.Sep 19 2019, 1:56 PM

@sunweaver here it is then: https://annex.softwareheritage.org/public/scratch/36489f4afbc3d2d3a43bf00d79f03deb4e9ed5f7.gz

tenma moved this task from Backlog to Done on the Vault board.Oct 16 2020, 11:33 AM
ardumont mentioned this in T2965: Adapt storage to actually write the visit_type in the origin_visit_status topic.Jan 13 2021, 9:47 AM
gitlab-migration changed the task status from Resolved to Migrated.Jan 8 2023, 4:28 PM
gitlab-migration claimed this task.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

About · Developer information · Legal