Change Details

Lister is deployed and ingestion started for the svn and git repositories [1] We need some more work for the mercurial loader and then start the ingestion for the mercurial repositories. This will track both the ingestion monitoring and the remaining actions to trigger the hg ingestion. When this is reasonably well on its way, say for example when the git and svn repositories are done, we need to update the logo in the main archive page [2] and add an entry in the archive changelog about it [3] [1] Status done out of total seen summary (out of [4] and [5] for the curious) ``` |------------+-------------------------------+-------------+--------+-------------------------------+-----------+---------| | Visit type | Status done (now) | Status done | Total | Total (now) | % Done | Remains | |------------+-------------------------------+-------------+--------+-------------------------------+-----------+---------| | git | 2021-07-22 07:15:46.763468+00 | 181500 | 181488 | 2021-07-22 07:36:27.463539+00 | 100.00661 | -12 | | svn | 2021-07-20 07:55:09.74254+00 | 101670 | 101881 | 2021-07-22 07:36:27.463539+00 | 99.792896 | 211 | | cvs | x | x | 28622 | 2021-07-22 07:36:27.463539+00 | x | x | | hg | x | x | 27645 | 2021-07-22 07:36:27.463539+00 | x | x | | bzr | x | x | 290 | 2021-07-22 07:36:27.463539+00 | x | x | |------------+-------------------------------+-------------+--------+-------------------------------+-----------+---------| #+TBLFM: @2$6=(100.0 * @2$3) / @2$4::@3$6=(100.0 * @3$3) / @3$4::@2$7=@2$4 - @2$3::@3$7=@3$4 - @3$3 ``` [2] https://archive.softwareheritage.org (integrated in D6004 already) [3] https://docs.softwareheritage.org/devel/archive-changelog.html (integrated in D5952) [4] count the listed origins: ``` softwareheritage-scheduler=> select now(), visit_type, count(*) from listed_origins lo inner join listers l on l.id=lo. lister_id where l.name='sourceforge' group by visit_type order by count(*) desc; ``` [5] count origins ``` softwareheritage=> select now(), count(*) from origin where url like 'https://git.code.sf.net%'; -- replace per `svn` ``` Limited to those origin types as we don't have any cvs nor bazar loader implementations.

Lister is deployed and ingestion started for the svn and git repositories [1] We need some more work for the mercurial loader and then start the ingestion for the mercurial repositories. This will track both the ingestion monitoring and the remaining actions to trigger the hg ingestion. When this is reasonably well on its way, say for example when the git and svn repositories are done, we need to update the logo in the main archive page [2] and add an entry in the archive changelog about it [3] [1] Status done out of total seen summary (out of [4] and [5] for the curious) ``` |------------+-------------------------------+-------------+--------+------------------------------+-----------+---------| | Visit type | Status done (now) | Status done | Total | Total (now) | % Done | Remains | |------------+-------------------------------+-------------+--------+------------------------------+-----------+---------| | git | 2021-07-30 08:06:15.578567+00 | 181658 | 181646 | 2021-07-30 08:06:26.37034+00 | 100.00661 | -12 | | svn | 2021-07-30 08:07:05.962362+00 | 101939 | 101894 | 2021-07-30 08:06:26.37034+00 | 100.04416 | -45 | | cvs | x | x | 28622 | 2021-07-30 08:06:26.37034+00 | x | x | | hg | 2021-07-30 08:05:32.979815+00 | 24160 | 27660 | 2021-07-30 08:06:26.37034+00 | 87.346349 | 3500 | | bzr | x | x | 290 | 2021-07-30 08:06:26.37034+00 | x | x | |------------+-------------------------------+-------------+--------+------------------------------+-----------+---------| #+TBLFM: @2$6=(100.0 * @2$3) / @2$4::@3$6=(100.0 * @3$3) / @3$4::@2$7=@2$4 - @2$3::@3$7=@3$4 - @3$3::@5$6=(100.0 * @5$3) / @5$4::@5$7=@5$4 - @5$3 ``` [2] https://archive.softwareheritage.org (integrated in D6004 already) [3] https://docs.softwareheritage.org/devel/archive-changelog.html (integrated in D5952) [4] count the listed origins: ``` softwareheritage-scheduler=> select now(), visit_type, count(*) from listed_origins lo inner join listers l on l.id=lo. lister_id where l.name='sourceforge' group by visit_type order by count(*) desc; ``` [5] count origins ``` softwareheritage=> select now(), count(*) from origin where url like 'https://git.code.sf.net%'; -- replace per `svn` ``` Limited to those origin types as we don't have any cvs nor bazar loader implementations.

Lister is deployed and ingestion started for the svn and git repositories [1] We need some more work for the mercurial loader and then start the ingestion for the mercurial repositories. This will track both the ingestion monitoring and the remaining actions to trigger the hg ingestion. When this is reasonably well on its way, say for example when the git and svn repositories are done, we need to update the logo in the main archive page [2] and add an entry in the archive changelog about it [3] [1] Status done out of total seen summary (out of [4] and [5] for the curious) ``` |------------+-------------------------------+-------------+--------+-------------------------------+-----------+---------| | Visit type | Status done (now) | Status done | Total | Total (now) || % Done | Remains | |------------+-------------------------------+-------------+--------+-------------------------------+-----------+---------| | git | 2021-07-22 07:15:46.76346830 08:06:15.578567+00 | 181500 181658 | 181488646 | 2021-07-22 07:36:27.46353930 08:06:26.37034+00 | 100.00661 | -12 | -12 | | svn | 2021-07-20 07:55:09.74254+00 | 101670 30 08:07:05.962362+00 | 101939 | 10188194 | 2021-07-22 07:36:27.46353930 08:06:26.37034+00 | 99.79289100.04416 | 211 | -45 | | cvs | x | x| x | 28622 | 2021-07-22 07:36:27.46353930 08:06:26.37034+00 | x | xx | |x | | hg | x | x2021-07-30 08:05:32.979815+00 | 24160 | 2764560 | 2021-07-22 07:36:27.46353930 08:06:26.37034+00 | x | x |87.346349 | 3500 | | bzr | x | x| x | 290 | 2021-07-22 07:36:27.46353930 08:06:26.37034+00 | x | xx | |x | |------------+-------------------------------+-------------+--------+-------------------------------+-----------+---------| #+TBLFM: @2$6=(100.0 * @2$3) / @2$4::@3$6=(100.0 * @3$3) / @3$4::@2$7=@2$4 - @2$3::@3$7=@3$4 - @3$3::@5$6=(100.0 * @5$3) / @5$4::@5$7=@5$4 - @5$3 ``` [2] https://archive.softwareheritage.org (integrated in D6004 already) [3] https://docs.softwareheritage.org/devel/archive-changelog.html (integrated in D5952) [4] count the listed origins: ``` softwareheritage-scheduler=> select now(), visit_type, count(*) from listed_origins lo inner join listers l on l.id=lo. lister_id where l.name='sourceforge' group by visit_type order by count(*) desc; ``` [5] count origins ``` softwareheritage=> select now(), count(*) from origin where url like 'https://git.code.sf.net%'; -- replace per `svn` ``` Limited to those origin types as we don't have any cvs nor bazar loader implementations.