Page MenuHomeSoftware Heritage

Origin-GoogleCodeTag
ActivePublic

Members

  • This project does not have any members.
  • View All

Watchers

  • This project does not have any watchers.
  • View All

Recent Activity

Jan 8 2023

gitlab-migration closed T958: googlecode import: Clean up googlecode origin's origin_visits, a subtask of T617: ingest Google Code Subversion repositories, as Migrated.
Jan 8 2023, 10:21 PM · Archive coverage, Origin-GoogleCode, SVN Loader
gitlab-migration closed T958: googlecode import: Clean up googlecode origin's origin_visits as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:21 PM · SVN Loader, Origin-GoogleCode, Archive content
gitlab-migration changed the status of T948: googlecode import: Loading failure on symbolic link edge cases, a subtask of T879: Reschedule googlecode svn origins from scratch, from Resolved to Migrated.
Jan 8 2023, 9:57 PM · Origin-GoogleCode, SVN Loader, Archive content
gitlab-migration changed the status of T955: googlecode import: hglib.error.CommandError during loading from Wontfix to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Origin-GoogleCode, Archive content, Mercurial loader
gitlab-migration changed the status of T947: googlecode import: Some dumps are just empty repository from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Origin-GoogleCode, SVN Loader, Archive content
gitlab-migration changed the status of T948: googlecode import: Loading failure on symbolic link edge cases from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Origin-GoogleCode, SVN Loader, Archive content
gitlab-migration changed the status of T947: googlecode import: Some dumps are just empty repository, a subtask of T879: Reschedule googlecode svn origins from scratch, from Resolved to Migrated.
Jan 8 2023, 9:57 PM · Origin-GoogleCode, SVN Loader, Archive content
gitlab-migration changed the status of T896: Clean up wrong origins, a subtask of T879: Reschedule googlecode svn origins from scratch, from Resolved to Migrated.
Jan 8 2023, 9:57 PM · Origin-GoogleCode, SVN Loader, Archive content
gitlab-migration changed the status of T896: Clean up wrong origins from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Origin-GoogleCode, SVN Loader, Archive content
gitlab-migration changed the status of T879: Reschedule googlecode svn origins from scratch, a subtask of T617: ingest Google Code Subversion repositories, from Resolved to Migrated.
Jan 8 2023, 9:57 PM · Archive coverage, Origin-GoogleCode, SVN Loader
gitlab-migration changed the status of T879: Reschedule googlecode svn origins from scratch from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Origin-GoogleCode, SVN Loader, Archive content
gitlab-migration changed the status of T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading, a subtask of T879: Reschedule googlecode svn origins from scratch, from Resolved to Migrated.
Jan 8 2023, 4:24 PM · Origin-GoogleCode, SVN Loader, Archive content
gitlab-migration changed the status of T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:24 PM · Origin-GoogleCode, SVN Loader
gitlab-migration changed the status of T876: loader-svn: Reschedule origins with missing data from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:23 PM · Origin-GoogleCode, SVN Loader
gitlab-migration changed the status of T863: loader-svn: Fix origin clashes for homonym but distinct svn dumps from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:23 PM · Origin-GoogleCode, SVN Loader
gitlab-migration changed the status of T847: loader-svn: Some SVN origins have occurrences that point to non-existent objects, a subtask of T617: ingest Google Code Subversion repositories, from Resolved to Migrated.
Jan 8 2023, 4:23 PM · Archive coverage, Origin-GoogleCode, SVN Loader
gitlab-migration changed the status of T676: Google Code SVN import: Examine ingestion logs for errors and list them if any, a subtask of T617: ingest Google Code Subversion repositories, from Resolved to Migrated.
Jan 8 2023, 4:20 PM · Archive coverage, Origin-GoogleCode, SVN Loader
gitlab-migration changed the status of T617: ingest Google Code Subversion repositories from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:20 PM · Archive coverage, Origin-GoogleCode, SVN Loader
gitlab-migration changed the status of T328: svn / subversion loader, a subtask of T617: ingest Google Code Subversion repositories, from Resolved to Migrated.
Jan 8 2023, 4:18 PM · Archive coverage, Origin-GoogleCode, SVN Loader

Nov 25 2020

zack closed T617: ingest Google Code Subversion repositories as Resolved.
Nov 25 2020, 1:49 PM · Archive coverage, Origin-GoogleCode, SVN Loader

Jul 3 2019

ardumont placed T617: ingest Google Code Subversion repositories up for grabs.
Jul 3 2019, 3:26 PM · Archive coverage, Origin-GoogleCode, SVN Loader
ardumont placed T958: googlecode import: Clean up googlecode origin's origin_visits up for grabs.
Jul 3 2019, 3:26 PM · SVN Loader, Origin-GoogleCode, Archive content

May 25 2019

zack closed T328: svn / subversion loader, a subtask of T617: ingest Google Code Subversion repositories, as Resolved.
May 25 2019, 5:01 PM · Archive coverage, Origin-GoogleCode, SVN Loader

Sep 30 2018

ardumont added a comment to T958: googlecode import: Clean up googlecode origin's origin_visits.

And also make sure the one visit date is the right one:

Sep 30 2018, 11:39 AM · SVN Loader, Origin-GoogleCode, Archive content

Sep 28 2018

ardumont closed T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading as Resolved.
Sep 28 2018, 3:04 PM · Origin-GoogleCode, SVN Loader
ardumont closed T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading, a subtask of T879: Reschedule googlecode svn origins from scratch, as Resolved.
Sep 28 2018, 3:04 PM · Origin-GoogleCode, SVN Loader, Archive content
ardumont added a comment to T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.
  • new loader svn packaged and deployed
  • origins in error scheduled back
  • workers logs (kibana dashboard) [1]
Sep 28 2018, 3:04 PM · Origin-GoogleCode, SVN Loader

Sep 27 2018

ardumont renamed T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading from loader-svn: googlecode import: UnicodeDecodeError in user svn properties to loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.
Sep 27 2018, 6:12 PM · Origin-GoogleCode, SVN Loader
ardumont renamed T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading from loader-svn: googlecode import: UnicodeDecodeError to loader-svn: googlecode import: UnicodeDecodeError in user svn properties.
Sep 27 2018, 6:12 PM · Origin-GoogleCode, SVN Loader
ardumont added a comment to T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.

Ok, so going for that fix.

Sep 27 2018, 4:51 PM · Origin-GoogleCode, SVN Loader
ardumont added a comment to T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.

\m/

Sep 27 2018, 4:48 PM · Origin-GoogleCode, SVN Loader
anlambert added a comment to T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.

So here are the results:

Sep 27 2018, 4:43 PM · Origin-GoogleCode, SVN Loader
anlambert added a comment to T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.

I was trying to play with your Python scripts to query kibana logs but it's been a while since I
did not write a query for elastic search and their json format is still awful.

Sep 27 2018, 4:24 PM · Origin-GoogleCode, SVN Loader
ardumont added a comment to T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.

Today is not a good day for me ;)

Sep 27 2018, 3:53 PM · Origin-GoogleCode, SVN Loader
ardumont added a comment to T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.

Great to have kibana back!

Sep 27 2018, 3:15 PM · Origin-GoogleCode, SVN Loader
anlambert added a comment to T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.

Another try with another svn repo gives me the following output:

Sep 27 2018, 2:37 PM · Origin-GoogleCode, SVN Loader
anlambert added a comment to T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.

Great to have kibana back!

Sep 27 2018, 2:29 PM · Origin-GoogleCode, SVN Loader
ardumont added a comment to T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.

I had to configure back the new kibana0 (was banco before) to start parsing those logs back.

Sep 27 2018, 1:56 PM · Origin-GoogleCode, SVN Loader
ardumont added a comment to T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.

This issue is reproduced on 6 repositories (so far, still running locally on some other big repositories).

To my old self, what are those other 5 repositories?

Sep 27 2018, 10:50 AM · Origin-GoogleCode, SVN Loader

Sep 25 2018

ardumont renamed T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading from googlecode import: UnicodeDecodeError to loader-svn: googlecode import: UnicodeDecodeError.
Sep 25 2018, 2:18 PM · Origin-GoogleCode, SVN Loader
ardumont added a comment to T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.

Digging deeper to try and improve the result to return (at the moment, empty string).
I tried to use chardet to detect the language to try and decode the bytes.
This fails as nothing appropriate is found.

Sep 25 2018, 2:18 PM · Origin-GoogleCode, SVN Loader
ardumont added a comment to T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.

By analyzing the repository dump file in emacs

Sep 25 2018, 2:18 PM · Origin-GoogleCode, SVN Loader
anlambert added a comment to T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.

Thinking a bit more about the issue, there might a way to workaround it in our client code instead
of hacking in subvertpy.

Sep 25 2018, 2:18 PM · Origin-GoogleCode, SVN Loader

Sep 24 2018

anlambert added a comment to T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.

Tracking down the issue in subvertpy source code, the error occurs in the subvertpy._ra C extension module.
More precisely, an exception is raised at line 1068 in file subvertpy/editor.c when Python tries to decode a svn property value from 'utf-8' encoding.

1062  static svn_error_t *py_cb_editor_change_prop(void *dir_baton, const char *name, const svn_string_t *value, apr_pool_t *pool)
1063  {
1064          PyObject *self = (PyObject *)dir_baton, *ret;
1065          PyGILState_STATE state = PyGILState_Ensure();
1066
1067          if (value != NULL) {
1068                  ret = PyObject_CallMethod(self, "change_prop", "sz#", name, value->data, value->len);
1069          } else {
1070                  ret = PyObject_CallMethod(self, "change_prop", "sO", name, Py_None);
1071          }
1072          CB_CHECK_PYRETVAL(ret);
1073          Py_DECREF(ret);
1074          PyGILState_Release(state);
1075          return NULL;
1076  }
Sep 24 2018, 4:55 PM · Origin-GoogleCode, SVN Loader
ardumont added a comment to T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading.

(If you are not interested in details, no need to look further, it's a run extract ;)

Sep 24 2018, 4:24 PM · Origin-GoogleCode, SVN Loader
ardumont lowered the priority of T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading from High to Normal.

This one is still true. Still banging my head on this.

Sep 24 2018, 4:14 PM · Origin-GoogleCode, SVN Loader

Sep 19 2018

ardumont closed T879: Reschedule googlecode svn origins from scratch, a subtask of T617: ingest Google Code Subversion repositories, as Resolved.
Sep 19 2018, 1:56 PM · Archive coverage, Origin-GoogleCode, SVN Loader
ardumont closed T879: Reschedule googlecode svn origins from scratch as Resolved.

That's been done for a while now.

Sep 19 2018, 1:56 PM · Origin-GoogleCode, SVN Loader, Archive content

Jun 19 2018

zack edited projects for T617: ingest Google Code Subversion repositories, added: Archive coverage; removed Archive content.
Jun 19 2018, 3:28 PM · Archive coverage, Origin-GoogleCode, SVN Loader

Feb 14 2018

ardumont closed T955: googlecode import: hglib.error.CommandError during loading as Wontfix.

I close this as another mirror exists that we already browsed multiple times.

Feb 14 2018, 10:23 AM · Origin-GoogleCode, Archive content, Mercurial loader