Page MenuHomeSoftware Heritage
Feed Advanced Search

Mar 22 2022

douardda updated the diff for D7386: Use the same 'id' column name everywhere in ORC files.

rebase

Mar 22 2022, 3:49 PM
douardda updated the diff for D7385: Write related ORC files in the same directory using the same UUID.

rebase

Mar 22 2022, 3:49 PM
douardda updated the diff for D7384: Add some user metadata in generated ORC files.

rebase

Mar 22 2022, 3:48 PM
douardda updated the diff for D7383: Implement test_orc exporter as a simple function instead of a fixture.

rebase

Mar 22 2022, 3:48 PM
douardda updated the diff for D7382: Make the kafka group_id prefix configurable in the config file.

rebase

Mar 22 2022, 3:47 PM
douardda updated the diff for D7381: Use a named logger for journalprocessor.py.

rebase

Mar 22 2022, 3:47 PM
douardda updated the diff for D7380: Update JournalClientOffsetRanges for swh.journal 0.9.

rebase

Mar 22 2022, 3:47 PM
douardda updated the diff for D7379: Encode TimestampWithTimezone as (sec, usec, offset) in ORC file.

Update the encoding of TimestampWithTimezone to keep the timestamp part as an ORC timestamp

Mar 22 2022, 3:46 PM
douardda accepted D7400: Add support for None as author or committer of a Revision.

I would got for the more compact version of the code in from_dict, otherwise lgtm.

Mar 22 2022, 12:07 PM
douardda added inline comments to D7400: Add support for None as author or committer of a Revision.
Mar 22 2022, 12:05 PM
douardda added inline comments to D7400: Add support for None as author or committer of a Revision.
Mar 22 2022, 12:04 PM

Mar 21 2022

douardda added inline comments to D6990: Add partial implementation of `ArchiveGraph` class.
Mar 21 2022, 5:28 PM
douardda added inline comments to D6990: Add partial implementation of `ArchiveGraph` class.
Mar 21 2022, 5:18 PM
douardda added inline comments to D6990: Add partial implementation of `ArchiveGraph` class.
Mar 21 2022, 5:16 PM
douardda added inline comments to D6990: Add partial implementation of `ArchiveGraph` class.
Mar 21 2022, 5:11 PM
douardda added inline comments to D6990: Add partial implementation of `ArchiveGraph` class.
Mar 21 2022, 5:07 PM
douardda updated the task description for T3415: Specify the Vitam archiving format.
Mar 21 2022, 10:18 AM

Mar 18 2022

douardda added inline comments to D7389: Add the raw_manifest column for revision, release and directory ORC files.
Mar 18 2022, 4:11 PM
douardda added a comment to D7388: Export revision extra headers in a dedicated ORC file.

couldn't it be an extra column in the revision export? I haven't seen any long extra header on revisions

Mar 18 2022, 4:10 PM
douardda updated the summary of D7388: Export revision extra headers in a dedicated ORC file.
Mar 18 2022, 4:08 PM
douardda added a comment to D7386: Use the same 'id' column name everywhere in ORC files.

Why? This may lead to confusion

Mar 18 2022, 4:05 PM
douardda added inline comments to D7382: Make the kafka group_id prefix configurable in the config file.
Mar 18 2022, 3:57 PM
douardda updated the diff for D7389: Add the raw_manifest column for revision, release and directory ORC files.

rebase

Mar 18 2022, 3:52 PM
douardda updated the diff for D7388: Export revision extra headers in a dedicated ORC file.

rebase

Mar 18 2022, 3:50 PM
douardda updated the diff for D7387: Add the type fields for revision and origin_visit_status ORC table.

rebase

Mar 18 2022, 3:50 PM
douardda updated the diff for D7386: Use the same 'id' column name everywhere in ORC files.

rebase

Mar 18 2022, 3:50 PM
douardda updated the diff for D7385: Write related ORC files in the same directory using the same UUID.

rebase

Mar 18 2022, 3:50 PM
douardda updated the diff for D7384: Add some user metadata in generated ORC files.

rebase

Mar 18 2022, 3:49 PM
douardda updated the diff for D7383: Implement test_orc exporter as a simple function instead of a fixture.

rebase

Mar 18 2022, 3:49 PM
douardda updated the diff for D7382: Make the kafka group_id prefix configurable in the config file.

rebase

Mar 18 2022, 3:49 PM
douardda updated the diff for D7381: Use a named logger for journalprocessor.py.

rebase and fixes suggested by ardumont

Mar 18 2022, 3:48 PM
douardda updated the diff for D7380: Update JournalClientOffsetRanges for swh.journal 0.9.

rebase

Mar 18 2022, 3:48 PM
douardda updated the diff for D7379: Encode TimestampWithTimezone as (sec, usec, offset) in ORC file.

Do not use TimestampWithTimezone object in swh_date_to_tuple()

Mar 18 2022, 3:47 PM
douardda added inline comments to D7379: Encode TimestampWithTimezone as (sec, usec, offset) in ORC file.
Mar 18 2022, 3:07 PM
douardda added inline comments to D7379: Encode TimestampWithTimezone as (sec, usec, offset) in ORC file.
Mar 18 2022, 3:04 PM
douardda added inline comments to D7381: Use a named logger for journalprocessor.py.
Mar 18 2022, 2:58 PM
douardda added inline comments to D7384: Add some user metadata in generated ORC files.
Mar 18 2022, 2:57 PM
douardda updated the diff for D7384: Add some user metadata in generated ORC files.

use pkg_resources instead of pkginfo

Mar 18 2022, 2:56 PM
douardda requested review of D7389: Add the raw_manifest column for revision, release and directory ORC files.
Mar 18 2022, 2:15 PM
douardda requested review of D7388: Export revision extra headers in a dedicated ORC file.
Mar 18 2022, 2:15 PM
douardda requested review of D7387: Add the type fields for revision and origin_visit_status ORC table.
Mar 18 2022, 2:15 PM
douardda requested review of D7386: Use the same 'id' column name everywhere in ORC files.
Mar 18 2022, 2:14 PM
douardda requested review of D7385: Write related ORC files in the same directory using the same UUID.
Mar 18 2022, 2:14 PM
douardda requested review of D7384: Add some user metadata in generated ORC files.
Mar 18 2022, 2:14 PM
douardda requested review of D7383: Implement test_orc exporter as a simple function instead of a fixture.
Mar 18 2022, 2:13 PM
douardda requested review of D7382: Make the kafka group_id prefix configurable in the config file.
Mar 18 2022, 2:13 PM
douardda requested review of D7381: Use a named logger for journalprocessor.py.
Mar 18 2022, 2:12 PM
douardda requested review of D7380: Update JournalClientOffsetRanges for swh.journal 0.9.
Mar 18 2022, 2:11 PM
douardda requested review of D7379: Encode TimestampWithTimezone as (sec, usec, offset) in ORC file.
Mar 18 2022, 2:11 PM
douardda closed D7372: Exclude name and email attributes from People comparison.
Mar 18 2022, 11:24 AM
douardda committed rDMODbc3831fddcd3: Exclude name and email attributes from People comparison (authored by douardda).
Exclude name and email attributes from People comparison
Mar 18 2022, 11:24 AM
douardda closed D7261: docker: Fix the nginx configuration file for grafana 8.3.5+.
Mar 18 2022, 11:23 AM
douardda committed rDENVf6a168800543: docker: Fix the nginx configuration file for grafana 8.3.5+ (authored by douardda).
docker: Fix the nginx configuration file for grafana 8.3.5+
Mar 18 2022, 11:23 AM
douardda closed D7260: docker: Install cython and configobj in the venv.
Mar 18 2022, 11:23 AM
douardda committed rDENV566b34d16957: docker: Install cython and configobj in the venv (authored by douardda).
docker: Install cython and configobj in the venv
Mar 18 2022, 11:23 AM
douardda committed rDENVd679839da0f3: docker: Fix the scheduler task creation example in the README file (authored by douardda).
docker: Fix the scheduler task creation example in the README file
Mar 18 2022, 11:23 AM
douardda closed D7259: docker: Fix the scheduler task creation example in the README file.
Mar 18 2022, 11:23 AM
douardda updated the diff for D7261: docker: Fix the nginx configuration file for grafana 8.3.5+.

rebase

Mar 18 2022, 10:52 AM
douardda updated the diff for D7260: docker: Install cython and configobj in the venv.

rebase

Mar 18 2022, 10:51 AM
douardda updated the diff for D7259: docker: Fix the scheduler task creation example in the README file.

rebase

Mar 18 2022, 10:50 AM
douardda updated the diff for D7372: Exclude name and email attributes from People comparison.

typo

Mar 18 2022, 10:42 AM

Mar 17 2022

douardda requested review of D7372: Exclude name and email attributes from People comparison.
Mar 17 2022, 6:20 PM

Mar 14 2022

douardda committed rDCORE89d7442beacb: Fix a typo (authored by douardda).
Fix a typo
Mar 14 2022, 5:18 PM
douardda closed D7343: Add a --non-interactive flag to the `swh db upgrade` command.
Mar 14 2022, 5:18 PM
douardda committed rDCOREe2415c009f12: Add a --(non-)interactive flag to the `swh db upgrade` command (authored by douardda).
Add a --(non-)interactive flag to the `swh db upgrade` command
Mar 14 2022, 5:18 PM
douardda updated the diff for D7343: Add a --non-interactive flag to the `swh db upgrade` command.

Include a small (unrelated) typo fix

Mar 14 2022, 1:37 PM
douardda updated the diff for D7343: Add a --non-interactive flag to the `swh db upgrade` command.

update according to vlorentz' suggestion

Mar 14 2022, 1:33 PM
douardda added inline comments to D7343: Add a --non-interactive flag to the `swh db upgrade` command.
Mar 14 2022, 1:30 PM
douardda added a comment to T3311: Use .gitmodules to discover origins.

It's been more/less discussed above but IMHO it would make sense to:

Mar 14 2022, 1:29 PM · Archive coverage, Git loader
douardda requested review of D7343: Add a --non-interactive flag to the `swh db upgrade` command.
Mar 14 2022, 11:39 AM

Mar 9 2022

douardda committed rDCOREf40adde2a91d: Fix a possible UnboundLocalError in swh_db_upgrade (authored by douardda).
Fix a possible UnboundLocalError in swh_db_upgrade
Mar 9 2022, 5:44 PM
douardda closed D7324: Do not do call swh_db_upgrade if not needed in `swh db upgrade`.
Mar 9 2022, 5:44 PM
douardda committed rDCORE6017252a078a: Do not do call swh_db_upgrade if not needed in `swh db upgrade` (authored by douardda).
Do not do call swh_db_upgrade if not needed in `swh db upgrade`
Mar 9 2022, 5:44 PM
douardda updated the diff for D7324: Do not do call swh_db_upgrade if not needed in `swh db upgrade`.

fix suggested by ardumont

Mar 9 2022, 5:42 PM
douardda requested review of D7324: Do not do call swh_db_upgrade if not needed in `swh db upgrade`.
Mar 9 2022, 5:18 PM

Mar 8 2022

douardda closed D7312: Remove aiohttp from requirements.txt.
Mar 8 2022, 5:05 PM
douardda committed rDSTO4e78014b079f: Remove aiohttp from requirements.txt (authored by douardda).
Remove aiohttp from requirements.txt
Mar 8 2022, 5:05 PM
douardda requested review of D7312: Remove aiohttp from requirements.txt.
Mar 8 2022, 4:39 PM
douardda added a watcher for Add Forge Now : douardda.
Mar 8 2022, 12:20 PM

Feb 25 2022

douardda requested review of D7261: docker: Fix the nginx configuration file for grafana 8.3.5+.
Feb 25 2022, 5:45 PM
douardda requested review of D7260: docker: Install cython and configobj in the venv.
Feb 25 2022, 5:45 PM
douardda requested review of D7259: docker: Fix the scheduler task creation example in the README file.
Feb 25 2022, 5:43 PM
douardda requested review of D7258: Update the mirror operation docker manual.
Feb 25 2022, 2:49 PM
douardda closed T3894: Add a 'swh db upgrade' cli as Resolved.
Feb 25 2022, 10:02 AM · Core & foundations

Feb 24 2022

douardda closed D7164: Adapt indexer to swh.core 2.0.0.
Feb 24 2022, 5:33 PM
douardda committed rDCIDX9e89b83be455: Adapt to swh.core 2.0.0 (authored by douardda).
Adapt to swh.core 2.0.0
Feb 24 2022, 5:33 PM
douardda updated the diff for D7164: Adapt indexer to swh.core 2.0.0.

remove the dep on types-toml

Feb 24 2022, 5:23 PM
douardda closed D7162: Adapt vault to swh-core 2.0.0.
Feb 24 2022, 5:15 PM
douardda committed rDVAUe4c9935c1488: Adapt to swh-core 2.0.0 (authored by douardda).
Adapt to swh-core 2.0.0
Feb 24 2022, 5:15 PM
douardda committed rDSCH43794aa673a0: Prepare v1: bump dependency to swh.core 2 (authored by douardda).
Prepare v1: bump dependency to swh.core 2
Feb 24 2022, 4:55 PM
douardda closed D7165: Adapt scheduler to swh.core 2.0.0.
Feb 24 2022, 4:34 PM
douardda committed rDSCH5cc62be1a405: Adapt to swh.core 2.0.0 (authored by douardda).
Adapt to swh.core 2.0.0
Feb 24 2022, 4:34 PM
douardda added a comment to D7165: Adapt scheduler to swh.core 2.0.0.

Remove the rev adding the dep. on types-toml

this should come from swh.core if any (see D7247).

Feb 24 2022, 4:33 PM
douardda abandoned D7247: Add a test-dependency on types-toml for mypy.

Looks to not be necessary in the end. not sure what happened...

Feb 24 2022, 4:25 PM
douardda updated the diff for D7165: Adapt scheduler to swh.core 2.0.0.

Remove the rev adding the dep. on types-toml

Feb 24 2022, 3:53 PM
douardda requested review of D7247: Add a test-dependency on types-toml for mypy.
Feb 24 2022, 3:51 PM
douardda updated the diff for D7165: Adapt scheduler to swh.core 2.0.0.

Add types-toml to requirements-test.txt to please mypy

Feb 24 2022, 12:22 PM
douardda added inline comments to D7164: Adapt indexer to swh.core 2.0.0.
Feb 24 2022, 12:05 PM
douardda committed rDSTO61acdf307ac5: Prepare v1: bump dependency to swh.core 2 (authored by douardda).
Prepare v1: bump dependency to swh.core 2
Feb 24 2022, 12:03 PM
douardda updated the diff for D7165: Adapt scheduler to swh.core 2.0.0.

Bump dep to swh.core 2

Feb 24 2022, 11:25 AM