Page MenuHomeSoftware Heritage
Feed Advanced Search

Feb 15 2022

douardda renamed T3730: Add a "user support" mechanism to the archive from Add a "user support" mechanism in the archive to Add a "user support" mechanism to the archive.
Feb 15 2022, 1:36 PM · meta-task, Roadmap 2022
douardda triaged T3934: Publish up-to-date docker images as Normal priority.
Feb 15 2022, 1:29 PM · System administration

Feb 14 2022

douardda updated the summary of D7063: Make 'swh db init' fill the dbversion table.
Feb 14 2022, 1:51 PM
douardda updated the diff for D7159: Add a documentation section for swh.core.db.

rebase

Feb 14 2022, 1:51 PM
douardda updated the diff for D7155: Refactor swh.core.db.pytest_plugin.

rebase

Feb 14 2022, 1:50 PM
douardda updated the diff for D7064: Add a 'swh db upgrade' command.

rebase

Feb 14 2022, 1:50 PM
douardda updated the diff for D7063: Make 'swh db init' fill the dbversion table.

rebas

Feb 14 2022, 1:49 PM
douardda updated the diff for D7062: Add support for dbversion and dbmodule handling in swh db init.

typos (thx ardumont)

Feb 14 2022, 1:47 PM
douardda added inline comments to D7062: Add support for dbversion and dbmodule handling in swh db init.
Feb 14 2022, 1:43 PM
douardda added inline comments to D7062: Add support for dbversion and dbmodule handling in swh db init.
Feb 14 2022, 1:35 PM
douardda closed D7161: Ensure the vault instance used in tests is recreated.
Feb 14 2022, 12:38 PM
douardda committed rDVAUdccc245a01ae: Ensure the vault instance used in tests is recreated (authored by douardda).
Ensure the vault instance used in tests is recreated
Feb 14 2022, 12:38 PM
douardda updated the diff for D7161: Ensure the vault instance used in tests is recreated.

add a comment

Feb 14 2022, 12:18 PM
douardda added a comment to T3930: Update swh-search QL examples.

I agree that having actually "working" examples in the doc is a must.

Feb 14 2022, 11:54 AM · Documentation, Archive search

Feb 11 2022

douardda added a revision to T3894: Add a 'swh db upgrade' cli: D7165: Adapt scheduler to swh.core 2.0.0.
Feb 11 2022, 5:14 PM · Core & foundations
douardda added a revision to T3894: Add a 'swh db upgrade' cli: D7164: Adapt indexer to swh.core 2.0.0.
Feb 11 2022, 5:08 PM · Core & foundations
douardda added a revision to T3894: Add a 'swh db upgrade' cli: D7162: Adapt vault to swh-core 2.0.0.
Feb 11 2022, 4:39 PM · Core & foundations
douardda requested review of D7161: Ensure the vault instance used in tests is recreated.
Feb 11 2022, 4:37 PM
douardda requested review of D7159: Add a documentation section for swh.core.db.
Feb 11 2022, 4:31 PM
douardda updated the diff for D7155: Refactor swh.core.db.pytest_plugin.

rebase

Feb 11 2022, 4:29 PM
douardda updated the diff for D7064: Add a 'swh db upgrade' command.

typos

Feb 11 2022, 4:28 PM
douardda updated the diff for D7063: Make 'swh db init' fill the dbversion table.

typos

Feb 11 2022, 4:27 PM
douardda added a revision to T3894: Add a 'swh db upgrade' cli: D7160: Update storage for swh.core 2.0.0.
Feb 11 2022, 4:20 PM · Core & foundations
douardda updated the diff for D7155: Refactor swh.core.db.pytest_plugin.

small fix

Feb 11 2022, 3:56 PM
douardda updated the diff for D7155: Refactor swh.core.db.pytest_plugin.

rebase and print/pass statements

Feb 11 2022, 2:38 PM
douardda updated the diff for D7064: Add a 'swh db upgrade' command.

rebase

Feb 11 2022, 2:34 PM
douardda updated the diff for D7063: Make 'swh db init' fill the dbversion table.

rebase

Feb 11 2022, 2:33 PM
douardda updated the diff for D7062: Add support for dbversion and dbmodule handling in swh db init.

typos

Feb 11 2022, 2:32 PM
douardda added inline comments to D7063: Make 'swh db init' fill the dbversion table.
Feb 11 2022, 2:29 PM
douardda added a comment to D7062: Add support for dbversion and dbmodule handling in swh db init.
In D7062#183909, @olasd wrote:

Thanks, this looks like a good step forward!

These "Also" changes would have been much easier to review (and land) as separate diffs; they're probably uncontroversial, but I'm not sure what they really are by looking at this diff :-)

Feb 11 2022, 2:13 PM
douardda closed D7153: Fix a bug in numfile_sortkey and add tests for it.
Feb 11 2022, 12:52 PM
douardda closed D7152: Convert test_utils to pytest.
Feb 11 2022, 12:52 PM
douardda committed rDCORE3139d3344e23: Fix a bug in numfile_sortkey and add tests for it (authored by douardda).
Fix a bug in numfile_sortkey and add tests for it
Feb 11 2022, 12:52 PM
douardda committed rDCORE68dc6811967f: Convert test_utils to pytest (authored by douardda).
Convert test_utils to pytest
Feb 11 2022, 12:52 PM
douardda closed D7061: Make `swh db init` retrieve the db cnx uri from the config file.
Feb 11 2022, 12:52 PM
douardda committed rDCORE3e43730df615: Make `swh db init` retrieve the db cnx uri from the config file (authored by douardda).
Make `swh db init` retrieve the db cnx uri from the config file
Feb 11 2022, 12:52 PM
douardda committed rDCORE459da96c1e6b: Move utility functions from cli.db to db.db_utils (authored by douardda).
Move utility functions from cli.db to db.db_utils
Feb 11 2022, 12:52 PM
douardda closed D7060: preparation refactoring for following diffs.
Feb 11 2022, 12:52 PM
douardda committed rDCORE932eed4863ba: Remove the old and unused log-schema.sql file (authored by douardda).
Remove the old and unused log-schema.sql file
Feb 11 2022, 12:52 PM
douardda added a comment to D7153: Fix a bug in numfile_sortkey and add tests for it.

You could also return float("infinity") just to be sure :)

I actually though about it, but then it would make the typing more complex for no real reason :-)

Feb 11 2022, 12:51 PM
douardda added a comment to D7153: Fix a bug in numfile_sortkey and add tests for it.

You could also return float("infinity") just to be sure :)

Feb 11 2022, 12:50 PM
douardda requested review of D7155: Refactor swh.core.db.pytest_plugin.
Feb 11 2022, 12:49 PM
douardda updated the diff for D7064: Add a 'swh db upgrade' command.

rebase

Feb 11 2022, 12:28 PM
douardda updated the diff for D7063: Make 'swh db init' fill the dbversion table.

rebase

Feb 11 2022, 12:27 PM
douardda updated the summary of D7062: Add support for dbversion and dbmodule handling in swh db init.
Feb 11 2022, 12:24 PM
douardda requested review of D7154: Refactor the mock_package_sql fixture to allow multiple sql script set.
Feb 11 2022, 12:24 PM
douardda updated the diff for D7062: Add support for dbversion and dbmodule handling in swh db init.

rebase and extracted D7154 as a standolone diff

Feb 11 2022, 12:24 PM
douardda requested review of D7153: Fix a bug in numfile_sortkey and add tests for it.
Feb 11 2022, 12:22 PM
douardda requested review of D7152: Convert test_utils to pytest.
Feb 11 2022, 12:22 PM
douardda updated the diff for D7061: Make `swh db init` retrieve the db cnx uri from the config file.

rebase

Feb 11 2022, 12:19 PM
douardda updated the diff for D7060: preparation refactoring for following diffs.

rebase

Feb 11 2022, 12:19 PM

Feb 9 2022

douardda committed rDSCHc46ffadf7adf: Prefix task types used in tests with 'test-' (authored by douardda).
Prefix task types used in tests with 'test-'
Feb 9 2022, 10:26 AM
douardda closed D7125: Prefix task types used in tests with 'test-'.
Feb 9 2022, 10:26 AM

Feb 8 2022

douardda requested review of D7125: Prefix task types used in tests with 'test-'.
Feb 8 2022, 5:37 PM

Feb 7 2022

douardda added a comment to D7062: Add support for dbversion and dbmodule handling in swh db init.
In D7062#183909, @olasd wrote:

Thanks, this looks like a good step forward!

These "Also" changes would have been much easier to review (and land) as separate diffs; they're probably uncontroversial, but I'm not sure what they really are by looking at this diff :-)

Feb 7 2022, 3:18 PM
douardda added a comment to T3890: schema of timezones in the journal.

Looks like we are going to keep the status quo in the short term, ie. a numeric offset for old objects, and offset_bytes for new objects without renaming.

@douardda @olasd agreed?

Feb 7 2022, 9:46 AM · Journal, Data Model

Feb 4 2022

douardda accepted D7069: Add typing to revision_walker.py and make the state a dataclass.

probably need to update the docstring, otherwise ok

Feb 4 2022, 4:10 PM
douardda added inline comments to D7069: Add typing to revision_walker.py and make the state a dataclass.
Feb 4 2022, 4:09 PM
douardda added a comment to D7069: Add typing to revision_walker.py and make the state a dataclass.

lgtm but as said on IRC, it's not just a type annotation diff, it does modify the code (introduce the State dataclass etc)

Feb 4 2022, 11:27 AM

Feb 2 2022

douardda added a comment to T3894: Add a 'swh db upgrade' cli.

To help a bit, here is the plan:

Feb 2 2022, 4:10 PM · Core & foundations
douardda updated the diff for D7064: Add a 'swh db upgrade' command.

rebase

Feb 2 2022, 3:53 PM
douardda updated the diff for D7063: Make 'swh db init' fill the dbversion table.

rebase

Feb 2 2022, 3:53 PM
douardda updated the diff for D7062: Add support for dbversion and dbmodule handling in swh db init.

rebase

Feb 2 2022, 3:53 PM
douardda updated the diff for D7061: Make `swh db init` retrieve the db cnx uri from the config file.

improve help for 'swh db init' as suggested by vlorentz

Feb 2 2022, 3:52 PM
douardda updated the diff for D7064: Add a 'swh db upgrade' command.

rebase

Feb 2 2022, 3:31 PM
douardda updated the diff for D7063: Make 'swh db init' fill the dbversion table.

rebase

Feb 2 2022, 3:31 PM
douardda updated the diff for D7062: Add support for dbversion and dbmodule handling in swh db init.

rebase

Feb 2 2022, 3:30 PM
douardda updated the diff for D7061: Make `swh db init` retrieve the db cnx uri from the config file.

rebase

Feb 2 2022, 3:30 PM
douardda updated the diff for D7060: preparation refactoring for following diffs.

move (forgotten) import stmts top level (thx vlorentz)

Feb 2 2022, 3:30 PM
douardda added inline comments to D7060: preparation refactoring for following diffs.
Feb 2 2022, 3:25 PM
douardda updated the diff for D7064: Add a 'swh db upgrade' command.

rebase

Feb 2 2022, 3:24 PM
douardda updated the diff for D7063: Make 'swh db init' fill the dbversion table.

small cleanup in cli_new/50-data.sql

Feb 2 2022, 3:24 PM
douardda requested review of D7064: Add a 'swh db upgrade' command.
Feb 2 2022, 3:22 PM
douardda requested review of D7063: Make 'swh db init' fill the dbversion table.
Feb 2 2022, 3:21 PM
douardda requested review of D7062: Add support for dbversion and dbmodule handling in swh db init.
Feb 2 2022, 2:46 PM
douardda requested review of D7061: Make `swh db init` retrieve the db cnx uri from the config file.
Feb 2 2022, 2:36 PM
douardda requested review of D7060: preparation refactoring for following diffs.
Feb 2 2022, 2:35 PM
douardda added a revision to T3894: Add a 'swh db upgrade' cli: D7064: Add a 'swh db upgrade' command.
Feb 2 2022, 1:53 PM · Core & foundations
douardda added a revision to T3894: Add a 'swh db upgrade' cli: D7063: Make 'swh db init' fill the dbversion table.
Feb 2 2022, 1:52 PM · Core & foundations
douardda added a revision to T3894: Add a 'swh db upgrade' cli: D7062: Add support for dbversion and dbmodule handling in swh db init.
Feb 2 2022, 1:51 PM · Core & foundations
douardda added a revision to T3894: Add a 'swh db upgrade' cli: D7061: Make `swh db init` retrieve the db cnx uri from the config file.
Feb 2 2022, 1:49 PM · Core & foundations
douardda added a revision to T3894: Add a 'swh db upgrade' cli: D7060: preparation refactoring for following diffs.
Feb 2 2022, 1:49 PM · Core & foundations

Jan 28 2022

douardda closed T3693: Provide a mecanism to report (with persistence) objects that fails to get replayed (mirror) as Resolved.
Jan 28 2022, 9:38 AM · Storage manager
douardda added a comment to T3894: Add a 'swh db upgrade' cli.

The problem with step 2. is that we do not have an API to declare the latest version, something that should come with swh.core.db is suppose.

Jan 28 2022, 9:38 AM · Core & foundations
douardda updated the task description for T3894: Add a 'swh db upgrade' cli.
Jan 28 2022, 9:36 AM · Core & foundations

Jan 27 2022

douardda updated the task description for T3894: Add a 'swh db upgrade' cli.
Jan 27 2022, 3:10 PM · Core & foundations
douardda triaged T3894: Add a 'swh db upgrade' cli as High priority.
Jan 27 2022, 3:07 PM · Core & foundations
douardda closed T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage as Resolved.

yeah!

Jan 27 2022, 2:21 PM · Journal
douardda closed T1279: swh-journal: The schema migration problem, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, as Wontfix.
Jan 27 2022, 2:21 PM · Journal
douardda closed T1279: swh-journal: The schema migration problem as Wontfix.

See T3893 instead.

Jan 27 2022, 2:21 PM · Journal
douardda renamed T3893: Version swh schema from Make the swh schema versioned to Version swh schema .
Jan 27 2022, 2:18 PM · Data Model
douardda updated the task description for T3893: Version swh schema .
Jan 27 2022, 2:16 PM · Data Model
douardda added a comment to T3893: Version swh schema .

From IRC:

Jan 27 2022, 2:13 PM · Data Model
douardda triaged T3893: Version swh schema as High priority.
Jan 27 2022, 2:09 PM · Data Model
douardda created T3893: Version swh schema .
Jan 27 2022, 2:09 PM · Data Model
douardda closed T1481: add metric to monitor "save code now" efficiency, a subtask of T1408: More/better Metrics, as Resolved.
Jan 27 2022, 1:45 PM · Metrics/monitoring, Sprint 2018 12
douardda closed T1481: add metric to monitor "save code now" efficiency as Resolved.

we can always improve it, but now we have a decent dashboard, so let's consider this done.

Jan 27 2022, 1:45 PM · Save Code Now, System administration, Metrics/monitoring
douardda closed T1481: add metric to monitor "save code now" efficiency, a subtask of T3082: Improve Save Code Now handling, as Resolved.
Jan 27 2022, 1:45 PM · Save Code Now, meta-task, Roadmap 2021, Web app
douardda closed T3218: The graph replayer generates REQTMOUT Timeout errors, a subtask of T3197: Mirror: fix common issues of a replayer session, as Resolved.
Jan 27 2022, 1:43 PM · Mirror
douardda closed T3218: The graph replayer generates REQTMOUT Timeout errors as Resolved.

Seems moslty ok, even if these errors still pop now and then in the logs.

Jan 27 2022, 1:43 PM · Mirror