Page MenuHomeSoftware Heritage
Feed Advanced Search

Advanced Search
Use Results
Hide Query

Jul 25 2020

ardumont added a revision to T2499: Drop the storage validate proxy used only in tests: D3617: Drop unsupported "validate" proxy.
Jul 25 2020, 7:54 AM · Storage manager

Jul 24 2020

ardumont added a revision to T645: Type swh-storage endpoints with swh.model objects: D3618: Update swh.storage.origin_get calls to latest api change.
Jul 24 2020, 6:30 PM · Data Model, Storage manager
ardumont added a revision to T645: Type swh-storage endpoints with swh.model objects: D3609: loader: Update swh.storage.origin_get call to latest api change.
Jul 24 2020, 8:51 AM · Data Model, Storage manager
ardumont added a revision to T645: Type swh-storage endpoints with swh.model objects: D3608: loader: Update swh.storage.origin_get call to latest api change.
Jul 24 2020, 8:26 AM · Data Model, Storage manager
ardumont added a revision to T645: Type swh-storage endpoints with swh.model objects: D3607: migrations: Update swh.storage.origin_get calls to latest api change.
Jul 24 2020, 8:14 AM · Data Model, Storage manager

Jul 23 2020

ardumont added a revision to T645: Type swh-storage endpoints with swh.model objects: D3605: storage*: origin_get(Iterable[str]) -> Iterable[Optional[Origin]].
Jul 23 2020, 5:55 PM · Data Model, Storage manager
ardumont renamed T645: Type swh-storage endpoints with swh.model objects from Make swh-storage endpoints typed to Type swh-storage endpoints.
Jul 23 2020, 1:27 PM · Data Model, Storage manager
ardumont renamed T645: Type swh-storage endpoints with swh.model objects from Add types to swh-storage's api internal data structure result to Make swh-storage endpoints typed.
Jul 23 2020, 1:27 PM · Data Model, Storage manager
ardumont added a revision to T645: Type swh-storage endpoints with swh.model objects: D3594: storage*.origin_visit_get_random: Return model object instead of dict.
Jul 23 2020, 1:26 PM · Data Model, Storage manager
ardumont removed a project from T645: Type swh-storage endpoints with swh.model objects: Web app.
Jul 23 2020, 10:34 AM · Data Model, Storage manager
ardumont added a parent task for T2494: tests: Use data model objects within tests (drop dicts): T645: Type swh-storage endpoints with swh.model objects.
Jul 23 2020, 10:15 AM · Storage manager
ardumont added a subtask for T645: Type swh-storage endpoints with swh.model objects: T2494: tests: Use data model objects within tests (drop dicts).
Jul 23 2020, 10:15 AM · Data Model, Storage manager
ardumont added a comment to T645: Type swh-storage endpoints with swh.model objects.

Well now:

  • the types are here.
  • All *_add endpoints from storages are taking as input the new model objects
  • All storage tests are using the data model objects as input
Jul 23 2020, 9:54 AM · Data Model, Storage manager

Jul 22 2020

ardumont closed T2494: tests: Use data model objects within tests (drop dicts) as Resolved.
Jul 22 2020, 4:59 PM · Storage manager
ardumont closed T2499: Drop the storage validate proxy used only in tests, a subtask of T2494: tests: Use data model objects within tests (drop dicts), as Resolved.
Jul 22 2020, 12:32 PM · Storage manager
ardumont closed T2499: Drop the storage validate proxy used only in tests as Resolved.
Jul 22 2020, 12:32 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3593: pytest_plugin: Make sample_data an object with attributes instead of dict.
Jul 22 2020, 8:57 AM · Storage manager

Jul 21 2020

ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3592: pytest_plugin: Rename sample_data_model to sample_data.
Jul 21 2020, 6:16 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3591: pytest_plugin: Drop sample_data to in favor of sample_data_model.
Jul 21 2020, 6:09 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3590: storage_data: Expose snapshots as model objects.
Jul 21 2020, 5:42 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3589: storage_data: Expose releases as model objects.
Jul 21 2020, 5:33 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3588: storage_data: Expose origin_visits as model objects.
Jul 21 2020, 5:21 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3587: storage_data: Expose origins as model objects.
Jul 21 2020, 4:52 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3586: storage_data: Expose revisions as model objects.
Jul 21 2020, 4:30 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3585: storage_data: Expose directories as directory model objects.
Jul 21 2020, 3:35 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3584: storage_data: Remove unused fixture data.
Jul 21 2020, 3:09 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3583: storage_data: Expose contents as content model object.
Jul 21 2020, 2:59 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3582: pytest_plugin: Drop unnecessary back and forth conversion.
Jul 21 2020, 2:50 PM · Storage manager
ardumont renamed T2494: tests: Use data model objects within tests (drop dicts) from tests: Prefer data model objects to dict within tests to tests: Use data model objects within tests (drop dicts).
Jul 21 2020, 10:51 AM · Storage manager
ardumont removed a revision from T2494: tests: Use data model objects within tests (drop dicts): D3581: cli.task: Fix iter_origin returned types.
Jul 21 2020, 10:45 AM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3581: cli.task: Fix iter_origin returned types.
Jul 21 2020, 10:35 AM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3580: tests: Convert left-over dicts to model objects.
Jul 21 2020, 10:20 AM · Storage manager
ardumont added a revision to T2499: Drop the storage validate proxy used only in tests: D3579: Drop no longer used validate proxy.
Jul 21 2020, 9:48 AM · Storage manager
ardumont triaged T2499: Drop the storage validate proxy used only in tests as Normal priority.
Jul 21 2020, 9:44 AM · Storage manager
ardumont updated the task description for T2494: tests: Use data model objects within tests (drop dicts).
Jul 21 2020, 9:43 AM · Storage manager

Jul 20 2020

ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3578: test_storage: Migrate last storage to use model objects.
Jul 20 2020, 10:25 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3577: test_storage: test_origin: Use data model object.
Jul 20 2020, 10:24 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3576: test_storage: origin_metadata: Centralize objects within sample_data_model.
Jul 20 2020, 10:24 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3575: test_storage: content_metadata: Centralize objects within sample_data_model.
Jul 20 2020, 10:23 PM · Storage manager
vlorentz added a parent task for T2498: Re-create the Cassandra cluster using on-premise servers: T2304: Cassandra storage: Reduce the size of the "secondary lookup tables" for contents.
Jul 20 2020, 6:01 PM · System administration, Storage manager
vlorentz added a subtask for T2304: Cassandra storage: Reduce the size of the "secondary lookup tables" for contents: T2498: Re-create the Cassandra cluster using on-premise servers.
Jul 20 2020, 6:01 PM · Storage manager
vlorentz added a subtask for T2214: Scale-out graph and database storage in production: T2033: Run Cassandra storage backend with production data.
Jul 20 2020, 6:00 PM · meta-task, Roadmap 2022, Roadmap 2021, Storage manager
vlorentz added a parent task for T2033: Run Cassandra storage backend with production data: T2214: Scale-out graph and database storage in production.
Jul 20 2020, 6:00 PM · Storage manager
vlorentz removed a parent task for T2214: Scale-out graph and database storage in production: T2033: Run Cassandra storage backend with production data.
Jul 20 2020, 6:00 PM · meta-task, Roadmap 2022, Roadmap 2021, Storage manager
vlorentz removed a subtask for T2033: Run Cassandra storage backend with production data: T2214: Scale-out graph and database storage in production.
Jul 20 2020, 6:00 PM · Storage manager
vlorentz added a subtask for T2033: Run Cassandra storage backend with production data: T2214: Scale-out graph and database storage in production.
Jul 20 2020, 5:58 PM · Storage manager
vlorentz added a parent task for T2214: Scale-out graph and database storage in production: T2033: Run Cassandra storage backend with production data.
Jul 20 2020, 5:58 PM · meta-task, Roadmap 2022, Roadmap 2021, Storage manager
vlorentz triaged T2498: Re-create the Cassandra cluster using on-premise servers as Normal priority.
Jul 20 2020, 5:58 PM · System administration, Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3574: test_storage: test_object_find_by_sha1: Use data model object.
Jul 20 2020, 5:58 PM · Storage manager
vlorentz added a subtask for T2182: Switch production swh-web to use swh-search instead of postgresql search.: T2497: Create an ElasticSearch cluster tuned for origin/metadata search.
Jul 20 2020, 5:56 PM · System administration, Archive search, Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3573: test_storage: content_find: Use data model object.
Jul 20 2020, 5:46 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3572: test_storage: stat_counters: Use data model object.
Jul 20 2020, 4:35 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3571: test_storage: snapshot: Use data model object.
Jul 20 2020, 3:58 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3570: test_storage: origin_visit/origin_visit_status: Use data model object.
Jul 20 2020, 3:35 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3569: test_storage: revision/release: Drop no longer needed conditionals.
Jul 20 2020, 2:52 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3568: test_storage: origin: Use data model object.
Jul 20 2020, 2:33 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3567: tests: Drop deprecated storage.origin_add_one use.
Jul 20 2020, 1:48 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3565: test_storage: release: Use data model object.
Jul 20 2020, 1:20 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3564: test_storage: revision: Use data model object.
Jul 20 2020, 12:55 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3563: test_storage: directory: Use data model object.
Jul 20 2020, 11:59 AM · Storage manager
vlorentz claimed T2074: Publish extrinsic metadata to swh-journal/Kafka.
Jul 20 2020, 11:20 AM · Storage manager, Journal, Metadata workflow
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3559: test_storage: Make swh_contents fixture generate content model objects.
Jul 20 2020, 11:10 AM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3558: tests.generate_data_test: Remove dead code.
Jul 20 2020, 10:42 AM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3557: test_storage: skipped_content/content_missing: Use data model object.
Jul 20 2020, 10:15 AM · Storage manager

Jul 17 2020

ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3556: test.storage: content_add_metadata: Use data model object.
Jul 17 2020, 5:52 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3555: test.storage: content_add: Use data model object.
Jul 17 2020, 5:00 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3554: test_cassandra: Use data model object.
Jul 17 2020, 4:38 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3547: tests: Check against snapshot model object.
Jul 17 2020, 11:14 AM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3546: tests: Check against snapshot model object.
Jul 17 2020, 11:01 AM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3544: tests: Check against snapshot model object.
Jul 17 2020, 10:33 AM · Storage manager

Jul 16 2020

ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3543: check_snapshot: Drop accepting using dict for snapshot comparison.
Jul 16 2020, 7:05 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3542: test_pypi: Check against snapshot model object.
Jul 16 2020, 6:58 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3541: test_npm: Check against snapshot model object.
Jul 16 2020, 6:40 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3539: test_nixguix: Check against snapshot model object.
Jul 16 2020, 6:23 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3538: test_deposit: Check against snapshot model object.
Jul 16 2020, 5:47 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3537: test_cran: Check against snapshot model object.
Jul 16 2020, 5:41 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3536: test_debian: Check against snapshot model object.
Jul 16 2020, 5:38 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3535: test_cli: Use snapshot model object within test.
Jul 16 2020, 5:32 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3533: test_archive: Check against snapshot model object.
Jul 16 2020, 5:03 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3530: algos.test_origin: Use data model object and drop validate proxy use.
Jul 16 2020, 3:35 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3529: algos.test_snapshot: Use model objects from sample_data_model.
Jul 16 2020, 3:33 PM · Storage manager
ardumont added a revision to T2494: tests: Use data model objects within tests (drop dicts): D3523: test_revision_bw_compat: Use revision model object.
Jul 16 2020, 12:08 PM · Storage manager
ardumont removed a revision from T2494: tests: Use data model objects within tests (drop dicts): D3515: pytest_plugin: Avoid fixture client to declare optional dependency.
Jul 16 2020, 10:42 AM · Storage manager
ardumont added revisions to T2494: tests: Use data model objects within tests (drop dicts): D3509: pytest-plugin: Expose a sample_data_model fixture, D3510: test_retry: Use sample_data_model fixture to manipulate model objects, D3511: test_retry: Drop validate proxy when we can, D3512: test_buffer: Use model objects in tests and drop validate proxy, D3513: test_filter: Use model objects in tests and drop validate proxy, D3515: pytest_plugin: Avoid fixture client to declare optional dependency.
Jul 16 2020, 10:30 AM · Storage manager
ardumont added a project to T2494: tests: Use data model objects within tests (drop dicts): Storage manager.
Jul 16 2020, 10:29 AM · Storage manager

Jul 6 2020

ardumont added a comment to T2474: drop blake2 hashes.

Nothing against it either.
If that can make us ingest faster, it'd be neat.

Jul 6 2020, 11:23 AM · Data Model, Storage manager
ardumont closed T2310: Make origin visits immutable as Resolved.
Jul 6 2020, 10:05 AM · Storage manager, Data Model
ardumont added a comment to T2310: Make origin visits immutable.

The main part is done, actually make the origin-visit immutable.
It's been deployed fully now.

Jul 6 2020, 10:04 AM · Storage manager, Data Model
ardumont updated the task description for T2310: Make origin visits immutable.
Jul 6 2020, 10:03 AM · Storage manager, Data Model
ardumont updated the task description for T2310: Make origin visits immutable.
Jul 6 2020, 9:59 AM · Storage manager, Data Model
ardumont triaged T2478: backfill origin-visit and origin-visit-status topics as Normal priority.
Jul 6 2020, 9:58 AM · Storage manager, Data Model

Jul 3 2020

ardumont updated the task description for T2310: Make origin visits immutable.
Jul 3 2020, 4:51 PM · Storage manager, Data Model
ardumont added a revision to T2310: Make origin visits immutable: D3416: storage.db: Drop db.origin_visit_upsert behavior.
Jul 3 2020, 4:34 PM · Storage manager, Data Model
douardda added a comment to T2474: drop blake2 hashes.

not sure about the db space as an argument, but the CPU is by itself worth the move IMHO.

Jul 3 2020, 4:30 PM · Data Model, Storage manager
vlorentz added a project to T2474: drop blake2 hashes: Data Model.
Jul 3 2020, 4:17 PM · Data Model, Storage manager
zack triaged T2474: drop blake2 hashes as Normal priority.
Jul 3 2020, 4:15 PM · Data Model, Storage manager

Jul 2 2020

ardumont updated the task description for T2310: Make origin visits immutable.
Jul 2 2020, 12:23 PM · Storage manager, Data Model
ardumont updated the task description for T2310: Make origin visits immutable.
Jul 2 2020, 10:32 AM · Storage manager, Data Model

Jul 1 2020

ardumont updated the task description for T2310: Make origin visits immutable.
Jul 1 2020, 4:22 PM · Storage manager, Data Model
ardumont updated the task description for T2310: Make origin visits immutable.
Jul 1 2020, 4:01 PM · Storage manager, Data Model
First
Prev
Next
About · Developer information · Legal