Page MenuHomeSoftware Heritage
Feed Advanced Search

Aug 25 2021

jayeshv updated the diff for D6094: Provenance Mongo backend.
  • Added the necessary directory for mongo pytest to work
Aug 25 2021, 3:38 PM · Provenance database
jayeshv updated the diff for D6094: Provenance Mongo backend.

MongoDB backend implementation for provenancestorage.

Aug 25 2021, 3:16 PM · Provenance database
jayeshv updated the diff for D6094: Provenance Mongo backend.
  • Made default provenance storage to psql
Aug 25 2021, 3:13 PM · Provenance database
jayeshv updated the diff for D6094: Provenance Mongo backend.
  • Pytest is using mongomock
Aug 25 2021, 3:09 PM · Provenance database

Aug 24 2021

jayeshv requested review of D6094: Provenance Mongo backend.
Aug 24 2021, 12:09 PM · Provenance database

Aug 19 2021

jayeshv added a comment to T3487: Installation of the new provenance server.

@vsellier I am not sure about this.
The idea is to use this machine as the production server. (I guess this will host either postgres or mongodb after we decide on a preferred backend. But that is going to take some time)
@olasd or @aeviso will know better.

Aug 19 2021, 11:49 AM · System administration

Aug 18 2021

jayeshv accepted D6084: Rename PostgreSQL backend and code styling.
Aug 18 2021, 10:23 AM

Aug 16 2021

jayeshv accepted D6084: Rename PostgreSQL backend and code styling.

LGTM

Aug 16 2021, 2:52 PM

Aug 4 2021

jayeshv committed rDPROV4679e3fa2211: inital find-first version (authored by jayeshv).
inital find-first version
Aug 4 2021, 4:58 PM
jayeshv committed rDPROVca44f0003b70: more mongo objects (authored by jayeshv).
more mongo objects
Aug 4 2021, 11:17 AM
jayeshv committed rDPROV4cf6e7b7d352: initial ingest (authored by jayeshv).
initial ingest
Aug 4 2021, 11:06 AM

Aug 3 2021

jayeshv committed rDPROVf48a85b1d011: small changes (authored by jayeshv).
small changes
Aug 3 2021, 5:04 PM
jayeshv committed rDPROV0857e4439634: basic ingest (authored by jayeshv).
basic ingest
Aug 3 2021, 4:42 PM
jayeshv committed rDPROV005f65034b9b: models (authored by jayeshv).
models
Aug 3 2021, 11:16 AM
jayeshv added a comment to T3431: Implement a MongoDB backend for SWH-provenance .

Mongo engine
db.serverStatus().storageEngine

"name" : "wiredTiger",
"supportsCommittedReads" : true,
"oldestRequiredTimestampForCrashRecovery" : Timestamp(0, 0),
"supportsPendingDrops" : true,
"dropPendingIdents" : NumberLong(0),
"supportsSnapshotReadConcern" : true,
"readOnly" : false,
"persistent" : true,
"backupCursorOpen" : false,
"supportsResumableIndexBuilds" : true
Aug 3 2021, 10:54 AM · Provenance database

Aug 2 2021

jayeshv committed rDPROVe701b18d9c58: data model changes (authored by jayeshv).
data model changes
Aug 2 2021, 3:04 PM
jayeshv committed rDPROVe91fe0857618: initial files (authored by jayeshv).
initial files
Aug 2 2021, 3:04 PM

Jul 27 2021

jayeshv updated the task description for T3431: Implement a MongoDB backend for SWH-provenance .
Jul 27 2021, 10:48 AM · Provenance database
jayeshv updated the task description for T3431: Implement a MongoDB backend for SWH-provenance .
Jul 27 2021, 10:45 AM · Provenance database
jayeshv updated the task description for T3431: Implement a MongoDB backend for SWH-provenance .
Jul 27 2021, 10:40 AM · Provenance database
jayeshv updated the task description for T3431: Implement a MongoDB backend for SWH-provenance .
Jul 27 2021, 10:09 AM · Provenance database
jayeshv updated the task description for T3431: Implement a MongoDB backend for SWH-provenance .
Jul 27 2021, 10:07 AM · Provenance database
jayeshv updated the task description for T3431: Implement a MongoDB backend for SWH-provenance .
Jul 27 2021, 10:05 AM · Provenance database

Jul 15 2021

jayeshv claimed T3431: Implement a MongoDB backend for SWH-provenance .
Jul 15 2021, 10:11 AM · Provenance database
jayeshv triaged T3431: Implement a MongoDB backend for SWH-provenance as Normal priority.
Jul 15 2021, 10:10 AM · Provenance database

Jun 29 2021

jayeshv claimed T3405: GraphQL apis for SWH.
Jun 29 2021, 3:57 PM · GraphQL API
jayeshv closed T3404: Add a search feature to snapshot releases view as Resolved.
Jun 29 2021, 3:54 PM · Web app
jayeshv closed T3157: Add a search feature to snapshot branches view as Resolved.
Jun 29 2021, 3:53 PM · Easy hack, Web app
jayeshv closed D5939: Search inside the origin releases with name.
Jun 29 2021, 2:28 PM
jayeshv committed rDWAPPSe26ceb221a88: Search inside the origin releases with name (authored by jayeshv).
Search inside the origin releases with name
Jun 29 2021, 2:28 PM
jayeshv updated the diff for D5939: Search inside the origin releases with name.

review changes

Jun 29 2021, 2:25 PM
jayeshv updated the diff for D5939: Search inside the origin releases with name.

added copyright text

Jun 29 2021, 12:03 PM
jayeshv added inline comments to D5939: Search inside the origin releases with name.
Jun 29 2021, 11:46 AM
jayeshv added inline comments to D5939: Search inside the origin releases with name.
Jun 29 2021, 11:37 AM
jayeshv updated the diff for D5939: Search inside the origin releases with name.

template changes, removed tabs

Jun 29 2021, 11:36 AM
jayeshv updated the diff for D5939: Search inside the origin releases with name.

template issues corrected

Jun 29 2021, 11:03 AM
jayeshv requested review of D5939: Search inside the origin releases with name.
Jun 29 2021, 10:57 AM
jayeshv added a revision to T3404: Add a search feature to snapshot releases view: D5939: Search inside the origin releases with name.
Jun 29 2021, 10:42 AM · Web app
jayeshv created P1081 docker-compose.
Jun 29 2021, 8:59 AM

Jun 28 2021

jayeshv updated the task description for T3413: Fix the inconsistency between snapshot_get_branches function in postgresql.storage and cassandra.storage.
Jun 28 2021, 2:52 PM · Storage manager
jayeshv triaged T3413: Fix the inconsistency between snapshot_get_branches function in postgresql.storage and cassandra.storage as Normal priority.
Jun 28 2021, 2:34 PM · Storage manager
jayeshv closed D5905: Search inside the origin branches with name.
Jun 28 2021, 2:19 PM
jayeshv reopened D5905: Search inside the origin branches with name.
Jun 28 2021, 2:17 PM
jayeshv closed D5905: Search inside the origin branches with name.

e18341dd82c1

Jun 28 2021, 2:14 PM
jayeshv added a comment to D5905: Search inside the origin branches with name.

Looks good to me, thanks ! There is still a typo remaining on an exception name, see inline comment.

Thanks. Fixed e18341dd82c1

Jun 28 2021, 2:14 PM
jayeshv committed rDWAPPSe18341dd82c1: Search inside the origin branches with name (authored by jayeshv).
Search inside the origin branches with name
Jun 28 2021, 1:45 PM
jayeshv updated the diff for D5905: Search inside the origin branches with name.

Review changes

Jun 28 2021, 12:39 PM
jayeshv added inline comments to D5905: Search inside the origin branches with name.
Jun 28 2021, 12:00 PM

Jun 25 2021

jayeshv updated the test plan for D5905: Search inside the origin branches with name.
Jun 25 2021, 6:55 PM
jayeshv updated the diff for D5905: Search inside the origin branches with name.

Requested changes

Jun 25 2021, 6:50 PM
jayeshv renamed T3404: Add a search feature to snapshot releases view from Add a search feature to snapshot origin view to Add a search feature to snapshot releases view.
Jun 25 2021, 3:12 PM · Web app

Jun 23 2021

jayeshv created T3405: GraphQL apis for SWH.
Jun 23 2021, 5:03 PM · GraphQL API
jayeshv added a project to T3404: Add a search feature to snapshot releases view: Web app.
Jun 23 2021, 2:08 PM · Web app
jayeshv triaged T3404: Add a search feature to snapshot releases view as Normal priority.
Jun 23 2021, 2:08 PM · Web app

Jun 22 2021

jayeshv added a comment to D5905: Search inside the origin branches with name.

Couple of remarks inline.

@thanks. Updated the version

Jun 22 2021, 12:42 PM
jayeshv updated the diff for D5905: Search inside the origin branches with name.

Suggested changes by @ardumont

Jun 22 2021, 12:41 PM
jayeshv updated the summary of D5905: Search inside the origin branches with name.
Jun 22 2021, 11:58 AM
jayeshv requested review of D5905: Search inside the origin branches with name.
Jun 22 2021, 11:42 AM
jayeshv added a revision to T3157: Add a search feature to snapshot branches view: D5905: Search inside the origin branches with name.
Jun 22 2021, 11:33 AM · Easy hack, Web app

Jun 15 2021

jayeshv closed T3354: Search UI: redirect to browse page if input matches an archived origin URL as Resolved.
Jun 15 2021, 4:05 PM · Easy hack, Web app
jayeshv closed D5828: Redirect to the browse origin page when the user searchs for an exact, already archived URL.
Jun 15 2021, 12:45 PM
jayeshv committed rDWAPPS740ad9ba51c7: Redirect any archived URL search to the browse origin page (authored by jayeshv).
Redirect any archived URL search to the browse origin page
Jun 15 2021, 12:45 PM
jayeshv added a comment to D5828: Redirect to the browse origin page when the user searchs for an exact, already archived URL.

Looks good to me ! You can now merge your feature branch in the master one and push it to remote, phabricator will automatically close the diff afterwards.

Jun 15 2021, 12:41 PM
jayeshv updated the diff for D5828: Redirect to the browse origin page when the user searchs for an exact, already archived URL.

Incorporating suggested changes and improved commit message

Jun 15 2021, 11:45 AM

Jun 14 2021

jayeshv updated the diff for D5828: Redirect to the browse origin page when the user searchs for an exact, already archived URL.

Synatax corrections

Jun 14 2021, 10:18 PM
jayeshv updated the diff for D5828: Redirect to the browse origin page when the user searchs for an exact, already archived URL.

Changed Promise to use async/await.

Jun 14 2021, 8:31 PM
jayeshv added inline comments to D5828: Redirect to the browse origin page when the user searchs for an exact, already archived URL.
Jun 14 2021, 8:16 PM
jayeshv updated the diff for D5828: Redirect to the browse origin page when the user searchs for an exact, already archived URL.

Updating to changes from origin/master

Jun 14 2021, 3:43 PM
jayeshv requested review of D5828: Redirect to the browse origin page when the user searchs for an exact, already archived URL.
Jun 14 2021, 3:40 PM
jayeshv created P1069 cypress.
Jun 14 2021, 2:35 PM

Jun 11 2021

jayeshv added a comment to T3366: Improve the page rendering mechanism in the web UI.

This will also let us think in terms of reusable widgets. I am not sure how important that would be in our case, but couple of use-cases are

  • we can make swh search or the origin browser a public widget, it can be integrated in any external website with just two lines of HTML code.
  • Many UI elements are in fact the same kind in SWH (eg: folder/file raw, list view etc). Most this can be re-used inside the system. This will make it efficient and easy to manage.
Jun 11 2021, 12:17 PM · Web app
jayeshv added a comment to T3366: Improve the page rendering mechanism in the web UI.

@zack Thanks for the input. I will start thinking about accessibility as well.
Many pages, including 'swh search', will not function as expected without enabling JS. So, I would say JS is integral.

Jun 11 2021, 12:07 PM · Web app

Jun 10 2021

jayeshv added a comment to T3157: Add a search feature to snapshot branches view.

This will simplify branches view implementation. You should create a diff to handle it.

Jun 10 2021, 12:03 PM · Easy hack, Web app
jayeshv added a comment to T3157: Add a search feature to snapshot branches view.

@anlambert Thank you. I will try to do some refactoring here.

Jun 10 2021, 11:42 AM · Easy hack, Web app

Jun 9 2021

jayeshv added a comment to T3157: Add a search feature to snapshot branches view.

@anlambert The server code seems to have an issue when branches are filtered by name.
"swh.web.common.archive.lookup_snapshot" function is raising an error if the number of searched branches is 0.
raise
This will eventually cause a 404 error when the user search for a non existing branch name in the UI. I don't think this is the intended behavior.

Jun 9 2021, 5:41 PM · Easy hack, Web app

Jun 8 2021

jayeshv added a revision to T3354: Search UI: redirect to browse page if input matches an archived origin URL: D5828: Redirect to the browse origin page when the user searchs for an exact, already archived URL.
Jun 8 2021, 7:14 PM · Easy hack, Web app

Jun 7 2021

jayeshv updated the task description for T3366: Improve the page rendering mechanism in the web UI.
Jun 7 2021, 3:49 PM · Web app
jayeshv updated the task description for T3366: Improve the page rendering mechanism in the web UI.
Jun 7 2021, 3:49 PM · Web app
jayeshv updated the task description for T3366: Improve the page rendering mechanism in the web UI.
Jun 7 2021, 3:48 PM · Web app
jayeshv updated the task description for T3366: Improve the page rendering mechanism in the web UI.
Jun 7 2021, 3:41 PM · Web app
jayeshv updated the task description for T3366: Improve the page rendering mechanism in the web UI.
Jun 7 2021, 3:40 PM · Web app
jayeshv created T3366: Improve the page rendering mechanism in the web UI.
Jun 7 2021, 3:39 PM · Web app

Jun 2 2021

jayeshv edited P1058 swh-web make test output.
Jun 2 2021, 10:48 AM
jayeshv edited P1058 swh-web make test output.
Jun 2 2021, 10:38 AM
jayeshv created P1058 swh-web make test output.
Jun 2 2021, 10:35 AM

Jun 1 2021

jayeshv added a comment to T3157: Add a search feature to snapshot branches view.

2: If we have to add a UI component, do we have a design or example for that? (maybe a generic one for both branches and Releases, the "search branches" widget in github looks nice)

Jun 1 2021, 9:50 AM · Easy hack, Web app
jayeshv added a comment to T3157: Add a search feature to snapshot branches view.

@anlambert I have a few questions regarding this task.
1: Should we add a filter UI component in the page or just a query param is enough?
2: If we have to add a UI component, do we have a design or example for that? (maybe a generic one for both branches and Releases, the "search branches" widget in github looks nice)
3: What about the API /snapshot/<id>, should we add the possibility of this filter there as well?
4: The branches seem to be randomly sorted over Date. Is that for a reason or something we should address?

Jun 1 2021, 9:07 AM · Easy hack, Web app

May 31 2021

jayeshv claimed T3354: Search UI: redirect to browse page if input matches an archived origin URL.
May 31 2021, 4:43 PM · Easy hack, Web app
jayeshv claimed T3157: Add a search feature to snapshot branches view.
May 31 2021, 1:48 PM · Easy hack, Web app

May 11 2021

jayeshv closed D5686: Minor typo fix in docker documentation.
May 11 2021, 5:29 PM

May 10 2021

jayeshv closed D5726: hash computation has been moved to swh.model; reflecting that change in the documentation.
May 10 2021, 5:47 PM
jayeshv committed rDCOREc3c387ddd445: hash computation has been moved to swh.model; reflecting that change in the… (authored by jayeshv).
hash computation has been moved to swh.model; reflecting that change in the…
May 10 2021, 5:47 PM
jayeshv requested review of D5726: hash computation has been moved to swh.model; reflecting that change in the documentation.
May 10 2021, 5:39 PM

May 5 2021

jayeshv added a comment to D5686: Minor typo fix in docker documentation.

first diff, achievement unlocked, w00t ;)

May 5 2021, 5:07 PM
jayeshv requested review of D5686: Minor typo fix in docker documentation.
May 5 2021, 5:05 PM

Apr 9 2021

jayeshv updated jayeshv.
Apr 9 2021, 11:22 AM