Page MenuHomeSoftware Heritage
Differential D6251

Work in progress. Not for review.
AbandonedPublicDraft
Actions

Authored by jayeshv on Sep 14 2021, 1:42 PM.

Details

Reviewers
None
Group Reviewers
Reviewers
Summary

Structure and base logic. Datamodel validation, indexes set and get methods.

Diff Detail

Repository
rDPROV Provenance database
Branch
mongo-refactoring
Lint
No Linters Available
Unit
No Unit Test Coverage
Build Status
Buildable 23672
Build 36950: Phabricator diff pipeline on jenkinsJenkins console · Jenkins
Build 36949: arc lint + arc unit

Event Timeline

jayeshv created this revision.Sep 14 2021, 1:42 PM
Herald added a reviewer: Reviewers. · View Herald TranscriptSep 14 2021, 1:42 PM
swh-public-ci added a comment.Sep 14 2021, 1:42 PM

Build has FAILED

Patch application report for D6251 (id=22640)

Rebasing onto 2e997f3103...

Current branch diff-target is up to date.
Changes applied before test
commit 38bcdeb9e67ff11a9cad74d2a58d858ace67dbc4
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Tue Sep 14 13:38:35 2021 +0200

    Structure and base logic

Link to build: https://jenkins.softwareheritage.org/job/DPROV/job/tests-on-diff/335/
See console output for more information: https://jenkins.softwareheritage.org/job/DPROV/job/tests-on-diff/335/console

Harbormaster returned this revision to the author for changes because remote builds failed.Sep 14 2021, 1:42 PM
Harbormaster failed remote builds in B23576: Diff 22640!
jayeshv updated this revision to Diff 22669.Sep 15 2021, 9:44 AM
  • small changes
  • structure changes and cache
swh-public-ci added a comment.Sep 15 2021, 9:44 AM

Build has FAILED

Patch application report for D6251 (id=22669)

Rebasing onto 3383cae57e...

First, rewinding head to replay your work on top of it...
Applying: Structure and base logic
Applying: small changes
Applying: structure changes and cache
Changes applied before test
commit 33b3ab8a1b7b77faf0c2b5590729bb49eaf280b6
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Wed Sep 15 09:42:16 2021 +0200

    structure changes and cache

commit 94cee90de35d42b215aed1c154e742d757e83519
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Tue Sep 14 13:51:34 2021 +0200

    small changes

commit 4073ca3f63484b411a796265cc557dca55bdd399
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Tue Sep 14 13:38:35 2021 +0200

    Structure and base logic

Link to build: https://jenkins.softwareheritage.org/job/DPROV/job/tests-on-diff/341/
See console output for more information: https://jenkins.softwareheritage.org/job/DPROV/job/tests-on-diff/341/console

Harbormaster returned this revision to the author for changes because remote builds failed.Sep 15 2021, 9:44 AM
Harbormaster failed remote builds in B23602: Diff 22669!
jayeshv updated this revision to Diff 22676.Sep 15 2021, 11:58 AM
  • cache
swh-public-ci added a comment.Sep 15 2021, 11:59 AM

Build has FAILED

Patch application report for D6251 (id=22676)

Rebasing onto 3383cae57e...

First, rewinding head to replay your work on top of it...
Applying: Structure and base logic
Applying: small changes
Applying: structure changes and cache
Applying: cache
Changes applied before test
commit c2c1ff725ededc287ca2b1e76916dd54f8a4b1fa
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Wed Sep 15 11:57:59 2021 +0200

    cache

commit d8fe35280ebb563ab32e373f0fb66a46be23f319
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Wed Sep 15 09:42:16 2021 +0200

    structure changes and cache

commit ea09d2c4922e69db75a6c7e521c33fe9e7127e57
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Tue Sep 14 13:51:34 2021 +0200

    small changes

commit 416bf59c77d839b43805b530045f07e0e0d76b20
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Tue Sep 14 13:38:35 2021 +0200

    Structure and base logic

Link to build: https://jenkins.softwareheritage.org/job/DPROV/job/tests-on-diff/342/
See console output for more information: https://jenkins.softwareheritage.org/job/DPROV/job/tests-on-diff/342/console

Harbormaster returned this revision to the author for changes because remote builds failed.Sep 15 2021, 11:59 AM
Harbormaster failed remote builds in B23609: Diff 22676!
jayeshv updated this revision to Diff 22741.Sep 16 2021, 1:32 PM
  • cache
  • bulk insert first
  • small
swh-public-ci added a comment.Sep 16 2021, 1:33 PM

Build has FAILED

Patch application report for D6251 (id=22741)

Rebasing onto 3383cae57e...

First, rewinding head to replay your work on top of it...
Applying: Structure and base logic
Applying: small changes
Applying: structure changes and cache
Applying: cache
Applying: cache
Applying: bulk insert first
Using index info to reconstruct a base tree...
M	swh/provenance/mongo/backend.py
Falling back to patching base and 3-way merge...
Auto-merging swh/provenance/mongo/backend.py
CONFLICT (content): Merge conflict in swh/provenance/mongo/backend.py
Patch failed at 0006 bulk insert first

Resolve all conflicts manually, mark them as resolved with
"git add/rm <conflicted_files>", then run "git rebase --continue".
You can instead skip this commit: run "git rebase --skip".
To abort and get back to the state before "git rebase", run "git rebase --abort".

Rebase failed (ret=1)!




Could not rebase; Attempt merge onto 3383cae57e...



Already up to date.





Changes applied before test



commit 7660f6472712ab27e8903ea60103ca5f44c3ee61
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Thu Sep 16 13:32:27 2021 +0200

    small

commit 5717573399e380a133423fe7cb592016b46bc174
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Thu Sep 16 13:30:12 2021 +0200

    bulk insert first

commit 6657f9c61c4411d709fb95da2afc9f6e8967e33f
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Thu Sep 16 09:36:21 2021 +0200

    cache

commit de51bad9b44330574b0b0354bb827f10468b2677
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Wed Sep 15 11:57:59 2021 +0200

    cache

commit 0eb53fefeef1947a400b6455aee0eb94a531dbe4
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Wed Sep 15 09:42:16 2021 +0200

    structure changes and cache

commit 9b9fee619f9b2f8bf3e194b08bdbfeb13249a61f
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Tue Sep 14 13:51:34 2021 +0200

    small changes

commit 38bcdeb9e67ff11a9cad74d2a58d858ace67dbc4
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Tue Sep 14 13:38:35 2021 +0200

    Structure and base logic



Link to build: https://jenkins.softwareheritage.org/job/DPROV/job/tests-on-diff/350/

See console output for more information: https://jenkins.softwareheritage.org/job/DPROV/job/tests-on-diff/350/console
Harbormaster returned this revision to the author for changes because remote builds failed.Sep 16 2021, 1:33 PM
Harbormaster failed remote builds in B23672: Diff 22741!
jayeshv updated this revision to Diff 22754.Sep 16 2021, 3:16 PM
    

  • upsert logic
    • 

swh-public-ci added a comment.Sep 16 2021, 3:16 PM
Build has FAILED



Patch application report for D6251 (id=22754)



Rebasing onto 3383cae57e...



First, rewinding head to replay your work on top of it...
Applying: Structure and base logic
Applying: small changes
Applying: structure changes and cache
Applying: cache
Applying: cache
Applying: bulk insert first
Using index info to reconstruct a base tree...
M	swh/provenance/mongo/backend.py
Falling back to patching base and 3-way merge...
Auto-merging swh/provenance/mongo/backend.py
CONFLICT (content): Merge conflict in swh/provenance/mongo/backend.py
Patch failed at 0006 bulk insert first

Resolve all conflicts manually, mark them as resolved with
"git add/rm <conflicted_files>", then run "git rebase --continue".
You can instead skip this commit: run "git rebase --skip".
To abort and get back to the state before "git rebase", run "git rebase --abort".



Rebase failed (ret=1)!






Could not rebase; Attempt merge onto 3383cae57e...



Already up to date.





Changes applied before test



commit 6a5c1e44b555df9bd6a77228f8221830f806a5e5
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Thu Sep 16 15:14:38 2021 +0200

    upsert logic

commit 5717573399e380a133423fe7cb592016b46bc174
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Thu Sep 16 13:30:12 2021 +0200

    bulk insert first

commit 6657f9c61c4411d709fb95da2afc9f6e8967e33f
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Thu Sep 16 09:36:21 2021 +0200

    cache

commit de51bad9b44330574b0b0354bb827f10468b2677
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Wed Sep 15 11:57:59 2021 +0200

    cache

commit 0eb53fefeef1947a400b6455aee0eb94a531dbe4
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Wed Sep 15 09:42:16 2021 +0200

    structure changes and cache

commit 9b9fee619f9b2f8bf3e194b08bdbfeb13249a61f
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Tue Sep 14 13:51:34 2021 +0200

    small changes

commit 38bcdeb9e67ff11a9cad74d2a58d858ace67dbc4
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Tue Sep 14 13:38:35 2021 +0200

    Structure and base logic



Link to build: https://jenkins.softwareheritage.org/job/DPROV/job/tests-on-diff/351/

See console output for more information: https://jenkins.softwareheritage.org/job/DPROV/job/tests-on-diff/351/console
Harbormaster returned this revision to the author for changes because remote builds failed.Sep 16 2021, 3:17 PM
Harbormaster failed remote builds in B23686: Diff 22754!
jayeshv updated this revision to Diff 22761.Sep 16 2021, 4:40 PM
    

  • small changes
    • 

swh-public-ci added a comment.Sep 16 2021, 4:41 PM
Build has FAILED



Patch application report for D6251 (id=22761)



Rebasing onto d0a11a1499...



First, rewinding head to replay your work on top of it...
Applying: Structure and base logic
Applying: small changes
Applying: structure changes and cache
Applying: cache
Applying: cache
Applying: bulk insert first
Using index info to reconstruct a base tree...
M	swh/provenance/mongo/backend.py
Falling back to patching base and 3-way merge...
Auto-merging swh/provenance/mongo/backend.py
CONFLICT (content): Merge conflict in swh/provenance/mongo/backend.py
Patch failed at 0006 bulk insert first

Resolve all conflicts manually, mark them as resolved with
"git add/rm <conflicted_files>", then run "git rebase --continue".
You can instead skip this commit: run "git rebase --skip".
To abort and get back to the state before "git rebase", run "git rebase --abort".



Rebase failed (ret=1)!






Could not rebase; Attempt merge onto d0a11a1499...



Already up to date.





Changes applied before test



commit cfd6ebb200bc286c4eb347765feff9a6df42375f
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Thu Sep 16 16:40:36 2021 +0200

    small changes

commit 6a5c1e44b555df9bd6a77228f8221830f806a5e5
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Thu Sep 16 15:14:38 2021 +0200

    upsert logic

commit 5717573399e380a133423fe7cb592016b46bc174
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Thu Sep 16 13:30:12 2021 +0200

    bulk insert first

commit 6657f9c61c4411d709fb95da2afc9f6e8967e33f
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Thu Sep 16 09:36:21 2021 +0200

    cache

commit de51bad9b44330574b0b0354bb827f10468b2677
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Wed Sep 15 11:57:59 2021 +0200

    cache

commit 0eb53fefeef1947a400b6455aee0eb94a531dbe4
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Wed Sep 15 09:42:16 2021 +0200

    structure changes and cache

commit 9b9fee619f9b2f8bf3e194b08bdbfeb13249a61f
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Tue Sep 14 13:51:34 2021 +0200

    small changes

commit 38bcdeb9e67ff11a9cad74d2a58d858ace67dbc4
Author: Jayesh Velayudhan <jayesh@softwareheritage.org>
Date:   Tue Sep 14 13:38:35 2021 +0200

    Structure and base logic



Link to build: https://jenkins.softwareheritage.org/job/DPROV/job/tests-on-diff/352/

See console output for more information: https://jenkins.softwareheritage.org/job/DPROV/job/tests-on-diff/352/console
Harbormaster returned this revision to the author for changes because remote builds failed.Sep 16 2021, 4:41 PM
Harbormaster failed remote builds in B23691: Diff 22761!
jayeshv abandoned this revision.Oct 27 2021, 4:33 PM
Revision Contents
Changeset List
PathSize
swh/
provenance/
mongo/
123 lines
8 lines
6 lines
models/
35 lines
14 lines
4 lines
54 lines
4 lines
4 lines
34 lines
104 lines
tests/
1 line
tests/
8 lines
Diff 22741
View Options
swh/provenance/mongo/backend.py
Loading...
View Options
swh/provenance/mongo/bootstrap.py
Loading...
View Options
swh/provenance/mongo/errors.py
Loading...
View Options
swh/provenance/mongo/models/cache.py
Loading...
View Options
swh/provenance/mongo/models/content.py
Loading...
View Options
swh/provenance/mongo/models/directory.py
Loading...
View Options
swh/provenance/mongo/models/entity.py
Loading...
View Options
swh/provenance/mongo/models/origin.py
Loading...
View Options
swh/provenance/mongo/models/revision.py
Loading...
View Options
swh/provenance/mongo/schema.json
Loading...
View Options
swh/provenance/mongo/storage.py
Loading...
View Options
swh/provenance/mongo/tests/__init__.py
Loading...
View Options
swh/provenance/tests/test_provenance_storage.py
Loading...
About · Developer information · Legal