In T2310#43131, @ardumont wrote:Thanks for the questions. I'm unsure about some questions and i replied as best
i could.do we allow an OriginVisitUpdate(status='ongoing', snaphost=None)? what would
be the meaning of this?Yes. It means "loading started, so no snapshot yet".
That sounds sensible ;)
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Apr 7 2020
Apr 7 2020
In T2310#43129, @vlorentz wrote:We currently don't have "created" (so no "start" either), but it would make sense to create it.
Regarding this model, a few questions come to my mind:
- do we allow an OriginVisitUpdate(status='ongoing', snaphost=None)? what would be the meaning of this? or do we enforce one just after the created step to model the start transition?
This could mean these things:
- on a first update, to mean the visit was created (but we don't need it if we have a "created" state)
Apr 6 2020
Apr 6 2020
As I understand this, an origin visit, consisting in one OriginVisit object plus a list of OriginVisitUpdate represent the process of visiting an origin to load its content in the archive.
Apr 3 2020
Apr 3 2020
douardda committed rDJNL7d6ead58a430: writer: make the writer use swh.model objects instead of (possibly) dicts (authored by douardda).
writer: make the writer use swh.model objects instead of (possibly) dicts
douardda committed rDJNLf3112dbf7cce: Enforce current dev version of pyflakes in tox and pre-commit (authored by douardda).
Enforce current dev version of pyflakes in tox and pre-commit
douardda committed rDJNLa25e1222aed6: Add a setup.cfg to make flake8 compatible with blackified files (authored by douardda).
Add a setup.cfg to make flake8 compatible with blackified files
douardda updated the diff for D2956: writer: make the writer use swh.model objects instead of (possibly) dicts.
rebase + add comment on @overload usage
rebase + modify tox as well
douardda updated the diff for D2954: Add a setup.cfg to make flake8 compatible with blackified files.
rebased
douardda added inline comments to D2956: writer: make the writer use swh.model objects instead of (possibly) dicts.
closed by f6a398f99a5fa57e590fc4dfaf4fdc880eefba9d
Code cleanup to make flake8 happy
douardda committed rDJNL9c697f681289: test: use Multihash to create a valid dict for a Content object (authored by douardda).
test: use Multihash to create a valid dict for a Content object
Apr 2 2020
Apr 2 2020
Apr 1 2020
Apr 1 2020
Let's consider this done with the landing of D2819 which adds runtime type validation.
see D2940
douardda accepted D2937: in_memory storage: Adapt internal implementations to use origin visit status model representation.
LGTM
closed by ca0f6a1eb7e6079ee0b8a649ff40353409c86560
closed by 414a6552143a1e2406bb980ed905969f4b778ad7
closed by f51327138fa14c5b285ffad2b2844afbb48e8462
closed by 20baa1b0bb3359e3a91a249fa1bae4d78cf1ddf2
closed by df3207a6b753b254e945db492227b3bb9bbac7d6
closed by fa4a043887e960731da5373f92e3f951ba411bc5
closed by fcca905a95a262dc5596ff2afd71c657a1bcb522
douardda committed rDMODca0f6a1eb7e6: model: add support for ctime in [Skipped]Content.from_[data,dict]() (authored by douardda).
model: add support for ctime in [Skipped]Content.from_[data,dict]()
douardda committed rDMOD414a6552143a: model: small code improvement of SkippedContent.from_dict (authored by douardda).
model: small code improvement of SkippedContent.from_dict
douardda committed rDMOD6ce0f71458d4: model: fix SkippedContent origin to be a str (authored by douardda).
model: fix SkippedContent origin to be a str
douardda committed rDMODf51327138fa1: hypothesis: split hypothesis strategies as a dict + entity instance (authored by douardda).
hypothesis: split hypothesis strategies as a dict + entity instance
douardda committed rDMOD10b069921e74: model: improve a bit the TimestampWithTimezone model (authored by douardda).
model: improve a bit the TimestampWithTimezone model
douardda committed rDMODac9d4c84a115: tests: add low level tests for the Timestamp model entity (authored by douardda).
tests: add low level tests for the Timestamp model entity
douardda committed rDMOD85ca7d784800: model: use attrs_static to enforce type validation of model objects (authored by douardda).
model: use attrs_static to enforce type validation of model objects
douardda committed rDSTOdf3207a6b753: Adapt cassandra backend to validating model types (authored by douardda).
Adapt cassandra backend to validating model types
douardda committed rDSTO20baa1b0bb33: test: convert test_converts.py to pytest style (authored by douardda).
test: convert test_converts.py to pytest style
douardda committed rDSTOfa4a043887e9: test: get rid of normalized_xxx in tests (authored by douardda).
test: get rid of normalized_xxx in tests
douardda committed rDSTOfcca905a95a2: test: ensure timestamp in test data are properly typed (authored by douardda).
test: ensure timestamp in test data are properly typed
In D2914#70906, @vlorentz wrote:In D2914#70849, @douardda wrote:In D2914#70601, @vlorentz wrote:it also misses tests to check date_to_db is used in release_to_db and revision_to_db
ok (but plz give all the infos/comments at once!)
It was a comment on your new version on the diff.
douardda updated the diff for D2906: model: add support for ctime in [Skipped]Content.from_[data,dict]().
rebase
rebase
douardda updated the diff for D2905: hypothesis: split hypothesis strategies as a dict + entity instance.
rebase + update for new origin visit updates entity
rebas
rebase
douardda updated the diff for D2819: model: use attrs_static to enforce type validation of model objects.
rebased
In D2914#70849, @douardda wrote:In D2914#70601, @vlorentz wrote:it also misses tests to check date_to_db is used in release_to_db and revision_to_db
ok (but plz give all the infos/comments at once!)
In D2914#70601, @vlorentz wrote:it also misses tests to check date_to_db is used in release_to_db and revision_to_db
douardda committed rDJNLca7e9d20c5c8: test: reimplement a local version of 'object_dicts' with 'skipped_content' (authored by douardda).
test: reimplement a local version of 'object_dicts' with 'skipped_content'
douardda committed rDJNLcd0485050688: test: ensure test data is properly typed (authored by douardda).
test: ensure test data is properly typed
Mar 31 2020
Mar 31 2020
douardda updated the diff for D2906: model: add support for ctime in [Skipped]Content.from_[data,dict]().
add a test for ctime as string in Content.from_dict()
Mar 30 2020
Mar 30 2020
douardda committed rDLDGa600855a1234: converters: fix types of TimestampWithTimezone arguments (authored by douardda).
converters: fix types of TimestampWithTimezone arguments
douardda added a comment to D2918: GitLoader: instantiate SnapshotBranch object using the from_dict factory.
In D2918#70261, @vlorentz wrote:DULWICH_TARGET_TYPES are already the right enum values.
Typo in the first commit message
douardda updated the diff for D2906: model: add support for ctime in [Skipped]Content.from_[data,dict]().
with the actual revision merged in...
test: make test data properly typed
In D2916#70253, @vlorentz wrote:This is going in the right direction, but I don't like the CassObject thing. I think you made it because you are conflating two uses of my "Frankenstein's model objects":
- Reads, where you can use the row directly (it's a namedtuple, so attr access)
- Writes, where a dict would do (item access)
add a test for date_to_db so the test coverage of this later stays the same
douardda committed rDSTO623a1b75cb97: test: add a small test to check for type validation (using release_add) (authored by douardda).
test: add a small test to check for type validation (using release_add)
douardda committed rDSTO90c411266897: validate: fix type annotation for origin_visit_add (authored by douardda).
validate: fix type annotation for origin_visit_add
douardda committed rDSTO1916fd71f26f: validate: ensure StorageArgumentException is always encodable (authored by douardda).
validate: ensure StorageArgumentException is always encodable
douardda committed rDSTOc67fe217f006: writer: fix skipped_content_add type declaration to use SkippedContent (authored by douardda).
writer: fix skipped_content_add type declaration to use SkippedContent
douardda committed rDSTO19be96fa306a: tests: fix types of several test data sets (authored by douardda).
tests: fix types of several test data sets
douardda updated the diff for D2906: model: add support for ctime in [Skipped]Content.from_[data,dict]().
Rebase + comments from vlorentz
Rebase
douardda updated the diff for D2905: hypothesis: split hypothesis strategies as a dict + entity instance.
Get rid of unnecessary calls to builds() as reported by vlorentz
douardda added a comment to D2905: hypothesis: split hypothesis strategies as a dict + entity instance.
In D2905#70213, @vlorentz wrote:You should rewrite all the object-generating strategies:
def releases(): return builds( Release.from_dict, releases_d())becomes:
releases = releases_d().map(Release.from_dict)build() is only useful if you want hypothesis to read the constructor's signature.
Mar 27 2020
Mar 27 2020