For the record, we recently disabled any origin URL processing in the Web API part (we were checking an origin URL with and without
trailing slash, but this should only be performed in the Web UI as the Web API should be as dumb as possible, see D7988).
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed All Stories
All Stories
All Stories
Jul 1 2022
Jul 1 2022
douardda triaged T4370: Refactor the origin visit data model (aka get rid of the OriginVisit model object) as High priority.
douardda requested review of D8066: Add the 'flavor' argument to db_utils.initialize_database_for_module().
jayeshv committed rDGQLe4d4a30b1f36: Add type annotations for base_connection (authored by jayeshv).
Add type annotations for base_connection
Looks good to me.
Build is green
Address review comments
Harbormaster failed remote builds in B30196: Diff 29104 for D8047: Indexer for Packagist(composer.json)!
Build was aborted
Excludes author.role from composer.py
Build is green
Add type annotation on _get_paged_result functions
jayeshv added a revision to T4261: Swh-graphql Code cleanup: D8065: Add type annotations for base_connection.
Nice catch.... actually, the GitLab API uses the project slug (e.g.: checkscale-gitlab/git-wtf) without the .git, we should make sure we can handle this same slug
douardda triaged T4368: Loosen "foreign key" validation in storages used as mirror ingestion endpoint as High priority.
douardda added a comment to T2309: Add support for other hash algo than sha1 in current objstorage implementation.
In T2309#87779, @douardda wrote:do you have in mind to make the actual hash used as primary key in an objstorage a configuration of said storage instance? e.g. create a pathslicer or s3 objstorage using sha256 is just a matter of configuration of the objstorage?
douardda added a comment to T2309: Add support for other hash algo than sha1 in current objstorage implementation.
do you have in mind to make the actual hash used as primary key in an objstorage a configuration of said storage instance? e.g. create a pathslicer or s3 objstorage using sha256 is just a matter of configuration of the objstorage?
ardumont committed rCJSWH0613c0c9d3df: README.md: Improve gogs setup instructions (authored by ardumont).
README.md: Improve gogs setup instructions
Ignore docker-compose.override.yml
Build is green
Excludes codemeta-v1 column from composer.csv
Jun 30 2022
Jun 30 2022
vsellier committed rCJSWHb0e07c673ec0: wip - add a forge to host the local Changes (authored by vsellier).
wip - add a forge to host the local Changes
Build is green
Corrects Copyright year
Build is green
Adds license to composer.py
Excludes redundant columns from composer.csv
Build is green
Undo changes to crosswalk.csv
Build is green
Build is green
Undo changes to crosswalk.csv
Composer mappings use a separate table
seirl committed rDGRPH555e3b6d3e11: rpc_server: use shlex.quote() to print command (authored by seirl).
rpc_server: use shlex.quote() to print command
Remove shlex.join() call (3.8 only)
GRPC: use port 50091 by default
Update sux4j to 5.4.0
Build is green
Adds composer mappings to metadata dictionary
seirl committed rDGRPH26e52b389fb1: rpc_server.py: terminate, then kill server on timeout (authored by seirl).
rpc_server.py: terminate, then kill server on timeout
seirl added a comment to T3259: Gracefully handle a client closing the connection in the middle of a response being streamed.
GRPC update: cancelling a GRPC stream works fine, but it doesn't seem like aiohttp is doing that when the HTTP stream is closed.
ardumont committed rCJSWHb0872b4ec80b: wip: Start swh-apps/update-dependencies job (authored by ardumont).
wip: Start swh-apps/update-dependencies job
ardumont committed rCJSWH6ce55e57218b: wip: Start swh-apps/update-dependencies job (authored by ardumont).
wip: Start swh-apps/update-dependencies job
ardumont committed rCJSWHdfac84b3435f: wip: Start swh-apps/update-dependencies job (authored by ardumont).
wip: Start swh-apps/update-dependencies job
ardumont committed rCJSWHe41c157273e8: wip: Start swh-apps/update-dependencies job (authored by ardumont).
wip: Start swh-apps/update-dependencies job
ardumont committed rCJSWHd25fc9bb8b51: wip: Start swh-apps/update-dependencies job (authored by ardumont).
wip: Start swh-apps/update-dependencies job
We requested a larger quota here: https://github.com/pypa/pypi-support/issues/1998
DumpProperties: fix output for tag names
wip - poc the swh-apps pipeline
wip - poc the swh-apps pipeline
README.md: Adapt docker instructions
seirl committed rDGRPH3b9685923021: Re-add swh/graph/client.py for backward-compatibility (authored by seirl).
Re-add swh/graph/client.py for backward-compatibility
vsellier committed rSPSITE57fb33253ca7: fix a typo on the production objstorage vhost (authored by vsellier).
fix a typo on the production objstorage vhost
Great, thanks !
fix typo for fun and profit! ;)
jayeshv renamed T4367: GraphQL: Pagination fixes to comply with the Relay spec from GraphQL: Fix issue in pagination to GraphQL: Fix issue in pagination 'after' argument.
seirl closed T2100: Bootstrap Debian packaging for swh.graph, a subtask of T3168: Proper deployment of swh-graph with debian package, as Wontfix.
We are migrating away from Debian packages as a deployment tool, closing this as WONTFIX.
We are migrating away from Debian packages as a deployment tool, closing this as WONTFIX.
No longer happens after the GRPC migration:
seirl closed T2103: (Debian) package py4j, a subtask of T2100: Bootstrap Debian packaging for swh.graph, as Wontfix.
We removed the Py4J dependency by migrating to GRPC.
We no longer support multiple algorithms for shortest path requests.
Obsoleted by the migration to GRPC. Now we use GRPC's threading model, with a threadpool configurable by passing --threads to the Java service. By default, nproc is used.
seirl committed rDGRPH32f2626a7d0a: Generate .labelobl files to speed-up labelled graph loading (authored by seirl).
Generate .labelobl files to speed-up labelled graph loading
Obsoleted by the migration to GRPC. We no longer create iterators on the decoded stream of a UNIX pipeline, we directly use GRPC stream iterators.
swh-public-ci added a comment to D8059: Generate .labelobl files to speed-up labelled graph loading.
Build is green
swh-public-ci added a comment to D8059: Generate .labelobl files to speed-up labelled graph loading.
Build has FAILED
vsellier committed rCJSWH21e47db56cb5: Add a docker environment to test the job-builder inside jenkins (authored by vsellier).
Add a docker environment to test the job-builder inside jenkins
Harbormaster failed remote builds in B30170: Diff 29081 for D8059: Generate .labelobl files to speed-up labelled graph loading!