Page MenuHomeSoftware Heritage
Feed Advanced Search

Aug 11 2022

jayeshv updated the diff for D8231: Add the possibility to search using a SWHID.

Extra check for object type while returing directory and snapshot

Aug 11 2022, 10:49 AM
jayeshv triaged T4430: GraphQL: Add a provenance backend as Low priority.
Aug 11 2022, 9:28 AM · GraphQL API
jayeshv updated the diff for D8231: Add the possibility to search using a SWHID.

bug fix

Aug 11 2022, 9:21 AM

Aug 10 2022

jayeshv updated the diff for D8231: Add the possibility to search using a SWHID.

doc string update

Aug 10 2022, 6:46 PM
jayeshv retitled D8231: Add the possibility to search using a SWHID from WIP: Add the possibility to search using a SWHID to Add the possibility to search using a SWHID.
Aug 10 2022, 4:35 PM
jayeshv updated the diff for D8231: Add the possibility to search using a SWHID.

schema updates

Aug 10 2022, 4:32 PM
jayeshv updated the diff for D8231: Add the possibility to search using a SWHID.

Add functional tests

Aug 10 2022, 3:47 PM
jayeshv requested review of D8231: Add the possibility to search using a SWHID.
Aug 10 2022, 2:52 PM
jayeshv added a revision to T4263: Add a search entrypoint to the GraphQL schema: D8231: Add the possibility to search using a SWHID.
Aug 10 2022, 2:50 PM · GraphQL API

Aug 9 2022

jayeshv updated the task description for T4310: GraphQL: Add missing fields in the content object.
Aug 9 2022, 11:06 AM · GraphQL API
jayeshv updated the task description for T4263: Add a search entrypoint to the GraphQL schema.
Aug 9 2022, 11:03 AM · GraphQL API

Aug 8 2022

jayeshv updated the task description for T4263: Add a search entrypoint to the GraphQL schema.
Aug 8 2022, 11:23 AM · GraphQL API

Aug 4 2022

jayeshv accepted D8176: requirements-test.txt: Blacklist Flask 2.2.0 for tests.
Aug 4 2022, 9:45 AM

Jul 6 2022

jayeshv abandoned D6291: WIP - Unit tests for the mongo backend.

Not relevant anymore

Jul 6 2022, 12:54 PM
jayeshv triaged T4382: GraphQL: Address STORAGE-TODOs in code as Low priority.
Jul 6 2022, 11:19 AM · GraphQL API
jayeshv updated the task description for T4367: GraphQL: Pagination fixes to comply with the Relay spec.
Jul 6 2022, 11:16 AM · GraphQL API
jayeshv added a comment to D8077: Add a static query cost calculator to reject malicious quries.

Oh wait I get it. Doing a connection with n nodes costs c*n (for a constant c you implicitly decided to be 1), then fetching each of these nodes also costs n, so it's c*n+n.

Yeah that makes sense to me.

Jul 6 2022, 10:14 AM
jayeshv added a comment to D8077: Add a static query cost calculator to reject malicious quries.

But there is also a per-node cost of 1, so that's the incensentive, right?

Jul 6 2022, 9:13 AM
jayeshv added a comment to D8077: Add a static query cost calculator to reject malicious quries.

An issue I have is with calculating cost for connections. As of now, I have hard coded that to 2 for every connection. But I don't really like this.

Why?

Jul 6 2022, 9:02 AM

Jul 5 2022

jayeshv updated the task description for T4263: Add a search entrypoint to the GraphQL schema.
Jul 5 2022, 3:16 PM · GraphQL API
jayeshv added a comment to D8077: Add a static query cost calculator to reject malicious quries.

These @cost directives will be ignored by parsers that don't support it, right?

Jul 5 2022, 10:27 AM
jayeshv updated the task description for T4299: GraphQL: Static query validation and max cost limiting.
Jul 5 2022, 9:29 AM · GraphQL API
jayeshv updated the diff for D8077: Add a static query cost calculator to reject malicious quries.

doc updates

Jul 5 2022, 9:09 AM
jayeshv retitled D8077: Add a static query cost calculator to reject malicious quries from Add basic rate limiting to Add a basic query cost validator.
Jul 5 2022, 6:44 AM
jayeshv updated the diff for D8077: Add a static query cost calculator to reject malicious quries.

Commit message updates

Jul 5 2022, 6:43 AM

Jul 4 2022

jayeshv retitled D8077: Add a static query cost calculator to reject malicious quries from WIP: Add basic rate limiting to Add basic rate limiting.
Jul 4 2022, 7:22 PM
jayeshv updated the diff for D8077: Add a static query cost calculator to reject malicious quries.

functional tests

Jul 4 2022, 7:21 PM
jayeshv updated the diff for D8077: Add a static query cost calculator to reject malicious quries.

Remove multiplier for connections; set complexity to 2

Jul 4 2022, 5:00 PM
jayeshv updated the diff for D8077: Add a static query cost calculator to reject malicious quries.

cost for nodes

Jul 4 2022, 3:57 PM
jayeshv requested review of D8077: Add a static query cost calculator to reject malicious quries.
Jul 4 2022, 3:36 PM
jayeshv added a revision to T4299: GraphQL: Static query validation and max cost limiting: D8077: Add a static query cost calculator to reject malicious quries.
Jul 4 2022, 3:34 PM · GraphQL API
jayeshv updated the task description for T4299: GraphQL: Static query validation and max cost limiting.
Jul 4 2022, 9:40 AM · GraphQL API

Jul 1 2022

jayeshv closed D8065: Add type annotations for base_connection.
Jul 1 2022, 3:00 PM
jayeshv committed rDGQLe4d4a30b1f36: Add type annotations for base_connection (authored by jayeshv).
Add type annotations for base_connection
Jul 1 2022, 3:00 PM
jayeshv updated the diff for D8065: Add type annotations for base_connection.

Address review comments

Jul 1 2022, 2:52 PM
jayeshv updated the diff for D8065: Add type annotations for base_connection.

Add type annotation on _get_paged_result functions

Jul 1 2022, 12:17 PM
jayeshv requested review of D8065: Add type annotations for base_connection.
Jul 1 2022, 11:55 AM
jayeshv added a revision to T4261: Swh-graphql Code cleanup: D8065: Add type annotations for base_connection.
Jul 1 2022, 11:53 AM · GraphQL API
jayeshv updated the task description for T4365: GraphQL: Use the right date time serialization.
Jul 1 2022, 10:54 AM · GraphQL API
jayeshv updated the task description for T4366: GraphQL: add revision log to the revision type.
Jul 1 2022, 10:54 AM · GraphQL API

Jun 30 2022

jayeshv renamed T4367: GraphQL: Pagination fixes to comply with the Relay spec from GraphQL: Fix issue in pagination to GraphQL: Fix issue in pagination 'after' argument.
Jun 30 2022, 4:33 PM · GraphQL API
jayeshv triaged T4367: GraphQL: Pagination fixes to comply with the Relay spec as Low priority.
Jun 30 2022, 4:32 PM · GraphQL API
jayeshv triaged T4366: GraphQL: add revision log to the revision type as Normal priority.
Jun 30 2022, 4:17 PM · GraphQL API
jayeshv triaged T4365: GraphQL: Use the right date time serialization as Normal priority.
Jun 30 2022, 4:15 PM · GraphQL API
jayeshv updated the task description for T4299: GraphQL: Static query validation and max cost limiting.
Jun 30 2022, 3:57 PM · GraphQL API
jayeshv lowered the priority of T4321: GraphQL: Add metadata to the schema from Normal to Low.
Jun 30 2022, 3:55 PM · GraphQL API
jayeshv updated the task description for T4309: GraphQL: Add missing target types in snapshot branch.
Jun 30 2022, 3:47 PM · GraphQL API
jayeshv closed T4308: GraphQL: Fix missing fields in Content object as Resolved.
Jun 30 2022, 3:44 PM · GraphQL API
jayeshv closed T4308: GraphQL: Fix missing fields in Content object, a subtask of T4083: New public API (GraphQL + thin layer), as Resolved.
Jun 30 2022, 3:44 PM · GraphQL API, Roadmap 2022

Jun 29 2022

jayeshv updated the diff for D8020: [WIP] Add a search entrypoint.

swhid search for contnet

Jun 29 2022, 2:46 PM
jayeshv updated the diff for D8020: [WIP] Add a search entrypoint.

release search with swhid

Jun 29 2022, 12:20 PM
jayeshv updated the diff for D8020: [WIP] Add a search entrypoint.

Swhid search for revision

Jun 29 2022, 11:40 AM

Jun 28 2022

jayeshv updated the diff for D8020: [WIP] Add a search entrypoint.

origin search

Jun 28 2022, 5:46 PM
jayeshv updated the diff for D8020: [WIP] Add a search entrypoint.

bug fix

Jun 28 2022, 11:23 AM
jayeshv updated the diff for D8020: [WIP] Add a search entrypoint.

doc strings update

Jun 28 2022, 9:05 AM
jayeshv updated the diff for D8020: [WIP] Add a search entrypoint.

basic control flow and docs

Jun 28 2022, 8:49 AM

Jun 24 2022

jayeshv closed D8032: Refactoring: remove unnecessary code.
Jun 24 2022, 2:37 PM
jayeshv committed rDGQL836eddb72ec8: Refactoring: remove unnecessary code (authored by jayeshv).
Refactoring: remove unnecessary code
Jun 24 2022, 2:37 PM
jayeshv requested review of D8032: Refactoring: remove unnecessary code.
Jun 24 2022, 12:22 PM

Jun 23 2022

jayeshv triaged T4350: Search in web UI using metadata is throwing an error as High priority.
Jun 23 2022, 3:27 PM · Web app
jayeshv updated the diff for D8020: [WIP] Add a search entrypoint.

basic working version

Jun 23 2022, 3:12 PM
jayeshv closed D7987: Refactor snapshot branch functional tests.
Jun 23 2022, 1:32 PM
jayeshv committed rDGQLce677e0bdeba: Refactor snapshot branch functional tests (authored by jayeshv).
Refactor snapshot branch functional tests
Jun 23 2022, 1:32 PM

Jun 22 2022

jayeshv requested review of D8020: [WIP] Add a search entrypoint.
Jun 22 2022, 3:40 PM
jayeshv accepted D8016: cache: Don't return objstorage.add's return value, and add types.
Jun 22 2022, 11:30 AM
jayeshv accepted D8015: Remove unused assignment of objstorage.add's return value.
Jun 22 2022, 11:19 AM

Jun 20 2022

jayeshv abandoned D7980: Return origin object for analogues URLs.

This change is not required

Jun 20 2022, 2:22 PM

Jun 17 2022

jayeshv added inline comments to D7987: Refactor snapshot branch functional tests.
Jun 17 2022, 2:31 PM
jayeshv added inline comments to D7987: Refactor snapshot branch functional tests.
Jun 17 2022, 11:48 AM
jayeshv updated the diff for D7987: Refactor snapshot branch functional tests.

Add utility function for building param string

Jun 17 2022, 11:43 AM

Jun 16 2022

jayeshv triaged T4332: SWH-WEB: Fix relevant issues reported by static analysis as Low priority.
Jun 16 2022, 5:29 PM · meta-task, Web app
jayeshv committed rDGQLed8d98201138: Fix the typo in union resolver test function name (authored by jayeshv).
Fix the typo in union resolver test function name
Jun 16 2022, 10:56 AM
jayeshv closed D7994: Add unit tests for snapshot branch target resolvers.
Jun 16 2022, 10:50 AM
jayeshv committed rDGQL1bff0aa8725f: Add unit tests for snapshot branch target resolvers (authored by jayeshv).
Add unit tests for snapshot branch target resolvers
Jun 16 2022, 10:50 AM
jayeshv added a comment to D7994: Add unit tests for snapshot branch target resolvers.

"if you say so" ;)

Jun 16 2022, 10:50 AM
jayeshv closed T4306: Use query variables instead of f-strings in swh-graphql tests as Resolved.
Jun 16 2022, 9:30 AM · GraphQL API
jayeshv closed T4306: Use query variables instead of f-strings in swh-graphql tests, a subtask of T4261: Swh-graphql Code cleanup, as Resolved.
Jun 16 2022, 9:30 AM · GraphQL API
jayeshv requested review of D7994: Add unit tests for snapshot branch target resolvers.
Jun 16 2022, 9:21 AM
jayeshv committed rDGQLdcfa280b152e: Remove unused utility functions (authored by jayeshv).
Remove unused utility functions
Jun 16 2022, 9:15 AM

Jun 15 2022

jayeshv added inline comments to D7987: Refactor snapshot branch functional tests.
Jun 15 2022, 7:30 PM
jayeshv updated the diff for D7987: Refactor snapshot branch functional tests.

Adressing some review comments

Jun 15 2022, 7:21 PM
jayeshv closed D7990: Refactor origin node functional tests.
Jun 15 2022, 4:54 PM
jayeshv committed rDGQL04b81ece1bfd: Refactor origin node functional tests (authored by jayeshv).
Refactor origin node functional tests
Jun 15 2022, 4:54 PM
jayeshv updated the diff for D7990: Refactor origin node functional tests.

rebase

Jun 15 2022, 4:51 PM
jayeshv closed D7989: Refactor origin connection functional tests.
Jun 15 2022, 4:46 PM
jayeshv committed rDGQL66c55a2f30ce: Refactor origin connection functional tests (authored by jayeshv).
Refactor origin connection functional tests
Jun 15 2022, 4:46 PM
jayeshv updated the diff for D7989: Refactor origin connection functional tests.

adress review comments

Jun 15 2022, 4:42 PM
jayeshv updated the diff for D7989: Refactor origin connection functional tests.

rebase

Jun 15 2022, 1:56 PM
jayeshv updated the diff for D7989: Refactor origin connection functional tests.

building query params from a dict

Jun 15 2022, 1:55 PM

Jun 14 2022

jayeshv added inline comments to D7990: Refactor origin node functional tests.
Jun 14 2022, 6:51 PM
jayeshv closed D7991: Use query variables instead of f-strings in functional tests.
Jun 14 2022, 4:15 PM
jayeshv committed rDGQL2c457bf0bc7f: Use query variables instead of f-strings in functional tests (authored by jayeshv).
Use query variables instead of f-strings in functional tests
Jun 14 2022, 4:15 PM
jayeshv requested review of D7991: Use query variables instead of f-strings in functional tests.
Jun 14 2022, 3:52 PM
jayeshv added a revision to T4306: Use query variables instead of f-strings in swh-graphql tests: D7991: Use query variables instead of f-strings in functional tests.
Jun 14 2022, 3:50 PM · GraphQL API
jayeshv requested review of D7990: Refactor origin node functional tests.
Jun 14 2022, 3:12 PM
jayeshv requested review of D7989: Refactor origin connection functional tests.
Jun 14 2022, 3:08 PM
jayeshv requested review of D7987: Refactor snapshot branch functional tests.
Jun 14 2022, 2:52 PM
jayeshv committed rDGQL67e0bf737061: Add a test case to validate edge cursor in snapshot branch (authored by jayeshv).
Add a test case to validate edge cursor in snapshot branch
Jun 14 2022, 1:44 PM
jayeshv added a comment to D7980: Return origin object for analogues URLs.

Why should this be implemented by the API (as opposed to UIs)?

This is part of our current REST APIs.

which is not a good enough argument to keep it. Let's not reproduce (potential) mistakes, if we can.

I think it makes sense to return
data with or without a slash in both UI and API.

I also agree, extra trailing slash or missing trailing slash in origin URL is a common source of errors when searching for an origin,
better handle that case API side.

I disagree; one expect the API to behave as dumb/simple as possible: you ask for an origin URL, the API should return data on that very specific URL only. Imagine we do have stored both versions of the origin URL (for historical reasons), with and without a trailing /, we want the API to allow the user query one or the other.

If need be, provide an dedicated API endpoint to search for known similar origins, but make it a dedicated one, not part of the main get_origin endpoint.

As @vlorentz suggested, this "smart" behavior is indeed an UI concern, not an API one.

Jun 14 2022, 12:43 PM
jayeshv closed D7986: Remove unnecessary base exception.
Jun 14 2022, 12:42 PM