Page MenuHomeSoftware Heritage

KShivendu (Kumar Shivendu)
User

Projects

User does not belong to any projects.

User Details

User Since
Feb 23 2021, 11:48 AM (70 w, 2 d)

Recent Activity

Yesterday

KShivendu added inline comments to D6138: package/utils: Handle downloads for urls with missing schema.
Thu, Jun 30, 8:07 AM
KShivendu added a comment to D6138: package/utils: Handle downloads for urls with missing schema.

Is it safe to land this now?

Thu, Jun 30, 7:19 AM

Mon, Jun 6

KShivendu edited P1378 Nix/Guix origin types.
Mon, Jun 6, 9:38 PM
KShivendu edited P1378 Nix/Guix origin types.
Mon, Jun 6, 9:36 PM
KShivendu edited P1378 Nix/Guix origin types.
Mon, Jun 6, 9:30 PM
KShivendu edited P1378 Nix/Guix origin types.
Mon, Jun 6, 8:46 PM
KShivendu edited P1378 Nix/Guix origin types.
Mon, Jun 6, 8:46 PM
KShivendu created P1378 Nix/Guix origin types.
Mon, Jun 6, 8:34 PM

May 17 2022

KShivendu updated subscribers of T4251: [swh-search] Investigate long search queries response time.
May 17 2022, 8:50 AM · System administration, Archive search
KShivendu created T4251: [swh-search] Investigate long search queries response time.
May 17 2022, 8:49 AM · System administration, Archive search

May 16 2022

KShivendu edited P1364 swh search kibana profiling .
May 16 2022, 9:08 PM
KShivendu added a comment to P1364 swh search kibana profiling .

Please run the above-mentioned queries using the Kibana search profiler as shown in the attached screenshot.

May 16 2022, 9:00 PM
KShivendu edited P1364 swh search kibana profiling .
May 16 2022, 8:58 PM
KShivendu added a comment to P1364 swh search kibana profiling .

Partial docker-compose.search.yml for introducing Kibana:

May 16 2022, 8:55 PM
KShivendu created P1364 swh search kibana profiling .
May 16 2022, 8:52 PM
KShivendu updated subscribers of T3560: Polish the swh-search QL.

Hey @vlorentz @zack, I've been using sourcegraph.com for almost a year now and I feel that they have worked a lot on polishing their search query language. I think we can learn from them and adapt our language. Here are a few suggestions:

May 16 2022, 10:38 AM · Archive search

Apr 20 2022

KShivendu triaged T4181: Fix overlaps in navbar for mobile devices as Wishlist priority.
Apr 20 2022, 6:54 AM · Easy hack, Web app

Apr 7 2022

KShivendu abandoned D7516: Fix query language metadata filter example.
Apr 7 2022, 9:48 AM
KShivendu added a comment to D7516: Fix query language metadata filter example.

Abandoning because this diff is a duplicate of D7510.

Apr 7 2022, 9:47 AM
KShivendu closed D7510: docs: Update query language metadata filter example.
Apr 7 2022, 9:47 AM
KShivendu committed rDSEA434bd252a2c7: Fix query language metadata filter example (authored by KShivendu).
Fix query language metadata filter example
Apr 7 2022, 9:47 AM
KShivendu requested review of D7516: Fix query language metadata filter example.
Apr 7 2022, 9:25 AM
KShivendu updated the diff for D7510: docs: Update query language metadata filter example.

Rebase

Apr 7 2022, 9:22 AM

Apr 5 2022

KShivendu requested review of D7510: docs: Update query language metadata filter example.
Apr 5 2022, 9:32 PM

Feb 18 2022

KShivendu added a comment to T3909: Get feedback on the swh-search QL.

@ardumont I'm neither able to access my account nor reset my password (Not receiving email from sentry.softwareheritage.org).
Is it possible to do something from your side?

Feb 18 2022, 9:18 AM · Archive search

Feb 12 2022

KShivendu added a comment to T3909: Get feedback on the swh-search QL.

@vlorentz Can you check what's the query (swh ql) for this request using sentry?

Feb 12 2022, 10:54 AM · Archive search

Feb 11 2022

KShivendu added a comment to T3926: Better syntax errors for the search query language.

Possible invalid queries [WIP]:

Feb 11 2022, 2:22 PM · Archive search

Feb 10 2022

KShivendu added a comment to T3910: Add an option to enable the swh-search QL for some users.

Yes, I can see the option. It's awesome to see 3 months of my hard work being live :D
Thanks a lot @ardumont

Feb 10 2022, 6:03 PM · Web app, Archive search
KShivendu added a comment to T3910: Add an option to enable the swh-search QL for some users.

Hi @vlorentz, I wasn't aware that the SWH staff members are using the query language. I thought that it is yet to be used by anyone. I'd like to try it and maybe even restart contributing whenever I'm free :)

Feb 10 2022, 3:56 PM · Web app, Archive search

Jan 16 2022

KShivendu archived P1257 rqwe.
Jan 16 2022, 10:09 AM
KShivendu created P1257 rqwe.
Jan 16 2022, 10:07 AM

Sep 4 2021

KShivendu added a comment to D6138: package/utils: Handle downloads for urls with missing schema.

@ardumont @olasd can we do this:

  • Add a new property fallback_schema = ['https', 'http'] in PackageLoader
  • Change download_package to try different schemas from fallback_schema list (if url/schema is valid)
  • Change this (fallback_schema) property in the inherited classes (from PackageLoader) as per requirements
Sep 4 2021, 2:03 PM
KShivendu updated the diff for D6138: package/utils: Handle downloads for urls with missing schema.
  • Handle missing schema only for niguix (instead of doing it for all types of downloads)
Sep 4 2021, 1:52 PM

Sep 1 2021

KShivendu requested review of D6138: package/utils: Handle downloads for urls with missing schema.
Sep 1 2021, 11:10 AM

Aug 26 2021

KShivendu added a comment to T2823: Write tests for swh/journal/writer/inmemory.py.

@vlorentz should we close this one?

Aug 26 2021, 5:08 AM · Easy hack, Journal

Aug 20 2021

KShivendu created P1126 search.yml.
Aug 20 2021, 10:59 AM
KShivendu created P1125 swh-{indexer,scheduler,search}-journal-client containers exit (unhealthy).
Aug 20 2021, 10:49 AM

Aug 18 2021

KShivendu closed D6109: grammar.js: Improve grammar and export tokens.
Aug 18 2021, 11:44 AM
KShivendu committed rDSEAdb47029f6c91: grammar.js: Improve grammar and export tokens (authored by KShivendu).
grammar.js: Improve grammar and export tokens
Aug 18 2021, 11:44 AM
KShivendu updated the diff for D6109: grammar.js: Improve grammar and export tokens.
  • tokens.js: Use concat in fields
Aug 18 2021, 8:56 AM
KShivendu closed D6108: cli.py: Add rpc-serve command.
Aug 18 2021, 6:07 AM
KShivendu committed rDSEAee04e01ae05f: cli.py: Add rpc-serve command (authored by KShivendu).
cli.py: Add rpc-serve command
Aug 18 2021, 6:07 AM
KShivendu updated the diff for D6109: grammar.js: Improve grammar and export tokens.
  • Changes suggested by vlorentz
  • Polish the code (add comments, improve formatting)
  • Squash
Aug 18 2021, 6:02 AM

Aug 17 2021

KShivendu updated the summary of D6109: grammar.js: Improve grammar and export tokens.
Aug 17 2021, 9:18 PM
KShivendu updated the summary of D6109: grammar.js: Improve grammar and export tokens.
Aug 17 2021, 9:14 PM
KShivendu updated the summary of D6109: grammar.js: Improve grammar and export tokens.
Aug 17 2021, 9:14 PM
KShivendu updated the diff for D6109: grammar.js: Improve grammar and export tokens.
  • Improve commit message
Aug 17 2021, 9:13 PM
KShivendu requested review of D6109: grammar.js: Improve grammar and export tokens.
Aug 17 2021, 9:08 PM
KShivendu updated the diff for D6108: cli.py: Add rpc-serve command.
  • Fix ql_rel_paths in translator.py (Development path was wrong and was throwing error when used with the rpc server)
  • Squash
Aug 17 2021, 8:51 PM
KShivendu requested review of D6108: cli.py: Add rpc-serve command.
Aug 17 2021, 8:39 PM

Aug 13 2021

KShivendu closed D6068: origin/search: Add support for search query language.
Aug 13 2021, 7:17 AM
KShivendu committed rDWAPPSc5259fce4f20: origin/search: Add support for search query language (authored by KShivendu).
origin/search: Add support for search query language
Aug 13 2021, 7:17 AM
KShivendu updated the diff for D6068: origin/search: Add support for search query language.
  • Rebase and Squash
Aug 13 2021, 6:38 AM

Aug 12 2021

KShivendu updated the diff for D6068: origin/search: Add support for search query language.
  • Changes suggested by vlorentz
Aug 12 2021, 7:30 PM

Aug 11 2021

KShivendu updated the diff for D6068: origin/search: Add support for search query language.
  • Fix failing cypress tests
  • Squash
Aug 11 2021, 3:50 PM
KShivendu updated the diff for D6068: origin/search: Add support for search query language.
  • Fix failing tests (by fixing mocker namespaces)
Aug 11 2021, 8:58 AM
KShivendu updated the diff for D6068: origin/search: Add support for search query language.
  • tests: Add tests for origin search with ql
Aug 11 2021, 8:41 AM

Aug 10 2021

KShivendu updated the summary of D6068: origin/search: Add support for search query language.
Aug 10 2021, 12:51 PM
KShivendu updated the summary of D6068: origin/search: Add support for search query language.
Aug 10 2021, 12:51 PM
KShivendu retitled D6068: origin/search: Add support for search query language from archive: Add configuration to use search query language to origin/search: Add support for search query language.
Aug 10 2021, 12:50 PM
KShivendu updated the diff for D6068: origin/search: Add support for search query language.
  • Add checkbox to use query langauge (Visible only if enable_ql config param = True/yes)
  • Rename metadata_search_backend to search_config
Aug 10 2021, 12:50 PM

Aug 9 2021

KShivendu requested review of D6068: origin/search: Add support for search query language.
Aug 9 2021, 4:26 PM
KShivendu accepted D6070: Disable fetch_last_revision_release_date outside tests.
Aug 9 2021, 3:58 PM

Aug 6 2021

KShivendu closed D6046: elasticsearch.py: Integrate query langauge translator.
Aug 6 2021, 12:40 PM
KShivendu committed rDSEAb27ee025ccaf: elasticsearch.py: Integrate query language translator (authored by KShivendu).
elasticsearch.py: Integrate query language translator
Aug 6 2021, 12:40 PM
KShivendu updated the diff for D6046: elasticsearch.py: Integrate query langauge translator.

rebase

Aug 6 2021, 12:35 PM
KShivendu updated the diff for D6046: elasticsearch.py: Integrate query langauge translator.
  • Rename to_raw to escape
  • Rename process_escaped to unescape
Aug 6 2021, 10:59 AM
KShivendu updated the diff for D6046: elasticsearch.py: Integrate query langauge translator.
  • Fix typo in commit message (Thanks @douardda)
  • Moved test_sort_by_and_limit_query from test_search.py to test_elasticsearch.py
Aug 6 2021, 10:50 AM

Aug 4 2021

KShivendu updated the diff for D6046: elasticsearch.py: Integrate query langauge translator.
  • test_elasticsearch.py: Test for sort_by and limit using the query (and some changes in grammar.js and elasticsearch.py for the same)
Aug 4 2021, 4:46 PM
KShivendu updated the diff for D6046: elasticsearch.py: Integrate query langauge translator.
  • utils.py: Use print() in doc tests for readability
  • translator.py: process escaped chars while parsing
Aug 4 2021, 12:28 PM
KShivendu updated the diff for D6046: elasticsearch.py: Integrate query langauge translator.
  • utils.py: Use raw string in to_raw documentation (To fix failing tests)
Aug 4 2021, 11:46 AM
KShivendu updated the diff for D6046: elasticsearch.py: Integrate query langauge translator.
  • origin_search: Use to_raw() to make the objects injectable
Aug 4 2021, 11:39 AM

Jul 30 2021

KShivendu requested review of D6046: elasticsearch.py: Integrate query langauge translator.
Jul 30 2021, 3:17 PM
KShivendu closed D6025: translator.py: Translate search query language to ES DSL.
Jul 30 2021, 3:03 PM
KShivendu committed rDSEA3428e71a042b: translator.py: Translate search query language to ES DSL (authored by KShivendu).
translator.py: Translate search query language to ES DSL
Jul 30 2021, 3:03 PM
KShivendu updated the diff for D6025: translator.py: Translate search query language to ES DSL.
  • Changes suggested by vlorentz
    • Improve keyword filter test using raw string
    • Improve swh_ql.so not found error message
Jul 30 2021, 2:59 PM
KShivendu updated the diff for D6025: translator.py: Translate search query language to ES DSL.

translator.py: Mention number of children while throwing exception in _traverse

Jul 30 2021, 11:27 AM

Jul 29 2021

KShivendu updated the diff for D6025: translator.py: Translate search query language to ES DSL.
  • translator.py: Mention filter category and name in exception
  • Squash
Jul 29 2021, 8:52 PM
KShivendu updated the diff for D6025: translator.py: Translate search query language to ES DSL.

Rebase:

  • translator.py: Translate search query language to ES DSL
  • translator.py: Complete all the filters and add new tests
  • translator.py: Fix resource path for tox environment
  • translator: Changes suggested by vlorentz
  • translator.py: Update list of possible ql paths (suggested by vlorentz)
Jul 29 2021, 10:56 AM
KShivendu accepted D6039: setup.py: Install swh_ql.so alongside .py files, so it can be seen by pkg_resources.
Jul 29 2021, 9:44 AM

Jul 28 2021

KShivendu added inline comments to D6025: translator.py: Translate search query language to ES DSL.
Jul 28 2021, 11:16 AM
KShivendu updated the diff for D6025: translator.py: Translate search query language to ES DSL.
  • translator: Changes suggested by vlorentz
Jul 28 2021, 11:15 AM

Jul 27 2021

KShivendu updated subscribers of D6025: translator.py: Translate search query language to ES DSL.
Jul 27 2021, 6:41 PM
KShivendu added inline comments to D6025: translator.py: Translate search query language to ES DSL.
Jul 27 2021, 6:32 PM
KShivendu requested review of D6025: translator.py: Translate search query language to ES DSL.
Jul 27 2021, 6:26 PM
KShivendu closed D6024: grammar.js: Segregate sort_by and limit from filters.
Jul 27 2021, 10:36 AM
KShivendu committed rDSEA05efa5418c43: grammar.js: Segregate sort_by and limit from filters (authored by KShivendu).
grammar.js: Segregate sort_by and limit from filters
Jul 27 2021, 10:36 AM

Jul 26 2021

KShivendu updated the diff for D6024: grammar.js: Segregate sort_by and limit from filters.

Sanitize commit message body

Jul 26 2021, 8:55 PM
KShivendu requested review of D6024: grammar.js: Segregate sort_by and limit from filters.
Jul 26 2021, 8:30 PM
KShivendu edited P1100 pytest failure.
Jul 26 2021, 5:42 PM
KShivendu edited P1100 pytest failure.
Jul 26 2021, 5:42 PM
KShivendu created P1100 pytest failure.
Jul 26 2021, 5:42 PM
KShivendu closed D5990: query_language: Setup tree-sitter and grammar.js.
Jul 26 2021, 5:23 PM
KShivendu committed rDSEA2edbbbe833e9: query_language: Setup tree-sitter and grammar.js (authored by KShivendu).
query_language: Setup tree-sitter and grammar.js
Jul 26 2021, 5:23 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.

rebase

Jul 26 2021, 5:16 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.

grammar.js: Allow using '-' with sort_by options

Jul 26 2021, 4:39 PM

Jul 23 2021

KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • query_language: Segregate sort_by and limit from filters
  • Add tests for the change mentioned above
Jul 23 2021, 8:43 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.

query_language/grammar.js: Improve function comments

Jul 23 2021, 9:20 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • query_language: Add test-sitter tests for escaping keywords in filter values
    • Origins with ' and " inside filter values
    • Origins with 'and' and 'or' inside filter values
Jul 23 2021, 8:11 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • grammar.js: Add some comments to improve readability
  • Add support for escaping " and ' from the filter values
  • Improve and break bulky tree-sitter tests into smaller tests (for readability)
  • setup.py: Use super().run() instead of build.run(self)
  • Squash commits
Jul 23 2021, 8:01 AM