Page MenuHomeSoftware Heritage

KShivendu (Kumar Shivendu)
User

Projects

User does not belong to any projects.

User Details

User Since
Feb 23 2021, 11:48 AM (34 w, 3 d)

Recent Activity

Sep 4 2021

KShivendu added a comment to D6138: package/utils: Handle downloads for urls with missing schema.

@ardumont @olasd can we do this:

  • Add a new property fallback_schema = ['https', 'http'] in PackageLoader
  • Change download_package to try different schemas from fallback_schema list (if url/schema is valid)
  • Change this (fallback_schema) property in the inherited classes (from PackageLoader) as per requirements
Sep 4 2021, 2:03 PM
KShivendu updated the diff for D6138: package/utils: Handle downloads for urls with missing schema.
  • Handle missing schema only for niguix (instead of doing it for all types of downloads)
Sep 4 2021, 1:52 PM

Sep 1 2021

KShivendu requested review of D6138: package/utils: Handle downloads for urls with missing schema.
Sep 1 2021, 11:10 AM

Aug 26 2021

KShivendu added a comment to T2823: Write tests for swh/journal/writer/inmemory.py.

@vlorentz should we close this one?

Aug 26 2021, 5:08 AM · Easy hack, Journal

Aug 20 2021

KShivendu created P1126 search.yml.
Aug 20 2021, 10:59 AM
KShivendu created P1125 swh-{indexer,scheduler,search}-journal-client containers exit (unhealthy).
Aug 20 2021, 10:49 AM

Aug 18 2021

KShivendu closed D6109: grammar.js: Improve grammar and export tokens.
Aug 18 2021, 11:44 AM
KShivendu committed rDSEAdb47029f6c91: grammar.js: Improve grammar and export tokens (authored by KShivendu).
grammar.js: Improve grammar and export tokens
Aug 18 2021, 11:44 AM
KShivendu updated the diff for D6109: grammar.js: Improve grammar and export tokens.
  • tokens.js: Use concat in fields
Aug 18 2021, 8:56 AM
KShivendu closed D6108: cli.py: Add rpc-serve command.
Aug 18 2021, 6:07 AM
KShivendu committed rDSEAee04e01ae05f: cli.py: Add rpc-serve command (authored by KShivendu).
cli.py: Add rpc-serve command
Aug 18 2021, 6:07 AM
KShivendu updated the diff for D6109: grammar.js: Improve grammar and export tokens.
  • Changes suggested by vlorentz
  • Polish the code (add comments, improve formatting)
  • Squash
Aug 18 2021, 6:02 AM

Aug 17 2021

KShivendu updated the summary of D6109: grammar.js: Improve grammar and export tokens.
Aug 17 2021, 9:18 PM
KShivendu updated the summary of D6109: grammar.js: Improve grammar and export tokens.
Aug 17 2021, 9:14 PM
KShivendu updated the summary of D6109: grammar.js: Improve grammar and export tokens.
Aug 17 2021, 9:14 PM
KShivendu updated the diff for D6109: grammar.js: Improve grammar and export tokens.
  • Improve commit message
Aug 17 2021, 9:13 PM
KShivendu requested review of D6109: grammar.js: Improve grammar and export tokens.
Aug 17 2021, 9:08 PM
KShivendu updated the diff for D6108: cli.py: Add rpc-serve command.
  • Fix ql_rel_paths in translator.py (Development path was wrong and was throwing error when used with the rpc server)
  • Squash
Aug 17 2021, 8:51 PM
KShivendu requested review of D6108: cli.py: Add rpc-serve command.
Aug 17 2021, 8:39 PM

Aug 13 2021

KShivendu closed D6068: origin/search: Add support for search query language.
Aug 13 2021, 7:17 AM
KShivendu committed rDWAPPSc5259fce4f20: origin/search: Add support for search query language (authored by KShivendu).
origin/search: Add support for search query language
Aug 13 2021, 7:17 AM
KShivendu updated the diff for D6068: origin/search: Add support for search query language.
  • Rebase and Squash
Aug 13 2021, 6:38 AM

Aug 12 2021

KShivendu updated the diff for D6068: origin/search: Add support for search query language.
  • Changes suggested by vlorentz
Aug 12 2021, 7:30 PM

Aug 11 2021

KShivendu updated the diff for D6068: origin/search: Add support for search query language.
  • Fix failing cypress tests
  • Squash
Aug 11 2021, 3:50 PM
KShivendu updated the diff for D6068: origin/search: Add support for search query language.
  • Fix failing tests (by fixing mocker namespaces)
Aug 11 2021, 8:58 AM
KShivendu updated the diff for D6068: origin/search: Add support for search query language.
  • tests: Add tests for origin search with ql
Aug 11 2021, 8:41 AM

Aug 10 2021

KShivendu updated the summary of D6068: origin/search: Add support for search query language.
Aug 10 2021, 12:51 PM
KShivendu updated the summary of D6068: origin/search: Add support for search query language.
Aug 10 2021, 12:51 PM
KShivendu retitled D6068: origin/search: Add support for search query language from archive: Add configuration to use search query language to origin/search: Add support for search query language.
Aug 10 2021, 12:50 PM
KShivendu updated the diff for D6068: origin/search: Add support for search query language.
  • Add checkbox to use query langauge (Visible only if enable_ql config param = True/yes)
  • Rename metadata_search_backend to search_config
Aug 10 2021, 12:50 PM

Aug 9 2021

KShivendu requested review of D6068: origin/search: Add support for search query language.
Aug 9 2021, 4:26 PM
KShivendu accepted D6070: Disable fetch_last_revision_release_date outside tests.
Aug 9 2021, 3:58 PM

Aug 6 2021

KShivendu closed D6046: elasticsearch.py: Integrate query langauge translator.
Aug 6 2021, 12:40 PM
KShivendu committed rDSEAb27ee025ccaf: elasticsearch.py: Integrate query language translator (authored by KShivendu).
elasticsearch.py: Integrate query language translator
Aug 6 2021, 12:40 PM
KShivendu updated the diff for D6046: elasticsearch.py: Integrate query langauge translator.

rebase

Aug 6 2021, 12:35 PM
KShivendu updated the diff for D6046: elasticsearch.py: Integrate query langauge translator.
  • Rename to_raw to escape
  • Rename process_escaped to unescape
Aug 6 2021, 10:59 AM
KShivendu updated the diff for D6046: elasticsearch.py: Integrate query langauge translator.
  • Fix typo in commit message (Thanks @douardda)
  • Moved test_sort_by_and_limit_query from test_search.py to test_elasticsearch.py
Aug 6 2021, 10:50 AM

Aug 4 2021

KShivendu updated the diff for D6046: elasticsearch.py: Integrate query langauge translator.
  • test_elasticsearch.py: Test for sort_by and limit using the query (and some changes in grammar.js and elasticsearch.py for the same)
Aug 4 2021, 4:46 PM
KShivendu updated the diff for D6046: elasticsearch.py: Integrate query langauge translator.
  • utils.py: Use print() in doc tests for readability
  • translator.py: process escaped chars while parsing
Aug 4 2021, 12:28 PM
KShivendu updated the diff for D6046: elasticsearch.py: Integrate query langauge translator.
  • utils.py: Use raw string in to_raw documentation (To fix failing tests)
Aug 4 2021, 11:46 AM
KShivendu updated the diff for D6046: elasticsearch.py: Integrate query langauge translator.
  • origin_search: Use to_raw() to make the objects injectable
Aug 4 2021, 11:39 AM

Jul 30 2021

KShivendu requested review of D6046: elasticsearch.py: Integrate query langauge translator.
Jul 30 2021, 3:17 PM
KShivendu closed D6025: translator.py: Translate search query language to ES DSL.
Jul 30 2021, 3:03 PM
KShivendu committed rDSEA3428e71a042b: translator.py: Translate search query language to ES DSL (authored by KShivendu).
translator.py: Translate search query language to ES DSL
Jul 30 2021, 3:03 PM
KShivendu updated the diff for D6025: translator.py: Translate search query language to ES DSL.
  • Changes suggested by vlorentz
    • Improve keyword filter test using raw string
    • Improve swh_ql.so not found error message
Jul 30 2021, 2:59 PM
KShivendu updated the diff for D6025: translator.py: Translate search query language to ES DSL.

translator.py: Mention number of children while throwing exception in _traverse

Jul 30 2021, 11:27 AM

Jul 29 2021

KShivendu updated the diff for D6025: translator.py: Translate search query language to ES DSL.
  • translator.py: Mention filter category and name in exception
  • Squash
Jul 29 2021, 8:52 PM
KShivendu updated the diff for D6025: translator.py: Translate search query language to ES DSL.

Rebase:

  • translator.py: Translate search query language to ES DSL
  • translator.py: Complete all the filters and add new tests
  • translator.py: Fix resource path for tox environment
  • translator: Changes suggested by vlorentz
  • translator.py: Update list of possible ql paths (suggested by vlorentz)
Jul 29 2021, 10:56 AM
KShivendu accepted D6039: setup.py: Install swh_ql.so alongside .py files, so it can be seen by pkg_resources.
Jul 29 2021, 9:44 AM

Jul 28 2021

KShivendu added inline comments to D6025: translator.py: Translate search query language to ES DSL.
Jul 28 2021, 11:16 AM
KShivendu updated the diff for D6025: translator.py: Translate search query language to ES DSL.
  • translator: Changes suggested by vlorentz
Jul 28 2021, 11:15 AM

Jul 27 2021

KShivendu updated subscribers of D6025: translator.py: Translate search query language to ES DSL.
Jul 27 2021, 6:41 PM
KShivendu added inline comments to D6025: translator.py: Translate search query language to ES DSL.
Jul 27 2021, 6:32 PM
KShivendu requested review of D6025: translator.py: Translate search query language to ES DSL.
Jul 27 2021, 6:26 PM
KShivendu closed D6024: grammar.js: Segregate sort_by and limit from filters.
Jul 27 2021, 10:36 AM
KShivendu committed rDSEA05efa5418c43: grammar.js: Segregate sort_by and limit from filters (authored by KShivendu).
grammar.js: Segregate sort_by and limit from filters
Jul 27 2021, 10:36 AM

Jul 26 2021

KShivendu updated the diff for D6024: grammar.js: Segregate sort_by and limit from filters.

Sanitize commit message body

Jul 26 2021, 8:55 PM
KShivendu requested review of D6024: grammar.js: Segregate sort_by and limit from filters.
Jul 26 2021, 8:30 PM
KShivendu edited P1100 pytest failure.
Jul 26 2021, 5:42 PM
KShivendu edited P1100 pytest failure.
Jul 26 2021, 5:42 PM
KShivendu created P1100 pytest failure.
Jul 26 2021, 5:42 PM
KShivendu closed D5990: query_language: Setup tree-sitter and grammar.js.
Jul 26 2021, 5:23 PM
KShivendu committed rDSEA2edbbbe833e9: query_language: Setup tree-sitter and grammar.js (authored by KShivendu).
query_language: Setup tree-sitter and grammar.js
Jul 26 2021, 5:23 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.

rebase

Jul 26 2021, 5:16 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.

grammar.js: Allow using '-' with sort_by options

Jul 26 2021, 4:39 PM

Jul 23 2021

KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • query_language: Segregate sort_by and limit from filters
  • Add tests for the change mentioned above
Jul 23 2021, 8:43 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.

query_language/grammar.js: Improve function comments

Jul 23 2021, 9:20 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • query_language: Add test-sitter tests for escaping keywords in filter values
    • Origins with ' and " inside filter values
    • Origins with 'and' and 'or' inside filter values
Jul 23 2021, 8:11 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • grammar.js: Add some comments to improve readability
  • Add support for escaping " and ' from the filter values
  • Improve and break bulky tree-sitter tests into smaller tests (for readability)
  • setup.py: Use super().run() instead of build.run(self)
  • Squash commits
Jul 23 2021, 8:01 AM

Jul 22 2021

KShivendu removed a watcher for Metadata workflow: KShivendu.
Jul 22 2021, 10:08 AM
KShivendu removed a watcher for Web app: KShivendu.
Jul 22 2021, 10:08 AM
KShivendu closed D6005: docs/query-language: Describe search query language syntax.
Jul 22 2021, 10:05 AM
KShivendu committed rDSEA4e453304ade0: docs/query-language: Describe search query language syntax (authored by KShivendu).
docs/query-language: Describe search query language syntax
Jul 22 2021, 10:05 AM
KShivendu updated the diff for D6005: docs/query-language: Describe search query language syntax.
  • Rebase
Jul 22 2021, 10:04 AM
KShivendu updated the diff for D6005: docs/query-language: Describe search query language syntax.
  • Changes suggested by @zack
  • Squash commits
Jul 22 2021, 9:59 AM
KShivendu updated the diff for D6005: docs/query-language: Describe search query language syntax.
  • docs/query-language: Use 'and' and 'or'
  • Add details and examples for precedences
  • Fix typos
Jul 22 2021, 7:10 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • query_language/grammar.js: Include Z in date regex
  • query_language: Add precedence and improve field names
  • query_language: Add support for freely using brackets
  • README: Add emsdk setup instructions
  • setup.py: Add commands for build steps
  • query_language/grammar.js: Remove redundancies using functions
Jul 22 2021, 7:08 AM

Jul 20 2021

KShivendu added inline comments to D6005: docs/query-language: Describe search query language syntax.
Jul 20 2021, 7:02 PM
KShivendu updated the diff for D6005: docs/query-language: Describe search query language syntax.
  • docs: Update query-language specs
Jul 20 2021, 7:01 PM

Jul 17 2021

KShivendu added a comment to D6005: docs/query-language: Describe search query language syntax.

Some aspects of the query language that I'm still thinking about :

Jul 17 2021, 10:57 PM
KShivendu requested review of D6005: docs/query-language: Describe search query language syntax.
Jul 17 2021, 10:57 PM

Jul 16 2021

KShivendu added a comment to D5990: query_language: Setup tree-sitter and grammar.js.

Can we have some documentation of the query language, included in this diff?

Jul 16 2021, 8:27 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Add newline at the end of package.json and sample_query
Jul 16 2021, 8:13 PM
KShivendu updated the summary of D5990: query_language: Setup tree-sitter and grammar.js.
Jul 16 2021, 8:07 PM
KShivendu updated the summary of D5990: query_language: Setup tree-sitter and grammar.js.
Jul 16 2021, 8:07 PM
KShivendu retitled D5990: query_language: Setup tree-sitter and grammar.js from parser: Setup TreeSitter with first draft for the grammar to query_language: Setup tree-sitter and grammar.js.
Jul 16 2021, 8:04 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Improve Makefile and README
  • Improve tree-sitter's native test development workflow
Jul 16 2021, 8:03 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Use locally installed emscripten instead of docker
Jul 16 2021, 5:16 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Inspecting jenkins build with echo
Jul 16 2021, 4:52 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Inspect docker container inside builds
Jul 16 2021, 4:45 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Use docker for emsdk
Jul 16 2021, 4:26 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Use sh instead of source
Jul 16 2021, 8:44 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Use emsdk for building .wasm
Jul 16 2021, 8:37 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Specify directory for build-wasm
Jul 16 2021, 8:09 AM
KShivendu added a comment to D5990: query_language: Setup tree-sitter and grammar.js.

Sorry for the mess (so many failed Jenkins builds), I couldn't reproduce the errors on my local machine.

Jul 16 2021, 7:56 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • fix typo
Jul 16 2021, 7:40 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • code to inspect jenkins builds
Jul 16 2021, 7:37 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Try fixing build failures
Jul 16 2021, 7:32 AM

Jul 15 2021

KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Try fixing errors
Jul 15 2021, 11:16 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.

Improve build process for .so and .wasm files :

  • Makefile.local: Add command inter-dependencies and introduce new commands
  • package.json: Use --no-bindings in generate and introduce new scripts to build .wasm files
  • setup.py: Make os.system calls configurable with environment variables, build .so and .wasm files and move to static/
Jul 15 2021, 10:59 PM