Page MenuHomeSoftware Heritage

KShivendu (Kumar Shivendu)
User

Projects

User does not belong to any projects.

User Details

User Since
Feb 23 2021, 11:48 AM (22 w, 3 d)

Recent Activity

Yesterday

KShivendu requested review of D6046: elasticsearch.py: Integrate query langauge translator.
Fri, Jul 30, 3:17 PM
KShivendu closed D6025: translator.py: Translate search query language to ES DSL.
Fri, Jul 30, 3:03 PM
KShivendu committed rDSEA3428e71a042b: translator.py: Translate search query language to ES DSL (authored by KShivendu).
translator.py: Translate search query language to ES DSL
Fri, Jul 30, 3:03 PM
KShivendu updated the diff for D6025: translator.py: Translate search query language to ES DSL.
  • Changes suggested by vlorentz
    • Improve keyword filter test using raw string
    • Improve swh_ql.so not found error message
Fri, Jul 30, 2:59 PM
KShivendu updated the diff for D6025: translator.py: Translate search query language to ES DSL.

translator.py: Mention number of children while throwing exception in _traverse

Fri, Jul 30, 11:27 AM

Thu, Jul 29

KShivendu updated the diff for D6025: translator.py: Translate search query language to ES DSL.
  • translator.py: Mention filter category and name in exception
  • Squash
Thu, Jul 29, 8:52 PM
KShivendu updated the diff for D6025: translator.py: Translate search query language to ES DSL.

Rebase:

  • translator.py: Translate search query language to ES DSL
  • translator.py: Complete all the filters and add new tests
  • translator.py: Fix resource path for tox environment
  • translator: Changes suggested by vlorentz
  • translator.py: Update list of possible ql paths (suggested by vlorentz)
Thu, Jul 29, 10:56 AM
KShivendu accepted D6039: setup.py: Install swh_ql.so alongside .py files, so it can be seen by pkg_resources.
Thu, Jul 29, 9:44 AM

Wed, Jul 28

KShivendu added inline comments to D6025: translator.py: Translate search query language to ES DSL.
Wed, Jul 28, 11:16 AM
KShivendu updated the diff for D6025: translator.py: Translate search query language to ES DSL.
  • translator: Changes suggested by vlorentz
Wed, Jul 28, 11:15 AM

Tue, Jul 27

KShivendu updated subscribers of D6025: translator.py: Translate search query language to ES DSL.
Tue, Jul 27, 6:41 PM
KShivendu added inline comments to D6025: translator.py: Translate search query language to ES DSL.
Tue, Jul 27, 6:32 PM
KShivendu requested review of D6025: translator.py: Translate search query language to ES DSL.
Tue, Jul 27, 6:26 PM
KShivendu closed D6024: grammar.js: Segregate sort_by and limit from filters.
Tue, Jul 27, 10:36 AM
KShivendu committed rDSEA05efa5418c43: grammar.js: Segregate sort_by and limit from filters (authored by KShivendu).
grammar.js: Segregate sort_by and limit from filters
Tue, Jul 27, 10:36 AM

Mon, Jul 26

KShivendu updated the diff for D6024: grammar.js: Segregate sort_by and limit from filters.

Sanitize commit message body

Mon, Jul 26, 8:55 PM
KShivendu requested review of D6024: grammar.js: Segregate sort_by and limit from filters.
Mon, Jul 26, 8:30 PM
KShivendu edited P1100 pytest failure.
Mon, Jul 26, 5:42 PM
KShivendu edited P1100 pytest failure.
Mon, Jul 26, 5:42 PM
KShivendu created P1100 pytest failure.
Mon, Jul 26, 5:42 PM
KShivendu closed D5990: query_language: Setup tree-sitter and grammar.js.
Mon, Jul 26, 5:23 PM
KShivendu committed rDSEA2edbbbe833e9: query_language: Setup tree-sitter and grammar.js (authored by KShivendu).
query_language: Setup tree-sitter and grammar.js
Mon, Jul 26, 5:23 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.

rebase

Mon, Jul 26, 5:16 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.

grammar.js: Allow using '-' with sort_by options

Mon, Jul 26, 4:39 PM

Fri, Jul 23

KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • query_language: Segregate sort_by and limit from filters
Fri, Jul 23, 8:43 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.

query_language/grammar.js: Improve function comments

Fri, Jul 23, 9:20 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • query_language: Add test-sitter tests for escaping keywords in filter values
    • Origins with ' and " inside filter values
    • Origins with 'and' and 'or' inside filter values
Fri, Jul 23, 8:11 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • grammar.js: Add some comments to improve readability
  • Add support for escaping " and ' from the filter values
  • Improve and break bulky tree-sitter tests into smaller tests (for readability)
  • setup.py: Use super().run() instead of build.run(self)
  • Squash commits
Fri, Jul 23, 8:01 AM

Thu, Jul 22

KShivendu removed a watcher for Metadata workflow: KShivendu.
Thu, Jul 22, 10:08 AM
KShivendu removed a watcher for Web app: KShivendu.
Thu, Jul 22, 10:08 AM
KShivendu closed D6005: docs/query-language: Describe search query language syntax.
Thu, Jul 22, 10:05 AM
KShivendu committed rDSEA4e453304ade0: docs/query-language: Describe search query language syntax (authored by KShivendu).
docs/query-language: Describe search query language syntax
Thu, Jul 22, 10:05 AM
KShivendu updated the diff for D6005: docs/query-language: Describe search query language syntax.
  • Rebase
Thu, Jul 22, 10:04 AM
KShivendu updated the diff for D6005: docs/query-language: Describe search query language syntax.
  • Changes suggested by @zack
  • Squash commits
Thu, Jul 22, 9:59 AM
KShivendu updated the diff for D6005: docs/query-language: Describe search query language syntax.
  • docs/query-language: Use 'and' and 'or'
  • Add details and examples for precedences
  • Fix typos
Thu, Jul 22, 7:10 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • query_language/grammar.js: Include Z in date regex
  • query_language: Add precedence and improve field names
  • query_language: Add support for freely using brackets
  • README: Add emsdk setup instructions
  • setup.py: Add commands for build steps
  • query_language/grammar.js: Remove redundancies using functions
Thu, Jul 22, 7:08 AM

Tue, Jul 20

KShivendu added inline comments to D6005: docs/query-language: Describe search query language syntax.
Tue, Jul 20, 7:02 PM
KShivendu updated the diff for D6005: docs/query-language: Describe search query language syntax.
  • docs: Update query-language specs
Tue, Jul 20, 7:01 PM

Sat, Jul 17

KShivendu added a comment to D6005: docs/query-language: Describe search query language syntax.

Some aspects of the query language that I'm still thinking about :

Sat, Jul 17, 10:57 PM
KShivendu requested review of D6005: docs/query-language: Describe search query language syntax.
Sat, Jul 17, 10:57 PM

Fri, Jul 16

KShivendu added a comment to D5990: query_language: Setup tree-sitter and grammar.js.

Can we have some documentation of the query language, included in this diff?

Fri, Jul 16, 8:27 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Add newline at the end of package.json and sample_query
Fri, Jul 16, 8:13 PM
KShivendu updated the summary of D5990: query_language: Setup tree-sitter and grammar.js.
Fri, Jul 16, 8:07 PM
KShivendu updated the summary of D5990: query_language: Setup tree-sitter and grammar.js.
Fri, Jul 16, 8:07 PM
KShivendu retitled D5990: query_language: Setup tree-sitter and grammar.js from parser: Setup TreeSitter with first draft for the grammar to query_language: Setup tree-sitter and grammar.js.
Fri, Jul 16, 8:04 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Improve Makefile and README
  • Improve tree-sitter's native test development workflow
Fri, Jul 16, 8:03 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Use locally installed emscripten instead of docker
Fri, Jul 16, 5:16 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Inspecting jenkins build with echo
Fri, Jul 16, 4:52 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Inspect docker container inside builds
Fri, Jul 16, 4:45 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Use docker for emsdk
Fri, Jul 16, 4:26 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Use sh instead of source
Fri, Jul 16, 8:44 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Use emsdk for building .wasm
Fri, Jul 16, 8:37 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Specify directory for build-wasm
Fri, Jul 16, 8:09 AM
KShivendu added a comment to D5990: query_language: Setup tree-sitter and grammar.js.

Sorry for the mess (so many failed Jenkins builds), I couldn't reproduce the errors on my local machine.

Fri, Jul 16, 7:56 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • fix typo
Fri, Jul 16, 7:40 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • code to inspect jenkins builds
Fri, Jul 16, 7:37 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Try fixing build failures
Fri, Jul 16, 7:32 AM

Thu, Jul 15

KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Try fixing errors
Thu, Jul 15, 11:16 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.

Improve build process for .so and .wasm files :

  • Makefile.local: Add command inter-dependencies and introduce new commands
  • package.json: Use --no-bindings in generate and introduce new scripts

to build .wasm files

  • setup.py: Make os.system calls configurable with environment variables,

build .so and .wasm files and move to static/

Thu, Jul 15, 10:59 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Polish the code
Thu, Jul 15, 2:59 PM
KShivendu added inline comments to D5990: query_language: Setup tree-sitter and grammar.js.
Thu, Jul 15, 2:56 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Install tree-sitter-cli (NodeJS) during builds
Thu, Jul 15, 12:38 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Generate parser before building swh_ql.so
Thu, Jul 15, 12:34 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Fix installation/build errors
Thu, Jul 15, 12:24 PM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Generate swh_ql.so at builds
Thu, Jul 15, 9:47 AM
KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Fix failing build ( because of data_files )
Thu, Jul 15, 9:16 AM

Wed, Jul 14

KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Move parser to search_language dir
  • Introduce Makefile.local and add TreeSitter related commands
  • Set data_files of setup.py to 'generated/search_ql.so'
Wed, Jul 14, 9:57 AM

Tue, Jul 13

KShivendu updated the diff for D5990: query_language: Setup tree-sitter and grammar.js.
  • Add newline at the end of files
Tue, Jul 13, 2:46 PM
KShivendu updated the summary of D5990: query_language: Setup tree-sitter and grammar.js.
Tue, Jul 13, 1:11 PM
KShivendu updated the summary of D5990: query_language: Setup tree-sitter and grammar.js.
Tue, Jul 13, 1:11 PM
KShivendu requested review of D5990: query_language: Setup tree-sitter and grammar.js.
Tue, Jul 13, 1:04 PM
KShivendu closed D5964: origin_search: Filters and sorting for date_{created,modified,published}.
Tue, Jul 13, 12:08 PM
KShivendu committed rDSEAfe7640f71024: origin_search: Filters and sorting for date_{created,modified,published} (authored by KShivendu).
origin_search: Filters and sorting for date_{created,modified,published}
Tue, Jul 13, 12:08 PM
KShivendu updated the diff for D5964: origin_search: Filters and sorting for date_{created,modified,published}.
  • Add test for sort_by : ["date_created"]
  • Deduplicate calculation of some variables in _get_sorting_key
  • Use iso8601 library to validate date format in instrinsic_metadata fields
Tue, Jul 13, 11:51 AM

Mon, Jul 12

KShivendu added inline comments to D5964: origin_search: Filters and sorting for date_{created,modified,published}.
Mon, Jul 12, 2:04 PM
KShivendu added a comment to P1090 swl_ql.

string_content and escape_sequence have been adapted from JSON Treesitter grammar

Mon, Jul 12, 8:13 AM
KShivendu edited P1090 swl_ql.
Mon, Jul 12, 8:08 AM
KShivendu edited P1090 swl_ql.
Mon, Jul 12, 8:06 AM

Fri, Jul 9

KShivendu created P1092 py-tree-sitter/swh_ql.
Fri, Jul 9, 11:19 AM
KShivendu added a comment to P1091 swh_ql.grammar.js.

For input

url : "github.com/django/Django" metadata : something qewq
with_visit : true with_visit : false
nb_visits >= 0  nb_visits = 10 nb_visits != 256 nb_visits < 1000 
sort_by : ["nb_visits", "last_revision_date", last_release_date]
last_release_date < 2001-02-13 15:54:21
licenses in ["MIT","BSD X","Apache"]
Fri, Jul 9, 9:33 AM
KShivendu created P1091 swh_ql.grammar.js.
Fri, Jul 9, 9:31 AM
KShivendu added a comment to P1090 swl_ql.

Generate the corresponding Railroad diagram with https://www.bottlecaps.de/rr/ui

Fri, Jul 9, 8:35 AM
KShivendu created P1090 swl_ql.
Fri, Jul 9, 8:33 AM

Wed, Jul 7

KShivendu updated the diff for D5964: origin_search: Filters and sorting for date_{created,modified,published}.
  • origin_update: Document rejection of metadata date fields if not parsable
Wed, Jul 7, 1:28 PM

Tue, Jul 6

KShivendu updated the diff for D5964: origin_search: Filters and sorting for date_{created,modified,published}.
  • elasticsearch.py: Use "linient: true"
  • origin_search: Validate intrinsic_metadata date field format before storing
  • test_search: Fix failing tests
Tue, Jul 6, 11:46 AM

Mon, Jul 5

KShivendu added a comment to D5964: origin_search: Filters and sorting for date_{created,modified,published}.

Can you either add tests, or deduplicate this code so we don't need to test every field?

Mon, Jul 5, 6:38 PM
KShivendu created P1089 Elasticsearch date errro.
Mon, Jul 5, 6:26 PM
KShivendu updated the diff for D5964: origin_search: Filters and sorting for date_{created,modified,published}.
  • Move get_expansion to utils.py
  • Add tests filters as well as sorting options
  • Polish existing code
Mon, Jul 5, 6:22 PM
KShivendu closed D5963: origin_search: Add keyword search for instrinsic_metadata keywords/description.
Mon, Jul 5, 12:41 PM
KShivendu committed rDSEAf378a989e972: origin_search: Add keyword search for instrinsic_metadata keywords/description (authored by KShivendu).
origin_search: Add keyword search for instrinsic_metadata keywords/description
Mon, Jul 5, 12:41 PM
KShivendu updated the summary of D5963: origin_search: Add keyword search for instrinsic_metadata keywords/description.
Mon, Jul 5, 12:32 PM
KShivendu updated the diff for D5963: origin_search: Add keyword search for instrinsic_metadata keywords/description.

Add commit body

Mon, Jul 5, 12:32 PM
KShivendu updated the diff for D5963: origin_search: Add keyword search for instrinsic_metadata keywords/description.
  • Squash
  • Minor polishes
Mon, Jul 5, 12:25 PM

Fri, Jul 2

KShivendu added inline comments to D5963: origin_search: Add keyword search for instrinsic_metadata keywords/description.
Fri, Jul 2, 6:21 PM
KShivendu updated the diff for D5963: origin_search: Add keyword search for instrinsic_metadata keywords/description.
  • origin_search: Polish the code with get_expansion and other methods
Fri, Jul 2, 6:17 PM
KShivendu created P1085 Find origins with description in instrinsic_metadata.
Fri, Jul 2, 5:29 PM
KShivendu requested review of D5964: origin_search: Filters and sorting for date_{created,modified,published}.
Fri, Jul 2, 5:21 PM
KShivendu requested review of D5963: origin_search: Add keyword search for instrinsic_metadata keywords/description.
Fri, Jul 2, 4:06 PM
KShivendu retitled D5949: origin_search: Filter for instrinsic_metadata language and license from journal_client: Store language and license from instrinsic_metadata to origin_search: Filter for instrinsic_metadata language and license.
Fri, Jul 2, 10:31 AM
KShivendu closed D5949: origin_search: Filter for instrinsic_metadata language and license.
Fri, Jul 2, 10:31 AM