@ardumont @olasd can we do this:

• Add a new property fallback_schema = ['https', 'http'] in PackageLoader
• Change download_package to try different schemas from fallback_schema list (if url/schema is valid)
• Change this (fallback_schema) property in the inherited classes (from PackageLoader) as per requirements

• Handle missing schema only for niguix (instead of doing it for all types of downloads)

@vlorentz should we close this one?

• tokens.js: Use concat in fields

• Changes suggested by vlorentz
• Polish the code (add comments, improve formatting)
• Squash

• Improve commit message

• Fix ql_rel_paths in translator.py (Development path was wrong and was throwing error when used with the rpc server)
• Squash

• Rebase and Squash

• Changes suggested by vlorentz

• Fix failing cypress tests
• Squash

• Fix failing tests (by fixing mocker namespaces)

• tests: Add tests for origin search with ql

• Add checkbox to use query langauge (Visible only if enable_ql config param = True/yes)
• Rename metadata_search_backend to search_config

rebase

• Rename to_raw to escape
• Rename process_escaped to unescape

• Fix typo in commit message (Thanks @douardda)
• Moved test_sort_by_and_limit_query from test_search.py to test_elasticsearch.py

• test_elasticsearch.py: Test for sort_by and limit using the query (and some changes in grammar.js and elasticsearch.py for the same)

• utils.py: Use print() in doc tests for readability
• translator.py: process escaped chars while parsing

• utils.py: Use raw string in to_raw documentation (To fix failing tests)

• origin_search: Use to_raw() to make the objects injectable

• Changes suggested by vlorentz
  • Improve keyword filter test using raw string
  • Improve swh_ql.so not found error message

translator.py: Mention number of children while throwing exception in _traverse

• translator.py: Mention filter category and name in exception
• Squash

Rebase:

• translator.py: Translate search query language to ES DSL
• translator.py: Complete all the filters and add new tests
• translator.py: Fix resource path for tox environment
• translator: Changes suggested by vlorentz
• translator.py: Update list of possible ql paths (suggested by vlorentz)

• translator: Changes suggested by vlorentz

Sanitize commit message body

rebase

grammar.js: Allow using '-' with sort_by options

• query_language: Segregate sort_by and limit from filters
• Add tests for the change mentioned above

query_language/grammar.js: Improve function comments

• query_language: Add test-sitter tests for escaping keywords in filter values
  • Origins with ' and " inside filter values
  • Origins with 'and' and 'or' inside filter values

• grammar.js: Add some comments to improve readability
• Add support for escaping " and ' from the filter values
• Improve and break bulky tree-sitter tests into smaller tests (for readability)
• setup.py: Use super().run() instead of build.run(self)
• Squash commits

• Rebase

• Changes suggested by @zack
• Squash commits

• docs/query-language: Use 'and' and 'or'
• Add details and examples for precedences
• Fix typos

• query_language/grammar.js: Include Z in date regex
• query_language: Add precedence and improve field names
• query_language: Add support for freely using brackets
• README: Add emsdk setup instructions
• setup.py: Add commands for build steps
• query_language/grammar.js: Remove redundancies using functions

• docs: Update query-language specs

Some aspects of the query language that I'm still thinking about :

Can we have some documentation of the query language, included in this diff?

• Add newline at the end of package.json and sample_query

• Improve Makefile and README
• Improve tree-sitter's native test development workflow

• Use locally installed emscripten instead of docker

• Inspecting jenkins build with echo

• Inspect docker container inside builds

• Use docker for emsdk

• Use sh instead of source

• Use emsdk for building .wasm

• Specify directory for build-wasm

Sorry for the mess (so many failed Jenkins builds), I couldn't reproduce the errors on my local machine.

• fix typo

• code to inspect jenkins builds

• Try fixing build failures

• Try fixing errors

Improve build process for .so and .wasm files :

• Makefile.local: Add command inter-dependencies and introduce new commands
• package.json: Use --no-bindings in generate and introduce new scripts to build .wasm files
• setup.py: Make os.system calls configurable with environment variables, build .so and .wasm files and move to static/