Page MenuHomeSoftware Heritage
Feed Advanced Search

Jan 8 2023

gitlab-migration closed T3953: UX audit and/or user-testing of the web search UI as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:23 PM · Web app, Archive search
gitlab-migration closed T3953: UX audit and/or user-testing of the web search UI , a subtask of T3952: Make the search query language a first class citizen , as Migrated.
Jan 8 2023, 10:23 PM · meta-task, Roadmap 2022, Archive search
gitlab-migration closed T3606: Document the swh-search design as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:23 PM · Archive search, Documentation
gitlab-migration closed T2254: textual search language for the Web UI as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:22 PM · Archive search, Web app
gitlab-migration changed the status of T4654: swh-indexer produces dates not supported by swh-search/ElasticSearch from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:04 PM · Archive search, Indexer
gitlab-migration changed the status of T3931: Pagination UI does not work at all when using the search QL from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:03 PM · Web app, Archive search
gitlab-migration changed the status of T3931: Pagination UI does not work at all when using the search QL, a subtask of T3560: Polish the swh-search QL, from Resolved to Migrated.
Jan 8 2023, 10:03 PM · Archive search
gitlab-migration changed the status of T3930: Update swh-search QL examples, a subtask of T3560: Polish the swh-search QL, from Resolved to Migrated.
Jan 8 2023, 10:03 PM · Archive search
gitlab-migration changed the status of T3930: Update swh-search QL examples from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:03 PM · Documentation, Archive search
gitlab-migration changed the status of Restricted Maniphest Task, a subtask of T3926: Better syntax errors for the search query language, from Resolved to Migrated.
Jan 8 2023, 10:03 PM · Archive search
gitlab-migration changed the status of T3910: Add an option to enable the swh-search QL for some users, a subtask of T3909: Get feedback on the swh-search QL, from Resolved to Migrated.
Jan 8 2023, 10:03 PM · Archive search
gitlab-migration changed the status of T3910: Add an option to enable the swh-search QL for some users from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:03 PM · Web app, Archive search
gitlab-migration changed the status of T3047: Enable to search in origin metadata with swh-search in webapp from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:01 PM · Web app, Archive search
gitlab-migration changed the status of T3047: Enable to search in origin metadata with swh-search in webapp, a subtask of T2590: Finish the indexer -> swh-search pipeline, from Resolved to Migrated.
Jan 8 2023, 10:01 PM · Journal, Archive search
gitlab-migration changed the status of T2936: Update the swh-search journal client to only set "has_visit" on "full" status of the visit, a subtask of T2905: Deploy swh-search for production, from Resolved to Migrated.
Jan 8 2023, 10:01 PM · System administration, Journal, Archive search
gitlab-migration changed the status of T2936: Update the swh-search journal client to only set "has_visit" on "full" status of the visit from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:01 PM · Journal, Archive search
gitlab-migration changed the status of T2934: Hide unvisited origins search option is not honored with elasticsearch backend from Invalid to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:01 PM · Archive search, Web app
gitlab-migration changed the status of T2904: Create a new production webapp using the frozen index on the staging ES from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:01 PM · System administrators, Journal, Archive search
gitlab-migration changed the status of T2904: Create a new production webapp using the frozen index on the staging ES, a subtask of T2590: Finish the indexer -> swh-search pipeline, from Resolved to Migrated.
Jan 8 2023, 10:01 PM · Journal, Archive search
gitlab-migration changed the status of T2876: metadata indexation : ES' dynamic mapping creation fails for field values that are of varying types, a subtask of T2590: Finish the indexer -> swh-search pipeline, from Resolved to Migrated.
Jan 8 2023, 10:01 PM · Journal, Archive search
gitlab-migration changed the status of T2876: metadata indexation : ES' dynamic mapping creation fails for field values that are of varying types from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:01 PM · Intrinsic metadata, Indexer, Archive search
gitlab-migration changed the status of T2876: metadata indexation : ES' dynamic mapping creation fails for field values that are of varying types, a subtask of T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch, from Resolved to Migrated.
Jan 8 2023, 10:01 PM · Archive search, Metadata workflow
gitlab-migration changed the status of T2867: Webapp search UI: set focus on search input by default from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:01 PM · Web app, Archive search
gitlab-migration changed the status of T2817: Enable the swh-search environment in staging, a subtask of T2590: Finish the indexer -> swh-search pipeline, from Resolved to Migrated.
Jan 8 2023, 10:01 PM · Journal, Archive search
gitlab-migration changed the status of T2817: Enable the swh-search environment in staging from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:01 PM · System administrators, Staging environment, Journal, Archive search
gitlab-migration changed the status of T2816: Enable the journal-writer for the swh-idx-storage in staging from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:01 PM · System administrators, Staging environment, Journal, Archive search
gitlab-migration changed the status of T2816: Enable the journal-writer for the swh-idx-storage in staging, a subtask of T2590: Finish the indexer -> swh-search pipeline, from Resolved to Migrated.
Jan 8 2023, 10:01 PM · Journal, Archive search
gitlab-migration changed the status of T2590: Finish the indexer -> swh-search pipeline, a subtask of T2182: Switch production swh-web to use swh-search instead of postgresql search., from Resolved to Migrated.
Jan 8 2023, 10:01 PM · System administration, Archive search, Storage manager
gitlab-migration changed the status of T2590: Finish the indexer -> swh-search pipeline from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:01 PM · Journal, Archive search
gitlab-migration changed the status of T2184: Replay origins to ElasticSearch's "origin" index, a subtask of T2183: Switch webapp0 to use swh-search instead of postgresql search., from Resolved to Migrated.
Jan 8 2023, 10:00 PM · Archive search, Storage manager
gitlab-migration changed the status of T2183: Switch webapp0 to use swh-search instead of postgresql search., a subtask of T2182: Switch production swh-web to use swh-search instead of postgresql search., from Resolved to Migrated.
Jan 8 2023, 10:00 PM · System administration, Archive search, Storage manager
gitlab-migration changed the status of T2183: Switch webapp0 to use swh-search instead of postgresql search. from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:00 PM · Archive search, Storage manager
gitlab-migration changed the status of T2184: Replay origins to ElasticSearch's "origin" index from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:00 PM · Archive search, Storage manager
gitlab-migration changed the status of T2074: Publish extrinsic metadata to swh-journal/Kafka, a subtask of T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch, from Resolved to Migrated.
Jan 8 2023, 10:00 PM · Archive search, Metadata workflow
gitlab-migration changed the status of T1910: Redesign origin search using a dedicated component (swh-search) from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:59 PM · Archive search, Storage manager
gitlab-migration closed T4650: Improve the search result UI as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:05 PM · Archive search
gitlab-migration closed T4650: Improve the search result UI, a subtask of T3952: Make the search query language a first class citizen , as Migrated.
Jan 8 2023, 5:05 PM · meta-task, Roadmap 2022, Archive search
gitlab-migration closed T4627: Specify the query language in PEG as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:05 PM · Archive search
gitlab-migration closed T4627: Specify the query language in PEG, a subtask of T3952: Make the search query language a first class citizen , as Migrated.
Jan 8 2023, 5:05 PM · meta-task, Roadmap 2022, Archive search
gitlab-migration closed T4438: Look into triple-stores suitable as swh-search backends as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:04 PM · Archive search
gitlab-migration closed T4296: Pagination does not work when using sort_by in search query language, a subtask of T3560: Polish the swh-search QL, as Migrated.
Jan 8 2023, 5:04 PM · Archive search
gitlab-migration closed T4296: Pagination does not work when using sort_by in search query language as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:04 PM · Archive search
gitlab-migration closed T4249: Choose/define an ontology to use for indexed extrinsic origin metadata as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:04 PM · Archive search, Metadata workflow
gitlab-migration closed T4249: Choose/define an ontology to use for indexed extrinsic origin metadata, a subtask of T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch, as Migrated.
Jan 8 2023, 5:04 PM · Archive search, Metadata workflow
gitlab-migration closed T3952: Make the search query language a first class citizen as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:03 PM · meta-task, Roadmap 2022, Archive search
gitlab-migration closed T3926: Better syntax errors for the search query language, a subtask of T3560: Polish the swh-search QL, as Migrated.
Jan 8 2023, 5:03 PM · Archive search
gitlab-migration closed T3926: Better syntax errors for the search query language as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:03 PM · Archive search
gitlab-migration closed T3909: Get feedback on the swh-search QL, a subtask of T3560: Polish the swh-search QL, as Migrated.
Jan 8 2023, 5:03 PM · Archive search
gitlab-migration closed T3909: Get feedback on the swh-search QL as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:03 PM · Archive search
gitlab-migration closed T3560: Polish the swh-search QL, a subtask of T3952: Make the search query language a first class citizen , as Migrated.
Jan 8 2023, 5:03 PM · meta-task, Roadmap 2022, Archive search
gitlab-migration closed T3560: Polish the swh-search QL, a subtask of T3558: Enable the swh-search QL in production, as Migrated.
Jan 8 2023, 5:03 PM · Archive search, System administration, Intrinsic metadata, Extrinsic metadata
gitlab-migration closed T3560: Polish the swh-search QL as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:03 PM · Archive search
gitlab-migration changed the status of T4613: Generalize and simplify the query language from Invalid to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:37 PM · Archive search
gitlab-migration changed the status of T4613: Generalize and simplify the query language, a subtask of T3952: Make the search query language a first class citizen , from Invalid to Migrated.
Jan 8 2023, 4:37 PM · meta-task, Roadmap 2022, Archive search
gitlab-migration changed the status of T4599: Github descriptions are not used to search origins from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:37 PM · Metadata workflow, Archive search
gitlab-migration changed the status of Restricted Maniphest Task, a subtask of T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch, from Resolved to Migrated.
Jan 8 2023, 4:37 PM · Archive search, Metadata workflow
gitlab-migration changed the status of T4364: "sort_by" in the search QL does not support pagination from Duplicate to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:37 PM · Archive search
gitlab-migration changed the status of T4354: Contribute terms to ForgeFed, a subtask of T4249: Choose/define an ontology to use for indexed extrinsic origin metadata, from Resolved to Migrated.
Jan 8 2023, 4:37 PM · Archive search, Metadata workflow
gitlab-migration changed the status of T4354: Contribute terms to ForgeFed from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:37 PM · Archive search, Metadata workflow
gitlab-migration changed the status of T4273: Rewrite indexers as journal clients when relevant, a subtask of T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch, from Resolved to Migrated.
Jan 8 2023, 4:36 PM · Archive search, Metadata workflow
gitlab-migration changed the status of T4192: Unstuck swh.search build from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:36 PM · Archive search
gitlab-migration changed the status of T3967: "Link" header is not properly displayed in apidoc when it contains [], a subtask of T3559: Enable the swh-search QL in staging, from Resolved to Migrated.
Jan 8 2023, 4:36 PM · Archive search, System administration, Intrinsic metadata, Extrinsic metadata
gitlab-migration changed the status of Restricted Maniphest Task, a subtask of T3560: Polish the swh-search QL, from Resolved to Migrated.
Jan 8 2023, 4:36 PM · Archive search
gitlab-migration changed the status of T3927: swh-search crashes when "only show origins visited at least once" is not checked, a subtask of T3560: Polish the swh-search QL, from Resolved to Migrated.
Jan 8 2023, 4:36 PM · Archive search
gitlab-migration changed the status of T3927: swh-search crashes when "only show origins visited at least once" is not checked from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:36 PM · Archive search
gitlab-migration changed the status of T3838: swh-search build is ko from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:36 PM · Archive search
gitlab-migration changed the status of T3803: swh-search tests are hanging since elasticsearch 7.16 release from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:36 PM · Archive search
gitlab-migration changed the status of T3742: yarn called in swh-search setup.py but not present in developer setup docs from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:35 PM · Archive search
gitlab-migration changed the status of T3741: swh-search - upgrade elasticsearch backend from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:35 PM · System administration (Component upgrades), Archive search
gitlab-migration changed the status of T3708: Upgrade swh-search elasticsearch version from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:35 PM · Archive search, System administration (Component upgrades)
gitlab-migration changed the status of T3671: staging - swh-search (metadata indexer) is unable to update a document due to an unparseable date from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:35 PM · Intrinsic metadata, Archive search
gitlab-migration changed the status of T3562: [swh-search] Document version conflict during parallel indexation from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:35 PM · Archive search
gitlab-migration changed the status of T3441: Implement query to get origin visit types dynamically from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:34 PM · Archive search
gitlab-migration changed the status of T3224: Implement blocklist support in swh.search from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:34 PM · Archive search
gitlab-migration changed the status of T3058: Metadata search is failing with "failed to parse date field", a subtask of T2590: Finish the indexer -> swh-search pipeline, from Resolved to Migrated.
Jan 8 2023, 4:33 PM · Journal, Archive search
gitlab-migration changed the status of T3058: Metadata search is failing with "failed to parse date field" from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:33 PM · Archive search
gitlab-migration changed the status of T2902: Document swh-search from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:32 PM · Archive search
gitlab-migration changed the status of T2798: Unbreak swh-search tests from Duplicate to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:32 PM · Archive search
gitlab-migration changed the status of T2791: Some swh-search tests are failing since the release of elasticsearch 7.10 from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:32 PM · Archive search
gitlab-migration changed the status of T2651: Make the indexer-storage publish its rows to Kafka, a subtask of T2590: Finish the indexer -> swh-search pipeline, from Resolved to Migrated.
Jan 8 2023, 4:31 PM · Journal, Archive search
gitlab-migration changed the status of T2102: Clean up Debian packaging branch bootstrapping scripts, a subtask of T2101: Bootstrap Debian packaging for swh.search, from Resolved to Migrated.
Jan 8 2023, 4:29 PM · Archive search
gitlab-migration changed the status of T2101: Bootstrap Debian packaging for swh.search from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:29 PM · Archive search
gitlab-migration changed the status of T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:28 PM · Archive search, Metadata workflow
gitlab-migration changed the status of T2052: Publish swh-search on PyPI, a subtask of T1910: Redesign origin search using a dedicated component (swh-search), from Resolved to Migrated.
Jan 8 2023, 4:28 PM · Archive search, Storage manager
gitlab-migration changed the status of T2052: Publish swh-search on PyPI from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:28 PM · Archive search

Dec 13 2022

vlorentz updated subscribers of T4438: Look into triple-stores suitable as swh-search backends.

@KShivendu pointed out that Neo4j may be a strong option too. It doesn't natively support SPARQL, but we could have it as a layer on top of the Tinkerpop API

Dec 13 2022, 12:24 PM · Archive search
vlorentz added a comment to T4438: Look into triple-stores suitable as swh-search backends.

Actually the open-source version of Virtuoso is unmaintained, and I couldn't figure out how to use it. Blazegraph and Apache Jena look promising too, though.

Dec 13 2022, 12:05 PM · Archive search

Dec 8 2022

vlorentz closed T4354: Contribute terms to ForgeFed as Resolved.
Dec 8 2022, 11:44 AM · Archive search, Metadata workflow
vlorentz closed T4354: Contribute terms to ForgeFed, a subtask of T4249: Choose/define an ontology to use for indexed extrinsic origin metadata, as Resolved.
Dec 8 2022, 11:44 AM · Archive search, Metadata workflow
vlorentz updated the task description for T4354: Contribute terms to ForgeFed.
Dec 8 2022, 11:44 AM · Archive search, Metadata workflow

Dec 1 2022

vlorentz closed T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch as Resolved.
Dec 1 2022, 4:16 PM · Archive search, Metadata workflow

Nov 21 2022

vlorentz closed T4599: Github descriptions are not used to search origins as Resolved.

It works now! eg. https://archive.softwareheritage.org/browse/search/?q=supybot+successor&with_visit=true&with_content=true&search_metadata=true

Nov 21 2022, 10:17 AM · Metadata workflow, Archive search

Nov 15 2022

vlorentz added a revision to T4599: Github descriptions are not used to search origins: D8842: metadata-search: Return swh-search even when missing from idx_storage.origin_intrinsic_metadata.
Nov 15 2022, 9:31 AM · Metadata workflow, Archive search

Nov 14 2022

vlorentz added a comment to T4599: Github descriptions are not used to search origins.

swh-web uses swh-search as a glorified postgresql index: for every result returned by swh-search, it pulls the corresponding row from origin_intrinsic_metadata in the indexer database; which means it ignores extrinsic metadata.

Nov 14 2022, 1:07 PM · Metadata workflow, Archive search

Nov 2 2022

vlorentz added a comment to T4599: Github descriptions are not used to search origins.

Now depends on https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4658 instead

Nov 2 2022, 11:51 AM · Metadata workflow, Archive search
vlorentz closed Restricted Maniphest Task, a subtask of T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch, as Resolved.
Nov 2 2022, 11:50 AM · Archive search, Metadata workflow
vlorentz closed T4654: swh-indexer produces dates not supported by swh-search/ElasticSearch as Resolved.
Nov 2 2022, 11:43 AM · Archive search, Indexer
vlorentz removed a parent task for T2183: Switch webapp0 to use swh-search instead of postgresql search.: T2185: Make webapp0 use Cassandra as storage backend..
Nov 2 2022, 11:34 AM · Archive search, Storage manager
vlorentz added a comment to T2183: Switch webapp0 to use swh-search instead of postgresql search..

(detaching this task from the Cassandra task tree, because it's getting really big)

Nov 2 2022, 11:33 AM · Archive search, Storage manager
vlorentz removed a parent task for T1910: Redesign origin search using a dedicated component (swh-search): T1892: Cassandra as a storage backend.
Nov 2 2022, 11:33 AM · Archive search, Storage manager