Page MenuHomeSoftware Heritage

Drop content_language and content_ctags tables and related SQL functions
ClosedPublic

Authored by vlorentz on Nov 28 2022, 12:33 PM.

Diff Detail

Repository
rDCIDX Metadata indexer
Branch
master
Lint
No Linters Available
Unit
No Unit Test Coverage
Build Status
Buildable 32989
Build 51698: Phabricator diff pipeline on jenkinsJenkins console · Jenkins
Build 51697: arc lint + arc unit

Unit TestsFailed

TimeTest
351 msJenkins > .tox.py3.lib.python3.7.site-packages.swh.indexer.tests.metadata_dictionary.test_npm::test_index_content_metadata_npm
request = <SubRequest 'idx_storage_postgresql' for <Function test_index_content_metadata_npm>> @pytest.fixture
2 msJenkins > .tox.py3.lib.python3.7.site-packages.swh.indexer.tests.storage.test_api_client::test_check_config
request = <SubRequest '_push_request_context' for <Function test_check_config>> @pytest.fixture(autouse=True)
1 msJenkins > .tox.py3.lib.python3.7.site-packages.swh.indexer.tests.storage.test_api_client.TestIndexerStorageContentFossologyLicense::test_add
request = <SubRequest '_push_request_context' for <Function test_add>> @pytest.fixture(autouse=True)
1 msJenkins > .tox.py3.lib.python3.7.site-packages.swh.indexer.tests.storage.test_api_client.TestIndexerStorageContentFossologyLicense::test_add__duplicate_twice
request = <SubRequest '_push_request_context' for <Function test_add__duplicate_twice>> @pytest.fixture(autouse=True)
1 msJenkins > .tox.py3.lib.python3.7.site-packages.swh.indexer.tests.storage.test_api_client.TestIndexerStorageContentFossologyLicense::test_add_empty
request = <SubRequest '_push_request_context' for <Function test_add_empty>> @pytest.fixture(autouse=True)
View Full Test Results (140 Failed · 331 Passed · 11 Skipped)

Event Timeline

Build has FAILED

Patch application report for D8888 (id=32040)

Rebasing onto f7833b7e2d...

Current branch diff-target is up to date.
Changes applied before test
commit 07b34be4f605ba3106aea1d535623b1d573f7655
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date:   Mon Nov 28 12:33:29 2022 +0100

    Drop content_language and content_ctags tables and related SQL functions

Link to build: https://jenkins.softwareheritage.org/job/DCIDX/job/tests-on-diff/529/
See console output for more information: https://jenkins.softwareheritage.org/job/DCIDX/job/tests-on-diff/529/console

Harbormaster returned this revision to the author for changes because remote builds failed.Nov 28 2022, 12:38 PM
Harbormaster failed remote builds in B32989: Diff 32040!

remove index content_language_pkey

Build is green

Patch application report for D8888 (id=32043)

Rebasing onto f7833b7e2d...

Current branch diff-target is up to date.
Changes applied before test
commit a5ee54aedece0cac8398e64fe2d2355cd482df13
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date:   Mon Nov 28 12:33:29 2022 +0100

    Drop content_language and content_ctags tables and related SQL functions

See https://jenkins.softwareheritage.org/job/DCIDX/job/tests-on-diff/530/ for more details.

ardumont added subscribers: zack, olasd.

lgtm

one question to team inline.

swh/indexer/sql/upgrades/137.sql
18

@olasd @zack shall we drop those tables once and for all (and no longer look back)?

This revision is now accepted and ready to land.Nov 29 2022, 2:15 PM
swh/indexer/sql/upgrades/137.sql
18

The content_ctags table is empty in prod.

The content_language table is, er, full of creative data that doesn't really have any relationship to reality.

I think they're best gone.

swh/indexer/sql/upgrades/137.sql
18

Fine then!

I should have checked their data indeed prior to me pinging you.
Memory served me badly this time, i remembered it was just not empty...