Page MenuHomeSoftware Heritage
Feed All Stories

Fri, Jan 17

anlambert added a comment to T2188: Fix documentation build on Jenkins.

Almost there ! All swh modules have been processed. The remaining warnings to fix are the following:

WARNING: autodoc: failed to import module 'dataset' from module 'swh'; the following exception was raised:
No module named 'swh.dataset'
/home/antoine/swh/swh-environment/swh-docs/docs/index.rst:121: WARNING: toctree contains reference to nonexisting document 'manual-setup'
/home/antoine/swh/swh-environment/swh-docs/docs/index.rst:121: WARNING: toctree contains reference to nonexisting document 'swh-loader'
/home/antoine/swh/swh-environment/swh-docs/docs/swh-dataset/graph/dataset.rst:2: WARNING: Duplicate explicit target name: "/graph/latest/popular-3k-python/sql/".
/home/antoine/swh/swh-environment/swh-docs/docs/swh-dataset/graph/schema.rst:20: WARNING: Bullet list ends without a blank line; unexpected unindent.
/home/antoine/swh/swh-environment/swh-docs/docs/swh-search/index.rst:4: WARNING: duplicate label swh-py-template, other instance in /home/antoine/swh/swh-environment/swh-docs/docs/swh-icinga-plugins/index.rst
/home/antoine/swh/swh-environment/swh-docs/docs/swh-icinga-plugins/index.rst: WARNING: document isn't included in any toctree
/home/antoine/swh/swh-environment/swh-docs/docs/swh-loader-core/index.rst: WARNING: document isn't included in any toctree
/home/antoine/swh/swh-environment/swh-docs/docs/swh-loader-git/index.rst: WARNING: document isn't included in any toctree
/home/antoine/swh/swh-environment/swh-docs/docs/swh-loader-mercurial/index.rst: WARNING: document isn't included in any toctree
/home/antoine/swh/swh-environment/swh-docs/docs/swh-loader-svn/index.rst: WARNING: document isn't included in any toctree
/home/antoine/swh/swh-environment/swh-docs/docs/swh-search/index.rst: WARNING: document isn't included in any toctree
/home/antoine/swh/swh-environment/swh-docs/docs/infrastructure/storage_site_rocquencourt_physical.rst:7: WARNING: undefined label: ceph cluster (if the link has no caption the label must precede a section header)
WARNING: logo file 'software-heritage-logo-title-motto-vertical-white.png' does not exist
Fri, Jan 17, 7:13 PM · Development documentation
swh-public-ci added a comment to D2560: docs: Fix sphinx warnings.

Build is green
See https://jenkins.softwareheritage.org/job/DGRPH/job/tox/121/ for more details.

Fri, Jan 17, 7:12 PM
anlambert created D2560: docs: Fix sphinx warnings.
Fri, Jan 17, 7:10 PM
swh-public-ci added a comment to D2559: Fix sphinx warning.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/323/ for more details.

Fri, Jan 17, 6:29 PM
swh-public-ci added a comment to D2558: Fix sphinx warning.

Build is green
See https://jenkins.softwareheritage.org/job/DMOD/job/tox/160/ for more details.

Fri, Jan 17, 6:27 PM
anlambert created D2559: Fix sphinx warning.
Fri, Jan 17, 6:26 PM
anlambert created D2558: Fix sphinx warning.
Fri, Jan 17, 6:26 PM
anlambert committed rDDEP9ab604794ca3: docs: Fix sphinx warnings (authored by anlambert).
docs: Fix sphinx warnings
Fri, Jan 17, 6:06 PM
anlambert closed D2557: Fix sphinx warnings.
Fri, Jan 17, 6:06 PM
anlambert committed rDSTO2454a7821f4c: docs: Fix sphinx warnings (authored by anlambert).
docs: Fix sphinx warnings
Fri, Jan 17, 6:06 PM
anlambert closed D2556: Fix sphinx warnings.
Fri, Jan 17, 6:06 PM
ardumont claimed T2175: Deploy swh-icinga-plugins.

As far as i could tell so far:

  • debian package this
  • update puppet configuration to add the checks [1]
Fri, Jan 17, 5:56 PM · Sprint 2019/12 (Monitor and Conquer), System administration, Metrics/monitoring
swh-public-ci added a comment to D2557: Fix sphinx warnings.

Build is green
See https://jenkins.softwareheritage.org/job/DDEP/job/tox/250/ for more details.

Fri, Jan 17, 5:51 PM
ardumont accepted D2557: Fix sphinx warnings.
Fri, Jan 17, 5:49 PM
ardumont accepted D2556: Fix sphinx warnings.
Fri, Jan 17, 5:48 PM
anlambert created D2557: Fix sphinx warnings.
Fri, Jan 17, 5:43 PM
ardumont accepted D2552: docker/test: add a pytest based test for the git loading stack.

lgtm

Fri, Jan 17, 5:36 PM
swh-public-ci added a comment to D2556: Fix sphinx warnings.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/869/ for more details.

Fri, Jan 17, 5:29 PM
anlambert created D2556: Fix sphinx warnings.
Fri, Jan 17, 5:26 PM
douardda added a comment to D2552: docker/test: add a pytest based test for the git loading stack.

Why does setup_pip call scheduler_host.check_output()?

Fri, Jan 17, 5:26 PM
ardumont added inline comments to D2552: docker/test: add a pytest based test for the git loading stack.
Fri, Jan 17, 5:14 PM
ardumont accepted D2553: docker/test: add a pytest based test for the vault stack.
Fri, Jan 17, 5:02 PM
vlorentz accepted D2553: docker/test: add a pytest based test for the vault stack.
Fri, Jan 17, 4:44 PM
vlorentz added a comment to D2552: docker/test: add a pytest based test for the git loading stack.

Why does setup_pip call scheduler_host.check_output()?

Fri, Jan 17, 4:41 PM
swh-public-ci added a comment to D2555: Fix sphinx warnings.

Build is green
See https://jenkins.softwareheritage.org/job/DLDSVN/job/tox/54/ for more details.

Fri, Jan 17, 4:39 PM
anlambert committed rDLDSVN41ca0923a053: docs: Fix sphinx warnings (authored by anlambert).
docs: Fix sphinx warnings
Fri, Jan 17, 4:38 PM
anlambert closed D2555: Fix sphinx warnings.
Fri, Jan 17, 4:38 PM
anlambert updated the diff for D2555: Fix sphinx warnings.

Use raw string litteral instead

Fri, Jan 17, 4:37 PM
anlambert added inline comments to D2555: Fix sphinx warnings.
Fri, Jan 17, 4:34 PM
swh-public-ci added a comment to D2555: Fix sphinx warnings.

Build is green
See https://jenkins.softwareheritage.org/job/DLDSVN/job/tox/53/ for more details.

Fri, Jan 17, 4:33 PM
vlorentz accepted D2555: Fix sphinx warnings.
Fri, Jan 17, 4:33 PM
anlambert created D2555: Fix sphinx warnings.
Fri, Jan 17, 4:31 PM
anlambert committed rDLDHG14054fabed48: docs: Fix sphinx warnings (authored by anlambert).
docs: Fix sphinx warnings
Fri, Jan 17, 4:31 PM
anlambert closed D2554: Fix sphinx warnings.
Fri, Jan 17, 4:31 PM
vlorentz committed rDSTOCc284c1c3ef91: Use prepared statements as much as possible. (authored by vlorentz).
Use prepared statements as much as possible.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOCe62a87be230c: Update tests to pass with the cassandra backend. (authored by vlorentz).
Update tests to pass with the cassandra backend.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC96eff6a666db: Split swh/storage/cassandra.py into swh/storage/cassandra/*.py (authored by vlorentz).
Split swh/storage/cassandra.py into swh/storage/cassandra/*.py
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC8768cfda8c59: Add type annotations. (authored by vlorentz).
Add type annotations.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC8543f4b59cb0: Move all remaining calls to execute_and_retry to CassandraProxy. (authored by vlorentz).
Move all remaining calls to execute_and_retry to CassandraProxy.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOCfd4fce51e610: Implement origin_list for cassandra. (authored by vlorentz).
Implement origin_list for cassandra.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOCae593b3388e8: Add validation in origin_visit_update for cassandra. (authored by vlorentz).
Add validation in origin_visit_update for cassandra.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC52d8fd569c5d: Fix handling of hidden content in cassandra backend (authored by vlorentz).
Fix handling of hidden content in cassandra backend
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC7e58f444bc65: Fix double-counting of contents. (authored by vlorentz).
Fix double-counting of contents.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC94066c308e6b: Update cassandra implementation of content_get_metadata to use the new signature (authored by vlorentz).
Update cassandra implementation of content_get_metadata to use the new signature
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC11bba0f300d8: Filter-out known content before publishing to kafka (authored by vlorentz).
Filter-out known content before publishing to kafka
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC41deb1e97b7d: Implement content_get_partition for cassandra. (authored by vlorentz).
Implement content_get_partition for cassandra.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOCad4f1ac0ab08: Really remove warnings about deprecated arguments. (authored by vlorentz).
Really remove warnings about deprecated arguments.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOCbe79b392fb8a: Implement origin_get_by_sha1 for cassandra. (authored by vlorentz).
Implement origin_get_by_sha1 for cassandra.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC9230bc6311c7: Implement origin_visit_get_random for cassandra. (authored by vlorentz).
Implement origin_visit_get_random for cassandra.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOCd0804a786db1: Use new signature of get_storage. (authored by vlorentz).
Use new signature of get_storage.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC5e5d95acc5e3: Implement {content,directory,revision,release,snapshot}_get_random for… (authored by vlorentz).
Implement {content,directory,revision,release,snapshot}_get_random for…
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOCc9108a5c822e: Add validation in content_add. (authored by vlorentz).
Add validation in content_add.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC2b0dacde584b: improve comments (authored by vlorentz).
improve comments
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOCbd1b17c9b1bb: Use a separate table to store revision parents, instead of a list. (authored by vlorentz).
Use a separate table to store revision parents, instead of a list.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOCb6bf7ef358c0: Don't import psycopg2 unconditionally (authored by vlorentz).
Don't import psycopg2 unconditionally
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC9d2a8db83725: Remove warning about deprecated arguments, the default is the right value… (authored by vlorentz).
Remove warning about deprecated arguments, the default is the right value…
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC5d9e4d2db48f: skip test_origin_count. (authored by vlorentz).
skip test_origin_count.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOCfd5c33ccbc9a: remove origin type (authored by vlorentz).
remove origin type
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC44d9b6ff7f23: Fix some tests. (authored by vlorentz).
Fix some tests.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC8514773b7872: Support for frozen model. (authored by vlorentz).
Support for frozen model.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC968cef9a3c9a: update for the new test structure + Java 11. (authored by vlorentz).
update for the new test structure + Java 11.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOCef12786a91b5: Store directory entries in a separate table to avoid huge records. (authored by vlorentz).
Store directory entries in a separate table to avoid huge records.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC2c88a1fbadd3: Require cassandra-driver >= 3.18.0 to support Cassandra 4. (authored by vlorentz).
Require cassandra-driver >= 3.18.0 to support Cassandra 4.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOCf6f4c62fa68b: Require cassandra-driver >= 3.19.0 to support alpha Cassandra versions. (authored by vlorentz).
Require cassandra-driver >= 3.19.0 to support alpha Cassandra versions.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOCebc8fc846fc7: Remove config sanitization from api/server.py. (authored by vlorentz).
Remove config sanitization from api/server.py.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC6d61c8097d47: Add a draft Cassandra backend. (authored by vlorentz).
Add a draft Cassandra backend.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOC2dc17cd789e9: Remove 'id' and 'object_id' from the output of object_find_by_sha1_git. (authored by vlorentz).
Remove 'id' and 'object_id' from the output of object_find_by_sha1_git.
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOCdba9e04f6faa: Rewrite test_content_get_partition_empty to not assume partitions are based on… (authored by vlorentz).
Rewrite test_content_get_partition_empty to not assume partitions are based on…
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOCb5a5084467ad: Make origin_visit_get_random return None instead of {} if there are no results. (authored by vlorentz).
Make origin_visit_get_random return None instead of {} if there are no results.
Fri, Jan 17, 4:28 PM
ardumont committed rDSTOCbf77f143f065: storage.retry: Fix objects loading when using generator parameters (authored by ardumont).
storage.retry: Fix objects loading when using generator parameters
Fri, Jan 17, 4:28 PM
anlambert committed rDSTOCcc29708564c3: storage: Fix objects loading when using generator parameters (authored by anlambert).
storage: Fix objects loading when using generator parameters
Fri, Jan 17, 4:28 PM
vlorentz committed rDSTOCe5846554ad2b: Remove test_content_*_same_input, which check for behavior we do not want to… (authored by vlorentz).
Remove test_content_*_same_input, which check for behavior we do not want to…
Fri, Jan 17, 4:28 PM
vlorentz committed rDSCH071220786e04: Use swh.core.sentry instead of calling sentry_sdk.init directly. (authored by vlorentz).
Use swh.core.sentry instead of calling sentry_sdk.init directly.
Fri, Jan 17, 4:27 PM
vlorentz closed D2515: Use swh.core.sentry instead of calling sentry_sdk.init directly..
Fri, Jan 17, 4:27 PM
vlorentz committed rDSTO2dc17cd789e9: Remove 'id' and 'object_id' from the output of object_find_by_sha1_git. (authored by vlorentz).
Remove 'id' and 'object_id' from the output of object_find_by_sha1_git.
Fri, Jan 17, 4:27 PM
vlorentz committed rDSTOb5a5084467ad: Make origin_visit_get_random return None instead of {} if there are no results. (authored by vlorentz).
Make origin_visit_get_random return None instead of {} if there are no results.
Fri, Jan 17, 4:27 PM
vlorentz closed D2549: Remove 'id' and 'object_id' from the output of object_find_by_sha1_git..
Fri, Jan 17, 4:27 PM
vlorentz closed D2542: Make origin_visit_get_random return None instead of {} if there are no results..
Fri, Jan 17, 4:27 PM
vlorentz committed rDSTOdba9e04f6faa: Rewrite test_content_get_partition_empty to not assume partitions are based on… (authored by vlorentz).
Rewrite test_content_get_partition_empty to not assume partitions are based on…
Fri, Jan 17, 4:27 PM
vlorentz closed D2539: Rewrite test_content_get_partition_empty to not assume partitions are based on sha1..
Fri, Jan 17, 4:27 PM
olasd accepted D2539: Rewrite test_content_get_partition_empty to not assume partitions are based on sha1..
Fri, Jan 17, 4:26 PM
vlorentz committed rDSTOCa6243b5b5f23: Move all remaining calls to execute_and_retry to CassandraProxy. (authored by vlorentz).
Move all remaining calls to execute_and_retry to CassandraProxy.
Fri, Jan 17, 4:24 PM
vlorentz committed rDSTOCb1bf1caa3865: Remove 'id' and 'object_id' from the output of object_find_by_sha1_git. (authored by vlorentz).
Remove 'id' and 'object_id' from the output of object_find_by_sha1_git.
Fri, Jan 17, 4:24 PM
vlorentz committed rDSTOC246bdf4ebcb1: Split swh/storage/cassandra.py into swh/storage/cassandra/*.py (authored by vlorentz).
Split swh/storage/cassandra.py into swh/storage/cassandra/*.py
Fri, Jan 17, 4:24 PM
ardumont accepted D2554: Fix sphinx warnings.
Fri, Jan 17, 4:21 PM
swh-public-ci added a comment to D2550: Fix sphinx warnings.

Build is green
See https://jenkins.softwareheritage.org/job/DLS/job/tox/537/ for more details.

Fri, Jan 17, 4:19 PM
swh-public-ci added a comment to D2554: Fix sphinx warnings.

Build is green
See https://jenkins.softwareheritage.org/job/DLDHG/job/tox/45/ for more details.

Fri, Jan 17, 4:19 PM
anlambert created D2554: Fix sphinx warnings.
Fri, Jan 17, 4:17 PM
anlambert committed rDLS99fcd2b3f55e: docs: Fix sphinx warnings (authored by anlambert).
docs: Fix sphinx warnings
Fri, Jan 17, 4:16 PM
anlambert closed D2550: Fix sphinx warnings.
Fri, Jan 17, 4:16 PM
anlambert committed rDLDBASEbf0e357e3555: docs: Fix sphinx warnings (authored by anlambert).
docs: Fix sphinx warnings
Fri, Jan 17, 4:16 PM
anlambert closed D2551: Fix sphinx warnings.
Fri, Jan 17, 4:16 PM
anlambert updated the diff for D2550: Fix sphinx warnings.

Rebase

Fri, Jan 17, 4:15 PM
douardda created D2553: docker/test: add a pytest based test for the vault stack.
Fri, Jan 17, 4:12 PM
douardda created D2552: docker/test: add a pytest based test for the git loading stack.
Fri, Jan 17, 4:12 PM
ardumont accepted D2551: Fix sphinx warnings.
Fri, Jan 17, 4:12 PM
ardumont accepted D2550: Fix sphinx warnings.
Fri, Jan 17, 4:11 PM
swh-public-ci added a comment to D2551: Fix sphinx warnings.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/314/ for more details.

Fri, Jan 17, 4:03 PM
anlambert created D2551: Fix sphinx warnings.
Fri, Jan 17, 4:00 PM
swh-public-ci added a comment to D2550: Fix sphinx warnings.

Build is green
See https://jenkins.softwareheritage.org/job/DLS/job/tox/536/ for more details.

Fri, Jan 17, 3:50 PM