Page MenuHomeSoftware Heritage
Feed All Stories

Oct 14 2019

ardumont committed rDLS9a1314c65609: tox.ini: Install ipdb dependency for development environment (authored by ardumont).
tox.ini: Install ipdb dependency for development environment
Oct 14 2019, 2:53 PM
ardumont committed rDLSfcd8521622c9: tests/conftest: Log the db url used by tests (authored by ardumont).
tests/conftest: Log the db url used by tests
Oct 14 2019, 2:53 PM
douardda updated the diff for D2119: test_api_client: refactor the code for new pytest based infra.

rebased

Oct 14 2019, 2:51 PM
swh-public-ci added a comment to D2117: tests/algos: rewrite test_snapshot with pytest.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/733/ for more details.

Oct 14 2019, 2:50 PM
douardda updated the diff for D2118: api: add (missing) refresh_stat_counters() endpoint.

rebased

Oct 14 2019, 2:48 PM
douardda updated the diff for D2117: tests/algos: rewrite test_snapshot with pytest.

rebased

Oct 14 2019, 2:46 PM
swh-public-ci added a comment to D2095: test_in_memory: adapt tests for the InMemoryStorage to new storage test infra.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/732/ for more details.

Oct 14 2019, 2:42 PM
olasd committed rSPSITEe3b614731010: getty isn't a kafka broker any more (authored by olasd).
getty isn't a kafka broker any more
Oct 14 2019, 2:39 PM
swh-public-ci added a comment to D2094: test_storage: rename TestStorageCommonProp as TestStorageGeneratedData.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/731/ for more details.

Oct 14 2019, 2:38 PM
douardda updated the diff for D2095: test_in_memory: adapt tests for the InMemoryStorage to new storage test infra.

rebased + merge with D2096

Oct 14 2019, 2:36 PM
swh-public-ci added a comment to D2093: test_storage: make test_origin_metadata_get more robust.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/730/ for more details.

Oct 14 2019, 2:34 PM
douardda abandoned D2096: in_memory: fix handling of 'hidden' content in InMemoryStorage.

merged in D2095

Oct 14 2019, 2:34 PM
swh-public-ci added a comment to D2092: test_storage: move db specific methods from main TestStorage to TestPgStorage.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/729/ for more details.

Oct 14 2019, 2:31 PM
swh-public-ci added a comment to D2090: tests: refactor main storage tests.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/728/ for more details.

Oct 14 2019, 2:27 PM
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/182/ for more details.

Oct 14 2019, 2:27 PM · Debian loader, Core Loader
douardda updated the diff for D2094: test_storage: rename TestStorageCommonProp as TestStorageGeneratedData.

rebased

Oct 14 2019, 2:26 PM
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/181/ for more details.

Oct 14 2019, 2:25 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • debian: Expose debian loader implementation first
Oct 14 2019, 2:25 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Improve dosctrings

Oct 14 2019, 2:24 PM · Debian loader, Core Loader
douardda updated the diff for D2093: test_storage: make test_origin_metadata_get more robust.

rebased

Oct 14 2019, 2:24 PM
douardda updated the diff for D2092: test_storage: move db specific methods from main TestStorage to TestPgStorage.

rebased

Oct 14 2019, 2:23 PM
douardda updated the diff for D2090: tests: refactor main storage tests.

smalle rework related to skipping a few tests due to origin id handling

Oct 14 2019, 2:23 PM
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/180/ for more details.

Oct 14 2019, 2:19 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Add missing type annotations

Oct 14 2019, 2:18 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/179/ for more details.

Oct 14 2019, 2:17 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • debian: Simplify build revision code
Oct 14 2019, 2:16 PM · Debian loader, Core Loader
olasd committed rSPSITEb4502744b987: Speed up startup of kafka by setting num.recovery.threads.per.data.dir (authored by olasd).
Speed up startup of kafka by setting num.recovery.threads.per.data.dir
Oct 14 2019, 2:13 PM
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/178/ for more details.

Oct 14 2019, 1:58 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • debian: Remove dead code
Oct 14 2019, 1:56 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/177/ for more details.

Oct 14 2019, 1:55 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • package.loader: Clarify download_package contract
  • package.debian: Compute the dsc information
  • debian: Remove duplicated computations step
Oct 14 2019, 1:54 PM · Debian loader, Core Loader
olasd committed rSPSITE48064894316a: Let systemd know that kafka exiting with 143 is successful (thanks Java) (authored by olasd).
Let systemd know that kafka exiting with 143 is successful (thanks Java)
Oct 14 2019, 1:53 PM
seirl updated the language for P548 Masterwork From Distant Lands from autodetect to java.
Oct 14 2019, 1:52 PM
seirl edited P548 Masterwork From Distant Lands.
Oct 14 2019, 1:52 PM
seirl committed rDGRPH97f7d693e58c: java: traversal: use HashSet to reduce initialization time (authored by seirl).
java: traversal: use HashSet to reduce initialization time
Oct 14 2019, 1:51 PM
Harbormaster failed remote builds in B8411: Diff 7197 for D2091: test_storage: kill StorageTestDbFixture class!
Oct 14 2019, 1:37 PM
swh-public-ci added a comment to D2091: test_storage: kill StorageTestDbFixture class.

Build has FAILED

Oct 14 2019, 1:37 PM
Harbormaster failed remote builds in B8410: Diff 7196 for D2119: test_api_client: refactor the code for new pytest based infra!
Oct 14 2019, 1:33 PM
swh-public-ci added a comment to D2119: test_api_client: refactor the code for new pytest based infra.

Build has FAILED

Oct 14 2019, 1:33 PM
Harbormaster failed remote builds in B8409: Diff 7195 for D2118: api: add (missing) refresh_stat_counters() endpoint!
Oct 14 2019, 1:30 PM
swh-public-ci added a comment to D2118: api: add (missing) refresh_stat_counters() endpoint.

Build has FAILED

Oct 14 2019, 1:30 PM
Harbormaster failed remote builds in B8408: Diff 7194 for D2117: tests/algos: rewrite test_snapshot with pytest!
Oct 14 2019, 1:28 PM
swh-public-ci added a comment to D2117: tests/algos: rewrite test_snapshot with pytest.

Build has FAILED

Oct 14 2019, 1:28 PM
Harbormaster failed remote builds in B8407: Diff 7193 for D2096: in_memory: fix handling of 'hidden' content in InMemoryStorage!
Oct 14 2019, 1:25 PM
swh-public-ci added a comment to D2096: in_memory: fix handling of 'hidden' content in InMemoryStorage.

Build has FAILED

Oct 14 2019, 1:25 PM
Harbormaster failed remote builds in B8406: Diff 7192 for D2095: test_in_memory: adapt tests for the InMemoryStorage to new storage test infra!
Oct 14 2019, 1:23 PM
swh-public-ci added a comment to D2095: test_in_memory: adapt tests for the InMemoryStorage to new storage test infra.

Build has FAILED

Oct 14 2019, 1:23 PM
Harbormaster failed remote builds in B8405: Diff 7191 for D2094: test_storage: rename TestStorageCommonProp as TestStorageGeneratedData!
Oct 14 2019, 1:21 PM
swh-public-ci added a comment to D2094: test_storage: rename TestStorageCommonProp as TestStorageGeneratedData.

Build has FAILED

Oct 14 2019, 1:21 PM
vlorentz accepted D2090: tests: refactor main storage tests.
Oct 14 2019, 1:19 PM
swh-public-ci added a comment to D2093: test_storage: make test_origin_metadata_get more robust.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/720/ for more details.

Oct 14 2019, 1:18 PM
vlorentz accepted D2119: test_api_client: refactor the code for new pytest based infra.
Oct 14 2019, 1:18 PM
swh-public-ci added a comment to D2092: test_storage: move db specific methods from main TestStorage to TestPgStorage.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/719/ for more details.

Oct 14 2019, 1:14 PM
douardda updated the diff for D2091: test_storage: kill StorageTestDbFixture class.

rebased

Oct 14 2019, 1:14 PM
douardda updated the diff for D2119: test_api_client: refactor the code for new pytest based infra.

rebased

Oct 14 2019, 1:13 PM
ardumont accepted D2090: tests: refactor main storage tests.
Oct 14 2019, 1:13 PM
douardda updated the diff for D2118: api: add (missing) refresh_stat_counters() endpoint.

rebsed

Oct 14 2019, 1:13 PM
douardda updated the diff for D2117: tests/algos: rewrite test_snapshot with pytest.

rebased

Oct 14 2019, 1:13 PM
douardda updated the diff for D2096: in_memory: fix handling of 'hidden' content in InMemoryStorage.

rebased

Oct 14 2019, 1:12 PM
douardda updated the diff for D2095: test_in_memory: adapt tests for the InMemoryStorage to new storage test infra.

rebased

Oct 14 2019, 1:12 PM
douardda updated the diff for D2094: test_storage: rename TestStorageCommonProp as TestStorageGeneratedData.

rebased

Oct 14 2019, 1:12 PM
douardda updated the diff for D2093: test_storage: make test_origin_metadata_get more robust.

rebased

Oct 14 2019, 1:11 PM
douardda updated the diff for D2092: test_storage: move db specific methods from main TestStorage to TestPgStorage.

rebased

Oct 14 2019, 1:10 PM
douardda updated the summary of D2119: test_api_client: refactor the code for new pytest based infra.
Oct 14 2019, 1:09 PM
douardda updated the summary of D2118: api: add (missing) refresh_stat_counters() endpoint.
Oct 14 2019, 1:09 PM
douardda updated the summary of D2117: tests/algos: rewrite test_snapshot with pytest.
Oct 14 2019, 1:09 PM
douardda updated the summary of D2096: in_memory: fix handling of 'hidden' content in InMemoryStorage.
Oct 14 2019, 1:09 PM
douardda updated the summary of D2095: test_in_memory: adapt tests for the InMemoryStorage to new storage test infra.
Oct 14 2019, 1:09 PM
douardda updated the summary of D2094: test_storage: rename TestStorageCommonProp as TestStorageGeneratedData.
Oct 14 2019, 1:08 PM
douardda updated the summary of D2093: test_storage: make test_origin_metadata_get more robust.
Oct 14 2019, 1:08 PM
douardda updated the summary of D2090: tests: refactor main storage tests.
Oct 14 2019, 1:04 PM
olasd added a comment to D2078: Add support for symbolic references.
In D2078#48207, @zack wrote:

Looks good, but I'm puzzled by some testing results.

The logic of extracting the branches for snapshot computation has trickled down to swh identify. (BTW, if you're up for some refactoring, this diff might be a chance to avoid the duplication, but it's certainly not a blocker here.)

So I've tried to just reuse your change in swh.model.cli too, here's the minimal diff: D2078.

Then I've dumped the branch list just before it's hashed (with P542 in swh.model.identifiers) and what I get is this:

alias HEAD 726566732f68656164732f6d6173746572
revision refs/heads/master 9768d0b576dbaaecd80abedad6dfd0d72f1476da
revision refs/remotes/origin/master c3c588713233609f5bbbb2d9e7f3fb4a660f3f72

where HEAD is an alias, but it's pointing to an object ID (this is on the sample git repo used for tests on swh-load-git, but I obtain similar results on any other repo I've tried).

What am I missing here?

Oct 14 2019, 12:35 PM
douardda created P547 (An Untitled Masterwork).
Oct 14 2019, 12:28 PM
douardda updated the summary of D2092: test_storage: move db specific methods from main TestStorage to TestPgStorage.
Oct 14 2019, 12:27 PM
vlorentz added inline comments to D2119: test_api_client: refactor the code for new pytest based infra.
Oct 14 2019, 12:26 PM
douardda updated the summary of D2091: test_storage: kill StorageTestDbFixture class.
Oct 14 2019, 12:24 PM
ftigeot committed rDDOCdd17bc3c2fbb: swh-docs: Add Elasticsearch documentation (authored by ftigeot).
swh-docs: Add Elasticsearch documentation
Oct 14 2019, 12:17 PM
vlorentz added a comment to D2090: tests: refactor main storage tests.

also replace boolean hypothesis strategy by pytest.mark.parametrize, so we do
not need to reset the storage in these tests (since the test is truly
executed twice).

Oct 14 2019, 12:16 PM
swh-public-ci added a comment to D2090: tests: refactor main storage tests.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/718/ for more details.

Oct 14 2019, 12:15 PM
douardda updated the diff for D2090: tests: refactor main storage tests.

revert usage for self._test_origin_ids and use_url to fix py3-no-origin-ids

Oct 14 2019, 12:11 PM
olasd committed rSPSITEb69971caa7d2: Avoid killing a kafka broker while it's winding down (authored by olasd).
Avoid killing a kafka broker while it's winding down
Oct 14 2019, 11:41 AM
Harbormaster failed remote builds in B8397: Diff 7183 for D2091: test_storage: kill StorageTestDbFixture class!
Oct 14 2019, 11:19 AM
swh-public-ci added a comment to D2091: test_storage: kill StorageTestDbFixture class.

Build has FAILED

Oct 14 2019, 11:19 AM
Harbormaster failed remote builds in B8396: Diff 7182 for D2119: test_api_client: refactor the code for new pytest based infra!
Oct 14 2019, 11:16 AM
swh-public-ci added a comment to D2119: test_api_client: refactor the code for new pytest based infra.

Build has FAILED

Oct 14 2019, 11:16 AM
Harbormaster failed remote builds in B8395: Diff 7181 for D2118: api: add (missing) refresh_stat_counters() endpoint!
Oct 14 2019, 11:12 AM
swh-public-ci added a comment to D2118: api: add (missing) refresh_stat_counters() endpoint.

Build has FAILED

Oct 14 2019, 11:12 AM
ardumont accepted D2117: tests/algos: rewrite test_snapshot with pytest.
Oct 14 2019, 11:11 AM
Harbormaster failed remote builds in B8394: Diff 7180 for D2117: tests/algos: rewrite test_snapshot with pytest!
Oct 14 2019, 11:10 AM
swh-public-ci added a comment to D2117: tests/algos: rewrite test_snapshot with pytest.

Build has FAILED

Oct 14 2019, 11:10 AM
Harbormaster failed remote builds in B8393: Diff 7179 for D2096: in_memory: fix handling of 'hidden' content in InMemoryStorage!
Oct 14 2019, 11:07 AM
swh-public-ci added a comment to D2096: in_memory: fix handling of 'hidden' content in InMemoryStorage.

Build has FAILED

Oct 14 2019, 11:07 AM
ardumont accepted D2090: tests: refactor main storage tests.
Oct 14 2019, 11:06 AM
Harbormaster failed remote builds in B8392: Diff 7178 for D2095: test_in_memory: adapt tests for the InMemoryStorage to new storage test infra!
Oct 14 2019, 11:05 AM
swh-public-ci added a comment to D2095: test_in_memory: adapt tests for the InMemoryStorage to new storage test infra.

Build has FAILED

Oct 14 2019, 11:05 AM
Harbormaster failed remote builds in B8391: Diff 7177 for D2094: test_storage: rename TestStorageCommonProp as TestStorageGeneratedData!
Oct 14 2019, 11:03 AM
swh-public-ci added a comment to D2094: test_storage: rename TestStorageCommonProp as TestStorageGeneratedData.

Build has FAILED

Oct 14 2019, 11:03 AM
swh-public-ci added a comment to D2093: test_storage: make test_origin_metadata_get more robust.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/710/ for more details.

Oct 14 2019, 11:00 AM
douardda added inline comments to D2119: test_api_client: refactor the code for new pytest based infra.
Oct 14 2019, 10:57 AM
swh-public-ci added a comment to D2090: tests: refactor main storage tests.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/709/ for more details.

Oct 14 2019, 10:57 AM