Page MenuHomeSoftware Heritage
Create Paste
Paste Active Pastes

Active Pastes
Use Results
Edit Query

  • P1068 (An Untitled Masterwork)
    swh-loader_1 | [2021-06-11 12:33:56,680: DEBUG/ForkPoolWorker-1] package_info: ArchivePackageInfo(url='https://web.archive.org/web/20100705043309/http://www.cs.unm.edu/~mccune/old-ftp/mace-1.2.0.tar.Z', filename='mace-1.2.0.tar.Z', directory_extrinsic_metadata=[], raw_info={'url': 'https://web.archive.org/web/20100705043309/http://www.cs.unm.edu/~mccune/old-ftp/mace-1.2.0.tar.Z', 'time': '1995-08-17T01:54:02', 'length': 132177, 'version': 'mace-1.2.0'}, length=132177, time='1995-08-17T01:54:02', version='mace-1.2.0')
    swh-loader_1 | [2021-06-11 12:33:58,128: DEBUG/ForkPoolWorker-1] filename: mace-1.2.0.tar.Z
    swh-loader_1 | [2021-06-11 12:33:58,128: DEBUG/ForkPoolWorker-1] filepath: /tmp/tmpupohipoc/mace-1.2.0.tar.Z
    swh-loader_1 | [2021-06-11 12:33:59,357: DEBUG/ForkPoolWorker-1] extrinsic_metadata
    swh-loader_1 | tar: /tmp/tmpupohipoc/src: Cannot open: No such file or directory
    ...
    • Jun 11 2021, 2:41 PM
    • 39 Lines
    Author: anlambert
  • P1067 come on come on come on... mypy joy!
    swh  tony  yavin4  ~  work  …  swh  swh-environment  swh-icinga-plugins   master  2✔  ERROR  %  pre-commit run --all-files
    Trim Trailing Whitespace.................................................Passed
    Check JSON...........................................(no files to check)Skipped
    Check Yaml...............................................................Passed
    flake8...................................................................Passed
    ...
    • Jun 9 2021, 10:37 AM
    • 42 Lines
    Author: ardumont
  • P1066 (An Untitled Masterwork)
    explain analyze
    with Y as
    (
    with X as
    (
    ...
    • Jun 8 2021, 3:54 PM
    • 45 Lines
    Author: douardda
  • P1065 (An Untitled Masterwork)
    explain analyze
    select R.sha1 as rev, R.date as date, X.sha1 as cnt, DL.path as prefix, CL.path as path
    from (
    select C.sha1, unnest(dirs) as dir, unnest(locs) as loc from C_D
    inner join content as C on (C.id=C_D.cnt)
    ...
    • Jun 8 2021, 3:40 PM
    • 45 Lines
    Author: douardda
  • P1064 scheduler runner stuck while listing debian distrib
    2725005 softw...cheduler swhscheduler 192.168.100.210/ 99.7 20.0 0.00B 0.00B 917:49.58 N N active select * from swh_scheduler_grab_ready_tasks( 'list-debian-distribution', '2021-06-06T16:31:13
    136390+00:00'::timestamptz, 5000 :: bigint)
    • Jun 7 2021, 9:50 AM
    • 2 Lines
    Author: ardumont
  • P1063 mypy crash star-expression
    $ pip3 install --user --upgrade git+https://github.com/python/mypy.git
    [...]
    Successfully installed mypy-0.820+dev.28718facbeea5b3c33ec96bc335bb018d3b0a395
    ...
    • Jun 4 2021, 12:53 PM
    • 52 Lines
    Author: vlorentz
  • P1062 scheduler: warning about backend name mismatch with the latest loader mercurial
    swhscheduler@saatchi:~$ swh scheduler --config-file /etc/softwareheritage/scheduler/backend.yml task-type register
    ...
    INFO:swh.scheduler.cli.task_type:Loading entrypoint for plugin loader.mercurial
    INFO:swh.scheduler.cli.task_type:Loading entrypoint for plugin loader.mercurial_from_disk
    WARNING:swh.scheduler.cli.task_type:Existing task type load-hg for module swh.loader.mercurial.tasks_from_disk has a different backend name than current code version provides (swh.loader.mercurial.tasks.LoadMercurial vs. swh.loader.mercurial.tasks_from_disk.LoadMercurialFromDisk)
    ...
    • Jun 4 2021, 12:05 PM
    • 7 Lines
    Author: ardumont
  • P1061 (An Untitled Masterwork)
    1000000050 53519b5a5e8cf12a4f81f82e489f95c1d04d5314 R06
    R06 | | | R 53519b5a5e8cf12a4f81f82e489f95c1d04d5314 | 1000000050
    | R---C | A/B/c | C fa08654474ae2ddc4f61ee3a43d017ba65a439c3 | 0
    | R-D | A/B/C | D c9cabe7f49012e3fdef6ac6b929efb5654f583cf | -40 <===\
    | D-C | + a | C 20329687bb9c1231a7e05afe86160343ad49b494 | -50 |-- note these!
    ...
    • Jun 4 2021, 9:35 AM
    • 6 Lines
    Author: douardda
  • P1060 get_storage with instantiated db connection
    # try this first
    get_storage(cls="postgresql", db=<psycopg2 connection instance>, objstorage={"cls": "memory"})
    # ïf that doesn't work, something like the following should work
    ...
    • Jun 2 2021, 2:04 PM
    • 7 Lines
    • Python
    Author: olasd
  • P1058 swh-web make test output
    file /home/jayesh/swh-environment/swh-web/swh/web/tests/common/test_origin_save.py, line 435
    @pytest.mark.django_db
    @pytest.mark.parametrize("visit_status", ["created", "ongoing",])
    def test_get_save_origin_requests_no_visit_date_found(mocker, visit_status):
    file /home/jayesh/swh-environment/swh-web/swh/web/tests/common/test_origin_save.py, line 52
    ...
    • Jun 2 2021, 10:35 AM
    • 25 Lines
    Author: jayeshv
  • P1057 swh-web config
    storage:
    cls: remote
    # url: http://localhost:5002/
    # url: http://storage0.internal.staging.swh.network:5002
    url: http://saam.internal.softwareheritage.org:5002/
    ...
    • Jun 1 2021, 1:53 PM
    • 96 Lines
    • YAML
    Author: anlambert
  • P1056 docker-compose.override.yml
    ---
    version: '2'
    services:
    swh-lister:
    volumes:
    ...
    • May 31 2021, 2:05 PM
    • 6 Lines
    • YAML
    Author: olasd
  • P1055 broken git commit 0017425613917e9cbcb7d5e6c3ed937158f61b93
    $ git clone https://github.com/buszczynska/systems_biology
    Cloning into 'systems_biology'...
    remote: Enumerating objects: 101, done.
    remote: Total 101 (delta 0), reused 0 (delta 0), pack-reused 101
    Receiving objects: 100% (101/101), 214.62 KiB | 2.98 MiB/s, done.
    ...
    • May 31 2021, 10:59 AM
    • 17 Lines
    Author: vlorentz
  • P1053 (An Untitled Masterwork)
    -[ RECORD 59 ]---+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    datid | 99085638
    datname | softwareheritage
    pid | 479899
    leader_pid |
    ...
    • May 26 2021, 3:16 PM
    • 38 Lines
    Author: vsellier
  • P1052 `swh deposit list` output
    $ swh deposit list --url http://deposit.staging.swh.network/1 \
    --username swh \
    --password $(swhpass ls operations/deposit.softwareheritage.org/http-auth/swh | head -1) \
    --format json | jq .
    WARNING:swh.core.cli:Could not load subcommand scanner: swh-scanner
    ...
    • May 25 2021, 5:47 PM
    • 997 Lines
    Author: ardumont
  • P1050 Loading https://foss.heptapod.net/mercurial/hgview with the new hg loader, in a database with data from the old loader.
    May 24 10:21:08 worker0 python3[1746909]: [2021-05-24 10:21:08,531: INFO/MainProcess] Received task: swh.loader.mercurial.tasks.LoadMercurial[2f2eaa71-0415-4a7b-9647-02f930b727f4]
    May 24 10:21:08 worker0 python3[1746920]: [2021-05-24 10:21:08,665: INFO/ForkPoolWorker-1] Load origin 'https://foss.heptapod.net/mercurial/hgview' with type 'hg'
    May 24 10:21:10 worker0 python3[1747220]: requesting all changes
    May 24 10:21:10 worker0 python3[1747220]: adding changesets
    May 24 10:21:10 worker0 python3[1747220]: adding manifests
    ...
    • May 24 2021, 1:00 PM
    • 23 Lines
    Author: olasd
  • P1049 weaver flapping between two snapshots
    ```
    > select * from origin_visit_status where origin=(select id from origin where url='https://bitbucket.org/pbui/weaver') order by origin,visit,date;
    origin │ visit │ date │ status │ metadata │ snapshot │ type
    ────────┼───────┼───────────────────────────────┼─────────┼──────────┼────────────────────────────────────────────┼──────
    694079 │ 1 │ 2020-07-15 11:39:31+00 │ created │ ∅ │ ∅ │ hg
    ...
    • May 21 2021, 6:44 PM
    • 69 Lines
    Author: olasd
  • P1047 CREATE AGGREGATE
    CREATE AGGREGATE my_aggregate(int)
    SFUNC my_row_function
    STYPE tuple<int, bigint>
    FINALFUNC my_final_function
    ...
    • May 18 2021, 3:03 PM
    • 6 Lines
    • SQL
    Author: vlorentz
  • P1046 azure objstorage, get implementation benchmark
    from swh.objstorage.factory import get_objstorage
    import yaml
    config = yaml.load(open("../swh-vault/vault.yml"))["objstorage"]
    objstorage = get_objstorage(**config)
    for _ in range(1000):
    ...
    • May 18 2021, 11:04 AM
    • 17 Lines
    • Python
    Author: vlorentz
  • P1045 azure objstorage, get implementation benchmark
    from swh.objstorage.factory import get_objstorage
    import yaml
    config = yaml.load(open("../swh-vault/vault.yml"))["objstorage"]
    objstorage = get_objstorage(**config)
    for _ in range(1000):
    ...
    • May 18 2021, 11:04 AM
    • 17 Lines
    • Python
    Author: vlorentz
  • P1044 puppetdb params for vagrant
    puppetdb::params::listen_address: 0.0.0.0
    puppetdb::params::listen_port: 8080
    puppetdb::params::ssl_listen_address: 0.0.0.0
    puppetdb::params::ssl_listen_port: 8081
    puppetdb::params::puppetdb_user: puppetdb
    ...
    • May 17 2021, 4:57 PM
    • 18 Lines
    Author: ardumont
  • P1043 python function colors
    def get(self, obj_id):
    """Retrieve blob's content if found.
    """
    hex_obj_id = self._internal_id(obj_id)
    ...
    • May 17 2021, 1:43 PM
    • 37 Lines
    • Python
    Author: vlorentz
  • P1042 count kafka lag
    /opt/kafka/bin/kafka-consumer-groups.sh --bootstrap-server $SERVER -describe --group swh-douardda-privileged-test-mirror-003 | grep swh.journal.objects.directory | awk '{print $6}' | paste -sd+ | bc
    52788770
    • May 12 2021, 9:50 AM
    • 2 Lines
    Author: vsellier
  • P1041 (An Untitled Masterwork)
    diff --git a/assets/src/bundles/save/index.js b/assets/src/bundles/save/index.js
    index 9d8bed44..2d42ba27 100644
    --- a/assets/src/bundles/save/index.js
    +++ b/assets/src/bundles/save/index.js
    @@ -50,26 +50,19 @@ export function maybeRequireExtraInputs() {
    ...
    • May 11 2021, 4:07 PM
    • 55 Lines
    Author: anlambert
  • P1040 (An Untitled Masterwork)
     ddouard  (e) swh   master … 2  ~/s/s/swh-provenance  mypy swh
    swh/provenance/provenance.py:297: error: Argument 1 to "add_child" of "IsochroneNode" has incompatible type "FileEntry"; expected "DirectoryEntry"
    swh/provenance/provenance.py:313: error: Incompatible types in assignment (expression has type "IsochroneNode", variable has type "Union[DirectoryEntry, FileEntry]")
    swh/provenance/provenance.py:314: error: Item "DirectoryEntry" of "Union[DirectoryEntry, FileEntry]" has no attribute "entry"
    swh/provenance/provenance.py:314: error: Item "FileEntry" of "Union[DirectoryEntry, FileEntry]" has no attribute "entry"
    ...
    • May 11 2021, 12:30 PM
    • 17 Lines
    Author: douardda
  • P1039 (An Untitled Masterwork)
    swh-graph-replayer-revision_3 | 2021-05-10T14:36:07.253273260Z INFO:swh.storage.tenacious:revision_add: failed to insert a batch of 200 revision objects, splitting
    swh-graph-replayer-revision_3 | 2021-05-10T14:36:07.282621939Z INFO:swh.storage.tenacious:revision_add: failed to insert a batch of 100 revision objects, splitting
    swh-graph-replayer-revision_3 | 2021-05-10T14:36:08.266450539Z INFO:swh.storage.tenacious:revision_add: failed to insert a batch of 50 revision objects, splitting
    swh-graph-replayer-revision_3 | 2021-05-10T14:36:09.948651782Z INFO:swh.storage.tenacious:revision_add: failed to insert a batch of 25 revision objects, splitting
    swh-graph-replayer-revision_3 | 2021-05-10T14:36:10.204954906Z INFO:swh.storage.tenacious:revision_add: failed to insert a batch of 13 revision objects, splitting
    ...
    • May 10 2021, 5:43 PM
    • 28 Lines
    Author: douardda
  • P1038 deposit (request of type metadata) staging for hal-preprod
    251 5 https://inria.halpreprod.archives-ouvertes.fr/hal-01243573 {"atom:id": "hal-01243573", "atom:author": {"atom:name": "HAL", "atom:email": "hal@ccsd.cnrs.fr"}, "atom:client": "hal", "codemeta:url": "http://halv3-local.ccsd.cnrs.fr/hal-01243573", "codemeta:name": "The assignment problem", "codemeta:author": {"codemeta:name": null}, "codemeta:license": {"codemeta:name": "GNU General Public License v3.0 or later"}, "codemeta:version": "1", "atom:create-origin": "hal-01243573", "codemeta:identifier": [{"@name": "0", "@xmlns": {"": "http://www.w3.org/2005/Atom", "codemeta": "https://doi.org/10.5063/SCHEMA/CODEMETA-2.0"}}, {"@name": "1"}], "codemeta:contributor": "Administrateur Du Ccsd", "codemeta:dateCreated": "2015-06-01", "codemeta:description": "Project in OR: The assignment problem A java implementation for the assignment problem first release", "codemeta:relatedLink": "https://www.gnu.org/software/glpk/", "codemeta:dateModified": "2017-12-21", "codemeta:datePublished": "2017-11-16", "codemeta:codeRepository": "https://github.com/moranegg/AffectationRO", "atom:external_identifier": "hal-01243573", "codemeta:operatingSystem": "debian", "codemeta:runtimePlatform": "outil", "codemeta:softwareVersion": "1.0.0", "codemeta:developmentStatus": "etat", "codemeta:applicationCategory": ["info", "info.info-ro"], "codemeta:programmingLanguage": ["java", "AMPL"], "codemeta:referencePublication": "hal-01587083"} <?xml version="1.0" encoding="utf-8"?>\n<entry xmlns="http://www.w3.org/2005/Atom" xmlns:codemeta="https://doi.org/10.5063/SCHEMA/CODEMETA-2.0">\n <client>hal</client>\n <id>hal-01243573</id>\n <external_identifier>hal-01243573</external_identifier>\n <create-origin>hal-01243573</create-origin>\n <author>\n <name>HAL</name>\n <email>hal@ccsd.cnrs.fr</email>\n </author>\n <codemeta:name>The assignment problem</codemeta:name>\n <codemeta:description>Project in OR: The assignment problem A java implementation for the assignment problem first release</codemeta:description>\n <codemeta:dateCreated>2015-06-01</codemeta:dateCreated>\n <codemeta:datePublished>2017-11-16</codemeta:datePublished>\n <codemeta:license>\n <codemeta:name>GNU General Public License v3.0 or later</codemeta:name>\n </codemeta:license>\n <codemeta:url>http://halv3-local.ccsd.cnrs.fr/hal-01243573</codemeta:url>\n <codemeta:identifier name="0"/>\n <codemeta:identifier name="1"/>\n <codemeta:applicationCategory>info</codemeta:applicationCategory>\n <codemeta:applicationCategory>info.info-ro</codemeta:applicationCategory>\n <codemeta:codeRepository>https://github.com/moranegg/AffectationRO</codemeta:codeRepository>\n <codemeta:relatedLink>https://www.gnu.org/software/glpk/</codemeta:relatedLink>\n <codemeta:programmingLanguage>java</codemeta:programmingLanguage>\n <codemeta:programmingLanguage>AMPL</codemeta:programmingLanguage>\n <codemeta:runtimePlatform>outil</codemeta:runtimePlatform>\n <codemeta:operatingSystem>debian</codemeta:operatingSystem>\n <codemeta:version>1</codemeta:version>\n <codemeta:softwareVersion>1.0.0</codemeta:softwareVersion>\n <codemeta:dateModified>2017-12-21</codemeta:dateModified>\n <codemeta:developmentStatus>etat</codemeta:developmentStatus>\n <codemeta:referencePublication>hal-01587083</codemeta:referencePublication>\n <codemeta:author>\n <codemeta:name> </codemeta:name>\n </codemeta:author>\n <codemeta:contributor>Administrateur Du Ccsd</codemeta:contributor>\n</entry>\n
    250 5 https://inria.halpreprod.archives-ouvertes.fr/hal-01243573 {"atom:id": "hal-01243573", "atom:author": {"atom:name": "HAL", "atom:email": "hal@ccsd.cnrs.fr"}, "atom:client": "hal", "codemeta:url": "http://halv3-local.ccsd.cnrs.fr/hal-01243573", "codemeta:name": "The assignment problem", "codemeta:author": {"codemeta:name": null}, "codemeta:license": {"codemeta:name": "GNU General Public License v3.0 or later"}, "codemeta:version": "1", "atom:create-origin": "hal-01243573", "codemeta:identifier": [{"@name": "0", "@xmlns": {"": "http://www.w3.org/2005/Atom", "codemeta": "https://doi.org/10.5063/SCHEMA/CODEMETA-2.0"}}, {"@name": "1"}], "codemeta:contributor": "Administrateur Du Ccsd", "codemeta:dateCreated": "2015-06-01", "codemeta:description": "Project in OR: The assignment problem A java implementation for the assignment problem first release", "codemeta:relatedLink": "https://www.gnu.org/software/glpk/", "codemeta:dateModified": "2017-12-21", "codemeta:datePublished": "2017-11-16", "codemeta:codeRepository": "https://github.com/moranegg/AffectationRO", "atom:external_identifier": "hal-01243573", "codemeta:operatingSystem": "debian", "codemeta:runtimePlatform": "outil", "codemeta:softwareVersion": "1.0.0", "codemeta:developmentStatus": "etat", "codemeta:applicationCategory": ["info", "info.info-ro"], "codemeta:programmingLanguage": ["java", "AMPL"], "codemeta:referencePublication": "hal-01587083"} <?xml version="1.0" encoding="utf-8"?>\n<entry xmlns="http://www.w3.org/2005/Atom" xmlns:codemeta="https://doi.org/10.5063/SCHEMA/CODEMETA-2.0">\n <client>hal</client>\n <id>hal-01243573</id>\n <external_identifier>hal-01243573</external_identifier>\n <create-origin>hal-01243573</create-origin>\n <author>\n <name>HAL</name>\n <email>hal@ccsd.cnrs.fr</email>\n </author>\n <codemeta:name>The assignment problem</codemeta:name>\n <codemeta:description>Project in OR: The assignment problem A java implementation for the assignment problem first release</codemeta:description>\n <codemeta:dateCreated>2015-06-01</codemeta:dateCreated>\n <codemeta:datePublished>2017-11-16</codemeta:datePublished>\n <codemeta:license>\n <codemeta:name>GNU General Public License v3.0 or later</codemeta:name>\n </codemeta:license>\n <codemeta:url>http://halv3-local.ccsd.cnrs.fr/hal-01243573</codemeta:url>\n <codemeta:identifier name="0"/>\n <codemeta:identifier name="1"/>\n <codemeta:applicationCategory>info</codemeta:applicationCategory>\n <codemeta:applicationCategory>info.info-ro</codemeta:applicationCategory>\n <codemeta:codeRepository>https://github.com/moranegg/AffectationRO</codemeta:codeRepository>\n <codemeta:relatedLink>https://www.gnu.org/software/glpk/</codemeta:relatedLink>\n <codemeta:programmingLanguage>java</codemeta:programmingLanguage>\n <codemeta:programmingLanguage>AMPL</codemeta:programmingLanguage>\n <codemeta:runtimePlatform>outil</codemeta:runtimePlatform>\n <codemeta:operatingSystem>debian</codemeta:operatingSystem>\n <codemeta:version>1</codemeta:version>\n <codemeta:softwareVersion>1.0.0</codemeta:softwareVersion>\n <codemeta:dateModified>2017-12-21</codemeta:dateModified>\n <codemeta:developmentStatus>etat</codemeta:developmentStatus>\n <codemeta:referencePublication>hal-01587083</codemeta:referencePublication>\n <codemeta:author>\n <codemeta:name> </codemeta:name>\n </codemeta:author>\n <codemeta:contributor>Administrateur Du Ccsd</codemeta:contributor>\n</entry>\n
    249 5 https://inria.halpreprod.archives-ouvertes.fr/hal-01243573 {"atom:id": "hal-01243573", "atom:author": {"atom:name": "HAL", "atom:email": "hal@ccsd.cnrs.fr"}, "atom:client": "hal", "codemeta:url": "http://halv3-local.ccsd.cnrs.fr/hal-01243573", "codemeta:name": "The assignment problem", "codemeta:author": {"codemeta:name": null}, "codemeta:license": {"codemeta:name": "GNU General Public License v3.0 or later"}, "codemeta:version": "1", "atom:create-origin": "hal-01243573", "codemeta:identifier": [{"@name": "0", "@xmlns": {"": "http://www.w3.org/2005/Atom", "codemeta": "https://doi.org/10.5063/SCHEMA/CODEMETA-2.0"}}, {"@name": "1"}], "codemeta:contributor": "Administrateur Du Ccsd", "codemeta:dateCreated": "2015-06-01", "codemeta:description": "Project in OR: The assignment problem A java implementation for the assignment problem first release", "codemeta:relatedLink": "https://www.gnu.org/software/glpk/", "codemeta:dateModified": "2017-12-21", "codemeta:datePublished": "2017-11-16", "codemeta:codeRepository": "https://github.com/moranegg/AffectationRO", "atom:external_identifier": "hal-01243573", "codemeta:operatingSystem": "debian", "codemeta:runtimePlatform": "outil", "codemeta:softwareVersion": "1.0.0", "codemeta:developmentStatus": "etat", "codemeta:applicationCategory": ["info", "info.info-ro"], "codemeta:programmingLanguage": ["java", "AMPL"], "codemeta:referencePublication": "hal-01587083"} <?xml version="1.0" encoding="utf-8"?>\n<entry xmlns="http://www.w3.org/2005/Atom" xmlns:codemeta="https://doi.org/10.5063/SCHEMA/CODEMETA-2.0">\n <client>hal</client>\n <id>hal-01243573</id>\n <external_identifier>hal-01243573</external_identifier>\n <create-origin>hal-01243573</create-origin>\n <author>\n <name>HAL</name>\n <email>hal@ccsd.cnrs.fr</email>\n </author>\n <codemeta:name>The assignment problem</codemeta:name>\n <codemeta:description>Project in OR: The assignment problem A java implementation for the assignment problem first release</codemeta:description>\n <codemeta:dateCreated>2015-06-01</codemeta:dateCreated>\n <codemeta:datePublished>2017-11-16</codemeta:datePublished>\n <codemeta:license>\n <codemeta:name>GNU General Public License v3.0 or later</codemeta:name>\n </codemeta:license>\n <codemeta:url>http://halv3-local.ccsd.cnrs.fr/hal-01243573</codemeta:url>\n <codemeta:identifier name="0"/>\n <codemeta:identifier name="1"/>\n <codemeta:applicationCategory>info</codemeta:applicationCategory>\n <codemeta:applicationCategory>info.info-ro</codemeta:applicationCategory>\n <codemeta:codeRepository>https://github.com/moranegg/AffectationRO</codemeta:codeRepository>\n <codemeta:relatedLink>https://www.gnu.org/software/glpk/</codemeta:relatedLink>\n <codemeta:programmingLanguage>java</codemeta:programmingLanguage>\n <codemeta:programmingLanguage>AMPL</codemeta:programmingLanguage>\n <codemeta:runtimePlatform>outil</codemeta:runtimePlatform>\n <codemeta:operatingSystem>debian</codemeta:operatingSystem>\n <codemeta:version>1</codemeta:version>\n <codemeta:softwareVersion>1.0.0</codemeta:softwareVersion>\n <codemeta:dateModified>2017-12-21</codemeta:dateModified>\n <codemeta:developmentStatus>etat</codemeta:developmentStatus>\n <codemeta:referencePublication>hal-01587083</codemeta:referencePublication>\n <codemeta:author>\n <codemeta:name> </codemeta:name>\n </codemeta:author>\n <codemeta:contributor>Administrateur Du Ccsd</codemeta:contributor>\n</entry>\n
    248 5 https://inria.halpreprod.archives-ouvertes.fr/hal-01243573 {"atom:id": "hal-01243573", "atom:author": {"atom:name": "HAL", "atom:email": "hal@ccsd.cnrs.fr"}, "atom:client": "hal", "codemeta:url": "http://halv3-local.ccsd.cnrs.fr/hal-01243573", "codemeta:name": "The assignment problem", "codemeta:author": {"codemeta:name": null}, "codemeta:license": {"codemeta:name": "GNU General Public License v3.0 or later"}, "codemeta:version": "1", "atom:create-origin": "hal-01243573", "codemeta:identifier": [{"@name": "0", "@xmlns": {"": "http://www.w3.org/2005/Atom", "codemeta": "https://doi.org/10.5063/SCHEMA/CODEMETA-2.0"}}, {"@name": "1"}], "codemeta:contributor": "Administrateur Du Ccsd", "codemeta:dateCreated": "2015-06-01", "codemeta:description": "Project in OR: The assignment problem A java implementation for the assignment problem first release", "codemeta:relatedLink": "https://www.gnu.org/software/glpk/", "codemeta:dateModified": "2017-12-21", "codemeta:datePublished": "2017-11-16", "codemeta:codeRepository": "https://github.com/moranegg/AffectationRO", "atom:external_identifier": "hal-01243573", "codemeta:operatingSystem": "debian", "codemeta:runtimePlatform": "outil", "codemeta:softwareVersion": "1.0.0", "codemeta:developmentStatus": "etat", "codemeta:applicationCategory": ["info", "info.info-ro"], "codemeta:programmingLanguage": ["java", "AMPL"], "codemeta:referencePublication": "hal-01587083"} <?xml version="1.0" encoding="utf-8"?>\n<entry xmlns="http://www.w3.org/2005/Atom" xmlns:codemeta="https://doi.org/10.5063/SCHEMA/CODEMETA-2.0">\n <client>hal</client>\n <id>hal-01243573</id>\n <external_identifier>hal-01243573</external_identifier>\n <create-origin>hal-01243573</create-origin>\n <author>\n <name>HAL</name>\n <email>hal@ccsd.cnrs.fr</email>\n </author>\n <codemeta:name>The assignment problem</codemeta:name>\n <codemeta:description>Project in OR: The assignment problem A java implementation for the assignment problem first release</codemeta:description>\n <codemeta:dateCreated>2015-06-01</codemeta:dateCreated>\n <codemeta:datePublished>2017-11-16</codemeta:datePublished>\n <codemeta:license>\n <codemeta:name>GNU General Public License v3.0 or later</codemeta:name>\n </codemeta:license>\n <codemeta:url>http://halv3-local.ccsd.cnrs.fr/hal-01243573</codemeta:url>\n <codemeta:identifier name="0"/>\n <codemeta:identifier name="1"/>\n <codemeta:applicationCategory>info</codemeta:applicationCategory>\n <codemeta:applicationCategory>info.info-ro</codemeta:applicationCategory>\n <codemeta:codeRepository>https://github.com/moranegg/AffectationRO</codemeta:codeRepository>\n <codemeta:relatedLink>https://www.gnu.org/software/glpk/</codemeta:relatedLink>\n <codemeta:programmingLanguage>java</codemeta:programmingLanguage>\n <codemeta:programmingLanguage>AMPL</codemeta:programmingLanguage>\n <codemeta:runtimePlatform>outil</codemeta:runtimePlatform>\n <codemeta:operatingSystem>debian</codemeta:operatingSystem>\n <codemeta:version>1</codemeta:version>\n <codemeta:softwareVersion>1.0.0</codemeta:softwareVersion>\n <codemeta:dateModified>2017-12-21</codemeta:dateModified>\n <codemeta:developmentStatus>etat</codemeta:developmentStatus>\n <codemeta:referencePublication>hal-01587083</codemeta:referencePublication>\n <codemeta:author>\n <codemeta:name> </codemeta:name>\n </codemeta:author>\n <codemeta:contributor>Administrateur Du Ccsd</codemeta:contributor>\n</entry>\n
    246 5 https://inria.halpreprod.archives-ouvertes.fr/hal-01243573 {"atom:id": "hal-01243573", "atom:author": {"atom:name": "HAL", "atom:email": "hal@ccsd.cnrs.fr"}, "atom:client": "hal", "codemeta:url": "http://halv3-local.ccsd.cnrs.fr/hal-01243573", "codemeta:name": "The assignment problem", "codemeta:author": {"codemeta:name": null}, "codemeta:license": {"codemeta:name": "GNU General Public License v3.0 or later"}, "codemeta:version": "1", "atom:create-origin": "hal-01243573", "codemeta:identifier": [{"@name": "0", "@xmlns": {"": "http://www.w3.org/2005/Atom", "codemeta": "https://doi.org/10.5063/SCHEMA/CODEMETA-2.0"}}, {"@name": "1"}], "codemeta:contributor": "Administrateur Du Ccsd", "codemeta:dateCreated": "2015-06-01", "codemeta:description": "Project in OR: The assignment problem A java implementation for the assignment problem first release", "codemeta:relatedLink": "https://www.gnu.org/software/glpk/", "codemeta:dateModified": "2017-12-21", "codemeta:datePublished": "2017-11-16", "codemeta:codeRepository": "https://github.com/moranegg/AffectationRO", "atom:external_identifier": "hal-01243573", "codemeta:operatingSystem": "debian", "codemeta:runtimePlatform": "outil", "codemeta:softwareVersion": "1.0.0", "codemeta:developmentStatus": "etat", "codemeta:applicationCategory": ["info", "info.info-ro"], "codemeta:programmingLanguage": ["java", "AMPL"], "codemeta:referencePublication": "hal-01587083"} <?xml version="1.0" encoding="utf-8"?>\n<entry xmlns="http://www.w3.org/2005/Atom" xmlns:codemeta="https://doi.org/10.5063/SCHEMA/CODEMETA-2.0">\n <client>hal</client>\n <id>hal-01243573</id>\n <external_identifier>hal-01243573</external_identifier>\n <create-origin>hal-01243573</create-origin>\n <author>\n <name>HAL</name>\n <email>hal@ccsd.cnrs.fr</email>\n </author>\n <codemeta:name>The assignment problem</codemeta:name>\n <codemeta:description>Project in OR: The assignment problem A java implementation for the assignment problem first release</codemeta:description>\n <codemeta:dateCreated>2015-06-01</codemeta:dateCreated>\n <codemeta:datePublished>2017-11-16</codemeta:datePublished>\n <codemeta:license>\n <codemeta:name>GNU General Public License v3.0 or later</codemeta:name>\n </codemeta:license>\n <codemeta:url>http://halv3-local.ccsd.cnrs.fr/hal-01243573</codemeta:url>\n <codemeta:identifier name="0"/>\n <codemeta:identifier name="1"/>\n <codemeta:applicationCategory>info</codemeta:applicationCategory>\n <codemeta:applicationCategory>info.info-ro</codemeta:applicationCategory>\n <codemeta:codeRepository>https://github.com/moranegg/AffectationRO</codemeta:codeRepository>\n <codemeta:relatedLink>https://www.gnu.org/software/glpk/</codemeta:relatedLink>\n <codemeta:programmingLanguage>java</codemeta:programmingLanguage>\n <codemeta:programmingLanguage>AMPL</codemeta:programmingLanguage>\n <codemeta:runtimePlatform>outil</codemeta:runtimePlatform>\n <codemeta:operatingSystem>debian</codemeta:operatingSystem>\n <codemeta:version>1</codemeta:version>\n <codemeta:softwareVersion>1.0.0</codemeta:softwareVersion>\n <codemeta:dateModified>2017-12-21</codemeta:dateModified>\n <codemeta:developmentStatus>etat</codemeta:developmentStatus>\n <codemeta:referencePublication>hal-01587083</codemeta:referencePublication>\n <codemeta:author>\n <codemeta:name> </codemeta:name>\n </codemeta:author>\n <codemeta:contributor>Administrateur Du Ccsd</codemeta:contributor>\n</entry>\n
    ...
    • May 6 2021, 2:39 PM
    • 100 Lines
    Author: ardumont
  • P1037 (An Untitled Masterwork)
    100644 150739631316
    40000 68197352326
    100755 4558750275
    160000 949276565
    120000 926827576
    ...
    • May 5 2021, 4:15 PM
    • 44 Lines
    Author: seirl
  • P1036 (An Untitled Masterwork)
    diff --git a/swh/web/settings/common.py b/swh/web/settings/common.py
    index d61949b6..c28bbcce 100644
    --- a/swh/web/settings/common.py
    +++ b/swh/web/settings/common.py
    @@ -58,7 +58,7 @@
    ...
    • May 5 2021, 3:07 PM
    • 31 Lines
    Author: vlorentz
  • P1035 datetime serialization issue when communicating with scheduler remote instance
    swh-web_1 | [05/May/2021 09:00:06] [DEBUG] urllib3.connectionpool._make_request:461 - http://swh-scheduler:5008 "POST /task_run/get HTTP/1.1" 200 170
    swh-web_1 | [05/May/2021 09:00:06] [DEBUG] Traceback (most recent call last):
    swh-web_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/rest_framework/views.py", line 506, in dispatch
    swh-web_1 | response = handler(request, *args, **kwargs)
    swh-web_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/rest_framework/decorators.py", line 50, in handler
    ...
    • May 5 2021, 11:19 AM
    • 40 Lines
    Author: ardumont
  • P1034 (An Untitled Masterwork)
    swh-graph-replayer_9 | INFO:swh.storage.tenacious:directory_add: failed to insert a batch of 200 directory objects, splitting
    swh-graph-replayer_9 | INFO:swh.storage.tenacious:Exception was duplicate key value violates unique constraint "directory_entry_dir_target_name_perms_idx"
    swh-graph-replayer_9 | DETAIL: Key (target, name, perms)=(\x12808630a3f448546d7ff22104f18cee070da608, \x617373657473, 16384) already exists.
    swh-graph-replayer_9 | CONTEXT: SQL statement "
    swh-graph-replayer_9 | insert into directory_entry_dir (target, name, perms)
    ...
    • May 5 2021, 10:05 AM
    • 16 Lines
    Author: douardda
  • P1033 doco exec swh-loader swh loader run nixguix "https://guix.gnu.org/sources.json"
    (swh) ✔ ~/swh/swh-environment/docker [master|⚑ 9]
    11:55 $ doco exec swh-loader swh loader run nixguix "https://guix.gnu.org/sources.json"
    INFO:swh.loader.package.nixguix.loader:Skip source '{'type': 'git', 'git_url': 'https://github.com/pali/0xffff', 'git_ref': '0.8'}' because key 'urls' is missing
    INFO:swh.loader.package.nixguix.loader:Skip source '{'type': 'git', 'git_url': 'https://github.com/pali/0xffff', 'git_ref': '0.8'}' because key 'integrity' is missing
    INFO:swh.loader.package.nixguix.loader:Skip source '{'type': 'git', 'git_url': 'https://github.com/4store/4store', 'git_ref': 'v1.1.6'}' because key 'urls' is missing
    ...
    • May 4 2021, 2:42 PM
    • 15,795 Lines
    Author: anlambert
  • P1032 (An Untitled Masterwork)
    Python 3.7.3 (default, Jul 25 2020, 13:03:44)
    [GCC 8.3.0] on linux
    Type "help", "copyright", "credits" or "license" for more information.
    >>> import requests
    >>> requests.head("git://git.zx2c4.com/cgit.git")
    ...
    • May 3 2021, 11:15 AM
    • 21 Lines
    Author: anlambert
  • P1031 (An Untitled Masterwork)
    WARNING: autodoc: failed to import module 'logger' from module 'swh.core'; the following exception was raised:
    No module named 'systemd'
    /home/jenkins/workspace/DDOC/publish/swh-docs/.tox/sphinx/lib/python3.7/site-packages/swh/fuse/fs/artifact.py:docstring of swh.fuse.fs.artifact.Content.swhid:1: WARNING: duplicate object description of swh.fuse.fs.artifact.Content.swhid, other instance in apidoc/swh.fuse.fs.artifact, use :noindex: for one of them
    /home/jenkins/workspace/DDOC/publish/swh-docs/.tox/sphinx/lib/python3.7/site-packages/swh/fuse/fs/artifact.py:docstring of swh.fuse.fs.artifact.Content.prefetch:1: WARNING: duplicate object description of swh.fuse.fs.artifact.Content.prefetch, other instance in apidoc/swh.fuse.fs.artifact, use :noindex: for one of them
    /home/jenkins/workspace/DDOC/publish/swh-docs/.tox/sphinx/lib/python3.7/site-packages/swh/fuse/fs/artifact.py:docstring of swh.fuse.fs.artifact.Directory.swhid:1: WARNING: duplicate object description of swh.fuse.fs.artifact.Directory.swhid, other instance in apidoc/swh.fuse.fs.artifact, use :noindex: for one of them
    ...
    • Apr 29 2021, 3:20 PM
    • 14 Lines
    Author: anlambert
  • P1030 (An Untitled Masterwork)
    diff --git a/docker/services/swh-web/entrypoint.sh b/docker/services/swh-web/entrypoint.sh
    index 2d0ef86..9fb843f 100755
    --- a/docker/services/swh-web/entrypoint.sh
    +++ b/docker/services/swh-web/entrypoint.sh
    @@ -46,6 +46,16 @@ case "$1" in
    ...
    • Apr 28 2021, 6:20 PM
    • 21 Lines
    Author: anlambert
  • P1029 (An Untitled Masterwork)
    #!/usr/bin/env python3
    # Copyright (C) 2020-2021 The Software Heritage developers
    # See the AUTHORS file at the top-level directory of this distribution
    # License: GNU Affero General Public License version 3, or any later version
    ...
    • Apr 28 2021, 4:25 PM
    • 27 Lines
    Author: anlambert
  • P1028 mkpasswd through docker
    $ docker run -it debian
    root@44dd2ec7f1fa:/# apt update ; apt install whois; mkpasswd --method=sha-512
    Get:1 http://security.debian.org/debian-security buster/updates InRelease [65.4 kB]
    Get:2 http://deb.debian.org/debian buster InRelease [121 kB]
    Get:3 http://deb.debian.org/debian buster-updates InRelease [51.9 kB]
    ...
    • Apr 28 2021, 1:11 PM
    • 31 Lines
    Author: ardumont
  • P1027 (An Untitled Masterwork)
     ddouard  (e) swh   fixer ✚ 1 … 6  ~/s/s/swh-storage  1  pytest --doctest-modules swh/storage/fixer.py
    ===================================== test session starts ======================================
    platform linux -- Python 3.9.2, pytest-6.1.2, py-1.9.0, pluggy-0.13.1
    rootdir: /home/ddouard/swh/swh-environment/swh-storage, configfile: pytest.ini
    plugins: dash-1.18.1, postgresql-2.5.2, asyncio-0.14.0, django-4.1.0, requests-mock-1.8.0, forked-1.3.0, mock-3.3.1, xdist-2.1.0, hypothesis-6.4.3, flask-1.1.0, swh.core-0.12.1.dev3+g189ca1f, swh.journal-0.7.2.dev4+g056c210
    ...
    • Apr 28 2021, 12:34 PM
    • 62 Lines
    Author: douardda
  • P1026 (An Untitled Masterwork)
     ddouard  (e) swh   fixer ✚ 1 … 6  ~/s/s/swh-storage  pytest --doctest-modules -k fix_raw_extrinsic_metadata swh
    ===================================== test session starts ======================================
    platform linux -- Python 3.9.2, pytest-6.1.2, py-1.9.0, pluggy-0.13.1
    rootdir: /home/ddouard/swh/swh-environment/swh-storage, configfile: pytest.ini
    plugins: dash-1.18.1, postgresql-2.5.2, asyncio-0.14.0, django-4.1.0, requests-mock-1.8.0, forked-1.3.0, mock-3.3.1, xdist-2.1.0, hypothesis-6.4.3, flask-1.1.0, swh.core-0.12.1.dev3+g189ca1f, swh.journal-0.7.2.dev4+g056c210
    ...
    • Apr 28 2021, 12:27 PM
    • 30 Lines
    Author: douardda
  • P1025 (An Untitled Masterwork)
    12:20:10 Expected:
    12:20:10 {
    12:20:10 'target': 'swh:1:dir:460a586d1c95d120811eaadb398d534e019b5243',
    12:20:10 }
    12:20:10 Got:
    ...
    • Apr 28 2021, 12:23 PM
    • 6 Lines
    Author: douardda
  • P1024 unimported function makes js sad (`make test-frontend-ui`, then trigger the origin-save.spec.js scenario)
    ReferenceError
    The following error originated from your test code, not from Cypress.
    > formatValuePerType is not defined
    ...
    • Apr 28 2021, 10:24 AM
    • 34 Lines
    Author: ardumont
  • P1023 HTML vs XHTML
    <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en">
    <head>
    <style>
    .first {
    background: red;
    ...
    • Apr 28 2021, 12:07 AM
    • 20 Lines
    • HTML
    Author: vlorentz
  • P1022 kafka-consumer-template.conf
    bootstrap.servers=broker1.journal.softwareheritage.org:9093,broker2.journal.softwareheritage.org:9093,broker3.journal.softwareheritage.org:9093,broker4.journal.softwareheritage.org:9093
    sasl.mechanism=SCRAM-SHA-512
    security.protocol=SASL_SSL
    sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \
    username="USERNAME" \
    ...
    • Apr 27 2021, 5:32 PM
    • 6 Lines
    Author: olasd
  • P1021 migrate_extra_headers.py
    #!/usr/bin/env python3
    # Copyright (C) 2021 The Software Heritage developers
    # See the AUTHORS file at the top-level directory of this distribution
    # License: GNU General Public License version 3, or any later version
    ...
    • Apr 27 2021, 3:25 PM
    • 94 Lines
    • Python
    Author: vlorentz
  • P1020 (An Untitled Masterwork)
    09:54:09 + tox -a
    09:54:09 + grep -qx sphinx
    09:54:09 Traceback (most recent call last):
    09:54:09 File "/usr/bin/tox", line 11, in <module>
    09:54:09 load_entry_point('tox==3.7.0', 'console_scripts', 'tox')()
    ...
    • Apr 27 2021, 11:55 AM
    • 144 Lines
    Author: anlambert
  • P1019 Docker Prometheus logs after hibernation
    swh-web_1 | 172.21.0.14 - - [27/Apr/2021:08:06:46 +0000] "GET /metrics/prometheus/ HTTP/1.1" 200 359 "-" "Prometheus/2.23.0"
    prometheus_1 | level=warn ts=2021-04-27T08:06:46.788Z caller=scrape.go:1378 component="scrape manager" scrape_pool=swh-web-exporter target=http://swh-web:5004/metrics/prometheus/ msg="Error on ingesting samples that are too old or are too far into the future" num_dropped=33
    prometheus_1 | level=warn ts=2021-04-27T08:06:46.788Z caller=scrape.go:1145 component="scrape manager" scrape_pool=swh-web-exporter target=http://swh-web:5004/metrics/prometheus/ msg="Append failed" err="out of bounds"
    prometheus_1 | level=warn ts=2021-04-27T08:06:46.789Z caller=scrape.go:1094 component="scrape manager" scrape_pool=swh-web-exporter target=http://swh-web:5004/metrics/prometheus/ msg="Appending scrape report failed" err="out of bounds"
    prometheus_1 | level=warn ts=2021-04-27T08:06:51.298Z caller=scrape.go:1094 component="scrape manager" scrape_pool=swh-counters-exporter target=http://swh-counters:5011/metrics msg="Appending scrape report failed" err="out of bounds"
    ...
    • Apr 27 2021, 10:08 AM
    • 31 Lines
    Author: vlorentz
  • P1018 docker interesting hint, maybe
    swh-web_1 | DEPRECATION: A future pip version will change local packages to be built in-place without first copying to a temporary directory. We recommend you use --use-feature=in-tree-build to test your packages with this new behavior before it becomes the default.
    • Apr 26 2021, 5:21 PM
    • 1 Line
    Author: ardumont
  • P1017 django custom command shenanigans...
    Not working:
    ```
    kubectl exec -ti deployment/webapp -- bash
    + LOCAL_CMD=/usr/local/bin/kubectl
    + '[' -f /usr/local/bin/kubectl ']'
    ...
    • Apr 26 2021, 3:05 PM
    • 28 Lines
    Author: ardumont
  • P1016 storage.yml
    storage:
    cls: local
    db: dbname=softwareheritage-dev
    objstorage:
    cls: memory
    ...
    • Apr 26 2021, 11:30 AM
    • 6 Lines
    • YAML
    Author: olasd
  • P1015 Command-Line Input
    ---
    storage:
    cls: pipeline
    steps:
    - cls: buffer
    ...
    • Apr 26 2021, 11:19 AM
    • 14 Lines
    Author: olasd
  • P1014 (An Untitled Masterwork)
    In [1]: from swh.storage.tests import storage_data as sd
    In [2]: set(sd.StorageData.git_revisions)
    ---------------------------------------------------------------------------
    TypeError Traceback (most recent call last)
    <ipython-input-11-45b8523ac10c> in <module>
    ...
    • Apr 22 2021, 5:37 PM
    • 22 Lines
    Author: douardda
  • P1013 (An Untitled Masterwork)
    (Pdb) p self
    Revision(message=b'hello', author=Person(fullname=b'Nicolas Dandrimont <nicolas@example.com> ', name=b'Nicolas Dandrimont', email=b'nicolas@example.com'), committer=Person(fullname=b'St\xc3fano Zacchiroli <stefano@example.com>', name=b'St\xc3fano Zacchiroli', email=b'stefano@example.com'), date=TimestampWithTimezone(timestamp=Timestamp(seconds=1234567890, microseconds=0), offset=120, negative_utc=False), committer_date=TimestampWithTimezone(timestamp=Timestamp(seconds=1123456789, microseconds=0), offset=120, negative_utc=False), type=<RevisionType.GIT: 'git'>, directory=b'RV\xe8V\xa0\xa0\x89\x89f\xd6\xba\x14\xfe\xb48\x8b\x8b\x82\xd3\x02', synthetic=True, metadata=ImmutableDict({'checksums': {'sha1': 'tarball-sha1', 'sha256': 'tarball-sha256'}, 'signed-off-by': 'some-dude'}), parents=(), id=b'\x01\xa7\x11O6\xfd\xdd^\xf2Q\x1b,\xad\xda#zh\xad\xbb\x12', extra_headers=((b'gpgsig', b'test123'), (b'mergetag', b'foo\\bar'), (b'mergetag', b'"\xaf\x89\x80\x01\x00')))
    (Pdb) p set([self])
    *** TypeError...
    • Apr 22 2021, 5:33 PM
    • 4 Lines
    Author: douardda
  • P1012 (An Untitled Masterwork)
    diff --git a/swh/web/tests/api/views/test_origin_save.py b/swh/web/tests/api/views/test_origin_save.py
    index f4a5cc33..b565ed89 100644
    --- a/swh/web/tests/api/views/test_origin_save.py
    +++ b/swh/web/tests/api/views/test_origin_save.py
    @@ -21,6 +21,7 @@ from swh.web.common.models import (
    ...
    • Apr 22 2021, 3:18 PM
    • 19 Lines
    Author: anlambert
  • P1011 make-package scm
    #!/usr/bin/env bash
    usage() {
    echo "Usage: $0 [-b|--build] [-u|--upload] [-d|--distribution <all|unstable|stable>] SWH_PACKAGE"
    echo "E.g.: make-package -b swh-core"
    ...
    • Apr 22 2021, 11:59 AM
    • 131 Lines
    • Bash Scripting
    Author: anlambert
  • P1010 (An Untitled Masterwork)
    journal_client:
    cls: kafka
    brokers:
    - broker0.journal.staging.swh.network:9093
    sasl.username: swh-douardda
    ...
    • Apr 21 2021, 10:27 AM
    • 12 Lines
    Author: douardda
  • P1009 not created save code now submitted and failing with a more clear error
    ```
    head -1 /tmp/reschedule-save-code-now.not-created.csv | swh web save submit-request | jq . | tee /tmp/reschedule-save-code-now.txt WARNING:swh.core.cli:Could not load subcommand scanner: swh-scanner
    --- Logging error ---
    Traceback (most recent call last):
    File "/home/tony/work/inria/repo/swh/swh-environment/swh-web-client/swh/web/client/cli.py", line 165, in submit_request
    ...
    • Apr 20 2021, 1:02 PM
    • 53 Lines
    Author: ardumont
  • P1008 Pending running save code now requests
    now | id | request_date | visit_type | origin_url | status | loading_task_id | visit_date | loading_task$
    -------------------------------+-------+-------------------------------+------------+---------------------------------------------------------------------------------+----------+-----------------+----------------------------+-------------$
    2021-04-20 07:12:06.315517+00 | 74388 | 2021-04-20 07:04:53.803404+00 | git | https://github.com/Anuken/Mindustry | accepted | 380600429 | | running
    2021-04-20 07:12:06.315517+00 | 74387 | 2021-04-20 07:04:30.629639+00 | git | https://github.com/tobspr/shapez.io | accepted | 380600405 | | running
    2021-04-20 07:12:06.315517+00 | 71357 | 2021-04-01 16:57:50.205+00 | git | https://scm.gforge.inria.fr/anonscm/git/simty/simty.git | accepted | 379069991 | | running
    ...
    • Apr 20 2021, 9:11 AM
    • 49 Lines
    Author: ardumont
  • P1007 can't read randomized origin visit status because... <- insert reason here ;)
    ```
    (Pdb++) self._swh_storage.origin_visit_status_get_random('git')
    *** swh.core.api.RemoteException: <RemoteException 500 TypeError: ["can not serialize '_GenericAlias' object"]>
    Traceback (most recent call last):
    File "/home/tony/work/inria/repo/swh/swh-environment/swh-core/swh/core/api/__init__.py", line 181, in meth_
    ...
    • Apr 15 2021, 5:35 PM
    • 25 Lines
    Author: ardumont
  • P1006 tryout fixture but this hung so meh
    Staged
    modified swh/scheduler/pytest_plugin.py
    @@ -1,13 +1,15 @@
    -# Copyright (C) 2020 The Software Heritage developers
    +# Copyright (C) 2020-2021 The Software Heritage developers
    ...
    • Apr 15 2021, 1:29 PM
    • 85 Lines
    Author: ardumont
  • P1005 Convert webapp historical data to historical json
    from swh.web.common.utils import parse_iso8601_date_to_utc
    import json
    _stat_counters_backfill = {
    "2015-09-01": {"revision": 0, "origin": 0, "content": 0},
    ...
    • Apr 13 2021, 11:17 AM
    • 38 Lines
    • Python
    Author: vsellier
  • P1004 elasticsearch index freeze/close
    import datetime
    import iso8601
    import elasticsearch
    ...
    • Apr 12 2021, 10:31 AM
    • 33 Lines
    • Python
    Author: olasd
  • P1003 (An Untitled Masterwork)
    /home/ddouard/.virtualenvs/swh/lib/python3.9/site-packages/django/db/backends/postgresql/base.py
    161a162,164
    > if settings_dict.get('NAME', '').startswith('postgresql://'):
    > return {'dsn': settings_dict['NAME']}
    >
    • Apr 9 2021, 4:04 PM
    • 5 Lines
    Author: douardda
  • P1002 save request duration metric draft
    # HELP swh_web_save_requests_delay_seconds Save Requests Duration
    # TYPE swh_web_save_requests_delay_seconds gauge
    swh_web_save_requests_delay_seconds{load_task_status="failed",visit_type="git"} 0.0
    swh_web_save_requests_delay_seconds{load_task_status="failed",visit_type="hg"} 0.0
    swh_web_save_requests_delay_seconds{load_task_status="failed",visit_type="svn"} 0.0
    ...
    • Apr 8 2021, 11:26 AM
    • 8 Lines
    Author: ardumont
  • P1001 save code now average ingestion time
    ```
    swh-web=> select loading_task_status, avg(visit_date - request_date) from save_origin_request where loading_task_status in ('succeeded', 'failed') group by loading_task_status;
    loading_task_status | avg
    ---------------------+-----------------
    succeeded | 06:13:01.904513
    ...
    • Apr 7 2021, 3:54 PM
    • 34 Lines
    Author: ardumont
  • P1000 deposit-ipol.not-done.csv
    587,2020-05-06 08:38:15.900328+00,2020-05-06 08:38:15.890146+00,ipol.2018.236,,rejected,7,6,,"{""archive"": [{""summary"": ""Deposit without archive is rejected""}], ""metadata"": [{""fields"": [""author""], ""summary"": ""Mandatory fields are missing""}, {""fields"": [""name or title""], ""summary"": ""Mandatory alternate fields are missing""}]}",,333174385,,https://doi.org/10.5201/ipol.2018.236
    589,2020-05-06 10:44:11.614131+00,2020-05-06 10:44:11.606561+00,ipol.2018.236,,rejected,7,6,,"{""archive"": [{""summary"": ""Deposit without archive is rejected""}], ""metadata"": [{""fields"": [""author""], ""summary"": ""Mandatory fields are missing""}, {""fields"": [""name or title""], ""summary"": ""Mandatory alternate fields are missing""}]}",,333176410,,https://doi.org/10.5201/ipol.2018.236
    632,2020-05-26 13:47:09.857387+00,2020-05-26 13:47:09.82403+00,ipol.2011.blm-cdf,,rejected,7,6,,"{""archive"": [{""fields"": [1180], ""summary"": ""Mandatory archive type is not supported""}]}",,334942017,,https://doi.org/10.5201/ipol.2011.blm-cdf
    636,2020-05-27 22:53:07.665269+00,2020-05-27 22:53:07.627188+00,ipol.2011.blm-cdf,,rejected,7,6,,"{""archive"": [{""fields"": [1188], ""summary"": ""Mandatory archive type is not supported""}]}",,335056086,,https://doi.org/10.5201/ipol.2011.blm-cdf
    1245,2020-12-19 14:46:03.412595+00,2020-12-19 14:46:03.411527+00,ipol.2014.71,,rejected,7,6,,"{""metadata"": [{""fields"": [""codemeta:dateCreated""], ""summary"": ""Invalid date format""}]}",,349310053,349310062,https://doi.org/10.5201/ipol.2014.71
    ...
    • Apr 2 2021, 2:57 PM
    • 68 Lines
    Author: ardumont
  • P999 deposit-ipol.done.csv
    551,2020-04-20 23:11:20.74476+00,2020-04-20 23:11:20.731795+00,87afca27-ebbb-408a-845d-5277b6a92f49,swh:1:dir:a10423592dd061a00f7d34e4a3c102ba00c3d2ab,done,7,6,,,swh:1:dir:a10423592dd061a00f7d34e4a3c102ba00c3d2ab;origin=https://www.ipol.im/87afca27-ebbb-408a-845d-5277b6a92f49;visit=swh:1:snp:98b5853bb907a1d931d46521c26f753ddf4de4d3;anchor=swh:1:rev:86e6c7e3ad0699601f73f343344a65f65b6f76ce;path=/,325543487,325543502,https://doi.org/10.5201/87afca27-ebbb-408a-845d-5277b6a92f49
    595,2020-05-06 22:48:30.487078+00,2020-05-06 22:48:30.447662+00,ipol.2018.236,swh:1:dir:a10423592dd061a00f7d34e4a3c102ba00c3d2ab,done,7,6,,,swh:1:dir:a10423592dd061a00f7d34e4a3c102ba00c3d2ab;origin=https://doi.org/10.5201/ipol.2018.236;visit=swh:1:snp:206991563b219d18cdfc998d0e35716ba142c12e;anchor=swh:1:rev:baabf12542cd6df80af9594de8922b5281f07272;path=/,333184241,333184251,https://doi.org/10.5201/ipol.2018.236
    596,2020-05-06 22:50:06.271071+00,2020-05-06 22:50:06.267703+00,ipol.2018.236,swh:1:dir:a10423592dd061a00f7d34e4a3c102ba00c3d2ab,done,7,6,,,swh:1:dir:a10423592dd061a00f7d34e4a3c102ba00c3d2ab;origin=https://doi.org/10.5201/ipol.2018.236;visit=swh:1:snp:3ceae6836c8fa31e09d66133934dbc2c68ac7860;anchor=swh:1:rev:17ba798378f39d47e0525ac436856976262ac733;path=/,333184242,333184252,https://doi.org/10.5201/ipol.2018.236
    597,2020-05-06 22:50:14.110159+00,2020-05-06 22:50:14.105915+00,ipol.2018.236,swh:1:dir:a10423592dd061a00f7d34e4a3c102ba00c3d2ab,done,7,6,,,swh:1:dir:a10423592dd061a00f7d34e4a3c102ba00c3d2ab;origin=https://doi.org/10.5201/ipol.2018.236;visit=swh:1:snp:f7decde6a26a4fa5f0886d71c010ceae827bae92;anchor=swh:1:rev:1bb3dbaf98e4e775ed84a9e2d428246a47ab12d6;path=/,333184243,333184254,https://doi.org/10.5201/ipol.2018.236
    602,2020-05-07 17:32:54.537693+00,2020-05-07 17:32:54.517556+00,ipol.2018.236,swh:1:dir:a10423592dd061a00f7d34e4a3c102ba00c3d2ab,done,7,6,597,,swh:1:dir:a10423592dd061a00f7d34e4a3c102ba00c3d2ab;origin=https://doi.org/10.5201/ipol.2018.236;visit=swh:1:snp:994f6ca7c49b1012768c4a5a6470f17f28d0e294;anchor=swh:1:rev:cd8faa35b66794fecfc5c1e49c826d1a287ab410;path=/,333382926,333382931,https://doi.org/10.5201/ipol.2018.236
    ...
    • Apr 2 2021, 2:56 PM
    • 115 Lines
    Author: ardumont
  • P998 (An Untitled Masterwork)
    2021-04-02T07:33:09.081346338Z swh_storage.1.yjtfpr7ambpm@libra | ERROR:root:unsupported Unicode escape sequence
    2021-04-02T07:33:09.081377763Z swh_storage.1.yjtfpr7ambpm@libra | DETAIL: \u0000 cannot be converted to text.
    2021-04-02T07:33:09.081383405Z swh_storage.1.yjtfpr7ambpm@libra | CONTEXT: JSON data, line 1: ...ng prices from the Steam market.", "description":...
    2021-04-02T07:33:09.081387993Z swh_storage.1.yjtfpr7ambpm@libra | COPY tmp_revision, line 10, column metadata: "{"intrinsic": {"tool": "PKG-INFO", "raw": {"metadata_version": "2.1", "name": "steammarket", "versio..."
    2021-04-02T07:33:09.081392498Z swh_storage.1.yjtfpr7ambpm@libra | Traceback (most recent call last):
    ...
    • Apr 2 2021, 9:34 AM
    • 32 Lines
    Author: douardda
  • P997 irc log
    14:01 * hakb[m] < https://matrix.org/_matrix/media/r0/download/matrix.org/sWuFMMJQwliKvENXMZBPCYuc/message.txt >
    14:02 * hakb[m] < https://matrix.org/_matrix/media/r0/download/matrix.org/ZVjcnGQYAvfmxpMyGzdahqbh/message.txt >
    14:02 * hakb[m] < https://matrix.org/_matrix/media/r0/download/matrix.org/NUHFuDYZBNRXTTXEkXhlmLGS/message.txt >
    14:03 * hakb[m] < https://matrix.org/_matrix/media/r0/download/matrix.org/hpRqGUJfkoikaajfTfXGPkmI/message.txt >
    • Apr 1 2021, 4:12 PM
    • 4 Lines
    Author: vlorentz
  • P996 (An Untitled Masterwork)
    fullset=# select * from revision order by id desc limit 10;
    id | sha1 | date | org
    --------+--------------------------------------------+------------------------+-----
    338447 | \x3a5c899326e18b639a8f09dea58c035ade73a8ea | 1970-01-01 01:00:00+01 |
    338446 | \x3bf3d78487e1700fb4b13396c8b1d41fd6b64446 | 1970-01-01 01:00:00+01 |
    ...
    • Apr 1 2021, 12:48 PM
    • 14 Lines
    Author: douardda
  • P995 (An Untitled Masterwork)
    C D R C-D C-R D-R Loc pos
    03-29T12:30 1,949,158 264 338,263 5022 498,545,729 101,905 32,647,347 9,302,016
    03-29T14:25 1,949,158 264 338,263 5022 498,545,729 101,905 32,897,808
    03-30T10:12 1,949,230 264 338,287 5022 661,970,360 117,289 34,102,420 9,302,016
    ...
    • Apr 1 2021, 11:11 AM
    • 6 Lines
    Author: douardda
  • P994 dsc metadata
    {'files': {'mapbox-geometry_1.0.0-1.debian.tar.xz': {'md5sum': '8c38df38641cad35883e2b207016709c',
    'name': 'mapbox-geometry_1.0.0-1.debian.tar.xz',
    'sha256': 'fab7bc559d03929685a47ad036ccee4151d5d0a5fbec522cde341908bbaeaf2a',
    'size': 3756,
    'uri': 'http://deb.debian.org/debian//pool/main/m/mapbox-geometry/mapbox-geometry_1.0.0-1.debian.tar.xz'},
    ...
    • Mar 30 2021, 1:10 PM
    • 19 Lines
    • Python
    Author: vlorentz
  • P993 swh/loader/mercurial/tests/test_partial_storage.py
    from datetime import datetime
    from hashlib import sha1
    import os
    import pytest
    ...
    • Mar 29 2021, 1:56 PM
    • 96 Lines
    • Python
    Author: vlorentz
  • P992 (An Untitled Masterwork)
    swh/graph/tests/test_cli.py::test_pipeline
    ------------------------------------------------------------------------------------------------- live log call --------------------------------------------------------------------------------------------------
    DEBUG swh.core.config:config.py:88 Loading config file /tmp/tmp2xijfg30.swh-graph-test/config.yml
    INFO root:config.py:33 using swh-graph JAR: /home/anlambert/swh/swh-environment/swh-graph/java/target/swh-graph-0.3.0.jar
    INFO root:webgraph.py:205 starting compression at 2021-03-26 12:41:38.621097
    ...
    • Mar 26 2021, 12:42 PM
    • 115 Lines
    Author: anlambert
  • P991 (An Untitled Masterwork)
    ddouard@petitpalais:~$ cat revision-cvs-extract.py
    #!/usr/bin/env python
    import sys
    import iso8601
    ...
    • Mar 26 2021, 9:52 AM
    • 25 Lines
    Author: douardda
  • P990 pytest wat
    def test_foo():
    from unittest.mock import MagicMock, call
    f = MagicMock()
    ...
    • Mar 25 2021, 5:45 PM
    • 33 Lines
    • Python
    Author: vlorentz
  • P989 class overload wat
    def test_load_get_known_extids() -> None:
    """Checks PackageLoader.load() fetches known extids efficiently"""
    storage = Mock(wraps=get_storage("memory"))
    class StubPackageInfo(BasePackageInfo):
    ...
    • Mar 25 2021, 5:11 PM
    • 26 Lines
    • Python
    Author: vlorentz
  • P988 swh-docs: make -C docs clean; make -C docs
    swh  tony  yavin4  ~  work  …  swh  swh-environment  swh-auth   master  1⬆  1✎  1⚑  %  make -C docs clean
    make: Entering directory '/home/tony/work/inria/repo/swh/swh-environment/swh-auth/docs'
    sphinx-build -M clean . _build
    Removing everything under '_build'...
    rm -rf apidoc
    ...
    • Mar 25 2021, 4:53 PM
    • 36 Lines
    Author: ardumont
  • P987 docker-keycloak 10.0.2 failures on start
    keycloak_1 | 16:25:55,702 ERROR [org.keycloak.services.error.KeycloakErrorHandler] (default task-1) Uncaught server error: java.lang.RuntimeException: com.fasterxml.jackson.databind.exc.UnrecognizedPropertyException: Unrecognized field "additionalParameters" (class org.keycloak.models.credential.dto.PasswordCredentialData), not marked as ignorable (2 known properties: "hashIterations", "algorithm"])
    keycloak_1 | at [Source: (String)"{"hashIterations":27500,"algorithm":"pbkdf2-sha256","additionalParameters":{}}"; line: 1, column: 77] (through reference chain: org.keycloak.models.credential.dto.PasswordCredentialData["additionalParameters"])
    keycloak_1 | at org.keycloak.keycloak-server-spi@10.0.2//org.keycloak.models.credential.PasswordCredentialModel.createFromCredentialModel(PasswordCredentialModel.java:55)
    keycloak_1 | at org.keycloak.keycloak-services@10.0.2//org.keycloak.credential.PasswordCredentialProvider.getPassword(PasswordCredentialProvider.java:71)
    keycloak_1 | at org.keycloak.keycloak-services@10.0.2//org.keycloak.credential.PasswordCredentialProvider.isValid(PasswordCredentialProvider.java:243)
    ...
    • Mar 24 2021, 5:32 PM
    • 122 Lines
    Author: ardumont
  • P986 (An Untitled Masterwork)
    ddouard@petitpalais:/data/aeviso$ ipython3
    Python 3.7.3 (default, Jul 25 2020, 13:03:44)
    Type "copyright", "credits" or "license" for more information.
    IPython 5.8.0 -- An enhanced Interactive Python.
    ...
    • Mar 24 2021, 2:46 PM
    • 15 Lines
    Author: douardda
  • P985 keycloak staging realm error from time to time...
    Mar 24 11:37:30 kelvingrove standalone.sh[946]: 11:37:30,352 ERROR [org.keycloak.services.error.KeycloakErrorHandler] (default task-216) Uncaught server error: org.keycloak.authentication.AuthenticationFlowException: authenticator: direct-grant-validate-password
    Mar 24 11:37:30 kelvingrove standalone.sh[946]: at org.keycloak.keycloak-services@10.0.2//org.keycloak.authentication.DefaultAuthenticationFlow.processSingleFlowExecutionModel(DefaultAuthenticationFlow.java:423)
    Mar 24 11:37:30 kelvingrove standalone.sh[946]: at org.keycloak.keycloak-services@10.0.2//org.keycloak.authentication.DefaultAuthenticationFlow.processFlow(DefaultAuthenticationFlow.java:247)
    Mar 24 11:37:30 kelvingrove standalone.sh[946]: at org.keycloak.keycloak-services@10.0.2//org.keycloak.authentication.AuthenticationProcessor.authenticateOnly(AuthenticationProcessor.java:976)
    Mar 24 11:37:30 kelvingrove standalone.sh[946]: at org.keycloak.keycloak-services@10.0.2//org.keycloak.protocol.oidc.endpoints.TokenEndpoint.resourceOwnerPasswordCredentialsGrant(TokenEndpoint.java:592)
    ...
    • Mar 24 2021, 12:41 PM
    • 77 Lines
    Author: ardumont
  • P984 (An Untitled Masterwork)
    return datetime.datetime(
    1970, 1, 1, tzinfo=datetime.timezone.utc
    ) + datetime.timedelta(
    seconds=obj["timestamp"]["seconds"],
    > microseconds=obj["timestamp"]["microseconds"],
    ...
    • Mar 24 2021, 11:04 AM
    • 7 Lines
    Author: seirl
  • P983 staging-users.yaml with creds redacted
    - username: hal
    password: ""
    email: ""
    - username: hal-preprod
    password: ""
    ...
    • Mar 23 2021, 12:17 PM
    • 21 Lines
    Author: ardumont
  • P982 (An Untitled Masterwork)
    11:17 $ curl -i -H "Authorization: Bearer ${TOKEN}" https://archive.softwareheritage.org/api/1/stat/counters/
    HTTP/1.1 403 Forbidden
    Date: Tue, 23 Mar 2021 10:17:27 GMT
    Server: gunicorn/19.9.0
    Content-Type: application/json
    ...
    • Mar 23 2021, 11:18 AM
    • 17 Lines
    Author: anlambert
  • P981 KeycloakError format is a json-dict bytes encoded
    swh-deposit_1 | [2021-03-23 09:29:57 +0000] [114] [DEBUG] GET /deposit/1/servicedocument/
    swh-deposit_1 | EEEEE KeycloakError: e: 401: b'{"error":"invalid_grant","error_description":"Invalid user credentials"}'
    swh-deposit_1 | EEEEE KeycloakError: e.error_message: b'{"error":"invalid_grant","error_description":"Invalid user credentials"}'
    swh-deposit_1 | EEEEE KeycloakError: e.code: 401
    swh-deposit_1 | EEEEE KeycloakError: e.body: b'{"error":"invalid_grant","error_description":"Invalid user credentials"}'
    • Mar 23 2021, 10:36 AM
    • 5 Lines
    Author: ardumont
  • P980 deposit client: parsing error returned by deposit server ends up in a cascading key error
    swh deposit upload --url http://localhost:5080/deposit \
    --username test \
    --password test \
    --metadata ../deposit-swh.update-metadata.xml --format json
    WARNING:swh.deposit.cli.client:The metadata file provided should contain "<swh:create_origin>" or "<swh:add_to_origin>" tag
    ...
    • Mar 22 2021, 4:07 PM
    • 33 Lines
    Author: ardumont
  • P979 Command-Line Input
    (base) [zacchiro@rioc ~]$ ls -al /scratch/apietri/graph-2020-12-15/
    total 1108962828
    drwxr-xr-x 2 apietri irill 5 Jan 3 04:49 .
    drwxr-xr-x 11 apietri irill 14 Jan 6 18:45 ..
    -rw-r--r-- 1 apietri irill 917013631214 Jan 1 23:43 graph-bv.graph
    ...
    • Mar 19 2021, 2:26 PM
    • 12 Lines
    Author: zack
  • P978 (An Untitled Masterwork)
    def test_provenance_revision_add(provenance, swh_storage_with_objects, archive_pg):
    """Test the ProvenanceDB.revision_add() method"""
    for revision in TEST_OBJECTS["revision"]:
    ...
    • Mar 18 2021, 6:43 PM
    • 19 Lines
    Author: douardda
  • P977 raw_extrinsic_metadata discrepancies
    softwareheritage=> select target, discovery_date from raw_extrinsic_metadata rem where not exists (select 1 from raw_extrinsic_metadata_new remn where date_trunc('second', remn.discovery_date) = date_trunc('second', rem.discovery_date) and remn.target = case when rem.target LIKE 'swh:1:%' then rem.target else 'swh:1:ori:' || encode(digest(rem.target, 'sha1'), 'hex') end) order by target;
    target | discovery_date
    ----------------------------------------------------+-------------------------------
    swh:1:dir:d83b7dda887dc790f7207608474650d4344b8df9 | 2021-03-16 00:03:03.765938+00
    swh:1:dir:d83b7dda887dc790f7207608474650d4344b8df9 | 2021-03-16 16:41:37.093553+00
    ...
    • Mar 17 2021, 7:46 PM
    • 10 Lines
    Author: olasd
  • P976 python3-mirakuru update tryouts
    $ gbp import-orig --uscan
    gbp:info: Launching uscan...
    gbp:info: Using uscan downloaded tarball ../mirakuru_2.3.0.orig.tar.gz
    What is the upstream version? [2.3.0]
    gbp:info: Importing '../mirakuru_2.3.0.orig.tar.gz' to branch 'debian/upstream'...
    ...
    • Mar 17 2021, 10:01 AM
    • 770 Lines
    Author: ardumont
  • P975 docker: auth_time not present in decoded_token
    ???
    swh-deposit_1 | Internal Server Error: /deposit/1/servicedocument/
    swh-deposit_1 | Traceback (most recent call last):
    swh-deposit_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/django/core/handlers/exception.py", line 34, in inner
    ...
    • Mar 13 2021, 10:25 AM
    • 38 Lines
    Author: ardumont
  • P974 (An Untitled Masterwork)
    tox -e py3-django2-dev -- -s -k test_backend_
    GLOB sdist-make: /home/tony/work/inria/repo/swh/swh-environment/swh-deposit/setup.py
    py3-django2-dev inst-nodeps: /home/tony/work/inria/repo/swh/swh-environment/swh-deposit/.tox/.tmp/package/1/swh.deposit-0.11.2.dev3+gf42e3dfe.d20210312.zip
    py3-django2-dev installed: aiohttp==3.7.4.post0,aiohttp-utils==3.1.1,amqp==5.0.5,async-timeout==3.0.1,attrs==20.3.0,attrs-strict==0.2.1,beautifulsoup4==4.9.3,billiard==3.6.3.0,blinker==1.4,cassandra-driver==3.24.0,celery==5.0.5,certifi==2020.12.5,cffi==1.14.5,chardet==4.0.0,click==7.1.2,click-didyoumean==0.0.3,click-plugins==1.1.1,click-repl==0.1.6,confluent-kafka==1.6.0,coreapi==2.3.3,coreschema==0.0.4,coverage==5.5,cryptography==3.4.6,decorator==4.4.2,Deprecated==1.2.11,distro==1.5.0,Django==2.2.19,django-stubs==1.7.0,django-test-migrations==1.1.0,djangorestframework==3.12.2,djangorestframework-stubs==1.4.0,ecdsa==0.14.1,elasticsearch==7.11.0,fancycompleter==0.9.1,Flask==1.1.2,geomet==0.2.1.post1,gunicorn==20.0.4,httplib2==0.19.0,humanize==3.2.0,hypothesis==6.8.0,idna==2.10,importlib-metadata==3.7.2,iniconfig==1.1.1,iso8601==0.1.14,itsdangerous==1.1.0,itypes==1.2.0,jeepney==0.6.0,Jinja2==2.11.3,keyring==23.0.0,kombu==5.0.2,launchpadlib==1.10.13,lazr.restfulclient==0.14.3,lazr.uri==1.0.5,MarkupSafe==1.1.1,mirakuru==2.3.0,msgpack==1.0.2,multidict==5.1.0,mypy==0.812,mypy-extensions==0.4.3,oauthlib==3.1.0,packaging==20.9,pbr==5.5.1,pdbpp==0.10.2,pika==1.2.0,pkginfo==1.7.0,plotille==3.7.2,pluggy==0.13.1,port-for==0.4,prompt-toolkit==3.0.17,psutil==5.8.0,psycopg2==2.8.6,py==1.10.0,pyasn1==0.4.8,pycparser==2.20,Pygments==2.8.1,pyparsing==2.4.7,pyrepl==0.9.0,pytest==6.2.2,pytest-cov==2.11.1,pytest-django==4.1.0,pytest-mock==3.5.1,pytest-postgresql==2.6.1,python-dateutil==2.8.1,python-debian==0.1.39,python-jose==3.2.0,python-keycloak==0.24.0,python-mimeparse==1.6.0,pytz==2021.1,PyYAML==5.4.1,requests==2.25.1,requests-mock==1.8.0,rsa==4.7.2,SecretStorage==3.3.1,sentry-sdk==1.0.0,simpy==3.0.13,six==1.15.0,sortedcontainers==2.3.0,soupsieve==2.2,sqlparse==0.4.1,swh.auth @ file:///home/tony/work/inria/repo/swh/swh-environment/swh-auth,swh.core==0.12.0,swh.deposit @ file:///home/tony/work/inria/repo/swh/swh-environment/swh-deposit/.tox/.tmp/package/1/swh.deposit-0.11.2.dev3%2Bgf42e3dfe.d20210312.zip,swh.journal==0.7.1,swh.lister==0.10.0,swh.loader.core==0.20.0,swh.model==2.1.0,swh.objstorage==0.2.2,swh.scheduler==0.10.0,swh.storage==0.24.1,tenacity==7.0.0,testresources==2.0.1,toml==0.10.2,typed-ast==1.4.2,typing-extensions==3.7.4.3,uritemplate==3.0.1,urllib3==1.26.3,vine==5.0.0,wadllib==1.3.5,wcwidth==0.2.5,Werkzeug==1.0.1,wmctrl==0.3,wrapt==1.12.1,xmltodict==0.12.0,yarl==1.6.3,zipp==3.4.1
    py3-django2-dev run-test-pre: PYTHONHASHSEED='3082583648'
    ...
    • Mar 12 2021, 4:10 PM
    • 177 Lines
    Author: ardumont
  • P973 (An Untitled Masterwork)
    http https://archive.softwareheritage.org/api/1/snapshot/fc7706e4c177714475a4886831486ad0979983ea/ "Authorization: Bearer ${SWH_TOKEN}"
    HTTP/1.1 403 Forbidden
    Age: 0
    Allow: OPTIONS, GET, HEAD, OPTIONS
    Connection: keep-alive
    ...
    • Mar 12 2021, 2:54 PM
    • 21 Lines
    Author: douardda
  • P972 mypy wat
    from typing import List
    def f() -> None:
    l1: List[str] = ["foo"]
    l2: List[int] = [42]
    ...
    • Mar 11 2021, 4:28 PM
    • 7 Lines
    • Python
    Author: vlorentz
  • P971 (An Untitled Masterwork)
    ______________ test_swh_model_todict_fromdict[metadata_authority-objects3] _______________
    object_type = 'metadata_authority'
    objects = [MetadataAuthority(type=<MetadataAuthorityType.FORGE: 'forge'>, url='http://example.org/', metadata=ImmutableDict({}))]
    ...
    • Mar 8 2021, 2:13 PM
    • 67 Lines
    Author: douardda
  • P970 deposit loader error in docker environment
    swh-loader-deposit_1 | [2021-03-05 13:29:50,864: INFO/MainProcess] Received task: swh.loader.package.deposit.tasks.LoadDeposit[29c39c67-9d10-4ee7-be6b-9a03c5dbbb8c]
    swh-loader-deposit_1 | [2021-03-05 13:29:50,867: DEBUG/ForkPoolWorker-1] Loading config file /loader-deposit.yml
    swh-loader-deposit_1 | [2021-03-05 13:29:51,384: DEBUG/MainProcess] heartbeat_tick : for connection 4c6e0d55bab340648017acbce1649821
    swh-loader-deposit_1 | [2021-03-05 13:29:51,384: DEBUG/MainProcess] heartbeat_tick : Prev sent/recv: 39/2290, now - 41/2446, monotonic - 845447.299477598, last_heartbeat_sent - 845447.299474569, heartbeat int. - 60 for connection 4c6e0d55bab340648017acbce1649821
    swh-loader-deposit_1 | [2021-03-05 13:29:52,977: DEBUG/ForkPoolWorker-1] last snapshot: None
    ...
    • Mar 5 2021, 2:33 PM
    • 43 Lines
    Author: anlambert
  • P969 swh.fuse failure in jenkins
    jenkins@bfa1ac925ae0:/var/lib/jenkins/workspace/DFUSE/tests-on-diff@tmp/swh-fuse$ swh --log-level=DEBUG fs mount -f /tmp/fuse
    WARNING:root:Using default configuration (cannot load custom one)
    Traceback (most recent call last):
    File "/home/jenkins/.local/lib/python3.7/site-packages/swh/fuse/cli.py", line 72, in fuse
    raise ValueError(f"Cannot parse configuration file: {config_file}")
    ...
    • Mar 4 2021, 6:00 PM
    • 47 Lines
    Author: olasd
  • P968 swhgraph.sh
    #!/bin/bash
    mkdir -p /srv/softwareheritage/ssd/seirl/tmp
    java -Xmx400G -server \
    -Djava.io.tmpdir=/srv/softwareheritage/ssd/seirl/tmp \
    ...
    • Mar 4 2021, 12:36 PM
    • 10 Lines
    • Bash Scripting
    Author: seirl
  • P967 (An Untitled Masterwork)
    print("content_raw middle")
    for chunk in r.iter_content(chunk_size=None, decode_unicode=False):
    print("content_raw chunk", repr(chunk))
    yield chunk
    ...
    • Mar 4 2021, 11:40 AM
    • 7 Lines
    Author: vlorentz
  • P966 Snapshot branches queries performances
    Executing the snapshot_get_branches query on db.internal.softwareheritage.org gives unexpected
    performance results:
    - limiting the query to 10 results is fast and responsive
    ...
    • Mar 3 2021, 2:07 PM
    • 150 Lines
    Author: anlambert
  • P965 Belvedere zfs errors
    ```
    The number of checksum errors associated with a ZFS device
    exceeded acceptable levels. ZFS has marked the device as
    degraded.
    ...
    • Mar 3 2021, 11:00 AM
    • 68 Lines
    Author: vsellier
First
Prev
Next
About · Developer information · Legal