Page MenuHomeSoftware Heritage
Paste Active Pastes
  • diff --git a/swh/provenance/postgresql/provenancedb.py b/swh/provenance/postgresql/provenancedb.py
    index 7276daf..8c626c5 100644
    --- a/swh/provenance/postgresql/provenancedb.py
    +++ b/swh/provenance/postgresql/provenancedb.py
    @@ -304,10 +304,8 @@ class ProvenanceDB:
    ...
    • Aug 6 2021, 3:21 PM
    • 38 Lines
  • --- /home/dev/.local/lib/python3.7/site-packages/dulwich/pack.py 2021-08-04 17:01:37.362133450 +0200
    +++ pack.py 2021-08-04 17:07:30.875342007 +0200
    @@ -1439,7 +1439,8 @@
    # Unlike PackData.get_object_at, there is no need to cache offsets as
    # this approach by design inflates each object exactly once.
    ...
    • Aug 4 2021, 5:02 PM
    • 12 Lines
    • Diff
  • swhwebapp@moma:~$ export DJANGO_SETTINGS_MODULE=swh.web.settings.production
    swhwebapp@moma:~$ time /usr/bin/django-admin refresh_savecodenow_statuses
    Successfully updated 4 save request(s).
    real 0m4.973s
    ...
    • Aug 3 2021, 5:52 PM
    • 49 Lines
  • (ve) swhscheduler@saatchi:~$ while true; do echo "$(date) update metrics"; time SWH_CONFIG_FILENAME=/etc/softwareheritage/scheduler/backend.yml swh scheduler --config-file /etc/softwareheritage/scheduler/backend.yml origin update-metrics | grep "real "; sleep 3600; done
    Thu Jul 29 12:36:48 UTC 2021 update metrics
    real 12m1.651s
    user 0m0.609s
    ...
    • Aug 3 2021, 2:18 PM
    • 501 Lines
  • To have real prometheus data on the vagrant vm
    - ssh -g -L 9090:192.168.100.29:9090 pergamon
    - On the vm, edit the `/etc/prometheus/prometheus.yml`
    ```
    ...
    • Aug 2 2021, 4:29 PM
    • 33 Lines
  • * Replication
    ** main db: publication
    connect to main db softwareheritage:
    ...
    • Aug 2 2021, 9:53 AM
    • 29 Lines
  • def stream_results_optional(
    f: Callable[..., Optional[PagedResult[TResult, TToken]]], *args, **kwargs
    ) -> Optional[Iterable[TResult]]:
    """Like stream_results(), but for functions ``f`` that return an Optional.
    ...
    • Jul 30 2021, 3:31 PM
    • 13 Lines
    • Python
  • def stream_results_optional(
    f: Callable[..., Optional[PagedResult[TResult, TToken]]], *args, **kwargs
    ) -> Optional[Iterable[TResult]]:
    """Like stream_results(), but for functions ``f`` that return an Optional.
    ...
    • Jul 30 2021, 3:21 PM
    • 23 Lines
    • Python
  • swhworker@worker16:~$ base_dir=/srv/storage/space/mirrors/boatbucket
    swhworker@worker16:~$ nb_origins=10
    swhworker@worker16:~$ head -n$nb_origins $base_dir/mapping-to-repos.txt | while read dir url; do
    > repo_dir="$base_dir/$dir"
    > visit_date=`stat -c %z $repo_dir/.hg/blackbox.log | sed -E 's/ \+0000/+0000/'`
    ...
    • Jul 30 2021, 12:32 PM
    • 50 Lines
  • swhworker@worker01:~$ SWH_CONFIG_FILENAME=/etc/softwareheritage/loader_high_priority.yml swh --log-level DEBUG loader run mercurial_from_disk https://foss.heptapod.net/pypy/cffi
    DEBUG:swh.loader.cli:ctx: <click.core.Context object at 0x7fefbe8a3278>
    DEBUG:swh.core.config:Loading config file /etc/softwareheritage/loader_high_priority.yml
    DEBUG:swh.loader.cli:config_file: /etc/softwareheritage/loader_high_priority.yml
    DEBUG:swh.loader.cli:config:
    ...
    • Jul 30 2021, 12:15 PM
    • 111 Lines
  • def test_load_new_extid_should_be_eventful(
    swh_storage, datadir, tmp_path
    ):
    """Changing the extid version should make loaders ignore existing extids,
    and load the repo again."""
    ...
    • Jul 29 2021, 11:11 AM
    • 26 Lines
    • Python
  • def test_load_new_extid_should_be_eventful(
    swh_storage, datadir, tmp_path
    ):
    """Changing the extid version should make loaders ignore existing extids,
    and load the repo again."""
    ...
    • Jul 29 2021, 10:48 AM
    • 23 Lines
    • Python
  • root@pergamon:~# clush -b -w @swh-workers "systemctl status swh-worker@loader_git" | grep -i linux
    Jul 28 09:22:30 worker01 python3[116142]: [2021-07-28 09:22:30,504: INFO/ForkPoolWorker-400] Load origin 'https://git.launchpad.net/~kerneltoast/+git/bionic-linux-hwe' with type 'git'
    Jul 28 10:05:11 worker02 python3[54928]: [2021-07-28 10:05:11,162: INFO/ForkPoolWorker-229] Load origin 'https://git.launchpad.net/~arighi/+git/xenial-linux-kvm' with type 'git'
    dulwich.errors.GitProtocolError: unexpected http resp 401 for https://git.launchpad.net/~arighi/+git/xenial-linux-kvm/info/refs?service=git-upload-pack
    swh.loader.exception.NotFound: unexpected http resp 401 for https://git.launchpad.net/~arighi/+git/xenial-linux-kvm/info/refs?service=git-upload-pack
    ...
    • Jul 28 2021, 12:19 PM
    • 31 Lines
  • $ sha512sum $SWH_CI_ENVIRONMENT_HOME/swh-jenkins-jobs/keyrings/cassandra.asc
    e1f7a62808fe1828ffe815aa6fa1001661b0d06ba3c7d7649d8dbdf77549cdefaf83f846dd002bc2fdd68f82256d7758bf4e5a1626a29a2afecdf3575e2c6e2b /home/tony/work/inria/repo/swh/ci-environment/swh-jenkins-jobs/keyrings/cassandra.asc
    $ sha512sum /home/tony/work/inria/resources/cassandra.asc
    e1f7a62808fe1828ffe815aa6fa1001661b0d06ba3c7d7649d8dbdf77549cdefaf83f846dd002bc2fdd68f82256d7758bf4e5a1626a29a2afecdf3575e2c6e2b /home/tony/work/inria/resources/cassandra.asc
    ...
    • Jul 28 2021, 11:11 AM
    • 98 Lines
  • #BVGraph properties
    #Tue Jul 27 14:28:26 UTC 2021
    bitsforreferences=0
    avgbitsforintervals=NaN
    graphclass=it.unimi.dsi.big.webgraph.BVGraph
    ...
    • Jul 27 2021, 5:20 PM
    • 35 Lines
  • 1. https://github.com/pushrax/round660
    People bruteforcing Git commit hashes for a CTF.
    Lowest hash: 000000000001b58ef4d6727f61f4d7f8625feb72
    ...
    • Jul 26 2021, 6:40 PM
    • 80 Lines
  • ❯ pytest .
    =============================================================== test session starts ================================================================
    platform linux -- Python 3.8.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1
    rootdir: /home/shivendu/projects/swh/swh-environment/swh-search, configfile: pytest.ini
    ...
    • Jul 26 2021, 5:42 PM
    • 19 Lines
  • UTC+2 time
    -- Mon, 26 Jul 2021 --
    03:27 <+swhbot> icinga PROBLEM: service linux-ssh on worker03.softwareheritage.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds
    03:30 <+swhbot> icinga PROBLEM: service load on worker03.softwareheritage.org is WARNING: WARNING - load average: 36.25, 23.93, 12.73
    ...
    • Jul 26 2021, 2:34 PM
    • 60 Lines
  • name | instance_name | current_state
    --------+------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    gitlab | gitlab | {"last_seen_next_link": "https://gitlab.com/api/v4/projects?id_after=2114599&membership=false&order_by=id&owned=false&page=1&pagination=keyset&per_page=20&repository_checksum_failed=false&simple=false&sort=asc&starred=false&statistics=false&wiki_checksum_failed=false&with_custom_attributes=false&with_issues_enabled=false&with_merge_requests_enabled=false"}
    gitlab | gitlab.inria.fr | {"last_seen_next_link": "https://gitlab.inria.fr/api/v4/projects?id_after=31598&membership=false&order_by=id&owned=false&page=1&pagination=keyset&per_page=20&simple=false&sort=asc&starred=false&statistics=false&with_custom_attributes=false&with_issues_enabled=false&with_merge_requests_enabled=false"}
    gitlab | gitlab.lip6.fr | {"last_seen_next_link": "https://gitlab.lip6.fr/api/v4/projects?id_after=967&membership=false&order_by=id&owned=false&page=1&pagination=keyset&per_page=20&simple=false&sort=asc&starred=false&statistics=false&with_custom_attributes=false&with_issues_enabled=false&with_merge_requests_enabled=false"}
    ...
    • Jul 23 2021, 4:59 PM
    • 13 Lines
  • swh-lister_1 | [2021-07-22 11:16:22,656: DEBUG/ForkPoolWorker-1] Fetching URL https://gitlab.com/api/v4/projects?id_after=575090&membership=false&order_by=id&owned=false&page=1&pagination=keyset&per_page=20&repository_checksum_failed=false&simple=false&sort=asc&starred=false&statistics=false&wiki_checksum_failed=false&with_custom_attributes=false&with_issues_enabled=false&with_merge_requests_enabled=false
    swh-lister_1 | [2021-07-22 11:16:23,364: WARNING/ForkPoolWorker-1] Unexpected HTTP status code 502 on https://gitlab.com/api/v4/projects?id_after=575090&membership=false&order_by=id&owned=false&page=1&pagination=keyset&per_page=20&repository_checksum_failed=false&simple=false&sort=asc&starred=false&statistics=false&wiki_checksum_failed=false&with_custom_attributes=false&with_issues_enabled=false&with_merge_requests_enabled=false: b'<!DOCTYPE html>\n<html>\n<head>\n <meta content="width=device-width, initial-scale=1, maximum-scale=1" name="viewport">\n <title>500 Error - GitLab</title>\n <style>body{color:#666;text-align:center;font-family:Helvetica Neue,Helvetica,Arial,sans-serif;margin:auto;font-size:14px;display:flex;flex-direction:column;align-items:center;justify-content:center}hr{max-width:800px;margin:18px auto;border:0;border-top:1px solid #eee;border-bottom:1px solid #fff}img{max-width:40vw}.container{margin:auto 20px}.cferror_details{list-style-type:none}.cf-error-details h1{color:#456;font-size:20px;font-weight:400;line-height:28px}</style>\n\n\n</head>\n\n<body>\n <h1>\n <img src="data:image/svg+xml;base64,PHN2ZyB3aWR0aD0iMjEwIiBoZWlnaHQ9IjIxMCIgdmlld0JveD0iMCAwIDIxMCAyMTAiIHhtbG5zPSJodHRwOi8vd3d3LnczLm9yZy8yMDAwL3N2ZyI+CiAgPHBhdGggZD0iTTEwNS4wNjE0IDIwMy42NTVsMzguNjQtMTE4LjkyMWgtNzcuMjhsMzguNjQgMTE4LjkyMXoiIGZpbGw9IiNlMjQzMjkiLz4KICA8cGF0aCBkPSJNMTA1LjA2MTQgMjAzLjY1NDhsLTM4LjY0LTExOC45MjFoLTU0LjE1M2w5Mi43OTMgMTE4LjkyMXoiIGZpbGw9IiNmYzZkMjYiLz4KICA8cGF0aCBkPSJNMTIuMjY4NSA4NC43MzQxbC0xMS43NDIgMzYuMTM5Yy0xLjA3MSAzLjI5Ni4xMDIgNi45MDcgMi45MDYgOC45NDRsMTAxLjYyOSA3My44MzgtOTIuNzkzLTExOC45MjF6IiBmaWxsPSIjZmNhMzI2Ii8+CiAgPHBhdGggZD0iTTEyLjI2ODUgODQuNzM0Mmg1NC4xNTNsLTIzLjI3My03MS42MjVjLTEuMTk3LTMuNjg2LTYuNDExLTMuNjg1LTcuNjA4IDBsLTIzLjI3MiA3MS42MjV6IiBmaWxsPSIjZTI0MzI5Ii8+CiAgPHBhdGggZD0iTTEwNS4wNjE0IDIwMy42NTQ4bDM4LjY0LTExOC45MjFoNTQuMTUzbC05Mi43OTMgMTE4LjkyMXoiIGZpbGw9IiNmYzZkMjYiLz4KICA8cGF0aCBkPSJNMTk3Ljg1NDQgODQuNzM0MWwxMS43NDIgMzYuMTM5YzEuMDcxIDMuMjk2LS4xMDIgNi45MDctMi45MDYgOC45NDRsLTEwMS42MjkgNzMuODM4IDkyLjc5My0xMTguOTIxeiIgZmlsbD0iI2ZjYTMyNiIvPgogIDxwYXRoIGQ9Ik0xOTcuODU0NCA4NC43MzQyaC01NC4xNTNsMjMuMjczLTcxLjYyNWMxLjE5Ny0zLjY4NiA2LjQxMS0zLjY4NSA3LjYwOCAwbDIzLjI3MiA3MS42MjV6IiBmaWxsPSIjZTI0MzI5Ii8+Cjwvc3ZnPgo=" alt="GitLab Logo" /><br />\n </h1>\n <div class="container">\n <div class="cf-error-details cf-error-502">\n <h1>Bad gateway</h1>\n <p>The web server reported a bad gateway error.</p>\n <ul>\n <li>Ray ID: 672c41a9985d3316</li>\n <li>Your IP address: 78.192.232.58</li>\n <li>Error reference number: 502</li>\n <li>Cloudflare Location: Paris</li>\n </ul>\n</div>\n\n <hr />\n <p>Please see our <a href="https://status.gitlab.com">status page</a> for more information.</p>\n </div>\n</body>\n</html>\n'
    swh-lister_1 | [2021-07-22 11:16:23,368: ERROR/ForkPoolWorker-1] Task swh.lister.gitlab.tasks.FullGitLabRelister[92b02cda-2ffe-4744-af4b-aac17c219899] raised unexpected: HTTPError('502 Server Error: Bad Gateway for url: https://gitlab.com/api/v4/projects?id_after=575090&membership=false&order_by=id&owned=false&page=1&pagination=keyset&per_page=20&repository_checksum_failed=false&simple=false&sort=asc&starred=false&statistics=false&wiki_checksum_failed=false&with_custom_attributes=false&with_issues_enabled=false&with_merge_requests_enabled=false')
    swh-lister_1 | Traceback (most recent call last):
    swh-lister_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/celery/app/trace.py", line 450, in trace_task
    ...
    • Jul 22 2021, 2:05 PM
    • 33 Lines
  • anlambert@carnavalet:~/tmp$ cat es_query.sh
    #!/bin/bash
    curl -X POST http://localhost:9200/origin-production/_search?pretty -H 'Content-Type: application/json' -d '
    {
    ...
    • Jul 22 2021, 12:59 PM
    • 87 Lines
  • 2021-07-06 07:07:05,685: svn 493.8169417530298s: 'eventful'
    2021-07-06 07:07:10,109: svn 2.36457402119413s: 'eventful'
    2021-07-06 07:07:15,745: svn 5.628665724769235s: 'eventful'
    2021-07-06 07:10:36,629: svn 200.8752660569735s: 'eventful'
    2021-07-06 07:10:41,017: svn 4.378507147077471s: 'eventful'
    ...
    • Jul 19 2021, 5:29 PM
    • 7,602 Lines
  • diff --git a/package.json b/package.json
    index c39fb88..9349bcf 100644
    --- a/package.json
    +++ b/package.json
    @@ -7,7 +7,7 @@
    ...
    • Jul 16 2021, 11:20 AM
    • 38 Lines
    • Diff
  • softwareheritage-scheduler=> select * from scheduler_metrics;
    lister_id | visit_type | last_update | origins_known | origins_enabled | origins_never_visited | origins_with_pending_changes
    --------------------------------------+------------+-------------------------------+---------------+-----------------+-----------------------+------------------------------
    b678cfc3-2780-4186-9186-d78a14bd4958 | cvs | 2021-07-09 15:47:09.900077+00 | 28622 | 0 | 0 | 0
    7a775770-2b2f-4139-aacb-ad715c022b9d | git | 2021-07-09 15:47:09.900077+00 | 1375 | 1375 | 1307 | 2
    ...
    • Jul 9 2021, 6:23 PM
    • 50 Lines
  • from tree_sitter import Language, Parser
    Language.build_library(
    'build/swh-query-language.so',
    ['.']
    ...
    • Jul 9 2021, 11:19 AM
    • 45 Lines
    • Python
  • module.exports = grammar({
    name: 'swh_search_query_language',
    rules: {
    program: $ => repeat(
    ...
    • Jul 9 2021, 9:31 AM
    • 124 Lines
    • Javascript
  • P1090 swl_ql
    query ::= ( patternFilter | booleanFilter | numericFilter | boundedListFilter | unboundedListFilter | dateFilter )*
    patternFilter ::= ( patternField patternOp patternVal )
    patternField ::= ( 'url' | 'metadata' )
    ...
    • Jul 9 2021, 8:33 AM
    • 58 Lines
  • [
    400,
    "search_phase_execution_exception",
    {
    "error": {
    ...
    • Jul 5 2021, 6:26 PM
    • 56 Lines
    • JSON
  • Result of this query:
    ```
    curl -H 'Content-Type: application/json' http://localhost:9200/origin-read/_search\?pretty -d '{
    "query": {
    "bool": {
    ...
    • Jul 5 2021, 3:53 PM
    • 34 Lines
  • from the server in question:
    ```
    root@tate:~# ssh-keygen -lf /etc/ssh/ssh_host_ecdsa_key.pub | awk '{print $2}'
    SHA256:0gi9tkEMHCDIveSm/VbZhdp8T83PlmWlufyli5OKrvg
    ```
    ...
    • Jul 5 2021, 12:02 PM
    • 12 Lines
  • curl -H 'Content-Type: application/json' http://localhost:9200/origin-read/_search\?pretty -d '{
    "query": {
    "bool": {
    "must": [
    {
    ...
    • Jul 2 2021, 5:40 PM
    • 30 Lines
  • GET origin/_search
    {
    "query": {
    "bool": {
    "must": [
    ...
    • Jul 2 2021, 5:29 PM
    • 30 Lines
  • 22:07 guest@softwareheritage => select extid_type, count(distinct extid) from extid e1 where exists (select 1 from extid e2 where e1.extid = e2.extid and e1.extid_type = e2.extid_type and e1.target < e2.target) group by extid_type;
    extid_type │ count
    ───────────────────────┼─────────
    cran-sha256 │ 7
    hg-nodeid │ 2691404
    ...
    • Jun 29 2021, 11:24 PM
    • 11 Lines
    • Jun 29 2021, 2:22 PM
    • 1 Line
  • ================================================================================================================== FAILURES ===================================================================================================================
    _________________________________________________________________________________ TestDirectoryCooker.test_directory_simple[cook_extract_directory_git_bare] __________________________________________________________________________________
    self = <swh.vault.tests.test_cookers.TestDirectoryCooker object at 0x7f26f605d748>, git_loader = <function git_loader.<locals>._create_loader at 0x7f26f5f8f9d8>
    cook_extract_directory = <function cook_extract_directory_git_bare at 0x7f26f6299510>
    ...
    • Jun 29 2021, 12:19 PM
    • 28 Lines
  • swh-web_1 | Downloading swh.storage-0.31.0-py3-none-any.whl (272 kB)
    swh-web_1 | INFO: pip is looking at multiple versions of swh-search to determine which version is compatible with other requirements. This could take a while.
    swh-web_1 | Collecting swh.search>=0.2.0
    swh-web_1 | Downloading swh.search-0.9.0-py3-none-any.whl (43 kB)
    swh-web_1 | Downloading swh.search-0.8.0-py3-none-any.whl (41 kB)
    ...
    • Jun 29 2021, 8:59 AM
    • 27 Lines
  • swh:1:dir:00016aedfa0a381d838a2a374a4618335c4ed33e
    swh:1:dir:00017cd05870c9dff67bf3a59deaf599bb52d13b
    swh:1:dir:000403d85d5a5e7fb9f172fa19b3755f6e2ba39f
    swh:1:dir:00040a338b2ad9a5bcad0de5cf9f0ecf8b997c01
    swh:1:dir:00046c7332123653985644a561f4d9406a789844
    ...
    • Jun 28 2021, 5:15 PM
    • 100 Lines
  • # Copyright (C) 2021 The Software Heritage developers
    # See the AUTHORS file at the top-level directory of this distribution
    # License: GNU General Public License version 3, or any later version
    # See top-level LICENSE file for more information
    ...
    • Jun 25 2021, 3:33 PM
    • 49 Lines
  • Jun 22 20:23:34 saatchi swh[2769803]: INFO:swh.scheduler.celery_backend.runner:Grabbed 1 tasks load-pypi
    Jun 22 20:26:23 saatchi swh[2769803]: INFO:swh.scheduler.cli.admin.runner:Scheduled 1 tasks
    # 725005 softw...cheduler swhscheduler 192.168.100.210/ 99.7 17.9 0.00B 0.00B 424 h N N active select * from swh_scheduler_grab_ready_tasks( 'list-debian-distribution', '2021-06-06T16:31:13 # <- killed a while ago but still listed somehow
    ...
    • Jun 24 2021, 10:48 AM
    • 6 Lines
  • import os
    from bs4 import BeautifulSoup
    import requests
    ...
    • Jun 21 2021, 2:02 PM
    • 55 Lines
    • Python
  • (swh2) shivendu@swh-self-hosted:~/swh-environment/swh-search$ pytest -sv swh/search/tests/test_journal_client.py
    ================================================== test session starts ==================================================
    platform linux -- Python 3.7.5, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /home/shivendu/.virtualenvs/swh2/bin/python3
    cachedir: .pytest_cache
    hypothesis profile 'default' -> database=DirectoryBasedExampleDatabase('/home/shivendu/swh-environment/swh-search/.hypothesis/examples')
    ...
    • Jun 18 2021, 4:19 PM
    • 149 Lines
  • diff --git a/swh/search/tests/test_elasticsearch.py b/swh/search/tests/test_elasticsearch.py
    index c59e173..8c5698b 100644
    --- a/swh/search/tests/test_elasticsearch.py
    +++ b/swh/search/tests/test_elasticsearch.py
    @@ -15,7 +15,7 @@
    ...
    • Jun 17 2021, 11:04 AM
    • 39 Lines
    • Diff
  • diff --git a/swh/search/tests/test_elasticsearch.py b/swh/search/tests/test_elasticsearch.py
    index c59e173..670a32a 100644
    --- a/swh/search/tests/test_elasticsearch.py
    +++ b/swh/search/tests/test_elasticsearch.py
    @@ -15,7 +15,7 @@
    ...
    • Jun 17 2021, 10:34 AM
    • 35 Lines
    • Diff
  • https://issues.sonatype.org/browse/MVNCENTRAL-6804 (registration required)
    I'm currently developing a Maven Central connector for the Software Heritage Foundation [1]. In a nutshell, the SWH aims to archive all existing source code in the world, and besides archiving to provide useful tools (unique IDs, search, graph-related tools..). It's all open-source, and many large forges and software systems have already been archived (GitHub, GitLab, npm, pypi, debian packages, CRAN..).
    [1] https://www.softwareheritage.org/
    ...
    • Jun 15 2021, 2:16 PM
    • 9 Lines
  • P1069 cypress
    it('should redirect to browse when origin url is searched', function() {
    71 cy.get('#swh-origins-url-patterns')
    72 .type(origin.url);
    73 cy.get('.swh-search-icon')
    74 .click();
    ...
    • Jun 14 2021, 2:35 PM
    • 12 Lines
  • swh-loader_1 | [2021-06-11 12:33:56,680: DEBUG/ForkPoolWorker-1] package_info: ArchivePackageInfo(url='https://web.archive.org/web/20100705043309/http://www.cs.unm.edu/~mccune/old-ftp/mace-1.2.0.tar.Z', filename='mace-1.2.0.tar.Z', directory_extrinsic_metadata=[], raw_info={'url': 'https://web.archive.org/web/20100705043309/http://www.cs.unm.edu/~mccune/old-ftp/mace-1.2.0.tar.Z', 'time': '1995-08-17T01:54:02', 'length': 132177, 'version': 'mace-1.2.0'}, length=132177, time='1995-08-17T01:54:02', version='mace-1.2.0')
    swh-loader_1 | [2021-06-11 12:33:58,128: DEBUG/ForkPoolWorker-1] filename: mace-1.2.0.tar.Z
    swh-loader_1 | [2021-06-11 12:33:58,128: DEBUG/ForkPoolWorker-1] filepath: /tmp/tmpupohipoc/mace-1.2.0.tar.Z
    swh-loader_1 | [2021-06-11 12:33:59,357: DEBUG/ForkPoolWorker-1] extrinsic_metadata
    swh-loader_1 | tar: /tmp/tmpupohipoc/src: Cannot open: No such file or directory
    ...
    • Jun 11 2021, 2:41 PM
    • 39 Lines
  • swh  tony  yavin4  ~  work  …  swh  swh-environment  swh-icinga-plugins   master  2✔  ERROR  %  pre-commit run --all-files
    Trim Trailing Whitespace.................................................Passed
    Check JSON...........................................(no files to check)Skipped
    Check Yaml...............................................................Passed
    flake8...................................................................Passed
    ...
    • Jun 9 2021, 10:37 AM
    • 42 Lines
  • explain analyze
    with Y as
    (
    with X as
    (
    ...
    • Jun 8 2021, 3:54 PM
    • 45 Lines
  • explain analyze
    select R.sha1 as rev, R.date as date, X.sha1 as cnt, DL.path as prefix, CL.path as path
    from (
    select C.sha1, unnest(dirs) as dir, unnest(locs) as loc from C_D
    inner join content as C on (C.id=C_D.cnt)
    ...
    • Jun 8 2021, 3:40 PM
    • 45 Lines
  • 2725005 softw...cheduler swhscheduler 192.168.100.210/ 99.7 20.0 0.00B 0.00B 917:49.58 N N active select * from swh_scheduler_grab_ready_tasks( 'list-debian-distribution', '2021-06-06T16:31:13
    136390+00:00'::timestamptz, 5000 :: bigint)
    • Jun 7 2021, 9:50 AM
    • 2 Lines
  • $ pip3 install --user --upgrade git+https://github.com/python/mypy.git
    [...]
    Successfully installed mypy-0.820+dev.28718facbeea5b3c33ec96bc335bb018d3b0a395
    ...
    • Jun 4 2021, 12:53 PM
    • 52 Lines
  • swhscheduler@saatchi:~$ swh scheduler --config-file /etc/softwareheritage/scheduler/backend.yml task-type register
    ...
    INFO:swh.scheduler.cli.task_type:Loading entrypoint for plugin loader.mercurial
    INFO:swh.scheduler.cli.task_type:Loading entrypoint for plugin loader.mercurial_from_disk
    WARNING:swh.scheduler.cli.task_type:Existing task type load-hg for module swh.loader.mercurial.tasks_from_disk has a different backend name than current code version provides (swh.loader.mercurial.tasks.LoadMercurial vs. swh.loader.mercurial.tasks_from_disk.LoadMercurialFromDisk)
    ...
    • Jun 4 2021, 12:05 PM
    • 7 Lines
  • 1000000050 53519b5a5e8cf12a4f81f82e489f95c1d04d5314 R06
    R06 | | | R 53519b5a5e8cf12a4f81f82e489f95c1d04d5314 | 1000000050
    | R---C | A/B/c | C fa08654474ae2ddc4f61ee3a43d017ba65a439c3 | 0
    | R-D | A/B/C | D c9cabe7f49012e3fdef6ac6b929efb5654f583cf | -40 <===\
    | D-C | + a | C 20329687bb9c1231a7e05afe86160343ad49b494 | -50 |-- note these!
    ...
    • Jun 4 2021, 9:35 AM
    • 6 Lines
  • # try this first
    get_storage(cls="postgresql", db=<psycopg2 connection instance>, objstorage={"cls": "memory"})
    # ïf that doesn't work, something like the following should work
    ...
    • Jun 2 2021, 2:04 PM
    • 7 Lines
    • Python
  • file /home/jayesh/swh-environment/swh-web/swh/web/tests/common/test_origin_save.py, line 435
    @pytest.mark.django_db
    @pytest.mark.parametrize("visit_status", ["created", "ongoing",])
    def test_get_save_origin_requests_no_visit_date_found(mocker, visit_status):
    file /home/jayesh/swh-environment/swh-web/swh/web/tests/common/test_origin_save.py, line 52
    ...
    • Jun 2 2021, 10:35 AM
    • 25 Lines
  • storage:
    cls: remote
    # url: http://localhost:5002/
    # url: http://storage0.internal.staging.swh.network:5002
    url: http://saam.internal.softwareheritage.org:5002/
    ...
    • Jun 1 2021, 1:53 PM
    • 96 Lines
    • YAML
  • ---
    version: '2'
    services:
    swh-lister:
    volumes:
    ...
    • May 31 2021, 2:05 PM
    • 6 Lines
    • YAML
  • $ git clone https://github.com/buszczynska/systems_biology
    Cloning into 'systems_biology'...
    remote: Enumerating objects: 101, done.
    remote: Total 101 (delta 0), reused 0 (delta 0), pack-reused 101
    Receiving objects: 100% (101/101), 214.62 KiB | 2.98 MiB/s, done.
    ...
    • May 31 2021, 10:59 AM
    • 17 Lines
  • -[ RECORD 59 ]---+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    datid | 99085638
    datname | softwareheritage
    pid | 479899
    leader_pid |
    ...
    • May 26 2021, 3:16 PM
    • 38 Lines
  • $ swh deposit list --url http://deposit.staging.swh.network/1 \
    --username swh \
    --password $(swhpass ls operations/deposit.softwareheritage.org/http-auth/swh | head -1) \
    --format json | jq .
    WARNING:swh.core.cli:Could not load subcommand scanner: swh-scanner
    ...
    • May 25 2021, 5:47 PM
    • 997 Lines
  • May 24 10:21:08 worker0 python3[1746909]: [2021-05-24 10:21:08,531: INFO/MainProcess] Received task: swh.loader.mercurial.tasks.LoadMercurial[2f2eaa71-0415-4a7b-9647-02f930b727f4]
    May 24 10:21:08 worker0 python3[1746920]: [2021-05-24 10:21:08,665: INFO/ForkPoolWorker-1] Load origin 'https://foss.heptapod.net/mercurial/hgview' with type 'hg'
    May 24 10:21:10 worker0 python3[1747220]: requesting all changes
    May 24 10:21:10 worker0 python3[1747220]: adding changesets
    May 24 10:21:10 worker0 python3[1747220]: adding manifests
    ...
    • May 24 2021, 1:00 PM
    • 23 Lines
  • ```
    > select * from origin_visit_status where origin=(select id from origin where url='https://bitbucket.org/pbui/weaver') order by origin,visit,date;
    origin │ visit │ date │ status │ metadata │ snapshot │ type
    ────────┼───────┼───────────────────────────────┼─────────┼──────────┼────────────────────────────────────────────┼──────
    694079 │ 1 │ 2020-07-15 11:39:31+00 │ created │ ∅ │ ∅ │ hg
    ...
    • May 21 2021, 6:44 PM
    • 69 Lines
  • CREATE AGGREGATE my_aggregate(int)
    SFUNC my_row_function
    STYPE tuple<int, bigint>
    FINALFUNC my_final_function
    ...
    • May 18 2021, 3:03 PM
    • 6 Lines
    • SQL
  • from swh.objstorage.factory import get_objstorage
    import yaml
    config = yaml.load(open("../swh-vault/vault.yml"))["objstorage"]
    objstorage = get_objstorage(**config)
    for _ in range(1000):
    ...
    • May 18 2021, 11:04 AM
    • 17 Lines
    • Python
  • from swh.objstorage.factory import get_objstorage
    import yaml
    config = yaml.load(open("../swh-vault/vault.yml"))["objstorage"]
    objstorage = get_objstorage(**config)
    for _ in range(1000):
    ...
    • May 18 2021, 11:04 AM
    • 17 Lines
    • Python
  • puppetdb::params::listen_address: 0.0.0.0
    puppetdb::params::listen_port: 8080
    puppetdb::params::ssl_listen_address: 0.0.0.0
    puppetdb::params::ssl_listen_port: 8081
    puppetdb::params::puppetdb_user: puppetdb
    ...
    • May 17 2021, 4:57 PM
    • 18 Lines
  • def get(self, obj_id):
    """Retrieve blob's content if found.
    """
    hex_obj_id = self._internal_id(obj_id)
    ...
    • May 17 2021, 1:43 PM
    • 37 Lines
    • Python
  • /opt/kafka/bin/kafka-consumer-groups.sh --bootstrap-server $SERVER -describe --group swh-douardda-privileged-test-mirror-003 | grep swh.journal.objects.directory | awk '{print $6}' | paste -sd+ | bc
    52788770
    • May 12 2021, 9:50 AM
    • 2 Lines
  • diff --git a/assets/src/bundles/save/index.js b/assets/src/bundles/save/index.js
    index 9d8bed44..2d42ba27 100644
    --- a/assets/src/bundles/save/index.js
    +++ b/assets/src/bundles/save/index.js
    @@ -50,26 +50,19 @@ export function maybeRequireExtraInputs() {
    ...
    • May 11 2021, 4:07 PM
    • 55 Lines
  •  ddouard  (e) swh   master … 2  ~/s/s/swh-provenance  mypy swh
    swh/provenance/provenance.py:297: error: Argument 1 to "add_child" of "IsochroneNode" has incompatible type "FileEntry"; expected "DirectoryEntry"
    swh/provenance/provenance.py:313: error: Incompatible types in assignment (expression has type "IsochroneNode", variable has type "Union[DirectoryEntry, FileEntry]")
    swh/provenance/provenance.py:314: error: Item "DirectoryEntry" of "Union[DirectoryEntry, FileEntry]" has no attribute "entry"
    swh/provenance/provenance.py:314: error: Item "FileEntry" of "Union[DirectoryEntry, FileEntry]" has no attribute "entry"
    ...
    • May 11 2021, 12:30 PM
    • 17 Lines
  • swh-graph-replayer-revision_3 | 2021-05-10T14:36:07.253273260Z INFO:swh.storage.tenacious:revision_add: failed to insert a batch of 200 revision objects, splitting
    swh-graph-replayer-revision_3 | 2021-05-10T14:36:07.282621939Z INFO:swh.storage.tenacious:revision_add: failed to insert a batch of 100 revision objects, splitting
    swh-graph-replayer-revision_3 | 2021-05-10T14:36:08.266450539Z INFO:swh.storage.tenacious:revision_add: failed to insert a batch of 50 revision objects, splitting
    swh-graph-replayer-revision_3 | 2021-05-10T14:36:09.948651782Z INFO:swh.storage.tenacious:revision_add: failed to insert a batch of 25 revision objects, splitting
    swh-graph-replayer-revision_3 | 2021-05-10T14:36:10.204954906Z INFO:swh.storage.tenacious:revision_add: failed to insert a batch of 13 revision objects, splitting
    ...
    • May 10 2021, 5:43 PM
    • 28 Lines
  • 251 5 https://inria.halpreprod.archives-ouvertes.fr/hal-01243573 {"atom:id": "hal-01243573", "atom:author": {"atom:name": "HAL", "atom:email": "hal@ccsd.cnrs.fr"}, "atom:client": "hal", "codemeta:url": "http://halv3-local.ccsd.cnrs.fr/hal-01243573", "codemeta:name": "The assignment problem", "codemeta:author": {"codemeta:name": null}, "codemeta:license": {"codemeta:name": "GNU General Public License v3.0 or later"}, "codemeta:version": "1", "atom:create-origin": "hal-01243573", "codemeta:identifier": [{"@name": "0", "@xmlns": {"": "http://www.w3.org/2005/Atom", "codemeta": "https://doi.org/10.5063/SCHEMA/CODEMETA-2.0"}}, {"@name": "1"}], "codemeta:contributor": "Administrateur Du Ccsd", "codemeta:dateCreated": "2015-06-01", "codemeta:description": "Project in OR: The assignment problem A java implementation for the assignment problem first release", "codemeta:relatedLink": "https://www.gnu.org/software/glpk/", "codemeta:dateModified": "2017-12-21", "codemeta:datePublished": "2017-11-16", "codemeta:codeRepository": "https://github.com/moranegg/AffectationRO", "atom:external_identifier": "hal-01243573", "codemeta:operatingSystem": "debian", "codemeta:runtimePlatform": "outil", "codemeta:softwareVersion": "1.0.0", "codemeta:developmentStatus": "etat", "codemeta:applicationCategory": ["info", "info.info-ro"], "codemeta:programmingLanguage": ["java", "AMPL"], "codemeta:referencePublication": "hal-01587083"} <?xml version="1.0" encoding="utf-8"?>\n<entry xmlns="http://www.w3.org/2005/Atom" xmlns:codemeta="https://doi.org/10.5063/SCHEMA/CODEMETA-2.0">\n <client>hal</client>\n <id>hal-01243573</id>\n <external_identifier>hal-01243573</external_identifier>\n <create-origin>hal-01243573</create-origin>\n <author>\n <name>HAL</name>\n <email>hal@ccsd.cnrs.fr</email>\n </author>\n <codemeta:name>The assignment problem</codemeta:name>\n <codemeta:description>Project in OR: The assignment problem A java implementation for the assignment problem first release</codemeta:description>\n <codemeta:dateCreated>2015-06-01</codemeta:dateCreated>\n <codemeta:datePublished>2017-11-16</codemeta:datePublished>\n <codemeta:license>\n <codemeta:name>GNU General Public License v3.0 or later</codemeta:name>\n </codemeta:license>\n <codemeta:url>http://halv3-local.ccsd.cnrs.fr/hal-01243573</codemeta:url>\n <codemeta:identifier name="0"/>\n <codemeta:identifier name="1"/>\n <codemeta:applicationCategory>info</codemeta:applicationCategory>\n <codemeta:applicationCategory>info.info-ro</codemeta:applicationCategory>\n <codemeta:codeRepository>https://github.com/moranegg/AffectationRO</codemeta:codeRepository>\n <codemeta:relatedLink>https://www.gnu.org/software/glpk/</codemeta:relatedLink>\n <codemeta:programmingLanguage>java</codemeta:programmingLanguage>\n <codemeta:programmingLanguage>AMPL</codemeta:programmingLanguage>\n <codemeta:runtimePlatform>outil</codemeta:runtimePlatform>\n <codemeta:operatingSystem>debian</codemeta:operatingSystem>\n <codemeta:version>1</codemeta:version>\n <codemeta:softwareVersion>1.0.0</codemeta:softwareVersion>\n <codemeta:dateModified>2017-12-21</codemeta:dateModified>\n <codemeta:developmentStatus>etat</codemeta:developmentStatus>\n <codemeta:referencePublication>hal-01587083</codemeta:referencePublication>\n <codemeta:author>\n <codemeta:name> </codemeta:name>\n </codemeta:author>\n <codemeta:contributor>Administrateur Du Ccsd</codemeta:contributor>\n</entry>\n
    250 5 https://inria.halpreprod.archives-ouvertes.fr/hal-01243573 {"atom:id": "hal-01243573", "atom:author": {"atom:name": "HAL", "atom:email": "hal@ccsd.cnrs.fr"}, "atom:client": "hal", "codemeta:url": "http://halv3-local.ccsd.cnrs.fr/hal-01243573", "codemeta:name": "The assignment problem", "codemeta:author": {"codemeta:name": null}, "codemeta:license": {"codemeta:name": "GNU General Public License v3.0 or later"}, "codemeta:version": "1", "atom:create-origin": "hal-01243573", "codemeta:identifier": [{"@name": "0", "@xmlns": {"": "http://www.w3.org/2005/Atom", "codemeta": "https://doi.org/10.5063/SCHEMA/CODEMETA-2.0"}}, {"@name": "1"}], "codemeta:contributor": "Administrateur Du Ccsd", "codemeta:dateCreated": "2015-06-01", "codemeta:description": "Project in OR: The assignment problem A java implementation for the assignment problem first release", "codemeta:relatedLink": "https://www.gnu.org/software/glpk/", "codemeta:dateModified": "2017-12-21", "codemeta:datePublished": "2017-11-16", "codemeta:codeRepository": "https://github.com/moranegg/AffectationRO", "atom:external_identifier": "hal-01243573", "codemeta:operatingSystem": "debian", "codemeta:runtimePlatform": "outil", "codemeta:softwareVersion": "1.0.0", "codemeta:developmentStatus": "etat", "codemeta:applicationCategory": ["info", "info.info-ro"], "codemeta:programmingLanguage": ["java", "AMPL"], "codemeta:referencePublication": "hal-01587083"} <?xml version="1.0" encoding="utf-8"?>\n<entry xmlns="http://www.w3.org/2005/Atom" xmlns:codemeta="https://doi.org/10.5063/SCHEMA/CODEMETA-2.0">\n <client>hal</client>\n <id>hal-01243573</id>\n <external_identifier>hal-01243573</external_identifier>\n <create-origin>hal-01243573</create-origin>\n <author>\n <name>HAL</name>\n <email>hal@ccsd.cnrs.fr</email>\n </author>\n <codemeta:name>The assignment problem</codemeta:name>\n <codemeta:description>Project in OR: The assignment problem A java implementation for the assignment problem first release</codemeta:description>\n <codemeta:dateCreated>2015-06-01</codemeta:dateCreated>\n <codemeta:datePublished>2017-11-16</codemeta:datePublished>\n <codemeta:license>\n <codemeta:name>GNU General Public License v3.0 or later</codemeta:name>\n </codemeta:license>\n <codemeta:url>http://halv3-local.ccsd.cnrs.fr/hal-01243573</codemeta:url>\n <codemeta:identifier name="0"/>\n <codemeta:identifier name="1"/>\n <codemeta:applicationCategory>info</codemeta:applicationCategory>\n <codemeta:applicationCategory>info.info-ro</codemeta:applicationCategory>\n <codemeta:codeRepository>https://github.com/moranegg/AffectationRO</codemeta:codeRepository>\n <codemeta:relatedLink>https://www.gnu.org/software/glpk/</codemeta:relatedLink>\n <codemeta:programmingLanguage>java</codemeta:programmingLanguage>\n <codemeta:programmingLanguage>AMPL</codemeta:programmingLanguage>\n <codemeta:runtimePlatform>outil</codemeta:runtimePlatform>\n <codemeta:operatingSystem>debian</codemeta:operatingSystem>\n <codemeta:version>1</codemeta:version>\n <codemeta:softwareVersion>1.0.0</codemeta:softwareVersion>\n <codemeta:dateModified>2017-12-21</codemeta:dateModified>\n <codemeta:developmentStatus>etat</codemeta:developmentStatus>\n <codemeta:referencePublication>hal-01587083</codemeta:referencePublication>\n <codemeta:author>\n <codemeta:name> </codemeta:name>\n </codemeta:author>\n <codemeta:contributor>Administrateur Du Ccsd</codemeta:contributor>\n</entry>\n
    249 5 https://inria.halpreprod.archives-ouvertes.fr/hal-01243573 {"atom:id": "hal-01243573", "atom:author": {"atom:name": "HAL", "atom:email": "hal@ccsd.cnrs.fr"}, "atom:client": "hal", "codemeta:url": "http://halv3-local.ccsd.cnrs.fr/hal-01243573", "codemeta:name": "The assignment problem", "codemeta:author": {"codemeta:name": null}, "codemeta:license": {"codemeta:name": "GNU General Public License v3.0 or later"}, "codemeta:version": "1", "atom:create-origin": "hal-01243573", "codemeta:identifier": [{"@name": "0", "@xmlns": {"": "http://www.w3.org/2005/Atom", "codemeta": "https://doi.org/10.5063/SCHEMA/CODEMETA-2.0"}}, {"@name": "1"}], "codemeta:contributor": "Administrateur Du Ccsd", "codemeta:dateCreated": "2015-06-01", "codemeta:description": "Project in OR: The assignment problem A java implementation for the assignment problem first release", "codemeta:relatedLink": "https://www.gnu.org/software/glpk/", "codemeta:dateModified": "2017-12-21", "codemeta:datePublished": "2017-11-16", "codemeta:codeRepository": "https://github.com/moranegg/AffectationRO", "atom:external_identifier": "hal-01243573", "codemeta:operatingSystem": "debian", "codemeta:runtimePlatform": "outil", "codemeta:softwareVersion": "1.0.0", "codemeta:developmentStatus": "etat", "codemeta:applicationCategory": ["info", "info.info-ro"], "codemeta:programmingLanguage": ["java", "AMPL"], "codemeta:referencePublication": "hal-01587083"} <?xml version="1.0" encoding="utf-8"?>\n<entry xmlns="http://www.w3.org/2005/Atom" xmlns:codemeta="https://doi.org/10.5063/SCHEMA/CODEMETA-2.0">\n <client>hal</client>\n <id>hal-01243573</id>\n <external_identifier>hal-01243573</external_identifier>\n <create-origin>hal-01243573</create-origin>\n <author>\n <name>HAL</name>\n <email>hal@ccsd.cnrs.fr</email>\n </author>\n <codemeta:name>The assignment problem</codemeta:name>\n <codemeta:description>Project in OR: The assignment problem A java implementation for the assignment problem first release</codemeta:description>\n <codemeta:dateCreated>2015-06-01</codemeta:dateCreated>\n <codemeta:datePublished>2017-11-16</codemeta:datePublished>\n <codemeta:license>\n <codemeta:name>GNU General Public License v3.0 or later</codemeta:name>\n </codemeta:license>\n <codemeta:url>http://halv3-local.ccsd.cnrs.fr/hal-01243573</codemeta:url>\n <codemeta:identifier name="0"/>\n <codemeta:identifier name="1"/>\n <codemeta:applicationCategory>info</codemeta:applicationCategory>\n <codemeta:applicationCategory>info.info-ro</codemeta:applicationCategory>\n <codemeta:codeRepository>https://github.com/moranegg/AffectationRO</codemeta:codeRepository>\n <codemeta:relatedLink>https://www.gnu.org/software/glpk/</codemeta:relatedLink>\n <codemeta:programmingLanguage>java</codemeta:programmingLanguage>\n <codemeta:programmingLanguage>AMPL</codemeta:programmingLanguage>\n <codemeta:runtimePlatform>outil</codemeta:runtimePlatform>\n <codemeta:operatingSystem>debian</codemeta:operatingSystem>\n <codemeta:version>1</codemeta:version>\n <codemeta:softwareVersion>1.0.0</codemeta:softwareVersion>\n <codemeta:dateModified>2017-12-21</codemeta:dateModified>\n <codemeta:developmentStatus>etat</codemeta:developmentStatus>\n <codemeta:referencePublication>hal-01587083</codemeta:referencePublication>\n <codemeta:author>\n <codemeta:name> </codemeta:name>\n </codemeta:author>\n <codemeta:contributor>Administrateur Du Ccsd</codemeta:contributor>\n</entry>\n
    248 5 https://inria.halpreprod.archives-ouvertes.fr/hal-01243573 {"atom:id": "hal-01243573", "atom:author": {"atom:name": "HAL", "atom:email": "hal@ccsd.cnrs.fr"}, "atom:client": "hal", "codemeta:url": "http://halv3-local.ccsd.cnrs.fr/hal-01243573", "codemeta:name": "The assignment problem", "codemeta:author": {"codemeta:name": null}, "codemeta:license": {"codemeta:name": "GNU General Public License v3.0 or later"}, "codemeta:version": "1", "atom:create-origin": "hal-01243573", "codemeta:identifier": [{"@name": "0", "@xmlns": {"": "http://www.w3.org/2005/Atom", "codemeta": "https://doi.org/10.5063/SCHEMA/CODEMETA-2.0"}}, {"@name": "1"}], "codemeta:contributor": "Administrateur Du Ccsd", "codemeta:dateCreated": "2015-06-01", "codemeta:description": "Project in OR: The assignment problem A java implementation for the assignment problem first release", "codemeta:relatedLink": "https://www.gnu.org/software/glpk/", "codemeta:dateModified": "2017-12-21", "codemeta:datePublished": "2017-11-16", "codemeta:codeRepository": "https://github.com/moranegg/AffectationRO", "atom:external_identifier": "hal-01243573", "codemeta:operatingSystem": "debian", "codemeta:runtimePlatform": "outil", "codemeta:softwareVersion": "1.0.0", "codemeta:developmentStatus": "etat", "codemeta:applicationCategory": ["info", "info.info-ro"], "codemeta:programmingLanguage": ["java", "AMPL"], "codemeta:referencePublication": "hal-01587083"} <?xml version="1.0" encoding="utf-8"?>\n<entry xmlns="http://www.w3.org/2005/Atom" xmlns:codemeta="https://doi.org/10.5063/SCHEMA/CODEMETA-2.0">\n <client>hal</client>\n <id>hal-01243573</id>\n <external_identifier>hal-01243573</external_identifier>\n <create-origin>hal-01243573</create-origin>\n <author>\n <name>HAL</name>\n <email>hal@ccsd.cnrs.fr</email>\n </author>\n <codemeta:name>The assignment problem</codemeta:name>\n <codemeta:description>Project in OR: The assignment problem A java implementation for the assignment problem first release</codemeta:description>\n <codemeta:dateCreated>2015-06-01</codemeta:dateCreated>\n <codemeta:datePublished>2017-11-16</codemeta:datePublished>\n <codemeta:license>\n <codemeta:name>GNU General Public License v3.0 or later</codemeta:name>\n </codemeta:license>\n <codemeta:url>http://halv3-local.ccsd.cnrs.fr/hal-01243573</codemeta:url>\n <codemeta:identifier name="0"/>\n <codemeta:identifier name="1"/>\n <codemeta:applicationCategory>info</codemeta:applicationCategory>\n <codemeta:applicationCategory>info.info-ro</codemeta:applicationCategory>\n <codemeta:codeRepository>https://github.com/moranegg/AffectationRO</codemeta:codeRepository>\n <codemeta:relatedLink>https://www.gnu.org/software/glpk/</codemeta:relatedLink>\n <codemeta:programmingLanguage>java</codemeta:programmingLanguage>\n <codemeta:programmingLanguage>AMPL</codemeta:programmingLanguage>\n <codemeta:runtimePlatform>outil</codemeta:runtimePlatform>\n <codemeta:operatingSystem>debian</codemeta:operatingSystem>\n <codemeta:version>1</codemeta:version>\n <codemeta:softwareVersion>1.0.0</codemeta:softwareVersion>\n <codemeta:dateModified>2017-12-21</codemeta:dateModified>\n <codemeta:developmentStatus>etat</codemeta:developmentStatus>\n <codemeta:referencePublication>hal-01587083</codemeta:referencePublication>\n <codemeta:author>\n <codemeta:name> </codemeta:name>\n </codemeta:author>\n <codemeta:contributor>Administrateur Du Ccsd</codemeta:contributor>\n</entry>\n
    246 5 https://inria.halpreprod.archives-ouvertes.fr/hal-01243573 {"atom:id": "hal-01243573", "atom:author": {"atom:name": "HAL", "atom:email": "hal@ccsd.cnrs.fr"}, "atom:client": "hal", "codemeta:url": "http://halv3-local.ccsd.cnrs.fr/hal-01243573", "codemeta:name": "The assignment problem", "codemeta:author": {"codemeta:name": null}, "codemeta:license": {"codemeta:name": "GNU General Public License v3.0 or later"}, "codemeta:version": "1", "atom:create-origin": "hal-01243573", "codemeta:identifier": [{"@name": "0", "@xmlns": {"": "http://www.w3.org/2005/Atom", "codemeta": "https://doi.org/10.5063/SCHEMA/CODEMETA-2.0"}}, {"@name": "1"}], "codemeta:contributor": "Administrateur Du Ccsd", "codemeta:dateCreated": "2015-06-01", "codemeta:description": "Project in OR: The assignment problem A java implementation for the assignment problem first release", "codemeta:relatedLink": "https://www.gnu.org/software/glpk/", "codemeta:dateModified": "2017-12-21", "codemeta:datePublished": "2017-11-16", "codemeta:codeRepository": "https://github.com/moranegg/AffectationRO", "atom:external_identifier": "hal-01243573", "codemeta:operatingSystem": "debian", "codemeta:runtimePlatform": "outil", "codemeta:softwareVersion": "1.0.0", "codemeta:developmentStatus": "etat", "codemeta:applicationCategory": ["info", "info.info-ro"], "codemeta:programmingLanguage": ["java", "AMPL"], "codemeta:referencePublication": "hal-01587083"} <?xml version="1.0" encoding="utf-8"?>\n<entry xmlns="http://www.w3.org/2005/Atom" xmlns:codemeta="https://doi.org/10.5063/SCHEMA/CODEMETA-2.0">\n <client>hal</client>\n <id>hal-01243573</id>\n <external_identifier>hal-01243573</external_identifier>\n <create-origin>hal-01243573</create-origin>\n <author>\n <name>HAL</name>\n <email>hal@ccsd.cnrs.fr</email>\n </author>\n <codemeta:name>The assignment problem</codemeta:name>\n <codemeta:description>Project in OR: The assignment problem A java implementation for the assignment problem first release</codemeta:description>\n <codemeta:dateCreated>2015-06-01</codemeta:dateCreated>\n <codemeta:datePublished>2017-11-16</codemeta:datePublished>\n <codemeta:license>\n <codemeta:name>GNU General Public License v3.0 or later</codemeta:name>\n </codemeta:license>\n <codemeta:url>http://halv3-local.ccsd.cnrs.fr/hal-01243573</codemeta:url>\n <codemeta:identifier name="0"/>\n <codemeta:identifier name="1"/>\n <codemeta:applicationCategory>info</codemeta:applicationCategory>\n <codemeta:applicationCategory>info.info-ro</codemeta:applicationCategory>\n <codemeta:codeRepository>https://github.com/moranegg/AffectationRO</codemeta:codeRepository>\n <codemeta:relatedLink>https://www.gnu.org/software/glpk/</codemeta:relatedLink>\n <codemeta:programmingLanguage>java</codemeta:programmingLanguage>\n <codemeta:programmingLanguage>AMPL</codemeta:programmingLanguage>\n <codemeta:runtimePlatform>outil</codemeta:runtimePlatform>\n <codemeta:operatingSystem>debian</codemeta:operatingSystem>\n <codemeta:version>1</codemeta:version>\n <codemeta:softwareVersion>1.0.0</codemeta:softwareVersion>\n <codemeta:dateModified>2017-12-21</codemeta:dateModified>\n <codemeta:developmentStatus>etat</codemeta:developmentStatus>\n <codemeta:referencePublication>hal-01587083</codemeta:referencePublication>\n <codemeta:author>\n <codemeta:name> </codemeta:name>\n </codemeta:author>\n <codemeta:contributor>Administrateur Du Ccsd</codemeta:contributor>\n</entry>\n
    ...
    • May 6 2021, 2:39 PM
    • 100 Lines
  • 100644 150739631316
    40000 68197352326
    100755 4558750275
    160000 949276565
    120000 926827576
    ...
    • May 5 2021, 4:15 PM
    • 44 Lines
  • diff --git a/swh/web/settings/common.py b/swh/web/settings/common.py
    index d61949b6..c28bbcce 100644
    --- a/swh/web/settings/common.py
    +++ b/swh/web/settings/common.py
    @@ -58,7 +58,7 @@
    ...
    • May 5 2021, 3:07 PM
    • 31 Lines
  • swh-web_1 | [05/May/2021 09:00:06] [DEBUG] urllib3.connectionpool._make_request:461 - http://swh-scheduler:5008 "POST /task_run/get HTTP/1.1" 200 170
    swh-web_1 | [05/May/2021 09:00:06] [DEBUG] Traceback (most recent call last):
    swh-web_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/rest_framework/views.py", line 506, in dispatch
    swh-web_1 | response = handler(request, *args, **kwargs)
    swh-web_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/rest_framework/decorators.py", line 50, in handler
    ...
    • May 5 2021, 11:19 AM
    • 40 Lines
  • swh-graph-replayer_9 | INFO:swh.storage.tenacious:directory_add: failed to insert a batch of 200 directory objects, splitting
    swh-graph-replayer_9 | INFO:swh.storage.tenacious:Exception was duplicate key value violates unique constraint "directory_entry_dir_target_name_perms_idx"
    swh-graph-replayer_9 | DETAIL: Key (target, name, perms)=(\x12808630a3f448546d7ff22104f18cee070da608, \x617373657473, 16384) already exists.
    swh-graph-replayer_9 | CONTEXT: SQL statement "
    swh-graph-replayer_9 | insert into directory_entry_dir (target, name, perms)
    ...
    • May 5 2021, 10:05 AM
    • 16 Lines
  • (swh) ✔ ~/swh/swh-environment/docker [master|⚑ 9]
    11:55 $ doco exec swh-loader swh loader run nixguix "https://guix.gnu.org/sources.json"
    INFO:swh.loader.package.nixguix.loader:Skip source '{'type': 'git', 'git_url': 'https://github.com/pali/0xffff', 'git_ref': '0.8'}' because key 'urls' is missing
    INFO:swh.loader.package.nixguix.loader:Skip source '{'type': 'git', 'git_url': 'https://github.com/pali/0xffff', 'git_ref': '0.8'}' because key 'integrity' is missing
    INFO:swh.loader.package.nixguix.loader:Skip source '{'type': 'git', 'git_url': 'https://github.com/4store/4store', 'git_ref': 'v1.1.6'}' because key 'urls' is missing
    ...
    • May 4 2021, 2:42 PM
    • 15,795 Lines
  • Python 3.7.3 (default, Jul 25 2020, 13:03:44)
    [GCC 8.3.0] on linux
    Type "help", "copyright", "credits" or "license" for more information.
    >>> import requests
    >>> requests.head("git://git.zx2c4.com/cgit.git")
    ...
    • May 3 2021, 11:15 AM
    • 21 Lines
  • WARNING: autodoc: failed to import module 'logger' from module 'swh.core'; the following exception was raised:
    No module named 'systemd'
    /home/jenkins/workspace/DDOC/publish/swh-docs/.tox/sphinx/lib/python3.7/site-packages/swh/fuse/fs/artifact.py:docstring of swh.fuse.fs.artifact.Content.swhid:1: WARNING: duplicate object description of swh.fuse.fs.artifact.Content.swhid, other instance in apidoc/swh.fuse.fs.artifact, use :noindex: for one of them
    /home/jenkins/workspace/DDOC/publish/swh-docs/.tox/sphinx/lib/python3.7/site-packages/swh/fuse/fs/artifact.py:docstring of swh.fuse.fs.artifact.Content.prefetch:1: WARNING: duplicate object description of swh.fuse.fs.artifact.Content.prefetch, other instance in apidoc/swh.fuse.fs.artifact, use :noindex: for one of them
    /home/jenkins/workspace/DDOC/publish/swh-docs/.tox/sphinx/lib/python3.7/site-packages/swh/fuse/fs/artifact.py:docstring of swh.fuse.fs.artifact.Directory.swhid:1: WARNING: duplicate object description of swh.fuse.fs.artifact.Directory.swhid, other instance in apidoc/swh.fuse.fs.artifact, use :noindex: for one of them
    ...
    • Apr 29 2021, 3:20 PM
    • 14 Lines
  • diff --git a/docker/services/swh-web/entrypoint.sh b/docker/services/swh-web/entrypoint.sh
    index 2d0ef86..9fb843f 100755
    --- a/docker/services/swh-web/entrypoint.sh
    +++ b/docker/services/swh-web/entrypoint.sh
    @@ -46,6 +46,16 @@ case "$1" in
    ...
    • Apr 28 2021, 6:20 PM
    • 21 Lines
  • #!/usr/bin/env python3
    # Copyright (C) 2020-2021 The Software Heritage developers
    # See the AUTHORS file at the top-level directory of this distribution
    # License: GNU Affero General Public License version 3, or any later version
    ...
    • Apr 28 2021, 4:25 PM
    • 27 Lines
  • $ docker run -it debian
    root@44dd2ec7f1fa:/# apt update ; apt install whois; mkpasswd --method=sha-512
    Get:1 http://security.debian.org/debian-security buster/updates InRelease [65.4 kB]
    Get:2 http://deb.debian.org/debian buster InRelease [121 kB]
    Get:3 http://deb.debian.org/debian buster-updates InRelease [51.9 kB]
    ...
    • Apr 28 2021, 1:11 PM
    • 31 Lines
  •  ddouard  (e) swh   fixer ✚ 1 … 6  ~/s/s/swh-storage  1  pytest --doctest-modules swh/storage/fixer.py
    ===================================== test session starts ======================================
    platform linux -- Python 3.9.2, pytest-6.1.2, py-1.9.0, pluggy-0.13.1
    rootdir: /home/ddouard/swh/swh-environment/swh-storage, configfile: pytest.ini
    plugins: dash-1.18.1, postgresql-2.5.2, asyncio-0.14.0, django-4.1.0, requests-mock-1.8.0, forked-1.3.0, mock-3.3.1, xdist-2.1.0, hypothesis-6.4.3, flask-1.1.0, swh.core-0.12.1.dev3+g189ca1f, swh.journal-0.7.2.dev4+g056c210
    ...
    • Apr 28 2021, 12:34 PM
    • 62 Lines
  •  ddouard  (e) swh   fixer ✚ 1 … 6  ~/s/s/swh-storage  pytest --doctest-modules -k fix_raw_extrinsic_metadata swh
    ===================================== test session starts ======================================
    platform linux -- Python 3.9.2, pytest-6.1.2, py-1.9.0, pluggy-0.13.1
    rootdir: /home/ddouard/swh/swh-environment/swh-storage, configfile: pytest.ini
    plugins: dash-1.18.1, postgresql-2.5.2, asyncio-0.14.0, django-4.1.0, requests-mock-1.8.0, forked-1.3.0, mock-3.3.1, xdist-2.1.0, hypothesis-6.4.3, flask-1.1.0, swh.core-0.12.1.dev3+g189ca1f, swh.journal-0.7.2.dev4+g056c210
    ...
    • Apr 28 2021, 12:27 PM
    • 30 Lines
  • 12:20:10 Expected:
    12:20:10 {
    12:20:10 'target': 'swh:1:dir:460a586d1c95d120811eaadb398d534e019b5243',
    12:20:10 }
    12:20:10 Got:
    ...
    • Apr 28 2021, 12:23 PM
    • 6 Lines
  • ReferenceError
    The following error originated from your test code, not from Cypress.
    > formatValuePerType is not defined
    ...
    • Apr 28 2021, 10:24 AM
    • 34 Lines
  • <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en">
    <head>
    <style>
    .first {
    background: red;
    ...
    • Apr 28 2021, 12:07 AM
    • 20 Lines
    • HTML
  • bootstrap.servers=broker1.journal.softwareheritage.org:9093,broker2.journal.softwareheritage.org:9093,broker3.journal.softwareheritage.org:9093,broker4.journal.softwareheritage.org:9093
    sasl.mechanism=SCRAM-SHA-512
    security.protocol=SASL_SSL
    sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \
    username="USERNAME" \
    ...
    • Apr 27 2021, 5:32 PM
    • 6 Lines
  • #!/usr/bin/env python3
    # Copyright (C) 2021 The Software Heritage developers
    # See the AUTHORS file at the top-level directory of this distribution
    # License: GNU General Public License version 3, or any later version
    ...
    • Apr 27 2021, 3:25 PM
    • 94 Lines
    • Python
  • 09:54:09 + tox -a
    09:54:09 + grep -qx sphinx
    09:54:09 Traceback (most recent call last):
    09:54:09 File "/usr/bin/tox", line 11, in <module>
    09:54:09 load_entry_point('tox==3.7.0', 'console_scripts', 'tox')()
    ...
    • Apr 27 2021, 11:55 AM
    • 144 Lines
  • swh-web_1 | 172.21.0.14 - - [27/Apr/2021:08:06:46 +0000] "GET /metrics/prometheus/ HTTP/1.1" 200 359 "-" "Prometheus/2.23.0"
    prometheus_1 | level=warn ts=2021-04-27T08:06:46.788Z caller=scrape.go:1378 component="scrape manager" scrape_pool=swh-web-exporter target=http://swh-web:5004/metrics/prometheus/ msg="Error on ingesting samples that are too old or are too far into the future" num_dropped=33
    prometheus_1 | level=warn ts=2021-04-27T08:06:46.788Z caller=scrape.go:1145 component="scrape manager" scrape_pool=swh-web-exporter target=http://swh-web:5004/metrics/prometheus/ msg="Append failed" err="out of bounds"
    prometheus_1 | level=warn ts=2021-04-27T08:06:46.789Z caller=scrape.go:1094 component="scrape manager" scrape_pool=swh-web-exporter target=http://swh-web:5004/metrics/prometheus/ msg="Appending scrape report failed" err="out of bounds"
    prometheus_1 | level=warn ts=2021-04-27T08:06:51.298Z caller=scrape.go:1094 component="scrape manager" scrape_pool=swh-counters-exporter target=http://swh-counters:5011/metrics msg="Appending scrape report failed" err="out of bounds"
    ...
    • Apr 27 2021, 10:08 AM
    • 31 Lines
  • swh-web_1 | DEPRECATION: A future pip version will change local packages to be built in-place without first copying to a temporary directory. We recommend you use --use-feature=in-tree-build to test your packages with this new behavior before it becomes the default.
    • Apr 26 2021, 5:21 PM
    • 1 Line
  • Not working:
    ```
    kubectl exec -ti deployment/webapp -- bash
    + LOCAL_CMD=/usr/local/bin/kubectl
    + '[' -f /usr/local/bin/kubectl ']'
    ...
    • Apr 26 2021, 3:05 PM
    • 28 Lines
  • storage:
    cls: local
    db: dbname=softwareheritage-dev
    objstorage:
    cls: memory
    ...
    • Apr 26 2021, 11:30 AM
    • 6 Lines
    • YAML
  • ---
    storage:
    cls: pipeline
    steps:
    - cls: buffer
    ...
    • Apr 26 2021, 11:19 AM
    • 14 Lines
  • In [1]: from swh.storage.tests import storage_data as sd
    In [2]: set(sd.StorageData.git_revisions)
    ---------------------------------------------------------------------------
    TypeError Traceback (most recent call last)
    <ipython-input-11-45b8523ac10c> in <module>
    ...
    • Apr 22 2021, 5:37 PM
    • 22 Lines
  • (Pdb) p self
    Revision(message=b'hello', author=Person(fullname=b'Nicolas Dandrimont <nicolas@example.com> ', name=b'Nicolas Dandrimont', email=b'nicolas@example.com'), committer=Person(fullname=b'St\xc3fano Zacchiroli <stefano@example.com>', name=b'St\xc3fano Zacchiroli', email=b'stefano@example.com'), date=TimestampWithTimezone(timestamp=Timestamp(seconds=1234567890, microseconds=0), offset=120, negative_utc=False), committer_date=TimestampWithTimezone(timestamp=Timestamp(seconds=1123456789, microseconds=0), offset=120, negative_utc=False), type=<RevisionType.GIT: 'git'>, directory=b'RV\xe8V\xa0\xa0\x89\x89f\xd6\xba\x14\xfe\xb48\x8b\x8b\x82\xd3\x02', synthetic=True, metadata=ImmutableDict({'checksums': {'sha1': 'tarball-sha1', 'sha256': 'tarball-sha256'}, 'signed-off-by': 'some-dude'}), parents=(), id=b'\x01\xa7\x11O6\xfd\xdd^\xf2Q\x1b,\xad\xda#zh\xad\xbb\x12', extra_headers=((b'gpgsig', b'test123'), (b'mergetag', b'foo\\bar'), (b'mergetag', b'"\xaf\x89\x80\x01\x00')))
    (Pdb) p set([self])
    *** TypeError...
    • Apr 22 2021, 5:33 PM
    • 4 Lines
  • diff --git a/swh/web/tests/api/views/test_origin_save.py b/swh/web/tests/api/views/test_origin_save.py
    index f4a5cc33..b565ed89 100644
    --- a/swh/web/tests/api/views/test_origin_save.py
    +++ b/swh/web/tests/api/views/test_origin_save.py
    @@ -21,6 +21,7 @@ from swh.web.common.models import (
    ...
    • Apr 22 2021, 3:18 PM
    • 19 Lines
  • #!/usr/bin/env bash
    usage() {
    echo "Usage: $0 [-b|--build] [-u|--upload] [-d|--distribution <all|unstable|stable>] SWH_PACKAGE"
    echo "E.g.: make-package -b swh-core"
    ...
    • Apr 22 2021, 11:59 AM
    • 131 Lines
    • Bash Scripting
  • journal_client:
    cls: kafka
    brokers:
    - broker0.journal.staging.swh.network:9093
    sasl.username: swh-douardda
    ...
    • Apr 21 2021, 10:27 AM
    • 12 Lines