Page MenuHomeSoftware Heritage

Remove now useless revision date checker in fixer
ClosedPublic

Authored by douardda on Oct 27 2021, 6:22 PM.

Diff Detail

Repository
rDSTO Storage manager
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

Build has FAILED

Patch application report for D6570 (id=23872)

Could not rebase; Attempt merge onto 49a932c989...

Updating 49a932c9..b44a1eea
Fast-forward
 swh/storage/cli.py   | 14 ++++++++++-
 swh/storage/fixer.py | 68 +++-------------------------------------------------
 2 files changed, 16 insertions(+), 66 deletions(-)
Changes applied before test
commit b44a1eea08f081cef2d5ddb3663403b1f8cd4ed8
Author: David Douard <david.douard@sdfa3.org>
Date:   Wed Oct 27 16:55:03 2021 +0200

    Remove now useless revision date checker in fixer

commit 74dbb2b0b148750de272f2f1a523c72b6b2e1365
Author: David Douard <david.douard@sdfa3.org>
Date:   Tue Oct 26 16:38:26 2021 +0200

    Add a --type option to 'swh storage replay'
    
    allows to choose replayed object types from the cli.

Link to build: https://jenkins.softwareheritage.org/job/DSTO/job/tests-on-diff/1464/
See console output for more information: https://jenkins.softwareheritage.org/job/DSTO/job/tests-on-diff/1464/console

Harbormaster returned this revision to the author for changes because remote builds failed.Oct 27 2021, 6:23 PM
Harbormaster failed remote builds in B24754: Diff 23872!
douardda retitled this revision from Remove now useless revision date checker in fixer Depends on D6569. to Remove now useless revision date checker in fixer.
douardda edited the summary of this revision. (Show Details)

rebase

Build is green

Patch application report for D6570 (id=23880)

Could not rebase; Attempt merge onto 49a932c989...

Updating 49a932c9..693acf27
Fast-forward
 swh/storage/cli.py   | 14 ++++++++++-
 swh/storage/fixer.py | 68 +++-------------------------------------------------
 2 files changed, 16 insertions(+), 66 deletions(-)
Changes applied before test
commit 693acf2760117d1a5f04a1143721662c903d1276
Author: David Douard <david.douard@sdfa3.org>
Date:   Wed Oct 27 16:55:03 2021 +0200

    Remove now useless revision date checker in fixer

commit 04ba5910d53c8e9eb55a4bc2396840f9a47a5ac5
Author: David Douard <david.douard@sdfa3.org>
Date:   Tue Oct 26 16:38:26 2021 +0200

    Add a --type option to 'swh storage replay'
    
    allows to choose replayed object types from the cli.

See https://jenkins.softwareheritage.org/job/DSTO/job/tests-on-diff/1468/ for more details.

A small description to mention why it's now useless would be great.

You checked on the whole journal, right?

While we're here, could you check whether the other fixers are really still needed too?

You checked on the whole journal, right?

not yet. The shouldn't be any left, but... I'll check as soon as I have credentials for the production kafka cluster.

In D6570#170941, @olasd wrote:

While we're here, could you check whether the other fixers are really still needed too?

good thinking, will do

You checked on the whole journal, right?

not yet. The shouldn't be any left, but... I'll check as soon as I have credentials for the production kafka cluster.

SO yes I did check and found no revision concerned by either _check_revision_date, _fix_revision_pypi_empty_string nor _fix_revision_transplant_source

This revision is now accepted and ready to land.Nov 4 2021, 10:44 AM

Build is green

Patch application report for D6570 (id=24037)

Could not rebase; Attempt merge onto a5bfe5b514...

Merge made by the 'recursive' strategy.
 swh/storage/cli.py            |  31 ++++-
 swh/storage/fixer.py          | 290 ++----------------------------------------
 swh/storage/tests/test_cli.py |  14 ++
 3 files changed, 56 insertions(+), 279 deletions(-)
Changes applied before test
commit 110788b3d58e7461cb06b73544d2c57f47177699
Merge: a5bfe5b5 17282b47
Author: Jenkins user <jenkins@localhost>
Date:   Mon Nov 8 14:27:18 2021 +0000

    Merge branch 'diff-target' into HEAD

commit 17282b47287a8258f3dca66f54a865485548ccc4
Author: David Douard <david.douard@sdfa3.org>
Date:   Wed Oct 27 16:56:53 2021 +0200

    Refactor fixer.fix_objects() to extract the inner object_fixers dict
    
    allowing to use this dict independently of the fix_objects() function.

commit 5e8d18c2ec676448d02391b1fe96f1d24f328027
Author: David Douard <david.douard@sdfa3.org>
Date:   Wed Oct 27 16:55:03 2021 +0200

    Remove now useless fixers
    
    keep the the fix_objects() function for bw compat for now.

commit 627a8a82c6b5496a2d6aec416a359b8bb360c124
Author: David Douard <david.douard@sdfa3.org>
Date:   Tue Oct 26 16:38:26 2021 +0200

    Add a --type option to 'swh storage replay'
    
    allows to choose replayed object types from the cli.

See https://jenkins.softwareheritage.org/job/DSTO/job/tests-on-diff/1481/ for more details.

Build has FAILED

Patch application report for D6570 (id=24086)

Could not rebase; Attempt merge onto 0262f1c191...

Updating 0262f1c1..04bd15a0
Fast-forward
 swh/storage/cli.py            |  31 ++++-
 swh/storage/fixer.py          | 290 ++----------------------------------------
 swh/storage/tests/test_cli.py |  14 ++
 3 files changed, 56 insertions(+), 279 deletions(-)
Changes applied before test
commit 04bd15a0bca87fc21139ffdccd322b5e17fa959e
Author: David Douard <david.douard@sdfa3.org>
Date:   Wed Oct 27 16:56:53 2021 +0200

    Refactor fixer.fix_objects() to extract the inner object_fixers dict
    
    allowing to use this dict independently of the fix_objects() function.

commit d655c8581d3c3a522ba083ee309157c4786e2de0
Author: David Douard <david.douard@sdfa3.org>
Date:   Wed Oct 27 16:55:03 2021 +0200

    Remove now useless fixers
    
    keep the the fix_objects() function for bw compat for now.

commit 55eed77b519c4c3fc22b95554afa3343e013a253
Author: David Douard <david.douard@sdfa3.org>
Date:   Tue Oct 26 16:38:26 2021 +0200

    Add a --type option to 'swh storage replay'
    
    allows to choose replayed object types from the cli.

Link to build: https://jenkins.softwareheritage.org/job/DSTO/job/tests-on-diff/1487/
See console output for more information: https://jenkins.softwareheritage.org/job/DSTO/job/tests-on-diff/1487/console

Build was aborted

Patch application report for D6570 (id=24086)

Could not rebase; Attempt merge onto 0262f1c191...

Updating 0262f1c1..04bd15a0
Fast-forward
 swh/storage/cli.py            |  31 ++++-
 swh/storage/fixer.py          | 290 ++----------------------------------------
 swh/storage/tests/test_cli.py |  14 ++
 3 files changed, 56 insertions(+), 279 deletions(-)
Changes applied before test
commit 04bd15a0bca87fc21139ffdccd322b5e17fa959e
Author: David Douard <david.douard@sdfa3.org>
Date:   Wed Oct 27 16:56:53 2021 +0200

    Refactor fixer.fix_objects() to extract the inner object_fixers dict
    
    allowing to use this dict independently of the fix_objects() function.

commit d655c8581d3c3a522ba083ee309157c4786e2de0
Author: David Douard <david.douard@sdfa3.org>
Date:   Wed Oct 27 16:55:03 2021 +0200

    Remove now useless fixers
    
    keep the the fix_objects() function for bw compat for now.

commit 55eed77b519c4c3fc22b95554afa3343e013a253
Author: David Douard <david.douard@sdfa3.org>
Date:   Tue Oct 26 16:38:26 2021 +0200

    Add a --type option to 'swh storage replay'
    
    allows to choose replayed object types from the cli.

Link to build: https://jenkins.softwareheritage.org/job/DSTO/job/tests-on-diff/1489/
See console output for more information: https://jenkins.softwareheritage.org/job/DSTO/job/tests-on-diff/1489/console

Build is green

Patch application report for D6570 (id=24086)

Could not rebase; Attempt merge onto 0262f1c191...

Updating 0262f1c1..04bd15a0
Fast-forward
 swh/storage/cli.py            |  31 ++++-
 swh/storage/fixer.py          | 290 ++----------------------------------------
 swh/storage/tests/test_cli.py |  14 ++
 3 files changed, 56 insertions(+), 279 deletions(-)
Changes applied before test
commit 04bd15a0bca87fc21139ffdccd322b5e17fa959e
Author: David Douard <david.douard@sdfa3.org>
Date:   Wed Oct 27 16:56:53 2021 +0200

    Refactor fixer.fix_objects() to extract the inner object_fixers dict
    
    allowing to use this dict independently of the fix_objects() function.

commit d655c8581d3c3a522ba083ee309157c4786e2de0
Author: David Douard <david.douard@sdfa3.org>
Date:   Wed Oct 27 16:55:03 2021 +0200

    Remove now useless fixers
    
    keep the the fix_objects() function for bw compat for now.

commit 55eed77b519c4c3fc22b95554afa3343e013a253
Author: David Douard <david.douard@sdfa3.org>
Date:   Tue Oct 26 16:38:26 2021 +0200

    Add a --type option to 'swh storage replay'
    
    allows to choose replayed object types from the cli.

See https://jenkins.softwareheritage.org/job/DSTO/job/tests-on-diff/1490/ for more details.