Details

Reviewers

olasd

Group Reviewers

Reviewers

Maniphest Tasks

T3782: Drop tasks archival service

Commits

rDSCHa8edbdbb0071: Clean up disabled scheduler archival task related services

Summary

This is dead code now as this has long been stopped and disabled in production.

Note:
Also, it was probably not that well tested (and the coverage peek we have with
this diff seems to approve)

Related to T3782

Test Plan

tox (should be happy)

Diff Detail

Repository

rDSCH Scheduling utilities

Branch

master

Lint

No Linters Available

Unit

No Unit Test Coverage

Build Status

Buildable 25443
Build 39777: Phabricator diff pipeline on jenkins	Jenkins console · Jenkins
Build 39776: arc lint + arc unit

Event Timeline

ardumont created this revision.Dec 7 2021, 2:37 PM

Herald added a reviewer: Reviewers. · View Herald TranscriptDec 7 2021, 2:37 PM

Build has FAILED

Patch application report for D6772 (id=24570)

Rebasing onto 0a6aac583a...

Current branch diff-target is up to date.

Changes applied before test

commit 4ca80a31e20c33146cd653535a37d9f28ddb8a5c
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Tue Dec 7 14:31:34 2021 +0100

    Clean up old ghtorrent scheduler related services
    
    This is dead code now as hhis has long been stopped and disabled in production.
    
    Related to T3777

Link to build: https://jenkins.softwareheritage.org/job/DSCH/job/tests-on-diff/498/
See console output for more information: https://jenkins.softwareheritage.org/job/DSCH/job/tests-on-diff/498/console

Harbormaster returned this revision to the author for changes because remote builds failed.Dec 7 2021, 2:38 PM

Harbormaster failed remote builds in B25442: Diff 24570!

Drop some more code

Build is green

Patch application report for D6772 (id=24571)

Rebasing onto 0a6aac583a...

Current branch diff-target is up to date.

Changes applied before test

commit de2ed04ec5e3293e6cc55cb31254ff1abfa2b692
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Tue Dec 7 14:31:34 2021 +0100

    Clean up old ghtorrent scheduler related services
    
    This is dead code now as hhis has long been stopped and disabled in production.
    
    Related to T3777

See https://jenkins.softwareheritage.org/job/DSCH/job/tests-on-diff/499/ for more details.

Harbormaster completed remote builds in B25443: Diff 24571.Dec 7 2021, 2:48 PM

ardumont requested review of this revision.Dec 7 2021, 2:48 PM

ardumont edited the summary of this revision. (Show Details)Dec 7 2021, 2:49 PM

Rebase

Build is green

Patch application report for D6772 (id=24606)

Rebasing onto 5de8ba42c2...

Current branch diff-target is up to date.

Changes applied before test

commit f0369228b933f76c5f70e6aef5cf59594f8bf9bb
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Tue Dec 7 14:31:34 2021 +0100

    Clean up old ghtorrent scheduler related services
    
    This is dead code now as hhis has long been stopped and disabled in production.
    
    Related to T3777

See https://jenkins.softwareheritage.org/job/DSCH/job/tests-on-diff/501/ for more details.

Harbormaster completed remote builds in B25466: Diff 24606.Dec 8 2021, 10:30 AM

Thank @olasd to make me realize it's not ghtorrent stuff (it's already been removed a while back), it's about the old task archival which got disabled as it was no longer running with decent time.

So, I think archiving old task entries is still something that we should want to do, but then again as this scheduler is slowly being phased out it may not be as critical as it used to be. Meh.

Aren't there some (test?) requirements that can be cleaned up now?

So, I think archiving old task entries is still something that we should want to do, but then again as this scheduler is slowly being phased out it may not be as critical as it used to be. Meh.

I agree.

Like i said in irc, given (in any order)

the somewhat complexity of the code
the poor coverage (of the time) and my lazyness to actually parse through it and improve the actual coverage
the fact that's not running.
what you said about this scheduler being phased out
you are neutral on the matter

I'd pretty much vote to drop that code.
That's less code to maintain or discover (with possibly questions which i probably no longer have answers for) for newcomers.

Aren't there some (test?) requirements that can be cleaned up now?

I'll double check.

You should be able to remove elasticsearch from requirements.txt

Amend commit
Drop no longer necessary requirement

You should be able to remove elasticsearch from requirements.txt

yes, done ;)

Build is green

Patch application report for D6772 (id=24613)

Rebasing onto 5de8ba42c2...

Current branch diff-target is up to date.

Changes applied before test

commit a8edbdbb00717f62e44ce87bfe6c1f698abfd728
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Tue Dec 7 14:31:34 2021 +0100

    Clean up disabled scheduler archival task related services
    
    This is dead code now as this has long been stopped and disabled in production.
    
    Related to T3777

See https://jenkins.softwareheritage.org/job/DSCH/job/tests-on-diff/502/ for more details.

Harbormaster completed remote builds in B25472: Diff 24613.Dec 8 2021, 11:17 AM

ardumont edited the summary of this revision. (Show Details)Dec 8 2021, 11:53 AM

ardumont removed a task: T3777: Cleanup old ghtorrent scheduler services.

olasd accepted this revision.Dec 9 2021, 10:33 AM

This revision is now accepted and ready to land.Dec 9 2021, 10:33 AM

ardumont edited the summary of this revision. (Show Details)Dec 9 2021, 10:52 AM

ardumont added a task: T3782: Drop tasks archival service.

Closed by commit rDSCHa8edbdbb0071: Clean up disabled scheduler archival task related services (authored by ardumont). · Explain WhyDec 9 2021, 11:06 AM

This revision was automatically updated to reflect the committed changes.

ardumont added a commit: rDSCHa8edbdbb0071: Clean up disabled scheduler archival task related services.