Details

Reviewers

anlambert

Group Reviewers

Reviewers

Maniphest Tasks

T3154: sysadm docs: Move relevant and public doc from intranet to swh-docs

Commits

rDDOCe6b0c5010ca5: Migrate the dns setup page into its own page

Summary

This moves the dns setup out of the networking page into its own section.
That also fixes and updates the /etc/hosts inlined [2] (which will be redirected to that
new page as well).

It's currently in the same page which describes the network configuration [1]. And i'm
having a hard time deciding whether i want to migrate that one or not. So i keep an
easier path and move that one part instead.

[1] https://intranet.softwareheritage.org/wiki/Network_configuration#Dns_servers

[2] https://intranet.softwareheritage.org/wiki/Network_configuration/etc/hosts

Related to T3154

Test Plan

make -C sysadm html

Diff Detail

Repository

rDSCH Scheduling utilities

Branch

bootstrap-scheduler-cog-recurrent-visits

Lint

No Linters Available

Unit

No Unit Test Coverage

Build Status

Buildable 24750
Build 38637: Phabricator diff pipeline on jenkins	Jenkins console · Jenkins
Build 38636: arc lint + arc unit

Event Timeline

ardumont created this revision.Oct 27 2021, 5:55 PM

Herald added a reviewer: Reviewers. · View Herald TranscriptOct 27 2021, 5:55 PM

ardumont edited the summary of this revision. (Show Details)Oct 27 2021, 5:55 PM

ardumont edited the summary of this revision. (Show Details)Oct 27 2021, 5:57 PM

ardumont edited the summary of this revision. (Show Details)

Fix vpn link

Build is green

Patch application report for D6568 (id=23866)

Rebasing onto c7efdcff90...

Current branch diff-target is up to date.

Changes applied before test

commit dc22b26dc12e5eed6f26af23cbe17275c8d9b0a8
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Wed Oct 27 17:52:56 2021 +0200

    Migrate the dns setup page into its own page
    
    This moves the dns setup out of the networking page into its own section.
    
    Related to T3154

See https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/28/ for more details.

Harbormaster completed remote builds in B24748: Diff 23866.Oct 27 2021, 6:05 PM

Build is green

Patch application report for D6568 (id=23867)

Rebasing onto c7efdcff90...

Current branch diff-target is up to date.

Changes applied before test

commit e6b0c5010ca50a6ea44ae86b98c931e5f69ce09a
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Wed Oct 27 17:52:56 2021 +0200

    Migrate the dns setup page into its own page
    
    This moves the dns setup out of the networking page into its own section.
    
    Related to T3154

See https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/29/ for more details.

Harbormaster completed remote builds in B24749: Diff 23867.Oct 27 2021, 6:12 PM

ardumont requested review of this revision.Oct 27 2021, 6:12 PM

Ensure the spawn does at least instantiate the build_app without crashing.

Update the diff

Build is green

Patch application report for D6568 (id=23868)

Rebasing onto 0c7ef27b7e...

First, rewinding head to replay your work on top of it...
Applying: Add a new cli endpoint to schedule recurrent visits in Celery

Changes applied before test

commit 4adf5f9928c87f8a2287a74ad4e1c928b9266f76
Author: Nicolas Dandrimont <nicolas@dandrimont.eu>
Date:   Wed Oct 27 12:09:42 2021 +0200

    Add a new cli endpoint to schedule recurrent visits in Celery
    
    For each known visit type, we run a loop which:
     - monitors the size of the relevant celery queue
     - schedules more visits of the relevant type once the number of
     available slots goes over a given threshold (currently set to 5% of the
     max queue size).
    
    The scheduling of visits combines multiple scheduling policies, for now
    using static ratios set in the `POLICY_RATIOS` dict. We emit a warning
    if the ratio of origins fetched for each policy is skewed with respect
    to the original request (allowing, for now, manual adjustement of the
    ratios).
    
    The CLI endpoint spawns one thread for each visit type, which all handle
    connections to RabbitMQ and the scheduler backend separately. For now,
    we handle exceptions in the visit scheduling threads by (stupidly)
    respawning the relevant thread directly. We should probably improve this
    to give up after a specific number of tries.
    
    Co-authored-by: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>

See https://jenkins.softwareheritage.org/job/DSCH/job/tests-on-diff/487/ for more details.

Harbormaster completed remote builds in B24750: Diff 23868.Oct 27 2021, 6:20 PM

Build is green

Patch application report for D6568 (id=23870)

Rebasing onto c7efdcff90...

Current branch diff-target is up to date.

Changes applied before test

commit e6b0c5010ca50a6ea44ae86b98c931e5f69ce09a
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Wed Oct 27 17:52:56 2021 +0200

    Migrate the dns setup page into its own page
    
    This moves the dns setup out of the networking page into its own section.
    
    Related to T3154

See https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/30/ for more details.

Harbormaster completed remote builds in B24752: Diff 23870.Oct 27 2021, 6:30 PM

anlambert accepted this revision.Oct 27 2021, 6:48 PM

This revision is now accepted and ready to land.Oct 27 2021, 6:48 PM

Closed by commit rDDOCe6b0c5010ca5: Migrate the dns setup page into its own page (authored by ardumont). · Explain WhyOct 28 2021, 9:40 AM

This revision was automatically updated to reflect the committed changes.

ardumont added a commit: rDDOCe6b0c5010ca5: Migrate the dns setup page into its own page.

Migrate the dns setup page into its own page
ClosedPublic
Actions

Details

Diff Detail

Event Timeline

Patch application report for D6568 (id=23866)

Changes applied before test

Patch application report for D6568 (id=23867)

Changes applied before test

Patch application report for D6568 (id=23868)

Changes applied before test

Patch application report for D6568 (id=23870)

Changes applied before test

Revision Contents
Changeset List

Diff 23868

swh/scheduler/celery_backend/recurrent_visits.py

swh/scheduler/cli/admin.py

swh/scheduler/tests/conftest.py

swh/scheduler/tests/test_cli.py

swh/scheduler/tests/test_recurrent_visits.py

Migrate the dns setup page into its own pageClosedPublicActions

Details

Diff Detail

Event Timeline

Patch application report for D6568 (id=23866)

Changes applied before test

Patch application report for D6568 (id=23867)

Changes applied before test

Patch application report for D6568 (id=23868)

Changes applied before test

Patch application report for D6568 (id=23870)

Changes applied before test

Revision ContentsChangeset List

Diff 23868

swh/scheduler/celery_backend/recurrent_visits.py

swh/scheduler/cli/admin.py

swh/scheduler/tests/conftest.py

swh/scheduler/tests/test_cli.py

swh/scheduler/tests/test_recurrent_visits.py

Migrate the dns setup page into its own page
ClosedPublic
Actions

Revision Contents
Changeset List