HomeSoftware Heritage

add static/robots.txt, disabling crawling of /api/
0a84869862baUnpublished

Unpublished Commit · Learn More

Not On Permanent Ref: This commit is not an ancestor of any permanent ref.

Description

add static/robots.txt, disabling crawling of /api/

This is related to T662, but doesn't completely addresses it as we also need an
HTTP-level alias /robots.txt -> /static/robots.txt.

Details

Provenance
zackAuthored on Feb 1 2017, 12:55 PM
seirlPushed on Feb 6 2017, 6:10 PM
Parents
R65:fb0bf65356aa: API: simplify HTML layout by dropping redundant nav and about page
Branches
Unknown
Tags
Unknown