HomeSoftware Heritage

add static/robots.txt, disabling crawling of /api/

Description

add static/robots.txt, disabling crawling of /api/

This is related to T662, but doesn't completely addresses it as we also need an
HTTP-level alias /robots.txt -> /static/robots.txt.

Details

Provenance
zackAuthored on Feb 1 2017, 12:55 PM
zackPushed on Feb 1 2017, 12:57 PM
Parents
rDWAPPSfb0bf65356aa: API: simplify HTML layout by dropping redundant nav and about page
Branches
Loading...
Tags
Loading...