worker: Make worker less chatty
Related to [1]
https://sentry.softwareheritage.org/organizations/swh/issues/9767/activity/?project=8&query=is%3Aignored