This:
- Aligns all tests to use `json` format output so the outputassertion check is simpler
simpler (no tampering with caplog record)
- Simplify the failure cases tocaplog record assertion check the caplog recordin failure scenarios
- Drop dead code
- Rename tests with a `test_cli_` prefix so it's simpler to run them separately from
the rest