User Details
User Details
- User Since
- Feb 11 2020, 6:04 PM (254 w, 6 d)
Sep 30 2022
Sep 30 2022
marmoute added a comment to T4590: swh-scanner - improve distribution, documentation and usability.
D8572 (patterns: adds a list of common patterns to exclude) should be attached to this task instead.
marmoute added a comment to T4592: swh-scanner - generic bug fixing, robustness and performance improvements.
https://forge.softwareheritage.org/D8571 is also relevant for this Task
marmoute committed rDMOD6a38c4ad047d: from_disks: fix some of the pattern checking logic (authored by marmoute).
from_disks: fix some of the pattern checking logic
Sep 29 2022
Sep 29 2022
marmoute updated the diff for D8571: from_disks: fix some of the pattern checking logic.
fixed typos
marmoute added a comment to D8571: from_disks: fix some of the pattern checking logic.
marmoute committed rDTSCN9a8258a7719a: login: automatically fetch a token through the API (authored by marmoute).
login: automatically fetch a token through the API
marmoute committed rDTSCN4aad6c17e8b3: scanner: add a `swh scanner login` command (authored by Alphare).
scanner: add a `swh scanner login` command
marmoute committed rDTSCNee788b24bcd0: scanner: issue a warning when no auth token exists (authored by marmoute).
scanner: issue a warning when no auth token exists
marmoute updated the diff for D8555: Add a warning and a command to help user to login.
rebase on the new master
marmoute committed rDTSCN5f3140ab75da: client: add an option to display http debug information (authored by marmoute).
client: add an option to display http debug information
marmoute committed rDTSCN11b13ce99119: client: add some basic error detection and rate limiting (authored by marmoute).
client: add some basic error detection and rate limiting
client: prepare for retry
marmoute committed rDTSCNa17846cda5b5: client: transforme the swhid to string earlier (authored by marmoute).
client: transforme the swhid to string earlier
marmoute committed rDTSCN038e7b9454e7: client: compute the client endpoin once and ealier (authored by marmoute).
client: compute the client endpoin once and ealier
marmoute committed rDTSCNc44df1c8ecfb: client: move `make_request` to be a method (authored by marmoute).
client: move `make_request` to be a method
client: reorder some conditionnal
marmoute committed rDTSCN5293bbe477f7: client: extract the `get_chunk` closure (authored by marmoute).
client: extract the `get_chunk` closure
marmoute updated the diff for D8541: Make HTTP requests more resilient.
rebase on master
marmoute committed rDTSCN4363c9a9e307: patterns: adds a list of common patterns to exclude (authored by marmoute).
patterns: adds a list of common patterns to exclude
marmoute updated the diff for D8572: patterns: adds a list of common patterns to exclude.
added the TODO comment suggested by ardumont
marmoute added a comment to D8572: patterns: adds a list of common patterns to exclude.
Sep 28 2022
Sep 28 2022
marmoute requested review of D8571: from_disks: fix some of the pattern checking logic.
marmoute requested review of D8572: patterns: adds a list of common patterns to exclude.
marmoute updated the diff for D8541: Make HTTP requests more resilient.
use the logging module instead of a print
marmoute updated the diff for D8555: Add a warning and a command to help user to login.
rebased on the new master.
marmoute committed rDTSCNf4f091776951: output: pick "summary" as the default (authored by marmoute).
output: pick "summary" as the default
output: add a "summary" output
marmoute committed rDTSCN821873a03541: scan: start documenting the --output-format option better (authored by marmoute).
scan: start documenting the --output-format option better
marmoute committed rDTSCNb3b8ca5f0f57: scan: use the current directory as the default the target directory (authored by marmoute).
scan: use the current directory as the default the target directory
marmoute updated the diff for D8555: Add a warning and a command to help user to login.
- login: automatically fetch a token through the API
marmoute requested review of D8555: Add a warning and a command to help user to login.
marmoute updated the diff for D8541: Make HTTP requests more resilient.
- client: add an option to display http debug information
marmoute updated the diff for D8540: Various user Experience improvement:.
- ran black
marmoute updated the diff for D8540: Various user Experience improvement:.
gathered relevant string as poitned by valentin
Sep 27 2022
Sep 27 2022
marmoute added inline comments to D8540: Various user Experience improvement:.
marmoute requested review of D8541: Make HTTP requests more resilient.
marmoute updated the diff for D8540: Various user Experience improvement:.
fix some commit
marmoute retitled D8540: Various user Experience improvement: from Various user Experience improvement:
- using a default directory to be scanned `$PWD`
- document the --output-format value and meaning
- add a "summary" output and use it the default.
Check individual commit messag for default:
---
scan: use... to Various user Experience improvement:.
marmoute requested review of D8540: Various user Experience improvement:.
Sep 26 2022
Sep 26 2022
marmoute committed rDMOD2d65a24a5f41: model: inline the call to `_check_swhid` (authored by marmoute).
model: inline the call to `_check_swhid`
marmoute committed rDMOD3608271a0aaa: model: optimization pass on custom validator (authored by marmoute).
model: optimization pass on custom validator
model: remove the try/except
model: delete unused validator code
marmoute committed rDMODcf529cd1622e: model: also optimize combined validator (authored by marmoute).
model: also optimize combined validator
marmoute committed rDMODedb57fb15359: model: implement specialized attribute-validator functions (authored by marmoute).
model: implement specialized attribute-validator functions
marmoute committed rDMOD6ababdebb749: model: drop the `type_validator()` indirection (authored by marmoute).
model: drop the `type_validator()` indirection
marmoute committed rDMOD1dfea3247702: model: prepare the filtering of type_validator into something faster (authored by marmoute).
model: prepare the filtering of type_validator into something faster
marmoute committed rDMODa2e8f18c2a68: from_disk: skip intermediate dictionnary creation when building model (authored by marmoute).
from_disk: skip intermediate dictionnary creation when building model
marmoute committed rDMODad3ecac9beae: model: avoid another extra creation of Model object (authored by marmoute).
model: avoid another extra creation of Model object
marmoute committed rDMOD814a6c8416d5: from_disk: only build a model object once (authored by marmoute).
from_disk: only build a model object once
Sep 23 2022
Sep 23 2022
marmoute updated the diff for D8512: various optimisation to the model validation logic..
batch-update
marmoute updated the diff for D8525: from_disk: skip intermediate dictionnary creation when building model.
batch-update
marmoute updated the diff for D8527: model: avoid another extra creation of Model object.
batch-update
marmoute updated the diff for D8510: from_disk: only build a model object once.
batch-update
marmoute added inline comments to D8512: various optimisation to the model validation logic..
marmoute added a comment to D8525: from_disk: skip intermediate dictionnary creation when building model.
marmoute added a reviewer for D8512: various optimisation to the model validation logic.: Reviewers.
marmoute retitled D8512: various optimisation to the model validation logic. from model: prepare the filtering of type_validator into something faster to various optimisation to the model validation logic..
marmoute retitled D8525: from_disk: skip intermediate dictionnary creation when building model from model: skip intermediate dictionnary creation when building model to from_disk: skip intermediate dictionnary creation when building model.
marmoute updated the summary of D8527: model: avoid another extra creation of Model object.
marmoute retitled D8527: model: avoid another extra creation of Model object from avoid another extra creation of Model object to model: avoid another extra creation of Model object.
marmoute updated the summary of D8510: from_disk: only build a model object once.
marmoute updated the diff for D8512: various optimisation to the model validation logic..
batch-update
marmoute updated the diff for D8525: from_disk: skip intermediate dictionnary creation when building model.
batch-update
marmoute updated the diff for D8527: model: avoid another extra creation of Model object.
batch-update
marmoute updated the diff for D8510: from_disk: only build a model object once.
batch-update
marmoute planned changes to D8512: various optimisation to the model validation logic..
I am in the process to adding more timing/profile data to the commit message (then to fight to get phabricator to display them)
marmoute planned changes to D8525: from_disk: skip intermediate dictionnary creation when building model.
I am in the process to adding more timing/profile data to the commit message (then to fight to get phabricator to display them)
marmoute planned changes to D8527: model: avoid another extra creation of Model object.
I am in the process to adding more timing/profile data to the commit message (then to fight to get phabricator to display them)
marmoute added a comment to D8510: from_disk: only build a model object once.
I have updated the commit message with more timing data, but I am not sure how to get phabricator to reflect that.
marmoute updated the diff for D8512: various optimisation to the model validation logic..
batch-update
marmoute updated the diff for D8525: from_disk: skip intermediate dictionnary creation when building model.
batch-update
marmoute updated the diff for D8527: model: avoid another extra creation of Model object.
batch-update
marmoute updated the diff for D8510: from_disk: only build a model object once.
batch-update
marmoute updated the diff for D8512: various optimisation to the model validation logic..
- model: prepare the filtering of type_validator into something faster
- model: implement specialized attribute-validator functions
- model: drop the type_validator() indirection
- model: also optimize combined validator
- model: remove the try/except
- model: delete unused code dead code
- model: optimization pass on custom validator
- model: inline _check_swhid
marmoute updated the diff for D8525: from_disk: skip intermediate dictionnary creation when building model.
testing update of diff
marmoute updated the diff for D8527: model: avoid another extra creation of Model object.
testing update of diff
marmoute updated the diff for D8510: from_disk: only build a model object once.
testing update of diff
marmoute requested review of D8527: model: avoid another extra creation of Model object.
marmoute requested review of D8525: from_disk: skip intermediate dictionnary creation when building model.
Sep 22 2022
Sep 22 2022
marmoute updated the diff for D8512: various optimisation to the model validation logic..
- model: inline _check_swhid
marmoute updated the diff for D8512: various optimisation to the model validation logic..
- model: optimization pass on custom validator
marmoute added a comment to D8512: various optimisation to the model validation logic..
The individual commit should be fairly clean. I'll provides some timing or profile soon™
marmoute updated the diff for D8512: various optimisation to the model validation logic..
- model: remove the try/except
- model: delete unused code dead code
Sep 20 2022
Sep 20 2022
marmoute requested review of D8512: various optimisation to the model validation logic..
marmoute requested review of D8510: from_disk: only build a model object once.
May 13 2022
May 13 2022
marmoute added a comment to T4239: Unstuck bitbucket incremental lister.
Our initial contact (Erik von Zijst) is no longer there, but you can try pinging other who were part of the discussion :
- TJ Kells <tkells@atlassian.com>
- Daniel Tao <dtao@atlassian.com>
- Ming Gong <mgong@atlassian.com>
- Tom Kane <tkane@atlassian.com>