indexer: open drop/skip policy update on duplicates (language/mimetype)

This adds the optional conflict_update parameter which specifies what to
do when conflicts on sha1 occurs.

conflict_update by default is false which ignores duplicates.
Otherwise, conflich_update to true, overwrite existing data.

Related T582