HomeSoftware Heritage

Add support for limited row numbers in ORC files

Description

Add support for limited row numbers in ORC files

Make it possible to specify a maximum number of rows a table can store
in a single ORC file. The limit can only be set on main tables for now
(i.e. cannot be specified for tables like revision_history or
directory_entry).

This can be set by configuration only (no extra cli options).

Details

Provenance
douarddaAuthored on Mar 23 2022, 4:35 PM
douarddaPushed on Mar 30 2022, 11:34 AM
Differential Revision
D7461: Add support for limited row numbers in ORC files
Parents
rDDATASETfd3f9aa61de3: Add the raw_manifest column for revision, release and directory ORC files
Branches
Unknown
Tags
Unknown
Build Status
Buildable 28001
Build 43855: test-and-buildJenkins console · Jenkins