Page MenuHomeSoftware Heritage
Differential D8910 Diff 32113 swh/graph/tests/dataset/compressed/logs/example-1669888203136-node_properties.log

Changeset View

Standalone View

View Options

swh/graph/tests/dataset/compressed/logs/example-1669888203136-node_properties.log

  • This file was added.
Starting compression step NODE_PROPERTIES at 2022-12-01 10:50:03.137042
Running: java org.softwareheritage.graph.compress.WriteNodeProperties swh/graph/tests/dataset/orc swh/graph/tests/dataset/compressed/example
Picked up JAVA_TOOL_OPTIONS: -Xmx30120409497 -XX:PretenureSizeThreshold=512M -XX:MaxNewSize=4G -XX:+UseLargePages -XX:+UseTransparentHugePages -XX:+UseNUMA -XX:+UseTLAB -XX:+ResizeTLAB -Dlogback.configurationFile=swh/graph/tests/dataset/compressed/tmp/logback.xml -Djava.io.tmpdir=swh/graph/tests/dataset/compressed/tmp
2022-12-01 10:50:03,374 164 INFO [main] o.s.g.c.WriteNodeProperties - Writing author/committer timestamps for release + revision
2022-12-01 10:50:03,500 290 WARN [main] o.a.h.u.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2022-12-01 10:50:03,637 427 INFO [main] o.a.o.i.ReaderImpl - Reading ORC rows from swh/graph/tests/dataset/orc/release/release-all.orc with {include: [false, true, false, false, false, false, false, true, true, false, false], offset: 0, length: 9223372036854775807, includeAcidColumns: true, allowSARGToFilter: false, useSelected: false}
2022-12-01 10:50:03,639 429 INFO [main] o.a.o.i.RecordReaderImpl - Reader schema not provided -- using file schema struct<id:string,name:binary,message:binary,target:string,target_type:string,author:binary,date:timestamp,date_offset:smallint,date_raw_offset_bytes:binary,raw_manifest:binary>
2022-12-01 10:50:03,672 462 INFO [main] o.a.o.i.ReaderImpl - Reading ORC rows from swh/graph/tests/dataset/orc/revision/revision-all.orc with {include: [false, true, false, false, true, true, false, false, false, false, false, false, false, false], offset: 0, length: 9223372036854775807, includeAcidColumns: true, allowSARGToFilter: false, useSelected: false}
2022-12-01 10:50:03,672 462 INFO [main] o.a.o.i.RecordReaderImpl - Reader schema not provided -- using file schema struct<id:string,message:binary,author:binary,date:timestamp,date_offset:smallint,date_raw_offset_bytes:binary,committer:binary,committer_date:timestamp,committer_offset:smallint,committer_date_raw_offset_bytes:binary,directory:string,type:string,raw_manifest:binary>
2022-12-01 10:50:03,689 479 INFO [main] o.a.o.i.ReaderImpl - Reading ORC rows from swh/graph/tests/dataset/orc/revision/revision-all.orc with {include: [false, true, false, false, false, false, false, false, true, true, false, false, false, false], offset: 0, length: 9223372036854775807, includeAcidColumns: true, allowSARGToFilter: false, useSelected: false}
2022-12-01 10:50:03,689 479 INFO [main] o.a.o.i.RecordReaderImpl - Reader schema not provided -- using file schema struct<id:string,message:binary,author:binary,date:timestamp,date_offset:smallint,date_raw_offset_bytes:binary,committer:binary,committer_date:timestamp,committer_offset:smallint,committer_date_raw_offset_bytes:binary,directory:string,type:string,raw_manifest:binary>
2022-12-01 10:50:03,693 483 INFO [main] o.s.g.c.WriteNodeProperties - Writing content lengths
2022-12-01 10:50:03,701 491 INFO [main] o.a.o.i.ReaderImpl - Reading ORC rows from swh/graph/tests/dataset/orc/content/content-all.orc with {include: [false, false, true, false, false, true, false, false], offset: 0, length: 9223372036854775807, includeAcidColumns: true, allowSARGToFilter: false, useSelected: false}
2022-12-01 10:50:03,701 491 INFO [main] o.a.o.i.RecordReaderImpl - Reader schema not provided -- using file schema struct<sha1:string,sha1_git:string,sha256:string,blake2s256:string,length:bigint,status:string,data:binary>
2022-12-01 10:50:03,712 502 INFO [main] o.a.o.i.ReaderImpl - Reading ORC rows from swh/graph/tests/dataset/orc/skipped_content/skipped_content-all.orc with {include: [false, false, true, false, false, true, false, false], offset: 0, length: 9223372036854775807, includeAcidColumns: true, allowSARGToFilter: false, useSelected: false}
2022-12-01 10:50:03,712 502 INFO [main] o.a.o.i.RecordReaderImpl - Reader schema not provided -- using file schema struct<sha1:string,sha1_git:string,sha256:string,blake2s256:string,length:bigint,status:string,reason:string>
2022-12-01 10:50:03,723 513 INFO [main] o.a.o.i.ReaderImpl - Reading ORC rows from swh/graph/tests/dataset/orc/skipped_content/skipped_content-all.orc with {include: [false, false, true, false, false, false, false, false], offset: 0, length: 9223372036854775807, includeAcidColumns: true, allowSARGToFilter: false, useSelected: false}
2022-12-01 10:50:03,723 513 INFO [main] o.a.o.i.RecordReaderImpl - Reader schema not provided -- using file schema struct<sha1:string,sha1_git:string,sha256:string,blake2s256:string,length:bigint,status:string,reason:string>
2022-12-01 10:50:03,726 516 INFO [main] o.s.g.c.WriteNodeProperties - Writing author/committer IDs for release + revision
2022-12-01 10:50:03,735 525 INFO [main] o.a.o.i.ReaderImpl - Reading ORC rows from swh/graph/tests/dataset/orc/release/release-all.orc with {include: [false, true, false, false, false, false, true, false, false, false, false], offset: 0, length: 9223372036854775807, includeAcidColumns: true, allowSARGToFilter: false, useSelected: false}
2022-12-01 10:50:03,735 525 INFO [main] o.a.o.i.RecordReaderImpl - Reader schema not provided -- using file schema struct<id:string,name:binary,message:binary,target:string,target_type:string,author:binary,date:timestamp,date_offset:smallint,date_raw_offset_bytes:binary,raw_manifest:binary>
2022-12-01 10:50:03,745 535 INFO [main] o.a.o.i.ReaderImpl - Reading ORC rows from swh/graph/tests/dataset/orc/revision/revision-all.orc with {include: [false, true, false, true, false, false, false, false, false, false, false, false, false, false], offset: 0, length: 9223372036854775807, includeAcidColumns: true, allowSARGToFilter: false, useSelected: false}
2022-12-01 10:50:03,745 535 INFO [main] o.a.o.i.RecordReaderImpl - Reader schema not provided -- using file schema struct<id:string,message:binary,author:binary,date:timestamp,date_offset:smallint,date_raw_offset_bytes:binary,committer:binary,committer_date:timestamp,committer_offset:smallint,committer_date_raw_offset_bytes:binary,directory:string,type:string,raw_manifest:binary>
2022-12-01 10:50:03,756 546 INFO [main] o.a.o.i.ReaderImpl - Reading ORC rows from swh/graph/tests/dataset/orc/revision/revision-all.orc with {include: [false, true, false, false, false, false, false, true, false, false, false, false, false, false], offset: 0, length: 9223372036854775807, includeAcidColumns: true, allowSARGToFilter: false, useSelected: false}
2022-12-01 10:50:03,756 546 INFO [main] o.a.o.i.RecordReaderImpl - Reader schema not provided -- using file schema struct<id:string,message:binary,author:binary,date:timestamp,date_offset:smallint,date_raw_offset_bytes:binary,committer:binary,committer_date:timestamp,committer_offset:smallint,committer_date_raw_offset_bytes:binary,directory:string,type:string,raw_manifest:binary>
2022-12-01 10:50:03,758 548 INFO [main] o.s.g.c.WriteNodeProperties - Writing messages for release + revision, and URLs for origins
2022-12-01 10:50:03,767 557 INFO [main] o.a.o.i.ReaderImpl - Reading ORC rows from swh/graph/tests/dataset/orc/release/release-all.orc with {include: [false, true, false, true, false, false, false, false, false, false, false], offset: 0, length: 9223372036854775807, includeAcidColumns: true, allowSARGToFilter: false, useSelected: false}
2022-12-01 10:50:03,767 557 INFO [main] o.a.o.i.RecordReaderImpl - Reader schema not provided -- using file schema struct<id:string,name:binary,message:binary,target:string,target_type:string,author:binary,date:timestamp,date_offset:smallint,date_raw_offset_bytes:binary,raw_manifest:binary>
2022-12-01 10:50:03,778 568 INFO [main] o.a.o.i.ReaderImpl - Reading ORC rows from swh/graph/tests/dataset/orc/revision/revision-all.orc with {include: [false, true, true, false, false, false, false, false, false, false, false, false, false, false], offset: 0, length: 9223372036854775807, includeAcidColumns: true, allowSARGToFilter: false, useSelected: false}
2022-12-01 10:50:03,778 568 INFO [main] o.a.o.i.RecordReaderImpl - Reader schema not provided -- using file schema struct<id:string,message:binary,author:binary,date:timestamp,date_offset:smallint,date_raw_offset_bytes:binary,committer:binary,committer_date:timestamp,committer_offset:smallint,committer_date_raw_offset_bytes:binary,directory:string,type:string,raw_manifest:binary>
2022-12-01 10:50:03,788 578 INFO [main] o.a.o.i.ReaderImpl - Reading ORC rows from swh/graph/tests/dataset/orc/origin/origin-all.orc with {include: [false, false, true], offset: 0, length: 9223372036854775807, includeAcidColumns: true, allowSARGToFilter: false, useSelected: false}
2022-12-01 10:50:03,788 578 INFO [main] o.a.o.i.RecordReaderImpl - Reader schema not provided -- using file schema struct<id:string,url:string>
2022-12-01 10:50:03,795 585 INFO [main] o.s.g.c.WriteNodeProperties - Writing tag names for release
2022-12-01 10:50:03,802 592 INFO [main] o.a.o.i.ReaderImpl - Reading ORC rows from swh/graph/tests/dataset/orc/release/release-all.orc with {include: [false, true, true, false, false, false, false, false, false, false, false], offset: 0, length: 9223372036854775807, includeAcidColumns: true, allowSARGToFilter: false, useSelected: false}
2022-12-01 10:50:03,802 592 INFO [main] o.a.o.i.RecordReaderImpl - Reader schema not provided -- using file schema struct<id:string,name:binary,message:binary,target:string,target_type:string,author:binary,date:timestamp,date_offset:smallint,date_raw_offset_bytes:binary,raw_manifest:binary>
Compression step NODE_PROPERTIES finished at 2022-12-01 10:50:03.830738 (in 0:00:00.693696)
About · Developer information · Legal