dcsimg

Import Log for iDigBio type specimen records

  • Started: January 22, 2022 22:03
  • Completed: 23:09:35
  • Failed: No.
  • Status: completed

Events (most recent first):

  • 23:09:35 (ends) Complete
  • 23:09:35 (ends) TOTAL TIME: 65.8m
  • 23:09:35 (starts) TraitBank::Denormalizer.update_resource_vernaculars
  • 23:09:35 (starts) Running
  • 23:09:32 (starts) Resource#fix_native_nodes
  • 23:09:32 (starts) Running
  • 23:09:32 (warns) Trait Publishing failed: At https://eol.org/data/tdfidbdt/publish_metadata_chunk_6.csv @ position 21004581 - there's a field starting with a quote and whereas it ends that quote there seems to be characters in that field after that ending quote. That isn't supported. This is what I read: 'Davis,W.J. ",,,,,,,,false OccurrenceMetadatum-48822636,R1091-PK249649312,http://rs.tdwg.org/dwc/terms/identifiedBy,"DD' FROM /usr/local/bundle/bundler/gems/neo4j-ruby-driver-fe5438fb945d/ffi/neo4j/driver/internal/handlers/response_handler.rb:38:in `check_summary_failure' << /app/lib/trait_bank/slurp.rb:560:in `merge_triple' << /app/lib/trait_bank/slurp.rb:447:in `block in load_csv_where' << /app/lib/trait_bank/slurp.rb:447:in `each' << /app/lib/trait_bank/slurp.rb:447:in `load_csv_where' << /app/lib/trait_bank/slurp.rb:331:in `block (2 levels) in load_csv'
  • 23:09:16 (warns) FAILED on build_nodes query (MetaData), will re-try once...
  • 23:09:16 (warns) At https://eol.org/data/tdfidbdt/publish_metadata_chunk_6.csv @ position 21004581 - there's a field starting with a quote and whereas it ends that quote there seems to be characters in that field after that ending quote. That isn't supported. This is what I read: 'Davis,W.J. ",,,,,,,,false OccurrenceMetadatum-48822636,R1091-PK249649312,http://rs.tdwg.org/dwc/terms/identifiedBy,"DD'
  • 23:09:04 (infos) Importing 250000 rows from publish_metadata_chunk_6.csv
  • 22:54:03 (infos) Waiting 900 seconds for the last 'chunk' to be added to neo4j...
  • 22:53:00 (infos) Importing 250000 rows from publish_metadata_chunk_5.csv
  • 22:40:29 (infos) Waiting 750 seconds for the last 'chunk' to be added to neo4j...
  • 22:39:12 (infos) Importing 250000 rows from publish_metadata_chunk_4.csv
  • 22:29:12 (infos) Waiting 600 seconds for the last 'chunk' to be added to neo4j...
  • 22:27:52 (infos) Importing 250000 rows from publish_metadata_chunk_3.csv
  • 22:20:22 (infos) Waiting 450 seconds for the last 'chunk' to be added to neo4j...
  • 22:19:08 (infos) Importing 250000 rows from publish_metadata_chunk_2.csv
  • 22:14:07 (infos) Waiting 300 seconds for the last 'chunk' to be added to neo4j...
  • 22:13:09 (infos) Importing 250000 rows from publish_metadata_chunk_1.csv
  • 22:13:09 (warns) Found 6633106 rows, will break up into 250000
  • 22:13:08 (infos) adding new metadata
  • 22:10:50 (infos) Importing 250000 rows from publish_traits_chunk_2.csv
  • 22:08:14 (infos) Importing 250000 rows from publish_traits_chunk_1.csv
  • 22:08:14 (warns) Found 475433 rows, will break up into 250000
  • 22:08:13 (infos) adding new traits
  • 22:08:13 (infos) removing all traits
  • 22:07:59 (infos) polling for trait diff metadata: /resources/1091/publish_diffs.json
  • 22:07:59 (starts) #publish_traits = TraitBank::Slurp.load_resource_from_repo
  • 22:07:59 (starts) Running
  • 22:07:58 (starts) Fixing native nodes...
  • 22:07:58 (warns) Skipping reindexing. You should reindex soon.
  • 22:07:58 (infos) importing 359 Pages
  • 22:07:58 (infos) importing 1000 Pages
  • 22:07:57 (infos) importing 1000 Pages
  • 22:07:57 (infos) importing 1000 Pages
  • 22:07:57 (infos) importing 1000 Pages
  • 22:07:57 (infos) importing 1000 Pages
  • 22:07:56 (infos) importing 1000 Pages
  • 22:07:56 (infos) importing 1000 Pages
  • 22:07:56 (infos) importing 1000 Pages
  • 22:07:56 (infos) importing 1000 Pages
  • 22:07:55 (infos) importing 1000 Pages
  • 22:07:55 (infos) importing 1000 Pages
  • 22:07:55 (infos) importing 1000 Pages
  • 22:07:55 (infos) importing 1000 Pages
  • 22:07:55 (infos) importing 1000 Pages
  • 22:07:54 (infos) importing 1000 Pages
  • 22:07:54 (infos) importing 1000 Pages
  • 22:07:54 (infos) importing 1000 Pages