dcsimg

Import Log for USDA Plants data

  • Started: May 30, 2023 10:05
  • Completed: 10:34:23.000
  • Failed: No.
  • Status: completed

Events (most recent first):

  • 10:34:23.000 (ends) Complete
  • 10:34:23.000 (ends) TOTAL TIME: 29.2m
  • 10:34:23.000 (starts) TraitBank::Denormalizer.update_resource_vernaculars
  • 10:34:23.000 (starts) Running
  • 10:34:22.000 (starts) Resource#fix_native_nodes
  • 10:34:22.000 (starts) Running
  • 10:34:22.000 (infos) Removing /app/tmp/usda_plants_node_ancestors.tsv
  • 10:34:22.000 (infos) Removing /app/tmp/usda_plants_scientific_names.tsv
  • 10:34:22.000 (infos) Removing /app/tmp/usda_plants_identifiers.tsv
  • 10:34:22.000 (infos) Removing /app/tmp/usda_plants_nodes.tsv
  • 10:34:22.000 (infos) Removing trait and metadata files
  • 10:34:20.000 (infos) Importing 128000 rows from publish_metadata.tsv
  • 10:34:20.000 (infos) adding new metadata
  • 10:33:41.000 (infos) Importing 128000 rows from publish_traits_chunk_5.csv
  • 10:31:58.000 (infos) Importing 128000 rows from publish_traits_chunk_4.csv
  • 10:23:57.000 (infos) Waiting 8 minutes for the last 'chunk' to be added to neo4j...
  • 10:22:35.000 (infos) Importing 128000 rows from publish_traits_chunk_3.csv
  • 10:16:34.000 (infos) Waiting 6 minutes for the last 'chunk' to be added to neo4j...
  • 10:15:10.000 (infos) Importing 128000 rows from publish_traits_chunk_2.csv
  • 10:11:09.000 (infos) Waiting 4 minutes for the last 'chunk' to be added to neo4j...
  • 10:09:23.000 (infos) Importing 128000 rows from publish_traits_chunk_1.csv
  • 10:09:21.000 (warns) Found 569017 rows, will break up into 128000
  • 10:09:20.000 (infos) adding new traits
  • 10:07:31.000 (infos) removing all traits
  • 10:07:30.000 (infos) Connecting to https://content.eol.org/ ...
  • 10:06:45.000 (infos) Connecting to https://content.eol.org/ ...
  • 10:06:45.000 (infos) polling for trait diff metadata: /resources/133/publish_diffs.json?since=1682293180
  • 10:06:45.000 (starts) #publish_traits = TraitBank::Slurp.load_resource_from_repo
  • 10:06:44.000 (starts) Running
  • 10:06:44.000 (starts) Fixing native nodes...
  • 10:06:44.000 (warns) Skipping reindexing. You should reindex soon.
  • 10:06:44.000 (infos) importing 62 Pages
  • 10:06:44.000 (infos) importing 1000 Pages
  • 10:06:43.000 (infos) importing 1000 Pages
  • 10:06:40.000 (infos) importing 1000 Pages
  • 10:06:24.000 (starts) create_new_pages
  • 10:06:24.000 (starts) PageCreator
  • 10:06:24.000 (starts) Running
  • 10:06:24.000 (warns) Missing matching name for VernacularPreference.find(62591) (Macoun wildrye)
  • 10:06:24.000 (warns) Missing matching name for VernacularPreference.find(62389) (tanoak)
  • 10:06:23.000 (starts) restoring vernacular preferences...
  • 10:06:23.000 (starts) Running
  • 10:06:23.000 (warns) MISSING https://content.eol.org/data/usda_plants/publish_content_sections.tsv [404] (8 bytes); skipping
  • 10:06:23.000 (infos) Connecting to https://content.eol.org/ ...
  • 10:06:23.000 (starts) #grab_file content_sections.tsv
  • 10:06:23.000 (starts) Running
  • 10:06:23.000 (starts) #import_and_prop_ids ContentSection
  • 10:06:23.000 (starts) Running
  • 10:06:23.000 (warns) MISSING https://content.eol.org/data/usda_plants/publish_references.tsv [404] (8 bytes); skipping
  • 10:06:23.000 (infos) Connecting to https://content.eol.org/ ...