linux - BigQuery: Does bq load command support loading from named pipe as a source? -


i trying load data google bigquery using bq load named pipe.

console window1:

 $ mkfifo /usr/pipe1  $ cat /dev1/item.dat > /usr/pipe1 

console window2:

 $ bq load --source_format=csv  projectid:dataset.itemtbl /usr/pipe1 field1:integer,field2:integer 

got following error:

bigquery error in load operation: source path not file: /usr/pipe1 

the bigquery client bq.py not support named pipes. explicitly requires files:

https://code.google.com/p/google-bigquery-tools/source/browse/bq/bigquery_client.py?r=30df4638ff2ddb01d3f495af5c131ed3c2cfbd04#617

allowing named pipes feature suggestion. can request here:

https://code.google.com/p/google-bigquery/issues/list

it looks tweak copy of bigquery_client.py pretty make work well. luck!


Comments

Popular posts from this blog

android - Gradle sync Error:Configuration with name 'default' not found -

java - Andrioid studio start fail: Fatal error initializing 'null' -

html - jQuery UI Sortable - Remove placeholder after item is dropped -