linux - BigQuery: Does bq load command support loading from named pipe as a source? -
i trying load data google bigquery using bq load
named pipe.
console window1:
$ mkfifo /usr/pipe1 $ cat /dev1/item.dat > /usr/pipe1
console window2:
$ bq load --source_format=csv projectid:dataset.itemtbl /usr/pipe1 field1:integer,field2:integer
got following error:
bigquery error in load operation: source path not file: /usr/pipe1
the bigquery client bq.py not support named pipes. explicitly requires files:
allowing named pipes feature suggestion. can request here:
https://code.google.com/p/google-bigquery/issues/list
it looks tweak copy of bigquery_client.py pretty make work well. luck!
Comments
Post a Comment