-
Notifications
You must be signed in to change notification settings - Fork 6.7k
BigQuery: Update pandas/bqstorage samples to latest library changes. #2413
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
tswast
commented
Sep 24, 2019
- Show how to use BQ Storage API with pandas-gbq and magics.
- Update tests to actually run BQ Storage API on smaller IRS 990 table.
shollyman
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
One minor comment, feel free to ignore.
| google-cloud-bigquery-storage==0.7.0 | ||
| pandas==0.25.1 | ||
| pandas-gbq==0.11.0 | ||
| pyarrow==0.14.1 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The pyarrow req still feels odd to me. Should we add a comment if there's an alternate option, or start expressing a harder dependency via one of the other libraries?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think at some point we'll make pyarrow a hard dependency in google-cloud-bigquery-storage (in fact, it already is in the conda package), but probably not until after filtering support is launched for the arrow wire format.