Skip to content

chore: make benchmark to read subfolders and three groupby benchmarks. #754

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 11 commits into from
Jun 6, 2024

Conversation

Genesis929
Copy link
Collaborator

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

  • Make sure to open an issue as a bug/issue before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea
  • Ensure the tests and linter pass
  • Code coverage does not decrease (if any source code was changed)
  • Appropriate docs were updated (if necessary)

Fixes #<issue_number_goes_here> 🦕

@product-auto-label product-auto-label bot added size: s Pull request size is small. api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. labels Jun 5, 2024
@Genesis929 Genesis929 added the owlbot:run Add this label to trigger the Owlbot post processor. label Jun 5, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Jun 5, 2024
@Genesis929 Genesis929 marked this pull request as ready for review June 5, 2024 21:40
@Genesis929 Genesis929 requested review from a team as code owners June 5, 2024 21:40
@Genesis929 Genesis929 requested a review from TrevorBergeron June 5, 2024 21:40
@Genesis929 Genesis929 requested a review from milkshakeiii June 5, 2024 21:40
@product-auto-label product-auto-label bot added size: m Pull request size is medium. and removed size: s Pull request size is small. labels Jun 6, 2024
@Genesis929 Genesis929 changed the title chore: make benchmark to read subfolders. chore: make benchmark to read subfolders and three groupby benchmark. Jun 6, 2024
@Genesis929 Genesis929 changed the title chore: make benchmark to read subfolders and three groupby benchmark. chore: make benchmark to read subfolders and three groupby benchmarks. Jun 6, 2024
Copy link
Contributor

@milkshakeiii milkshakeiii left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

---BIGQUERY USAGE REPORT---
visualization/bq_dataframes_covid_line_graphs.ipynb - query count: 2, bytes processed sum: 12948886977, slot millis sum: 31010420
generative_ai/bq_dataframes_llm_kmeans.ipynb - query count: 20, bytes processed sum: 4137546100, slot millis sum: 2097125
dataframes/dataframe.ipynb - query count: 44, bytes processed sum: 5598362, slot millis sum: 170966
regression/easy_linear_regression.ipynb - query count: 16, bytes processed sum: 151961, slot millis sum: 139131
getting_started/getting_started_bq_dataframes.ipynb - query count: 19, bytes processed sum: 204521, slot millis sum: 124841
dataframes/index_col_null.ipynb - query count: 16, bytes processed sum: 4596839, slot millis sum: 35759
dataframes/integrations.ipynb - query count: 7, bytes processed sum: 270, slot millis sum: 26118
generative_ai/large_language_models.ipynb - query count: 4, bytes processed sum: 7260, slot millis sum: 10742
location/regionalized.ipynb - query count: 162, bytes processed sum: 1595325, slot millis sum: 678236
remote_functions/remote_function.ipynb - query count: 12, bytes processed sum: 86086638598, slot millis sum: 12955024
regression/sklearn_linear_regression.ipynb - query count: 17, bytes processed sum: 135165, slot millis sum: 289204
---total queries: 319, total bytes: 103185361378, total slot millis: 47537566---

LGTM!

@Genesis929 Genesis929 merged commit 60f13e7 into main Jun 6, 2024
22 of 23 checks passed
@Genesis929 Genesis929 deleted the perf-1-huanc branch June 6, 2024 23:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. size: m Pull request size is medium.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants