Skip to content

Support multiple timestamp formats in non arrow flow #533

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
Mar 18, 2025

Conversation

jprakash-db
Copy link
Contributor

@jprakash-db jprakash-db commented Mar 7, 2025

Description

Adding support for multiple timestamp formats parsing using python-dateutil

Testing

Added unit tests for the most popular timestamp formats used ata Databricks

@jprakash-db jprakash-db marked this pull request as ready for review March 8, 2025 19:00
Copy link

Thanks for your contribution! To satisfy the DCO policy in our contributing guide every commit message must include a sign-off message. One or more of your commits is missing this message. You can reword previous commit messages with an interactive rebase (git rebase -i main).

Copy link

Thanks for your contribution! To satisfy the DCO policy in our contributing guide every commit message must include a sign-off message. One or more of your commits is missing this message. You can reword previous commit messages with an interactive rebase (git rebase -i main).

Copy link

Thanks for your contribution! To satisfy the DCO policy in our contributing guide every commit message must include a sign-off message. One or more of your commits is missing this message. You can reword previous commit messages with an interactive rebase (git rebase -i main).

@jprakash-db jprakash-db merged commit 83550c8 into main Mar 18, 2025
22 of 23 checks passed
varun-edachali-dbx pushed a commit that referenced this pull request May 27, 2025
* Added check for 2 formats

* Wrote unit tests

* Added more supporting formats

* Added the T format datetime

* Added more timestamp formats

* Added python-dateutil library

Signed-off-by: varun-edachali-dbx <[email protected]>
varun-edachali-dbx pushed a commit that referenced this pull request May 28, 2025
* Added check for 2 formats

* Wrote unit tests

* Added more supporting formats

* Added the T format datetime

* Added more timestamp formats

* Added python-dateutil library

Signed-off-by: varun-edachali-dbx <[email protected]>
varun-edachali-dbx pushed a commit that referenced this pull request May 28, 2025
* Added check for 2 formats

* Wrote unit tests

* Added more supporting formats

* Added the T format datetime

* Added more timestamp formats

* Added python-dateutil library

Signed-off-by: varun-edachali-dbx <[email protected]>
varun-edachali-dbx pushed a commit that referenced this pull request May 28, 2025
* Added check for 2 formats

* Wrote unit tests

* Added more supporting formats

* Added the T format datetime

* Added more timestamp formats

* Added python-dateutil library

Signed-off-by: varun-edachali-dbx <[email protected]>
varun-edachali-dbx pushed a commit that referenced this pull request May 28, 2025
* Added check for 2 formats

* Wrote unit tests

* Added more supporting formats

* Added the T format datetime

* Added more timestamp formats

* Added python-dateutil library

Signed-off-by: varun-edachali-dbx <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants