-
-
Notifications
You must be signed in to change notification settings - Fork 330
top-level functions for reading, creating data #2463
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
111 commits
Select commit
Hold shift + click to select a range
fd6ecd1
add functions for easy read-only data access
d-v-b fa343f5
sync funcs
d-v-b d95eba8
make read-only funcs top-level exports
d-v-b f6765bc
Merge branch 'main' into feat/read-funcs
d-v-b 5d8445b
add create_array, create_group, and tests
d-v-b 9526571
add top-level imports
d-v-b 90bf421
Merge branch 'feat/read-funcs' of github.com:d-v-b/zarr-python into f…
d-v-b de280a7
add test for top-level exports
d-v-b d9878cf
add test for read
d-v-b e5217ce
add asserts
d-v-b 40cc7af
Apply suggestions from code review
d-v-b d7ce58b
Merge branch 'main' into feat/read-funcs
d-v-b a0dfe18
Merge branch 'main' into feat/read-funcs
d-v-b 98bc328
Merge branch 'main' into feat/read-funcs
d-v-b 16f5cc2
Merge branch 'main' of github.com:zarr-developers/zarr-python into fe…
d-v-b 4b45ebf
handle sharding in create_array
d-v-b 750a439
Merge branch 'main' of github.com:zarr-developers/zarr-python into fe…
d-v-b 7a5cbe7
tweak
d-v-b 215ff96
Merge branch 'main' of github.com:zarr-developers/zarr-python into fe…
d-v-b 489e2a2
make logic of _auto_partition better for shard shape
d-v-b 05dd0d8
add dtype parsing, and tweak auto_partitioning func
d-v-b 3fbfc21
sketch of docstring; remove auto chunks / shard shape
d-v-b b348737
Merge branch 'main' of github.com:zarr-developers/zarr-python into fe…
d-v-b 5025ad6
tweak docstring
d-v-b e204a32
Merge branch 'main' of github.com:zarr-developers/zarr-python into fe…
d-v-b 68465db
docstrings
d-v-b d7bb121
ensure tests pass
d-v-b 99cc8f5
tuple -> list
d-v-b a39457f
allow data in create_array
d-v-b 3f0a3e0
docstring
d-v-b 26ced00
remove auto_partition
d-v-b af55ac4
make shape shapelike
d-v-b 07f07ea
use create_array everywhere in group class
d-v-b bc552ce
remove readers
d-v-b 74f731a
fix dodgy imports
d-v-b 43877c0
compressors -> compression, auto chunking, auto sharding, auto compre…
d-v-b c693fb4
use sane shard shape when there are too few chunks
d-v-b 4c18aaa
Merge branch 'main' into feat/read-funcs
jhamman dba2594
fix: allow user-specified filters and compression
d-v-b 669ad72
np.dtype[np.generic] -> np.dtype[Any]
d-v-b ae1832d
handle singleton compressor / filters input
d-v-b 5cb6dd8
default codec config now uses the full config dict
normanrz 5dcd80b
test for auto sharding
d-v-b 810ff9b
Merge branch 'feat/default-codecs' into feat/read-funcs
normanrz eab46a2
test
normanrz bcdc4cc
adds a shards property
normanrz 4e978f9
add (typed) functions for resolving codecs
d-v-b a9850bf
better codec parsing
d-v-b 2747d69
add warning if auto sharding is used
d-v-b 023c16b
remove read_array
d-v-b de2c36e
rename compression to compressors, and make the docstring for create_…
d-v-b 74d31ef
compression -> compressors, shard_shape -> shards, chunk_shape -> chunks
d-v-b 470b60f
use typerror instead of valuerror; docstring
d-v-b e8b1ad1
default order is None
d-v-b b919483
Merge branch 'feat/chunks-shards' into feat/read-funcs
normanrz 6fcd976
fix circular dep
normanrz d9c30a3
format
normanrz 0bf4dd0
fix some tests
normanrz ea3ed0e
use filters=auto and compressors=auto in Group.create_array
normanrz 54fd920
compression -> compressors
normanrz a4ba7db
Update src/zarr/core/group.py
d-v-b fb286a7
fix mypy
normanrz df35d13
narrow type of filters param and compression param
d-v-b 80b5a10
Merge branch 'feat/read-funcs' of github.com:d-v-b/zarr-python into f…
d-v-b 77f40a5
remove data kwarg to create_array
d-v-b 235e246
mypy fixes
normanrz 95348d6
ensure that we accept dict form of compressor in _parse_chunk_encodin…
d-v-b 91a7916
Merge branch 'feat/read-funcs' of github.com:d-v-b/zarr-python into f…
d-v-b 665037e
fix properties test
normanrz ae76bb3
Merge branch 'feat/read-funcs' of github.com:d-v-b/zarr-python into f…
normanrz 0a983e6
add tests for compressors and filters kwargs to create_array
d-v-b 2182793
add tests for codec inference
d-v-b c04d7cf
add test for illegal shards kwarg for v2 arrays
d-v-b 144b2b7
remove redundant test function
d-v-b d407e5d
tests and types
normanrz 1301c5f
rm print
normanrz 31b3ad4
types
normanrz a0c1c95
merge
normanrz 43b6774
resolve cyclic import
normanrz e55023a
add create_array to async and sync API
normanrz e24bdeb
docs for create_array
normanrz b564ae6
rename (Async)Array.create to _create
normanrz 75b2197
adds array_bytes_codec kwarg
normanrz 2f6f8a0
tests
normanrz c4330ef
tests for no filters+compressors
normanrz f926a5a
Merge branch 'main' into feat/read-funcs
d-v-b 95ffadd
widen type of FiltersParam to include single numcodecs codec instances
d-v-b bbe3a94
don't alias None to default codecs in _create_v2
d-v-b 856b40f
allow single codec instances for filters, and None for filters / comp…
d-v-b 2aa3acc
add docstring for None
normanrz 9fb8a33
single-item tuple for compressors in v2
normanrz 99faa8e
Update src/zarr/core/array.py
normanrz 108daa0
Merge branch 'main' into feat/read-funcs
normanrz 305fdb7
merge
normanrz 947f20e
tweaks
normanrz 2d2af8f
Merge branch 'main' into feat/no-array-create
normanrz 14c45cd
pr feedback 1
normanrz ff5e5cb
Merge branch 'feat/no-array-create' of github.com:zarr-developers/zar…
normanrz 2afe940
tests
normanrz e3f1f33
mypy
normanrz 1643983
rename array_bytes_codec to serializer
normanrz aad8e9d
Update src/zarr/api/asynchronous.py
d-v-b f29b2d9
docstrings
d-v-b 4654cbd
*params -> *like
d-v-b 5cdb515
*params -> *like, in tests
d-v-b 0dc7dc6
merge
normanrz c5c761e
Merge remote-tracking branch 'origin/main' into feat/read-funcs
normanrz be60d73
adds deprecated compressor arg to Group.create_array
normanrz ae1aa2a
Merge remote-tracking branch 'origin/main' into feat/read-funcs
normanrz 0a8b91c
docs
normanrz 315ba88
Merge branch 'main' into feat/read-funcs
jhamman File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.