You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
redisvl.readers will be a module of classes named after the method used to read data from specific formats. For example, the pandas reader will be implemented first with support with csv, and pickled dataframe formats.
The Reader will be imported by the user and passed to the SearchIndex class. The SearchIndex will use the Reader to get data prior to loading it into redis.
The interface isn't complete stable, but should be more flushed out after the pandas reader is adapted to it.
Out of scope here
out of scope items, but worth thinking about while developing.
multifile reader
distributed reader (i.e. Dask)
larger than memory reader
conversion of vectors to bytes
Acceptance Criteria
Implemented the redisvl.readers.pandas module adhering to the above interface.
tests confirming support for
Pickled dataframe
csv
Use in CLI load command
The text was updated successfully, but these errors were encountered:
closed with #13. The complete functionality is not implemented as the base class isn't written yet, but further issues will follow that determine what should be in the base class primarily to handle bytes conversion
Uh oh!
There was an error while loading. Please reload this page.
Description
redisvl.readers
will be a module of classes named after the method used to read data from specific formats. For example, the pandas reader will be implemented first with support with csv, and pickled dataframe formats.Interface
The
Reader
will be imported by the user and passed to theSearchIndex
class. TheSearchIndex
will use theReader
to get data prior to loading it into redis.The interface isn't complete stable, but should be more flushed out after the pandas reader is adapted to it.
Out of scope here
out of scope items, but worth thinking about while developing.
Acceptance Criteria
redisvl.readers.pandas
module adhering to the above interface.load
commandThe text was updated successfully, but these errors were encountered: