Skip to content

Add example for writing a FileFormat #11079

@alamb

Description

@alamb

Is your feature request related to a problem or challenge?

Now that @devinjdangelo has added better support for user defined file formats (see #11060)

We have an example of a custom table provider: https://datafusion.apache.org/library-user-guide/custom-table-providers.html and example

It would be great to have an example of creating a file format

Such an example would make sure the APIs added in this PR can be used for the end to end case, as well as obviously made it easier for others to discover and use this feature

Describe the solution you'd like

Add an example in https://github.com/apache/datafusion/tree/main/datafusion-examples that does:

  1. Creates a new file format (something basic like use CSV / ROT13)
  2. reads / writes data using that format

Describe alternatives you've considered

No response

Additional context

No response

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions