Skip to content

[Rivulet] Populate more fields in Deltacat metastore files (e.g. row count, content type) #476

@mcember

Description

@mcember

The Deltacat metastore format has a ton of fields which we do not populate for rivulet datasets / deltas / manifests. This metadata is useful/necessary for a variety of reasons

The goal of this ticket is to populate the fields which we can add easily add, and make child tickets if necessary to populate other fields that may require more work like rowCount

Acceptance criteria

  • Audit of fields in deltacat manifest/delta/stream/table version/table which we are not populating and may be able to populate
  • Make code changes to populate those fields, or make spinoff tickets if necessary

Metadata

Metadata

Assignees

Labels

P4Resolve if not working on P0/P1/P2/P3 (long-term fix)V2Related to DeltaCAT V2 native catalog supportexperimentalThis issue is related to an experimental new feature, test, or integration

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions