Ingestion should fail when trying to ingest a log with duplicate keys

[de-sh]

Currently, we allow json of the shape: {"status": 400, "status": 200}. This will result in wrong behavior.

[psiayn]

ill be working on this issue

[nitisht]

sure @psiayn , i have assigned it to you. Feel free let comment here if something is unclear

[psiayn]

by default serde takes the latest key and it looks like the http logs are being fed and transformed into Value. unless we implement our own Value and a custom Deserializer im not sure if it will be possible to flag duplicate keys.

it looks like serde had added allowing duplicate keys as default and the only way it fails is by extracting the string into a custom struct. serde-rs/serde#690

im just checking before going ahead as this may break a lot of functionality

[psiayn]

@nitisht @de-sh could you help point in the direction i should proceed?

[vrongmeal]

@nitisht I would like to pick this up.

[nitisht]

Sure @vrongmeal , moving