Fluentbit does not work when configFileFormat is set to yaml

[truongnht]

When deploying the helmchart with configFileFormat: yaml our Fluentbit pod crashes with the following error

paritial fluent-bit config in secret

Please let me know if further information is needed.

[github-actions]

@truongnht this issue was automatically closed because it did not follow the issue template

[cw-Guo]

I was able to reproduced the issue. It's related to this upstream issue: fluent/fluent-bit#9508.
To fix it, we need to support the latest yaml config file with parser support. fluent/fluent-bit#9513

the following config won't work due to this issue.

apiVersion: fluentbit.fluent.io/v1alpha2
kind: ClusterFluentBitConfig
metadata:
  name: fluentbitconfig-sample
  namespace: fluent
spec:
  service:
    daemon: false
    logLevel: info
    parsersFiles: 
      - parsers.conf
      - parsers_multiline.conf
  inputSelector:
    matchExpressions:
      - key: fluentbit.fluent.io/enabled
        operator: In
        values: ["true"]
  filterSelector:
    matchExpressions:
      - key: fluentbit.fluent.io/enabled
        operator: In
        values: ["true"]
  outputSelector:
    matchExpressions:
      - key: fluentbit.fluent.io/enabled
        operator: In
        values: ["true"]
  configFileFormat: yaml

but the following will work:

apiVersion: fluentbit.fluent.io/v1alpha2
kind: ClusterFluentBitConfig
metadata:
  name: fluentbitconfig-sample
  namespace: fluent
spec:
  service:
    daemon: false
    logLevel: info
    parsersFile: parsers.conf
  inputSelector:
    matchExpressions:
      - key: fluentbit.fluent.io/enabled
        operator: In
        values: ["true"]
  filterSelector:
    matchExpressions:
      - key: fluentbit.fluent.io/enabled
        operator: In
        values: ["true"]
  outputSelector:
    matchExpressions:
      - key: fluentbit.fluent.io/enabled
        operator: In
        values: ["true"]
  configFileFormat: yaml