You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
I got an AttributeError: property' object has no attribute 'get' when I try to use evaluate() function to evaluate a dataset with ContextRelevance, LLMContextPrecisionWithoutReference metrics. It's working when I only use faithfulness. And it's working when I evaluate a SingleTurnSample-
Ragas version: newest version
Python version: newest version
Code to Reproduce
result = evaluate(eval_dataset, metrics=[faithfulness, AnswerRelevancy], llm = evaluator_llm)
Error trace
File , line 27
22 eval_dataset = EvaluationDataset.from_pandas(df_bge_pd)
23 print(eval_dataset)
---> 27 result = evaluate(eval_dataset, metrics=[faithfulness, AnswerRelevancy], llm = evaluator_llm)
File /local_disk0/.ephemeral_nfs/envs/pythonEnv-f55819bb-501c-45c7-93b3-dc3c0125c4ca/lib/python3.11/site-packages/ragas/validation.py:60, in validate_required_columns(ds, metrics)
58 metric_type = get_supported_metric_type(ds)
59 for m in metrics:
---> 60 required_columns = set(m.required_columns.get(metric_type, []))
61 available_columns = set(ds.features())
62 if not required_columns.issubset(available_columns):