fine tune for json does not work

[javixeneize]

Describe the bug

I am parsing a json file with the command openai tools fine_tunes.prepare_data -f javi.json, and i always have this error message:

Analyzing...

ERROR in read_any_format validator: Your file javi.json does not appear to be in valid JSON format. Please ensure your file is formatted as a valid JSON file.

Aborting...%

It does not matter whats the content of the file, even with something as simple as { "name": "javi"} it throws this error

To Reproduce

Create a json file with any content

Run openai tools fine_tunes.prepare_data -f javi.json

It errors

Code snippets

No response

OS

Monterrey

Python version

Python 3.9.6

Library version

openai 0.27.4

[shawnesquivel]

getting the same error
OS ventura 13.3.1
openai 0.27.4
pandas 2.0.1

my json format:

[
{
"prompt": "Write a summary of Luka Doncic statistics:",
"completion": "Luka Doncic played 19 games, starting 19 of them. He had an average of 37.4 minutes per game, scoring 33.5 points per game. He made 218 out of 432 field goals, for a field goal percentage of 50.5. He made 46 out of 146 three-point field goals, for a three-point field goal percentage of 31.5. He made 154 out of 213 free throws, for a free throw percentage of 72.3. He plays as PG for the DAL."
},
{
"prompt": "Write a summary of Stephen Curry statistics:",
"completion": "Stephen Curry played 20 games, starting 20 of them. He had an average of 34.7 minutes per game, scoring 31.4 points per game. He made 214 out of 413 field goals, for a field goal percentage of 51.8. He made 103 out of 236 three-point field goals, for a three-point field goal percentage of 43.6. He made 97 out of 107 free throws, for a free throw percentage of 90.7. He plays as PG for the GS."
}
]

[shawnesquivel]

Hi @javixeneize, this did the trick for me. Referenced from #296

 pip install openai==0.25.0

[javixeneize]

Downgrading to 0.25? I didn’t expect that 😳.
Will try tomorrow. Thanks!!

[shawnesquivel]

Downgrading to 0.25? I didn’t expect that 😳. Will try tomorrow. Thanks!!

Yeah, not the best solution. Hoping someone else has a less hacky way of fixing it 😆

[zzj0402]

Confirmed. The new version of prep data thing is not working. Nothing is jsonl for it.