Should filenames of batches start with leading zeros, like `00001.nc`?

[JackKelly]

Detailed Description

At the moment, batch filenames don't have leading zeros (e.g. 1.nc).

This is nice and simple.

But the downside is that lexographical sorting doesn't work. So, for example, in filesystem.utils.get_maximum_batch_id(path), we have to process all the batch filenames in a for loop, instead of just sorting the string filenames and taking the last one. Also, directory listings of batches are in the wrong order.

Are there any downsides to using leading zeros in the batch filenames?

Possible Implementation

We can probably safelly assume that, for now, we'll never want more than 999,999 batches, so we can use f"{batch_id:06d}.nc" to format the filenames.

[jacobbieker]

Yeah, I think that sounds good, there isn't any downside to leading zeros, and I think also just looks nicer