Currently `monai.data.TestTimeAugmentation` seemingly [assumes the inverse transformations can be applied to the predictions](https://github.com/Project-MONAI/MONAI/blob/46a5272196a6c2590ca2589029eed8e4d56ff008/monai/data/test_time_augmentation.py#L199), which necessarily means the predictions must be spatial. Seems fairly straightforward - would be willing to write up a PR if there's interest and no reason this doesn't make sense.