I just tested the busio.SPI on the M4, and it works with my display, however, there is a minor issue:
I noticed that the clock frequency doesn't match the baudrate setting. At 48MHz, 32MHz and 24MHz I get a 12MHz clock (as measured with a logic analyzer), and at 12MHz I get 8MHz. At 8MHz baudrate I get 6MHz clock, and so on.