Do you remember when I mentioned the difficulty of running 🐸 CoquiTTS in the cloud yesterday? My first experiment was to run it directly in my Cloud Run backend service. In theory, this could have worked, but you'll never guess why it failed in practice.
x86 CPUs. Really. Like the ones we had in our computers in the 90s. How did I figure this out? After taking a horribly long time to start up, the TTS service failed with a message saying that it was running on an 'incompatible' CPU architecture. Specifically, 32-bit x86 CPUs.
Of course, for many workloads that people normally run in Cloud Run, this wouldn't matter at all. But for TTS and other ML-heavy workloads it does matter.
It should be obvious by now that this idea was a non-starter. Coming up tomorrow: More about the unexpected reason why this still didn't work out of the box when using a dedicated preemptive VM!