At AI Infrastructure Field Day 3, Rafay took on the idea of challenging the Hyperscalers with bringing AI workloads to the more small and rural telco world.
CEO of Rafay Systems, Haseeb Budhani, talked about how they are helping Telcos in Thailand and Indonesia build AI Infrastructure for renting GPU farms closer to where their end users and customers are located. He calls these Telco AI Networks, Sovereign AI Clouds.
What are the benefits of a Sovereign AI Cloud?
The reason Rafay says Sovereign AI Clouds are so important is the run to the bottom for GPU rentals or GPU-as-a-Service (GPaas) providers. He says AWS charges $8 while you can rent GPUs for $1.6.
He references a report from Accenture that suggests that GPU-as-a-Service are decreasing as the AI market matures, with more value being derived from services.
Rafay is trying to bring control of all the chaos of AI Infrastructure, to bridge these AI workflows to be more cloud like. Is that something that will benefit rural telcos? That is yet to be determined at scale, but it sounds like it is happening in other countries. How about here in the states?