Tenstorrent, a chipmaker that recently raised nearly $700 million in funding, has made its AI accelerators available on Koyeb's serverless cloud platform. This move marks a significant milestone in the company's efforts to build an alternative to Nvidia's dominant GPU and CUDA library ecosystem.

Koyeb, founded by former Scaleway executives, offers a unique serverless cloud platform that allows developers to deploy applications across multiple virtual machines using a command-line interface or a git push. The platform supports Docker containers and various popular programming languages. One of its key features is the ability to automatically scale applications to hundreds of servers when needed, and then scale down when traffic decreases, providing a low-latency experience for AI workloads.

In recent months, Koyeb has been focusing on supporting AI applications, and the integration with Tenstorrent's AI accelerators is a significant step forward. Tenstorrent's processors are built around the RISC-V instruction set architecture and come with an open-source neural network library, TT-NN, and a low-level programming model, TT-Metalium. This open-source approach is designed to foster a community-driven ecosystem, similar to what ARM achieved in the server market.

Developers can now access Tenstorrent's AI accelerators on Koyeb's platform through two new instance types: TT-N300S and TT-Loudbox. The TT-N300S instance features 24GB of GDDR6 memory, 192MB of SRAM, and provides up to 466 FP8 TFLOPS, paired with 64GB of RAM and 4 vCPUs. The TT-Loudbox instance, which includes four N300S, offers 96GB of GDDR6, 768MB of SRAM, and up to 1,864 FP8 TFLOPS, along with 256GB of RAM and 16 vCPUs.

Koyeb's CEO, Yann Leger, highlighted the significance of this integration, drawing parallels with ARM's debut in the server market. Leger emphasized Koyeb's experience in deploying diverse hardware architectures, having introduced ARM to the market with Scaleway in 2013-2014. This expertise will be crucial in supporting the adoption of Tenstorrent's AI accelerators.

For Tenstorrent, this partnership is a key step in building a developer ecosystem around its open-source programming model. The company is seeking partners to help create a viable alternative to Nvidia's AI stack, which has long dominated the market. With Koyeb's serverless cloud platform, developers can now access Tenstorrent's AI accelerators and explore the possibilities of this new ecosystem.

The implications of this integration are far-reaching, as it offers developers a new path to building AI applications without relying on Nvidia's proprietary technology. As the AI landscape continues to evolve, this partnership could play a significant role in shaping the future of AI development and deployment.