Inferact

Inferact is a startup in the AI inference industry, founded by the creators of the popular vLLM open-source LLM inference engine. The company's mission is to make AI inference significantly cheaper and faster by optimizing the vLLM engine, thereby accelerating AI progress and making advanced models more accessible.

AWSAzureBashC++CUDADistributed SystemsDockerGCPGoHelmKubernetesLinuxPythonRustvLLMTerraformTypeScriptvLLM
https://inferact.ai/ ↗
Visit https://inferact.ai/ ↗
Opens https://inferact.ai/ in a new tab
Stack
AWSAzureBashC++CUDADistributed SystemsDockerGCPGoHelmKubernetesLinuxPythonRustvLLMTerraformTypeScriptvLLM