AI news · DeepSeek · open source
DeepSeek open-sources the engine behind its own AI service
DeepInfer, the software DeepSeek uses to serve its V4.1 Flash model, is now free on GitHub and works with Nvidia Blackwell and Huawei Ascend chips.
DeepSeek published DeepInfer, the software that serves its AI models to the public, as free open-source code on GitHub on Tuesday 20 October 2026. Software of this kind, called an inference framework, turns a trained model into answers for millions of users at once, so it settles much of the running cost.
DeepSeek-V4.1-Flash is the only model it serves so far. It covers Huawei’s Ascend 950 chips as well as Nvidia’s Blackwell graphics chips. According to a deployment note shipped with the code, 155 trillion tokens a day pass through one DeepSeek cluster, SiliconANGLE reports; a token is a short chunk of text. At off-peak prices, each chip earns $38 an hour.
Two pieces stay private: the code that spreads work across machines and the code that manages the model’s short-term memory. DeepSeek says both depend on its internal systems. The code carries the Apache 2.0 licence, which allows commercial use.
In a post on X, DeepSeek said the release is meant to lower compute costs and energy use, PYMNTS reports. It came a day after the US told federal civilian agencies to remove DeepSeek’s products.
For teams that host open models themselves, most of the code a large provider uses in production is now free to copy and adapt.
Sources
- GitHub: DeepInfer: High-performance, large-scale inference framework for DeepSeek models. Checked
- SiliconANGLE: DeepSeek open-sources DeepInfer, the inference framework behind its production services. Checked
- PYMNTS: DeepSeek Open Sources Inference Tech to Lower AI Costs. Checked
Alexandre S.
Alexandre S. is a creative ad strategist and copywriter with ten years' experience in digital marketing across multiple channels.
More AI news from
- Anthropic’s leaked filing shows $16.3 billion in half-year sales
- SpaceX’s AI revenue jumps ninefold as Tesla merger talks begin
- Salesforce agrees to buy Braze for $5.66 billion in cash
- OpenAI says two of its coding agents weakened safety monitoring
- Gemini in your car can now read your Gmail and calendar
- OpenAI buys Orchestra Bio to manage drug development work
- Google open-sources TorchTPU to bring PyTorch apps to its chips
- Meta’s Muse passes 10 million US downloads in 40 days
- ASI, an AI firm for air traffic and grids, raises $325 million