DeepSeek open-sourced the inference engine that serves its own production traffic (github.com)
The release covers one model, DeepSeek-V4.1-Flash, and runs on NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs. It deliberately leaves out the KV cache system and prefill/decode disaggregation.
In the thread, one reader wants to know if the whole release is a bet against US valuations. Another answers that investors don't believe Western firms will run Chinese models.
Sign in to save