DeepSeek open sources DSpark, a new framework to speed up LLM inference by up to 85%

DeepSeek has announced the release of DSpark, a new open-source framework designed to significantly accelerate inference in large language models…

The system, released under the MIT license, is available to developers and researchers. DSpark employs a technique called speculative decoding, which allows a smaller draft model to predict multiple tokens…