DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive Generation

DSpark is a speculative decoding framework proposed by DeepSeek. Speculative decoding is an acceleration technique for LLM inference.