DigiNews

Tech Watch by Johan Denoyer

← Back to articles

Show HN: Distilling DeepSeek into GPT-OSS doesn't transfer censorship. Try it

Quality: 8/10 Relevance: 9/10

Summary

The article reports on a study that distills knowledge from a censored Chinese model into an American open-base GPT-OSS model. It finds that censorship in the teacher does not transfer to the distilled student across finance-related prompts, and presents a detailed evaluation of self-distillation versus teacher-taught distillation, along with the release of LineageEval and open weights.

🚀 Service construit par Johan Denoyer