Tag: model distillation
1 article
US Accuses China’s Moonshot AI of Illicit Model Distillation
The US has accused China's Moonshot AI of illicitly replicating a top AI model using a technique called model distillation, allowing it to quickly switch between methods to avoid detection. Moonshot AI allegedly built a sophisticated platform to pull off the feat, using powerful servers to train its own rival model, K3.