Meta stopped worrying about distillation and just shipped the pipeline

Meta released Muse Glimmer, a 30-billion-parameter model, without distillation, and licensed it under Apache 2.0. This matters as it shows a shift in approach to model deployment. Engineers should be aware of this new model and its implications. Further details are needed to understand the full impact.