Search

Few direct matches — filled in with the latest updates.

Tag: #multimodal-training3 results

Self-Flow Boosts Multimodal Training 2.8x

Self-Flow Boosts Multimodal Training 2.8x

Black Forest Labs released Self-Flow, a self-supervised flow matching framework that enables multimodal AI models to learn representations and generation simultaneously without external teachers like CLIP. It uses Dual-Timestep Scheduling for self-distillation, achieving state-of-the-art results in images, video, and audio. The technique converges 2.8x faster than the REPA standard and scales without plateauing.

Apple's MixAtlas Boosts Multimodal LLM Training

Apple's MixAtlas Boosts Multimodal LLM Training

Apple introduces MixAtlas, an uncertainty-aware framework for optimizing data mixtures in multimodal LLM midtraining, accepted at ICLR 2026's NADPFM workshop. It tackles underexplored multimodal pretraining via principled domain reweighting for better sample efficiency and generalization. The approach uses systematic domain decomposition and smaller proxy models for compute efficiency.

Apple Machine LearningOfficialApr 16#multimodal-training#data-optimization#domain-reweighting