DramaBox: High-expression voice model based on LTX 2.3

DramaBox is built upon the LTX 2.3 architecture, which is primarily a multimodal Diffusion Transformer (DiT) model developed by Lightricks. Key technical details of this underlying architecture include:

• Unified Architecture: LTX 2.3 generates synchronized video and audio within a single unified architecture, processing both modalities together to maintain temporal coherence.
• Diffusion Transformer (DiT): The model is built on a DiT architecture, combining diffusion models with transformer-based processing, which is a standard foundation for high-performing generative video models.
• Parameter Count: LTX 2.3 is a 22-billion parameter model.
• Unified Embedding Space: Video frames, audio spectrograms, and text conditioning tokens are all represented in the same embedding space and processed through shared transformer blocks, enabling direct cross-modal attention.
• Enhanced Text Encoder: The text encoder in LTX 2.3 has been quadrupled in size, leading to smarter prompt adherence and more accurate resolution of complex prompts, including multiple subjects, spatial relationships, and motion cues.
• Updated Vocoder: For audio generation, LTX 2.3 includes a newly updated vocoder that increases dialogue clarity and ensures tighter cross-modal alignment, reducing lip-syncing and timing artifacts.
• VAE for Fidelity: A rebuilt video Variational Autoencoder (VAE) and refined latent space contribute to preserving fine textures, facial features, text, and edges in the generated output.