On-Device Luganda LM Launch

🔑 Enhanced Key Takeaways

• •The BULaMU project (Breakthrough in Utilization of Large Language Models in Uganda) was developed by researcher Rick Mwebaza and utilizes modified training scripts derived from Andrej Karpathy's llama2.c repository.
• •The model family includes three distinct versions: a 20M parameter model (Version 1), and 42M and 110M parameter models (Version 2), with both base and fine-tuned weights available for download.
• •The E.A.S.T. (Expanding Access to Systems of Learning and Intelligence) Android application is designed to facilitate local inference of these models, specifically targeting low-power hardware such as older tablets (e.g., 2021 Fire HD 10) by leveraging C-based execution.

🛠️ Technical Deep Dive

• •Architecture: Based on modified scripts from the llama2.c repository, optimized for C-based inference.
• •Deployment: Inference is performed directly in C, bypassing the need for heavy Python runtimes or GPU acceleration.
• •Model Variants: Three sizes (20M, 42M, 110M parameters) to accommodate varying RAM constraints on low-end Android devices.
• •Accessibility: Open-source weights and training scripts provided on HuggingFace, allowing for community-driven fine-tuning and further development.

🔮 Future ImplicationsAI analysis grounded in cited sources

⏳ Timeline