Search

Tag: #open-source-llm20 results

🔬

Nanochat vs Llama for Scratch Training

A researcher shares success with Nanochat for pretraining and SFT on historical data but notes poor transformers compatibility. They're considering switching to Llama architecture with Hugging Face's trainer for better interoperability and open-source accessibility on a larger dataset. Seeks advice on best options including Nanochat export scripts.

Reddit r/MachineLearningCommunityApr 24#open-source-llm
Major LLM Release Teased

Major LLM Release Teased

Reddit post teases 'it is coming' linking to X post by 青龍聖者. Shared in r/LocalLLaMA, hinting at upcoming local LLM development. No further details provided.

Reddit r/LocalLLaMACommunityMar 11#teaser#open-source-llm
Page 2 of 2