LMStudio Adds Presence Penalty for Qwen 3.5
๐กLMStudio's Presence Penalty for Qwen 3.5 means better local LLM diversity soon
โก 30-Second TL;DR
What Changed
Presence Penalty feature coming to LMStudio
Why It Matters
This update brings LMStudio closer to full parity with cloud APIs for advanced sampling parameters, benefiting local AI developers experimenting with Qwen models. It could boost adoption of open-weight models in production workflows.
What To Do Next
Update LMStudio to the latest version and test Presence Penalty with Qwen 3.5 models for repetition-free outputs.
Key Points
- โขPresence Penalty feature coming to LMStudio
- โขSpecifically for Qwen 3.5 models
- โขPosted by u/ZootAllures9111 on r/LocalLLaMA
- โขImproves token repetition control in local runs
๐ง Deep Insight
Background and context from public sources โ not the original article. 8 sources cited.
๐ Enhanced Key Takeaways
- โขQwen3.5 models feature a hybrid architecture with 35B total parameters and only 3B activated parameters, enabling efficient inference on consumer hardware while maintaining performance comparable to much larger models[4]
- โขPresence penalty is one of multiple sampling parameters (including frequency penalty, DRY sampling, and temperature controls) that LM inference servers like LLaMA Box and LM Studio support to control token repetition and generation quality[2][5]
- โขQwen3.5 defaults to reasoning mode enabled, automatically triggering extended thinking before responses unless explicitly disabled, which interacts with repetition penalties during the thinking phase[1][4][7]
๐ ๏ธ Technical Deep Dive
Architecture
- โขQwen3.5 uses Gated Delta Networks combined with sparse Mixture-of-Experts (256 total experts, 8 routed + 1 shared active) for efficient hybrid inference[4]
- โขNative context length of 262,144 tokens with demonstrated accuracy up to 1M tokens via YaRN-based positional extension[3][4]
- โขEarly fusion training on multimodal tokens enables unified vision-language capabilities across reasoning, coding, and visual understanding tasks[4]
Sampling_parameters
- โขPresence penalty: Repeat alpha presence penalty (default: 0.0, disabled)[2]
- โขFrequency penalty: Repeat alpha frequency penalty (default: 0.0, disabled)[2]
- โขRepeat penalty: Penalize repeat sequence of tokens (default: 1.0, disabled)[2]
- โขDRY sampling: Multiplier (default: 0.0), base value (default: 1.75), allowed length (default: 2)[2]
- โขTemperature, top-p, top-k, min-p, and typical sampling also available for fine-grained control[2][5]
๐ฎ Future ImplicationsAI analysis grounded in cited sources
โณ Timeline
๐ Sources (8)
Factual claims are grounded in the sources below. Forward-looking analysis is AI-generated interpretation.
Weekly AI Recap
Read this week's curated digest of top AI events โ
๐Related Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: Reddit r/LocalLLaMA โ
This is a summary, not the original. Read the source, or get the weekly briefing.
Weekly AI briefing
One email a week. Unsubscribe anytime.