license: apache-2.0
library_name: mlx
datasets:
- DavidAU/ST-TheNextGeneration
language:
- en
- fr
- zh
- de
tags:
- programming
- code generation
- code
- codeqwen
- moe
- coding
- coder
- qwen2
- chat
- qwen
- qwen-coder
- Qwen3-Coder-30B-A3B-Instruct
- Qwen3-30B-A3B
- mixture of experts
- 128 experts
- 8 active experts
- 1 million context
- qwen3
- finetune
- brainstorm 20x
- brainstorm
- optional thinking
- qwen3_moe
- unsloth
- mlx
base_model: DavidAU/Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-III
pipeline_tag: text-generation
Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-III-mxfp4-mlx
This quant is scheduled to be deleted due to the limits on accounts imposed by HuggingFace.
There is nothing I can do but delete old models to make room.
Please archive this model locally as I will not be able to upload a new one.
You can still use the slightly larger Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-III qx86-hi-mlx instead, it performs much better, besides I am the only one being able to create the qx quants.
If you want to create your own mxfp4 model from a source, you can use the mlx tools as follows:
mlx_lm.convert --hf-path My/Model --mlx-path My-Model-mxfp4-mlx -q --q-bits 4 --q-group-size 32 --q-mode mxfp4
And then you wait. You need a lot of RAM and patience.
Sorry for the inconvenience.
-G
This model [Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-III-mxfp4-mlx]a(https://huggingface.co/Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-III-mxfp4-mlx) was converted to MLX format from DavidAU/Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-III using mlx-lm version 0.28.2.
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-III-mxfp4-mlx")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)