job completed mlx-community/Qwen2.5-Coder-7B-Instruct-4bit • 91 tok
job started mlx-community/Llama-3.2-1B-Instruct-4bit • streaming first tokens
job completed mlx-community/Qwen2.5-3B-Instruct-4bit • 184 tok
job completed mlx-community/Meta-Llama-3.1-8B-Instruct-4bit • 132 tok
job started mlx-community/Qwen2.5-Coder-7B-Instruct-4bit • warming cache