Unsloth Releases GGUF Files for Cohere's North-Mini-Code-1.0 30B A3B Model
English summary
Unsloth has published GGUF quantizations for Cohere's new North-Mini-Code-1.0 model on Hugging Face. North-Mini-Code-1.0 is a 30B parameter code-focused language model with a 3B active parameter architecture (A3B). The GGUF files enable local inference using llama.cpp or compatible tools. A related pull request in llama.cpp (PR #24260) may be required for full model support. The model remains untested by the Reddit poster at the time of posting.
Chinese summary
Unsloth 已在 Hugging Face 上发布了 Cohere 新模型 North-Mini-Code-1.0 的 GGUF 量化文件。North-Mini-Code-1.0 是一个 30B 参数的代码语言模型，采用 3B 活跃参数架构 (A3B)。这些 GGUF 文件可支持通过 llama.cpp 或兼容工具进行本地推理。可能需要关联的 llama.cpp 拉取请求 (PR #24260) 才能实现完整模型支持。发帖时模型尚未经过原帖作者测试。
Key points
Unsloth uploaded GGUF files for Cohere's North-Mini-Code-1.0 model on Hugging Face.
Unsloth 在 Hugging Face 上传了 Cohere 的 North-Mini-Code-1.0 模型的 GGUF 文件。
North-Mini-Code-1.0 is a 30B parameter code model with a 3B active parameter architecture.
North-Mini-Code-1.0 是一个 30B 参数的代码模型，采用 3B 活跃参数架构。
GGUF files allow local inference with llama.cpp or compatible tools.
GGUF 文件允许使用 llama.cpp 或兼容工具进行本地推理。
A llama.cpp PR (#24260) may be related and needed for full support.
可能相关的 llama.cpp PR (#24260) 或为完整支持所需。
The model had not been tested by the poster at the time of the Reddit post.
发帖时，发帖人尚未测试该模型。