Model Registry: Torrents for open models using Hugging Face as a fallback web seed
English summary
Developer Ravindra Marella created Model Registry, a GitHub repository and website for sharing .torrent files of popular open models. The system uses a custom backend service to redirect BitTorrent client requests to Hugging Face URLs, providing a web seed fallback when no peers are available. The service is currently experimental, with occasional CDN errors that usually succeed after retries. Plans include automating torrent creation and publishing via GitHub Actions, though the free runners' 100 GB disk limit is a hurdle for models over 100 GB.
Chinese summary
开发者Ravindra Marella创建了Model Registry,一个用于分享流行开放模型种子文件的GitHub仓库和网站。系统通过自定义后端服务将BitTorrent客户端请求重定向到Hugging Face URL,在没有其他对等节点时提供Web种子后备。该服务目前为实验阶段,偶尔出现CDN错误,重试后通常成功。计划通过GitHub Actions自动化种子创建与发布,但免费运行器的100 GB磁盘限制对超过100 GB的模型构成障碍。
Key points
Model Registry shares .torrent files for popular open models, enhancing decentralized distribution.
Model Registry分享流行开放模型的种子文件,增强去中心化分发。
Uses Hugging Face as a fallback web seed via a custom backend that handles LFS file redirects for BitTorrent clients.
通过自定义后端处理BitTorrent客户端的LFS文件重定向,将Hugging Face用作后备Web种子。
The service is experimental with occasional HF CDN errors, resolvable by retrying downloads.
服务尚在实验阶段,偶尔出现HF CDN错误,重试后可解决。
Plans to automate the pipeline with GitHub Actions are limited by the 100 GB disk space of free runners, requiring alternatives for large models.
计划用GitHub Actions自动化流程,但免费运行器100 GB磁盘空间限制了大模型,需寻找替代方案。