Hugging Face Inference Is Now Powered by OpenRouter
Summary
Hugging Face has partnered with OpenRouter to route all inference requests through OpenRouter, providing users with access to various model providers directly from Hugging Face model pages. This integration allows users to view detailed provider metrics (such as price per million tokens and tokens per second) and manage usage, billing, and specific provider access within the Hugging Face ecosystem.
Key takeaways
-
Unified Inference Routing
Hugging Face requests are now routed via OpenRouter to ensure the 'best possible inference' is available, regardless of the underlying provider.
-
Advanced Model Metrics
0:01
The platform displays detailed metrics for selected models, including price per million tokens (input/output), tokens per second, time to first token, and context window.
-
Coding Agent Integration
0:02
Models can be utilized directly within various coding agents, including Pi coding agent, Open Code, Claude Code, and Codex.
-
Provider Control and Filtering
0:03
Users can manage inference providers in settings, allowing them to filter out or disable specific providers (e.g., Novita, Cerebras, Fal) from automatic routing.
Technical details
-
Model and Provider Specifics
1s
The DeepSeek-V4.1-Flash-1017 checkpoint is cited as a current example of an open-weight model available through the system.
-
Billing and Credits
2s
Hugging Face Pro accounts include $2 monthly credits, which are stated to be sufficient for approximately 150 million tokens of DeepSeek-V4.1-Flash, assuming prompt caching.
-
Pricing Transparency
2s
The displayed prices are guaranteed to have no markup and match the prices announced by OpenRouter.
Mentioned resources
Channel & topics
Watch on YouTube · Back to latest
This independent, AI-assisted summary is provided for commentary and informational purposes. It may contain errors or omit important context. Please watch the original video for the creator's complete presentation. Video, thumbnail, and related copyrights belong to their respective owners.