toolspool

Compare tools

Side-by-side features, use cases and pricing — because the right pick depends on your job and budget, not just the ranking.

⇄ Comparison dimension — pick the market you're actually shopping in

Groq logo
Groq
✓ verifiedFreemium

Fast, low-cost AI inference provider running LLMs on custom LPU chips via GroqCloud's pay-as-you-go API.

3.6M visits/mo
Runpod logo
Runpod
✓ verifiedPaid

Developer-focused GPU cloud offering on-demand pods, serverless inference and multi-node clusters at per-second pricing for AI workloads.

2.3M visits/mo
Fireworks AI logo
Fireworks AI
✓ verifiedPaid

Developer platform for fast serverless inference and training of open generative models, billed per token or GPU-second.

611K visits/mo1.3K saves
Modal logo
Modal
✓ verifiedFreemium

Serverless AI cloud for running inference, training and sandboxes on GPUs with fast cold starts and pay-per-use billing.

988K visits/mo
ZenMux logo
ZenMux
✓ verifiedPaid

Enterprise unified API gateway giving one integration point to 100+ LLMs like Claude, GPT, and Gemini with reliability guarantees.

435K visits/mo11K saves
Pricing
GPT-OSS 20B: $0.075 per 1M input tokens ($0.30 per 1M output)
GPT-OSS 120B: $0.15 per 1M input tokens
Pods A40 48GB: $0.44/hr
Pods RTX 4090 24GB: $0.69/hr
Pods A100 SXM 80GB: $1.49/hr
Pods H100 SXM 80GB: $2.99/hr
Pods H200 141GB: $4.39/hr
Pods B300 288GB: $7.39/hr
On-Demand H100/H200: $7/GPU-hour
On-Demand B200: $10/GPU-hour
On-Demand B300: $12/GPU-hour
Fine-tuning (LoRA SFT, models up to 16B): from $0.50 per 1M training tokens
Starter: $0/mo + compute ($30 free credit)
Team: $250/mo + compute

No public pricing

Core features
  • LPU custom inference hardware
  • GroqCloud tokens-as-a-service API
  • High-speed, low-latency inference
  • Pay-as-you-go token pricing
  • Free API key to start
  • Broad open-model support
  • On-demand GPU pods across 30+ GPU types and 31 regions
  • Serverless GPU endpoints with sub-200ms cold starts
  • Zero idle cost billing for inference workloads
  • Multi-node clusters for distributed training
  • Persistent network storage for full pipelines
  • Real-time logs, monitoring and autoscaling from 0 to hundreds of workers
  • Serverless per-token inference with OpenAI/Anthropic-compatible APIs
  • On-demand dedicated and reserved GPU deployments
  • Fine-tuning and reinforcement-learning training pipelines
  • Large library of open LLM, vision, image and audio models
  • Optimized inference engine for throughput and latency
  • Serverless GPU compute defined in Python
  • Sub-second container cold starts
  • Autoscale 0 to 1000+ GPUs
  • Inference, training and batch workloads
  • Secure sandboxes for untrusted code
  • Built-in logging and observability
  • Unified API for 100+ AI models
  • Intelligent request routing across models
  • AI Model Insurance for quality/reliability guarantees
  • Enterprise-focused LLM access layer
Use cases
  • Running LLM inference at high speed
  • Cutting inference costs at scale
  • Powering low-latency AI chat apps
  • Serving models via a hosted API
  • Renting GPUs for model training and fine-tuning
  • Deploying low-latency real-time inference APIs
  • Running AI agents that need to scale instantly
  • Processing compute-heavy batch or distributed workloads
  • Serving open models in production apps and agents
  • Fine-tuning models on private data
  • Powering code assistants, chatbots and RAG at scale
  • Deploying and scaling model inference
  • Fine-tuning and training models
  • Running batch/parallel AI jobs
  • Executing untrusted code in sandboxes
  • Building applications that need failover across multiple LLM providers
  • Consolidating billing/access to many AI models under one API
  • Enterprises requiring guaranteed model output reliability
Visit
More in Model Hosting Inference