toolspool

kluster.ai

Paid

What it does

kluster.ai is an AI cloud platform offering serverless inference and fine-tuning with higher rate limits, predictable performance, and cost savings of up to 50%. It provides a developer-friendly AI cloud with tools for AI inference, scalable AI solutions, batch and real-time AI inference, cost-effective AI tools, and AI integration tools. It supports LLM batch processing and models like LLAMA 3.3, LLAMA 3.1m, and DeepSeek-R1.

How to use: Developers can deploy, scale, and fine-tune models using the kluster.ai platform. The platform offers an OpenAI compatible API, allowing users to submit requests and receive responses. Users can also fine-tune AI models by uploading datasets, starting fine-tuning jobs, and monitoring progress.

Core features

  • Adaptive Inference for intelligent scaling
  • Serverless inference and fine-tuning
  • Batch and real-time AI inference
  • OpenAI compatible API

Use cases

  • Analyzing vast amounts of EMRs, lab reports, and case histories in healthcare to identify eligible patients for clinical trials.
  • Performing monthly customer segmentation jobs with fine-tuned LLMs at a fraction of the cost of self-hosting.
  • Handling high volumes of AI requests without hitting rate limits.

Pricing

Qwen3-235B-A22B: $0.15 input/ $2 output
Qwen3-235B-A22B: $0.10 input/ $1.50 output
Qwen3-235B-A22B: $0.08 input/ $1.00 output
Qwen3-235B-A22B: $0.06 input/ $0.75 output
Qwen2.5-VL-7B-Instruct: $0.30 input/output
Qwen2.5-VL-7B-Instruct: $0.15
Qwen2.5-VL-7B-Instruct: $0.10
Qwen2.5-VL-7B-Instruct: $0.05
Llama 4 Maverick: $0.2 input/ $0.8 output
Llama 4 Maverick: $0.25
Llama 4 Maverick: $0.20
Llama 4 Maverick: $0.15
Llama 4 Scout: $0.8 input/ $0.45 output
Llama 4 Scout: $0.15
Llama 4 Scout: $0.12
Llama 4 Scout: $0.10
DeepSeek-V3-0324: $0.7 input/ $1.4 output
DeepSeek-V3-0324: $0.63
DeepSeek-V3-0324: $0.50
DeepSeek-V3-0324: $0.35
DeepSeek-R1: $3 input/ $5 output
DeepSeek-R1: $3.50
DeepSeek-R1: $3.00
DeepSeek-R1: $2.50
Gemma 3: $0.35 input/output
Gemma 3: $0.30
Gemma 3: $0.25
Gemma 3: $0.20
Llama 8B Instruct Turbo: $0.18 input/output
Llama 8B Instruct Turbo: $0.05
Llama 8B Instruct Turbo: $0.04
Llama 8B Instruct Turbo: $0.03
Llama 70B Instruct Turbo: $0.70 input/output
Llama 70B Instruct Turbo: $0.20
Llama 70B Instruct Turbo: $0.18
Llama 70B Instruct Turbo: $0.15
M3-Embeddings: $0.01 input
M3-Embeddings: $0.005
M3-Embeddings: $0.005
M3-Embeddings: $0.005
Mistral NeMo: $0.025 input/ $0.07 output
Mistral NeMo: $0.02 input/ $0.06 output
Mistral NeMo: $0.018 input/ $0.05 output
Mistral NeMo: $0.017 input/ $0.045 output