PromptMage
Open-source Python framework for building, versioning, and testing multi-step LLM applications with a self-hosted playground.
What it does
PromptMage is an open-source Python framework for developing complex, multi-step LLM applications. It provides a prompt playground for testing and comparing prompts, built-in version control for tracking prompt changes, an auto-generated FastAPI-based API, and tools for manual and automatic evaluation.
Core features
Python framework for multi-step LLM workflows
Built-in prompt version control
Interactive prompt playground for testing
Auto-generated FastAPI integration
Manual and automatic evaluation mode
Self-hosted deployment
Best for
→Developers building custom LLM-powered applications
→Small teams tracking prompt iteration history
→Researchers evaluating prompt performance before deployment