rt96 hub prompt tester

WHAT IT CONNECTS

What rt96 hub prompt tester gives an AI Agent

• Test prompts with OpenAI and Anthropic models
• Configure system prompts, user prompts, and other parameters
• Get formatted responses or error messages
• Easy environment setup with .env file support
• `OPENAI_API_KEY` - Your OpenAI API key
• `ANTHROPIC_API_KEY` - Your Anthropic API key
• Create a file named `.env` in your project directory or home directory
• Add your API keys in the following format:
• The server will automatically detect and load these keys
• None required
• `comparisons` (array): A list of 1-4 comparison configurations, each containing:
• `provider` (string): The LLM provider to use ("openai" or "anthropic")
• `model` (string): The model name
• `system_prompt` (string): The system prompt (instructions for the model)
• `user_prompt` (string): The user's message/prompt
• `temperature` (number, optional): Controls randomness
• `max_tokens` (integer, optional): Maximum number of tokens to generate
• `top_p` (number, optional): Controls diversity via nucleus sampling
• `start`: Begins a new conversation
• `continue`: Continues an existing conversation
• `get`: Retrieves conversation history
• `list`: Lists all active conversations
• `close`: Closes a conversation
• `mode` (string): Operation mode ("start", "continue", "get", "list", or "close")
• `conversation_id` (string): Unique ID for the conversation (required for continue, get, close modes)
• `provider` (string): The LLM provider (required for start mode)
• `model` (string): The model name (required for start mode)
• `system_prompt` (string): The system prompt (required for start mode)
• `user_prompt` (string): The user message (used in start and continue modes)
• `temperature` (number, optional): Temperature parameter for the model
• `max_tokens` (integer, optional): Maximum tokens to generate
• `top_p` (number, optional): Top-p sampling parameter
• **Discovery**: The agent can use `list_providers` to discover available models and their capabilities
• **Simple Testing**: For quick tests, use the `test_comparison` tool with a single configuration
• **Comparison**: When the agent needs to evaluate different prompts or models, it can use `test_comparison` with multiple configurations
• **Stateful Interactions**: For multi-turn conversations, the agent can manage a conversation using the `test_multiturn_conversation` tool
• Test prompt variants to find the most effective phrasing
• Compare different models for specific tasks
• Maintain context in multi-turn conversations
• Optimize parameters like temperature and max_tokens
• Track token usage and costs during development
• `OPENAI_API_KEY` - Your OpenAI API key
• `ANTHROPIC_API_KEY` - Your Anthropic API key
• `LANGFUSE_SECRET_KEY` - Your Langfuse secret key
• `LANGFUSE_PUBLIC_KEY` - Your Langfuse public key
• `LANGFUSE_HOST` - URL of your Langfuse instance