Installation
Quick Start
- Your agent’s endpoint URL
- Knowledge source for test questions
- Run evaluation and display results
Knowledge Sources
1. Local Files (default)
Create aqanda.json file in your current directory:
2. Pinecone Database
3. PostgreSQL Database
Templates
Use pre-configured evaluation scenarios with the-t flag:
Command Line Options
Basic Options
| Option | Description | Example |
|---|---|---|
-t, --template <name> | Use a pre-configured template | rippletide eval -t banking_analyst |
-a, --agent <url> | Agent endpoint URL | rippletide eval -a localhost:8000 |
-k, --knowledge <source> | Knowledge source: files, pinecone, or postgresql | rippletide eval -k pinecone |
--debug | Show detailed error information | rippletide eval --debug |
-h, --help | Show help message | rippletide --help |
Custom Endpoint Options
For agents that don’t use the default request/response format, you can customize headers, the request body, and the response field:| Option | Description |
|---|---|
-H, --headers <headers> | Custom headers, comma-separated (e.g. "Authorization: Bearer token, X-Key: value") |
-B, --body <template> | Custom request body template. Use {question} as placeholder for the test question |
-rf, --response-field <path> | Path to the answer in the JSON response, using dot notation (e.g. data.response) |
Agent Endpoint Requirements
Your endpoint must accept POST requests and return responses in one of these formats:-B and -rf flags above.
Results
After evaluation, you’ll receive:- Summary: Total tests, passed/failed count, duration
- Dashboard URL: Link to view detailed results and hallucination analysis at trust.rippletide.com
Troubleshooting
Permission errors during installation:Support
- GitHub: github.com/rippletideco/starter
- Discord: discord.gg/zUPTRH5eFv