Runs integration tests against a real Metadata instance. These tests use actual API calls.
Usage
/run-integration [sdk]
Where [sdk] is optional: python, typescript, java, cli, n8n, or all (default).
Prerequisites
Integration tests require environment variables:
AI_SDK_HOST- Base URL of the Metadata instance (e.g.,https://your-instance.getcollate.io)AI_SDK_TOKEN- Valid JWT token for authenticationAI_SDK_TEST_AGENT- (Optional) Name of agent to test with
Commands
Run All Integration Tests
AI_SDK_HOST=https://... AI_SDK_TOKEN=... make test-integration
Run Individual SDK Tests
Python:
cd python && AI_SDK_HOST=... AI_SDK_TOKEN=... pytest tests/integration/ -v
TypeScript:
cd typescript && AI_SDK_HOST=... AI_SDK_TOKEN=... npm run test:integration
Java:
cd java && AI_SDK_HOST=... AI_SDK_TOKEN=... mvn test -Dtest=IntegrationTest
Rust CLI:
cd cli && AI_SDK_HOST=... AI_SDK_TOKEN=... cargo test --test integration_test
n8n:
cd n8n-nodes-metadata && AI_SDK_HOST=... AI_SDK_TOKEN=... npm run test:integration
What Integration Tests Verify
- Authentication - Token is valid and accepted
- Agent Discovery - Can list available agents
- Agent Invocation - Can invoke an agent and get response
- Streaming - SSE streaming works correctly (if
AI_SDK_RUN_CHAT_TESTS=true) - Error Handling - Proper errors for invalid requests
Troubleshooting
| Error | Cause | Fix |
|---|---|---|
| 401 Unauthorized | Invalid/expired token | Get fresh token from Metadata UI |
| 404 Not Found | Agent doesn't exist | Check AI_SDK_TEST_AGENT value |
| Connection refused | Wrong host URL | Verify AI_SDK_HOST |
| Timeout | Network/firewall issue | Check connectivity |
Notes
- Integration tests are skipped in CI unless secrets are configured
- Tests use real AI tokens when
AI_SDK_RUN_CHAT_TESTS=true - Always test locally before pushing changes that affect API calls