Off the Bit
Tools: Promptfoo
Category: Models and AI infrastructure
Site: github.com
Promptfoo
Testing, evaluation and red-teaming for prompts and agents, including vulnerability scanning.
Treats a prompt as something you can regression-test.
What it is sold for
Comparing model behaviour and probing for weaknesses.
Same shelf
The rest of models and ai infrastructure, alphabetically. Sharing a category is a filing decision, not a relationship.
- AI Dev Jobs MCP did not answerThe same job board exposed over MCP so an agent can search it. The endpoint refused a plain request.
- Clarifai did not answerComputer vision and model deployment APIs. The site timed out on every attempt.
- Anthropic's model family, and the one this catalogue's own tooling is written against.
- Claude MCP Servers did not answerA directory of MCP servers. The domain no longer resolves.
- Scores APIs on how usable they are without a human: auth method, headless operation, pricing transparency.
- Image recognition returning natural language descriptions rather than label sets.
- Meta's open-weight code model family, released with inference code and licence terms permitting commercial use.
- Mistral's code model, available through their platform and for local deployment under their licence.
ImranTools[Promptfoo]