Fast multilingual decision engine that turns any text into typed choice, score, and yes/no answers in a single forward pass.

Open baseline for semantic ifs that reads typed option probabilities straight from open models with no text generation.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Go ahead and axolotl questions

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

AI Observability & Evaluation

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

The platform for LLM evaluations and AI agent testing

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

the LLM vulnerability scanner

Adding guardrails to large language models.

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

LLM Prompt Injection Detector

sentence-similarity

feature-extraction

feature-extraction

sentence-similarity

sentence-similarity

sentence-similarity

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator