Sign inSign up

arizephoenix/phoenix

By arizephoenix

β€’Updated 1 day ago

AI Observability & Evaluation - Evaluate, troubleshoot, and fine tune your LLM application

Image
Machine learning & AI
12

5M+

arizephoenix/phoenix repository overview

phoenix banner ⁠

⁠ ⁠ ⁠ ⁠ ⁠ ⁠ ⁠ ⁠ ⁠ ⁠ Add Arize Phoenix MCP server to Cursor

Phoenix is an open-source AI observability platform designed for experimentation, evaluation, and troubleshooting. It provides:

  • Tracing⁠ - Trace your LLM application's runtime using OpenTelemetry-based instrumentation.
  • Evaluation⁠ - Leverage LLMs to benchmark your application's performance using response and retrieval evals.
  • Datasets⁠ - Create versioned datasets of examples for experimentation, evaluation, and fine-tuning.
  • Experiments⁠ - Track and evaluate changes to prompts, LLMs, and retrieval.
  • Playground⁠- Optimize prompts, compare models, adjust parameters, and replay traced LLM calls.
  • Prompt Management⁠- Manage and test prompt changes systematically using version control, tagging, and experimentation.

Phoenix is vendor and language agnostic with out-of-the-box support for popular frameworks (πŸ¦™LlamaIndex⁠, πŸ¦œβ›“LangChain⁠, Haystack⁠, 🧩DSPy⁠, πŸ€—smolagents⁠) and LLM providers (OpenAI⁠, Bedrock⁠, MistralAI⁠, VertexAI⁠, LiteLLM⁠, Google GenAI⁠ and more). For details on auto-instrumentation, check out the OpenInference⁠ project.

Phoenix runs practically anywhere, including your local machine, a Jupyter notebook, a containerized deployment, or in the cloud.

⁠Installation

Install Phoenix via pip or conda

pip install arize-phoenix

Phoenix container images are available via Docker Hub⁠ and can be deployed using Docker or Kubernetes. Arize AI also provides cloud instances at app.phoenix.arize.com⁠.

⁠Packages

The arize-phoenix package includes the entire Phoenix platfom. However if you have deployed the Phoenix platform, there are light-weight Python sub-packages and TypeScript packages that can be used in conjunction with the platfrom.

⁠Subpackages
PackageLanguageDescription
arize-phoenix-otel⁠Python PyPI VersionProvides a lightweight wrapper around OpenTelemetry primitives with Phoenix-aware defaults
arize-phoenix-client⁠Python PyPI VersionLightweight client for interacting with the Phoenix server via its OpenAPI REST interface
arize-phoenix-evals⁠Python PyPI VersionTooling to evaluate LLM applications including RAG relevance, answer relevance, and more
@arizeai/phoenix-client⁠JavaScript NPM VersionClient for the Arize Phoenix API
@arizeai/phoenix-evals⁠TypeScript NPM VersionTypeScript evaluation library for LLM applications (alpha release)
@arizeai/phoenix-mcp⁠JavaScript NPM VersionMCP server implementation for Arize Phoenix providing unified interface to Phoenix's capabilities

⁠Community

Join our community to connect with thousands of AI builders.

⁠Breaking Changes

See the migration guide⁠ for a list of breaking changes.

Copyright 2025 Arize AI, Inc. All Rights Reserved.

Portions of this code are patent protected by one or more U.S. Patents. See the IP_NOTICE⁠.

This software is licensed under the terms of the Elastic License 2.0 (ELv2). See LICENSE⁠.

Tag summary

Content type

Image

Digest

sha256:c0de43c54…

Size

333.6 MB

Last updated

2 days ago

docker pull arizephoenix/phoenix