Label Studio
Data labellingIndependent review. IonBin has no partnership with Label Studio and was not paid for this page. Our evaluation is our own, based on public documentation and our research. Product names are trademarks of their owners and are used for identification only. How disclosure works.
Annotation software for turning examples into reviewed labels. Match the edition and task configuration to the review process. Documentation checked; not hands-on tested.
Reference entry: listed because workflows on IonBin use it. IonBin has no affiliate or paid relationship with Label Studio.
- Labelling text, images or other task data
- Keeping annotation exports for evaluation work
- Assuming Community includes Enterprise review and assignment features
Top use cases
- Import task data for annotation source ↗
- Read projects and annotations through the official MCP server source ↗
In depth
Define the label before collecting it
Write a task-specific rubric and resolve ambiguous examples before using annotations as reference data. A label is a reviewer decision, not proof that the underlying source is correct. source ↗
Check the edition
Community software and commercial offerings differ. Verify review, access-control and assignment features for the edition you deploy. source ↗
How to use it with AI
How Label Studio connects to each AI platform: native connector or MCP, API through code the agent writes, browser control, or file upload.
| Platform | MCP / connector | API (agent-written code) | Browser | Upload / export |
|---|---|---|---|---|
| Claude (incl. Claude Code) | Not documented Label Studio has an official MCP server and Claude (incl. Claude Code) supports MCP, but Label Studio's docs don't name this pairing. Auth setup may differ. Label Studio MCP docs ↗Claude (incl. Claude Code) MCP docs ↗ | Not documented Claude (incl. Claude Code): Claude Code edits files and runs commands Label Studio publishes an API, but this pairing still needs network, authentication and execution-scope checks. Label Studio API ↗Claude (incl. Claude Code) docs ↗ | Inferred Claude Code with the Claude in Chrome extension (Chrome, Edge and other Chromium browsers). Label Studio is a web app; the pairing itself is not documented. Claude (incl. Claude Code) browser docs ↗ | Not documented Verify which side exports and which imports, supported formats and permissions. Label Studio's recorded upload/import status is yes; Claude (incl. Claude Code)'s file status is yes. These flags do not establish a file-transfer route. Label Studio file docs ↗Claude (incl. Claude Code) file docs ↗ |
| OpenAI Codex | Not documented Label Studio has an official MCP server and OpenAI Codex supports MCP, but Label Studio's docs don't name this pairing. Auth setup may differ. Label Studio MCP docs ↗OpenAI Codex MCP docs ↗ | Not documented OpenAI Codex: Edits files and runs commands locally; cloud tasks run in isolated workspaces Label Studio publishes an API, but this pairing still needs network, authentication and execution-scope checks. Label Studio API ↗OpenAI Codex docs ↗ | Inferred Only in the ChatGPT desktop app; not in the Codex CLI or IDE extension. Label Studio is a web app; the pairing itself is not documented. OpenAI Codex browser docs ↗ | Not documented Verify which side exports and which imports, supported formats and permissions. Label Studio's recorded upload/import status is yes; OpenAI Codex's file status is yes. These flags do not establish a file-transfer route. Label Studio file docs ↗OpenAI Codex file docs ↗ |
| Google Antigravity | Not documented Label Studio has an official MCP server and Google Antigravity supports MCP, but Label Studio's docs don't name this pairing. Auth setup may differ. Label Studio MCP docs ↗Google Antigravity MCP docs ↗ | Not documented Google Antigravity: Agents edit code and run tasks Label Studio publishes an API, but this pairing still needs network, authentication and execution-scope checks. Label Studio API ↗Google Antigravity docs ↗ | Inferred The /browser guide documents App and CLI support through Chrome DevTools MCP; the overview comparison conflicts on CLI availability. IDE browser features are separate. Label Studio is a web app; the pairing itself is not documented. Google Antigravity browser docs ↗ | Not documented Verify which side exports and which imports, supported formats and permissions. Label Studio's recorded upload/import status is yes; Google Antigravity's file status is yes. These flags do not establish a file-transfer route. Label Studio file docs ↗Google Antigravity file docs ↗ |
Confirmed is reserved for evidence of the specific connection route. The current named integrations include plugins, skills and CLIs, so a named platform alone does not confirm MCP or a native connector. Inferred means each side documents a relevant capability, but no document describes the pairing. Code execution still needs network and credential access; file handling still needs a compatible format and transfer direction. Not documented means the records do not establish the route. IonBin has not tested these pairings. Recorded Oct 18, 2026.
Agent compatibility
| Level | Status | Detail / source |
|---|---|---|
| Native connector / MCP | Yes | Official docs ↗ |
| API / CLI | Yes | Official docs ↗ |
| Browser / manual | No | Browser access is recorded alongside a documented programmatic route. |
| File upload / import | Yes | Official docs ↗ |
Recorded Oct 18, 2026. Setup and plan limits vary; check the vendor's docs. How levels are assigned.
Appears in these proposed stacks
AI evaluation & quality control Swap-in
An official MCP server is documented for this tool. These platforms separately document MCP client support: ChatGPT, Claude, Cursor, Gemini (Google), Google Antigravity, Grok, Grok Bot, Lindy, LM Studio, Mistral Vibe, OpenAI Codex. This inventory does not establish compatible transport, authentication or actions for a pairing. Check the connection matrix and linked sources.
Automation hubs to assess for a custom API connection: Gumloop, Make, n8n, Zapier. Verify credentials, supported requests, limits and error handling; no configured integration is implied.
Workflows using this tool
Explained in the wiki
Review
No long-form review yet. Verdict is based on research, not hands-on testing.