OpenAI catalog / Microsoft CLI / skills/.curated/playwright/SKILL.md
Playwright CLI
A terminal-driven browser workflow for navigation, form interaction, screenshots and UI debugging. This catalog version is a historical reference.
Runtime probed · reviewed · A helper or bounded runtime behavior was probed. This does not establish model task effectiveness or comprehensive security.
01 / Task fit
Where it may help.
These are intended uses indicated by the upstream material. They are not measured outcomes.
- Understanding a browser automation workflow
- Comparing CLI browser tooling and its access requirements
02 / Setup & access
What it asks of your environment.
Requirements
- Node.js/npm with npx on PATH, Bash for the bundled wrapper and a working browser runtime.
- The wrapper resolves @playwright/cli through npx; package/browser setup and target-page access may require networking.
- No skill-specific API key is specified. Private sites need their own authorized account/session; host-agent access is separate.
- The Bash wrapper and Unix examples are not a verified native-PowerShell workflow.
Permissions & data access
- Run an npm-distributed CLI and browser subprocesses.
- Navigate websites, fill and submit forms, and write screenshots or traces.
- An authenticated browser can act with the authority of the account signed into the target site.
Instructions alone do not enforce a sandbox. The agent host, connected tools and approvals determine what the skill can actually read, change or send.
03 / Things to check
Security concerns & practical limits.
These concerns follow from the reviewed sources. They describe possible exposure or required review; they are not confirmed vulnerabilities.
Review before use
Unpinned executable dependency
The wrapper uses npx --yes --package @playwright/cli without a package version. IonBin assessment: pin and review the CLI package separately; a pinned skill commit does not pin the executable it launches.
Higher attention
Browser actions can change accounts
The skill includes form submission and trace capture. IonBin assessment: constrain target sites and consequential actions, and protect artifacts that may contain private page content.
Limits and nuances
- The openai/skills README marks the repository deprecated and points to openai/plugins for current examples.
- Review covers this catalog skill and wrapper, not the npm package, browser internals or current successor plugin.
- No authentication, browser compatibility or real-site workflow was exercised.
- OpenAI directs current skill/plugin examples to openai/plugins. Its inspected tree has Vercel agent-browser examples but no direct playwright-named skill; no equivalent drop-in migration was verified.
04 / Review record
What we checked. What’s still open.
Recorded review scope
- Entire SKILL.md
- Entire scripts/playwright_cli.sh
- README.md deprecation notice
- LICENSE.txt
- Bounded evaluation; exact operations, counts, environment and limitations in the linked public report
Not tested or established
- No effectiveness benchmark or security certification
- Transitive dependencies, current advisories and host-agent permission controls not audited
- No audit of @playwright/cli or browser dependencies
- Five wrapper dispatch checks used a fake npx, plus one Git Bash environment check
- No real npx, npm package, Playwright CLI or target browser workflow was executed
- Review date
- Source revision
49f948faa9258a0c61caceaf225e179651397431- Our relationship
- Explored. Investigated through the recorded review. No use or replication is claimed.
Upstream content can change after review. A repository revision identifies source scope; it does not prove that every script, dependency or runtime behavior was tested. How freshness is handled.
Recorded evaluation / Helper probe
Results with their limits attached.
Five mocked npx dispatch checks and Bash startup passed. The actual CLI package, browser workflow and authentication were not exercised.
- Passed
- 6
- Failed
- 0
- Total recorded
- 6
These counts refer to the cases in this report. They are not a benchmark against other skills. A helper probe does not measure model task effectiveness or establish comprehensive security.
Read the evidence reportDownload the authored reproduction harness (JSON bundle) ↗
The report provides the case definitions, observations and baseline scope. Missing baselines or untested behaviors remain limitations.
Recorded environment
- Windows-11-10.0.26200-SP0; Python 3.12.10; Node 24.18.0; Chrome 155.0.8059.82
- Synthetic local fixtures; minimal child environment; no live account or credential; no OS sandbox
- Dependencies: pypdf 6.19.0, reportlab 4.4.9, Pillow 12.3.0, pdf2image 1.17.0, defusedxml 0.7.1
- Git Bash 5.3.15(1)-release (x86_64-pc-cygwin); Poppler 26.07.0
Recorded commands (1)
Commands document this evaluation. They are not setup instructions for your environment.
python run_evals.py --runtime-libs <existing-bundled-site-packages> --poppler-bin <poppler-binaries>Findings from this evaluation
No individual findings were recorded. This does not establish the absence of risk.
Evaluation limitations
- Five wrapper dispatch checks used a fake npx, plus one Git Bash environment check
- No real npx, npm package, Playwright CLI or target browser workflow was executed
- No install/compatibility, live-site, account, session-security or artifact-confidentiality claim follows
- The wrapper still delegates to an unpinned npm package; these checks do not evaluate that package
- This is the historical catalog revision, not the current successor plugin
- Supervised local processes, not an OS sandbox
- No container, VM or memory/resource quota
- Application guards do not establish containment of arbitrary hostile code
- No real credential, remote account, or destructive-effect testing
05 / Reuse & discovery
License, attribution & popularity.
Apache-2.0
Per-skill license includes a Microsoft copyright notice. This review did not audit the npm package's separate dependency licenses.
Why it is in this collection
Rounded repository-wide GitHub stars observed in the public repository page; not skill installs, a quality score, or a measured trend.
28,100 repository stars (rounded)
- Scope
- Repository-wide; not individual skill usage.
- Observed
- Time window
- Single observation; no trend is established.
Popularity and inclusion do not establish quality, compatibility or security. Counts belong to their named metric and date; they are not a current ranking.
06 / Follow the evidence
Go to the original.
- Browser workflow and prerequisite checks github.com
- Unpinned npx wrapper and Bash requirement github.com
- Repository deprecation and successor link github.com
- Per-skill license github.com
- Repository popularity context github.com
- Current catalog replacement tree inspected; no direct playwright skill found github.com
- Current OpenAI plugin catalog (not verified as the same Playwright implementation) github.com
IonBin’s source notes are independent assessments. Upstream authors retain their work and attribution. This page does not install or execute the skill.