Agent skill marketplaces need a safety listing standard.
Reusable agent skills are software packages with authority. If a marketplace lets skills touch files, memory, browsers, SaaS tools, messages, workflows, or customers, the listing needs to disclose the contract before installation.
The risk
Many skill listings describe only the happy path. A useful listing exposes the trust boundary: allowed actions, expected data, tool scope, memory behavior, receipts, exception handling, and eval evidence.
Minimum listing standard
Identity
Job-to-be-done, non-goals, intended runner, version, owner.
Input contract
Required inputs, forbidden inputs, private-data boundaries, freshness assumptions.
Tool authority
Allowed tools, forbidden tools, destructive/spend/external-action policy.
Output contract
Expected artifact/schema, evidence requirements, confidence notes.
Receipts + memory
What gets logged, what may be read/written/proposed/expired, and what must never be stored.
Exceptions + evals
When to stop or escalate, plus happy-path, edge-case, adversarial, and rollback tests.
Three-lane review workflow
| Lane | When to use | Required checks | Outcome |
|---|---|---|---|
| Self-attested | Low-risk text-only skills | Listing fields + 30-minute review kit | Publish with low-risk label |
| Verified | Files, memory, browser, SaaS, or messaging authority | Scorecard + sample receipts + eval evidence | Feature only after fixes |
| Restricted | Spend, deletion, credentials, regulated data, customer-facing authority, irreversible actions | Human review + red-team cases + rollback plan | Pilot privately or reject |
Buyer-facing labels
- Text-only: no tools, no memory writes, no external actions.
- Reads local context: can inspect files, memory, or documents but should not modify them.
- Writes local state: can edit files, create artifacts, or propose memory updates.
- Controls tools: can use browser, SaaS, shell, APIs, or workflow systems.
- External action: can message, post, submit forms, trigger workflows, or affect third parties.
- Restricted authority: spend, deletion, credentials, regulated data, or irreversible operations.
A skill can carry multiple labels. The highest-risk label should drive review depth.
Copy/paste marketplace policy
Fast implementation plan
- Day 1: Add the listing fields above to the submission form.
- Day 2: Add labels for tool/memory/external-action authority.
- Day 3: Require sample receipts and at least four eval cases for tool-using skills.
- Day 4: Create a restricted-authority review lane for spend, deletion, credentials, customer-facing workflows, and regulated data.
- Day 5: Publish the policy and apply it to all newly featured skills.
Resources
- Agent Skill Safety Review
- 30-Minute Agent Skill Review Kit
- Portable Agent Skill Contract Template
- Agent Marketplace Safety Checklist
- Buyer Due Diligence Checklist
- Sample Mini-Report