AI model and provider selection
Compares AI candidates on your real tasks, acceptable errors, operating constraints and cost per usable result.
ai-solution-benchmark-selection
Included files 1
SKILL.md
Team members: 9
Choose suitable APIs, bound spending and build measurable, recoverable AI workflows.
Choose suitable APIs, bound spending and build measurable, recoverable AI workflows.
Members: Alina, Cato, Ellis, Freya, Nia, Noel, Oswin, Selene, and Zora. Includes their complete profiles, portraits and 48 shared supporting skills.
Install the team, then assign it to a project. The shared specialists and their skill dependencies travel together.
AI provider and model selection specialist
Primary model:
Gemini Argon (latest)
AI token and spending limit engineer
Primary model:
Opus (latest)
AI usage and billing reconciliation specialist
Primary model:
GPT Astra (latest)
Tenant-aware RAG evidence engineer
Primary model:
Opus (latest)
Durable AI automation engineer
Primary model:
Opus (latest)
AI evaluation and release specialist
Primary model:
GPT Astra (latest)
MCP tool security engineer
Primary model:
Opus (latest)
AI context and cache efficiency specialist
Primary model:
Opus (latest)
AI execution tracing and recovery engineer
Primary model:
GPT Astra (latest)
Explore the skills assigned to this team. Open a card for a clear explanation, a practical example and the agents who use it.
Compares AI candidates on your real tasks, acceptable errors, operating constraints and cost per usable result.
ai-solution-benchmark-selection
SKILL.mdMakes LLM quality and failures inspectable by connecting execution traces to focused evaluations and reusable regression evidence.
llm-eval-observability
SKILL.mdProvides a consistent application-facing contract across LLM APIs while retaining the provider details needed for correct replay and accounting.
llm-provider-adapters
SKILL.mdHelps choose between realistic solutions by considering development effort, ongoing maintenance and the consequences of changing course later.
trade-off-lifecycle-cost-analysis
SKILL.mdTraces actual product, commercial and personal-data workflows before legal analysis or document drafting.
product-data-flow-discovery
SKILL.mdTests a risky technical assumption in a small controlled experiment before committing to an implementation approach.
empirical-micro-benchmark-prototyping
SKILL.mdLabels capability claims according to documentation, inspected source, executed experiments or explicit inference.
evidence-grading-research-verification
SKILL.mdReserves budget before billable AI work starts and reconciles usage without hiding unresolved provider charges.
ai-budget-admission-control
SKILL.mdChecks balance conservation, reservation limits and replay safety across generated financial and quota operations.
financial-quota-properties
SKILL.mdFinds why concurrent requests lose updates, create duplicates or violate business invariants.
data-concurrency-debugging
LICENSE.txtSKILL.mdTurns differing provider usage reports into comparable records while preserving cache, reasoning and incomplete-stream distinctions.
llm-token-cache-accounting
SKILL.mdCalculates costs against immutable effective-dated rates while keeping internal cost separate from customer charges.
versioned-pricing-cost-calculation
SKILL.mdTests whether concurrent operations preserve business invariants across controlled scheduling orders, with reproducible counterexamples when they fail.
concurrency-properties
SKILL.mdMakes agent execution recoverable through explicit lifecycle states, durable tool history and bounded continuation after interruption.
agent-runtime-state
SKILL.mdReconstructs AI charges from provider usage, pricing versions and internal records while keeping unexplained differences visible.
ai-provider-usage-reconciliation
SKILL.mdTests usage accounting for conservation, precise accumulation, duplicate delivery and historical pricing consistency.
metering-verification
SKILL.mdKeeps repeated usage events from creating duplicate charges while retaining a reconstructable accounting history.
deduplication-accounting-integrity
SKILL.mdConnects individual resource charges to owners and execution records, then compares internal totals with provider reports.
cost-attribution-reconciliation
SKILL.mdBuilds understandable cost reports whose totals lead to the underlying tasks, runs and immutable usage records.
cost-reporting-drill-down
SKILL.mdBuilds retrieval that can justify answers with authorized, versioned evidence and acknowledge when available sources do not support a claim.
tenant-rag-evidence-quality
SKILL.mdTests tenant boundaries adversarially using comparable data in two workspaces, including indirect relationships and shared infrastructure.
tenant-isolation-verification
SKILL.mdOrganizes reusable agent knowledge with source history, scope and freshness controls, then retrieves evidence suited to the current task.
agent-memory-retrieval
SKILL.mdExtends tenant isolation beyond database rows to caches, search suggestions, derived indexes and stored file access.
tenant-aware-cache-search-files
SKILL.mdOrganizes AI session context into stable instructions, verified history and current work so compaction preserves actionable state.
context-engineering
SKILL.mdPlaces deterministic controls around agent tools so untrusted documents cannot freely turn access to sensitive data into external actions.
agent-permissions-trust
SKILL.mdSeparates replayable workflow state from model calls and external actions so interrupted automation can resume safely.
durable-ai-automation
SKILL.mdMakes workflow progress traceable through runs, steps and attempts without showing unverified success.
execution-tracking-verification
SKILL.mdSeparates workflow meaning, canvas layout and execution history into explicit versioned models and state transitions.
workflow-semantics-state-modeling
SKILL.mdMakes workflows waiting for deadlines or external events survive restarts and duplicate wake-up signals.
durable-waits-event-correlation
SKILL.mdRecovers failed workflow steps using durable results, bounded retries and explicit handling of uncertain external effects.
retries-compensation
SKILL.mdAdds durable human decision points to workflows with exact request binding, decision permissions and clear expiry behavior.
approval-human-tasks
SKILL.mdEmbeds AI steps in workflows with validated outputs, durable checkpoints, scoped tools and evidence of external effects.
ai-tool-step-integration
SKILL.mdEvaluates AI changes against representative tasks, explicit failure severity and reproducible quality, cost and latency criteria.
ai-evaluation-release-gates
SKILL.mdChecks the credibility of property tests by validating independent expectations, meaningful generated cases and sensitivity to known faults.
test-oracle-generator-validation
SKILL.mdAllocates test effort according to the impact and likelihood of what a change could break.
risk-based-testing
LICENSE.txtSKILL.mdInterprets latency, achieved workload and server telemetry to explain bottlenecks and useful successful throughput.
performance-measurement-analysis
SKILL.mdVerifies a release in its actual runtime and selects a recovery path that accounts for data and schema effects.
deployment-verification-recovery
SKILL.mdDefines narrow model-accessible tools whose permissions are enforced by application code rather than tool descriptions.
mcp-tool-security-contracts
SKILL.mdDefines unambiguous AI tools with constrained inputs, validated execution and outputs that preserve useful context.
tool-calling-contracts
SKILL.mdRestricts agent actions to both the delegating person’s authority and the agent’s assigned purpose, including paused and resumed work.
agent-authorization
SKILL.mdChecks that people can only view and change what they are allowed to, including bulk actions and data exports.
authorization-verification
SKILL.mdConnects agent capabilities through typed tools, resources and subprocesses with strict transport and lifecycle handling.
mcp-cli-integration
SKILL.mdTranslates protocol requirements into an integration contract and checks where reference implementations or libraries differ from the specification.
protocol-spec-reference-analysis
SKILL.mdReduces unnecessary context and cache costs while preserving task constraints, source evidence and access boundaries.
ai-context-cache-efficiency
SKILL.mdTurns model responses into validated application data while treating incomplete streaming fragments as provisional.
structured-outputs-streaming
SKILL.mdReconstructs failed agent runs from durable evidence and chooses recovery without duplicating uncertain external work.
ai-trace-failure-recovery
SKILL.mdConnects logs, metrics and traces to concrete questions about failures, performance and user impact.
observability
LICENSE.txtSKILL.mdOrganizes incoming bug evidence into reported claims, observations and testable hypotheses before asking for missing context.
bug-intake-evidence-analysis
SKILL.md