home / skills / jeremylongshore / claude-code-plugins-plus-skills / orchestrating-test-execution
/plugins/testing/test-orchestrator/skills/orchestrating-test-execution
This skill coordinates parallel test execution across environments and frameworks, delivering automated orchestration, results analysis, and actionable reports.
npx playbooks add skill jeremylongshore/claude-code-plugins-plus-skills --skill orchestrating-test-executionReview the files below or copy the command above to add this skill to your agents.
---
name: orchestrating-test-execution
description: |
Test coordinate parallel test execution across multiple environments and frameworks.
Use when performing specialized testing.
Trigger with phrases like "orchestrate tests", "run parallel tests", or "coordinate test execution".
allowed-tools: Read, Write, Edit, Grep, Glob, Bash(test:orchestrate-*)
version: 1.0.0
author: Jeremy Longshore <[email protected]>
license: MIT
---
# Test Orchestrator
This skill provides automated assistance for test orchestrator tasks.
## Prerequisites
Before using this skill, ensure you have:
- Test environment configured and accessible
- Required testing tools and frameworks installed
- Test data and fixtures prepared
- Appropriate permissions for test execution
- Network connectivity if testing external services
## Instructions
### Step 1: Prepare Test Environment
Set up the testing context:
1. Use Read tool to examine configuration from {baseDir}/config/
2. Validate test prerequisites are met
3. Initialize test framework and load dependencies
4. Configure test parameters and thresholds
### Step 2: Execute Tests
Run the test suite:
1. Use Bash(test:orchestrate-*) to invoke test framework
2. Monitor test execution progress
3. Capture test outputs and metrics
4. Handle test failures and error conditions
### Step 3: Analyze Results
Process test outcomes:
- Identify passed and failed tests
- Calculate success rate and performance metrics
- Detect patterns in failures
- Generate insights for improvement
### Step 4: Generate Report
Document findings in {baseDir}/test-reports/:
- Test execution summary
- Detailed failure analysis
- Performance benchmarks
- Recommendations for fixes
## Output
The skill generates comprehensive test results:
### Test Summary
- Total tests executed
- Pass/fail counts and percentage
- Execution time metrics
- Resource utilization stats
### Detailed Results
Each test includes:
- Test name and identifier
- Execution status (pass/fail/skip)
- Actual vs. expected outcomes
- Error messages and stack traces
### Metrics and Analysis
- Code coverage percentages
- Performance benchmarks
- Trend analysis across runs
- Quality gate compliance status
## Error Handling
Common issues and solutions:
**Environment Setup Failures**
- Error: Test environment not properly configured
- Solution: Verify configuration files; check environment variables; ensure dependencies are installed
**Test Execution Timeouts**
- Error: Tests exceeded maximum execution time
- Solution: Increase timeout thresholds; optimize slow tests; parallelize test execution
**Resource Exhaustion**
- Error: Insufficient memory or disk space during testing
- Solution: Clean up temporary files; reduce concurrent test workers; increase resource allocation
**Dependency Issues**
- Error: Required services or databases unavailable
- Solution: Verify service health; check network connectivity; use mocks if services are down
## Resources
### Testing Tools
- Industry-standard testing frameworks for your language/platform
- CI/CD integration guides and plugins
- Test automation best practices documentation
### Best Practices
- Maintain test isolation and independence
- Use meaningful test names and descriptions
- Keep tests fast and focused
- Implement proper setup and teardown
- Version control test artifacts
- Run tests in CI/CD pipelines
## Overview
This skill provides automated assistance for test orchestrator tasks.
This skill provides automated assistance for the described functionality.
## Examples
Example usage patterns will be demonstrated in context.This skill coordinates parallel test execution across multiple environments and frameworks to reduce feedback time and improve test reliability. It helps prepare environments, launch concurrent test jobs, monitor progress, and consolidate results into actionable reports. Use it to standardize orchestration across CI systems and local test farms.
The skill inspects environment configuration and verifies prerequisites before initializing test runners and loading dependencies. It invokes test frameworks via shell commands or APIs, dispatches parallel workers across target environments, and streams execution logs and metrics. After runs complete it aggregates pass/fail data, performance metrics, and failure traces to produce consolidated reports and recommendations.
What prerequisites are required?
Ensure test environments are reachable, required frameworks and dependencies are installed, test data/fixtures are prepared, and you have permissions to run tests on target hosts.
How are timeouts and resource limits handled?
Configure worker counts and per-test timeouts before execution; the orchestrator recommends tuning based on observed resource utilization and can fall back to serial runs if resources are exhausted.
What outputs does the skill produce?
A consolidated test summary with pass/fail counts, execution time, resource utilization, per-test details (status, errors, stack traces), coverage and performance metrics, and recommendations for fixes.