validate-test

Imported from wrtnlabs/autobe-examples (qwen/qwen3.5-397b-a17b/reddit/.claude/skills/validate-test/SKILL.md). Install upstream with npx skills add wrtnlabs/autobe-examples --skill validate-test. Copyright stays with the author.

Validate Test Infrastructure

Validate that test infrastructure properly covers providers and interfaces. This skill only checks for discrepancies - it does NOT modify any files.

Purpose

Compare interface/provider implementations with test coverage and report:

• ✅ Matching items
• ❌ Mismatching items (needs fix)
• ⚠️ Items requiring review

Workflow

┌─────────────────────────────────────┐
│  Step 1: Read Interfaces            │
│  /src/api/structures/ (ICreate)     │
└───────────────┬─────────────────────┘
                │
                ▼
┌─────────────────────────────────────┐
│  Step 2: Read Test Files            │
│  /test/prepare/                     │
│  /test/generate/                    │
│  /test/features/api/                │
└───────────────┬─────────────────────┘
                │
                ▼
┌─────────────────────────────────────┐
│  Step 3: Compare & Report           │
│  - Missing prepare functions        │
│  - Missing generate functions       │
│  - Missing test scenarios           │
│  - Empty implementations            │
└─────────────────────────────────────┘

Step 1: Extract ICreate Interfaces

grep -r "export type ICreate\|\.ICreate" src/api/structures/ --include="*.ts"

List all interfaces that need test data generators.

Step 2: Read Test Files

# Prepare functions
find test/prepare -name "prepare_random_*.ts" -type f

# Generate functions
find test/generate -name "generate_random_*.ts" -type f

# Feature tests
find test/features/api -name "*.ts" -type f

Step 3: Validation Checks

3.1 prepare_random Coverage

For each ICreate interface:

• ✅ prepare_random_* function exists
• ❌ Function missing
• ❌ Function returns empty {}

3.2 generate_random Coverage

For each prepare_random function:

• ✅ generate_random_* function exists (1:1 mapping)
• ❌ Function missing
• ❌ Orphan generate without prepare

3.3 Test Scenario Coverage

For each entity:

• ✅ Create test exists
• ✅ Read test exists
• ✅ Update test exists
• ✅ Delete test exists
• ❌ Missing CRUD tests
• ⚠️ Missing edge case tests

3.4 Test Quality

• ✅ Uses prepare_random (not hardcoded data)
• ✅ Uses generate_random (not direct API calls)
• ❌ Uses typia.random with empty type
• ❌ Hardcoded UUIDs
• ⚠️ Missing assertions

Output Format

# Validation Report: Test Infrastructure

## Summary
- ICreate interfaces: X
- prepare_random functions: Y
- generate_random functions: Z
- Test files: W

## ✅ Valid Items
- [Prepare] `prepare_random_entity` - All fields generated
- [Generate] `generate_random_entity` - Properly calls API
- [Test] `test_entity_create` - Complete assertions

## ❌ Issues Found
- [Missing Prepare] `another_entity` - No prepare function for ICreate
- [Missing Generate] `another_entity` - No generate function
- [Empty Prepare] `prepare_random_thing.ts` - Returns `{}`
- [Orphan Generate] `generate_random_old.ts` - No matching prepare function

## ⚠️ Warnings
- [Missing Test] `entity` - No delete test scenario
- [Edge Case] `entity` - No validation error test
- [Edge Case] `entity` - No unauthorized access test

## Recommendation
Run `/fix-test` to fix the issues above.

Important

This skill is READ-ONLY.

• Does NOT modify any files
• Does NOT run any build commands
• Only reports discrepancies

To fix issues, use /fix-test skill.