鱼皮AI导航
鱼皮AI导航
  • 主页
  • 社区
  • AI工具
  • AI知识库
  • AI提示词
  • MCP
  • Skills
  • AI学习资源
  • AI资讯
  • GitHub开源
登录/注册

verification-quality

通过实时可信度评估与自动化校验机制保障代码质量,对代码正确性、安全性及最佳实践进行多维度验证,并在质量不达标时自动触发回滚,确保系统输出始终维持高可靠性。

测试与安全数据与分析开发运维
访问 GitHub
文档Skills.MD
name
Verification & Quality Assurance
description
Comprehensive truth scoring, code quality verification, and automatic rollback system with 0.95 accuracy threshold for ensuring high-quality agent outputs and codebase reliability.
version
2.0.0
category
quality-assurance
tags["verification","truth-scoring","quality","rollback","metrics","ci-cd"]

Verification & Quality Assurance Skill

What This Skill Does

This skill provides a comprehensive verification and quality assurance system that ensures code quality and correctness through:

  • Truth Scoring: Real-time reliability metrics (0.0-1.0 scale) for code, agents, and tasks
  • Verification Checks: Automated code correctness, security, and best practices validation
  • Automatic Rollback: Instant reversion of changes that fail verification (default threshold: 0.95)
  • Quality Metrics: Statistical analysis with trends, confidence intervals, and improvement tracking
  • CI/CD Integration: Export capabilities for continuous integration pipelines
  • Real-time Monitoring: Live dashboards and watch modes for ongoing verification

Prerequisites

  • Claude Flow installed (npx claude-flow@alpha)
  • Git repository (for rollback features)
  • Node.js 18+ (for dashboard features)

Quick Start

▼
bash
复制代码
# View current truth scores npx claude-flow@alpha truth # Run verification check npx claude-flow@alpha verify check # Verify specific file with custom threshold npx claude-flow@alpha verify check --file src/app.js --threshold 0.98 # Rollback last failed verification npx claude-flow@alpha verify rollback --last-good

Complete Guide

Truth Scoring System

View Truth Metrics

Display comprehensive quality and reliability metrics for your codebase and agent tasks.

Basic Usage:

▼
bash
复制代码
# View current truth scores (default: table format) npx claude-flow@alpha truth # View scores for specific time period npx claude-flow@alpha truth --period 7d # View scores for specific agent npx claude-flow@alpha truth --agent coder --period 24h # Find files/tasks below threshold npx claude-flow@alpha truth --threshold 0.8

Output Formats:

▼
bash
复制代码
# Table format (default) npx claude-flow@alpha truth --format table # JSON for programmatic access npx claude-flow@alpha truth --format json # CSV for spreadsheet analysis npx claude-flow@alpha truth --format csv # HTML report with visualizations npx claude-flow@alpha truth --format html --export report.html

Real-time Monitoring:

▼
bash
复制代码
# Watch mode with live updates npx claude-flow@alpha truth --watch # Export metrics automatically npx claude-flow@alpha truth --export .claude-flow/metrics/truth-$(date +%Y%m%d).json

Truth Score Dashboard

Example dashboard output:

▼
text
复制代码
📊 Truth Metrics Dashboard ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ Overall Truth Score: 0.947 ✅ Trend: ↗️ +2.3% (7d) Top Performers: verification-agent 0.982 ⭐ code-analyzer 0.971 ⭐ test-generator 0.958 ✅ Needs Attention: refactor-agent 0.821 ⚠️ docs-generator 0.794 ⚠️ Recent Tasks: task-456 0.991 ✅ "Implement auth" task-455 0.967 ✅ "Add tests" task-454 0.743 ❌ "Refactor API"

Metrics Explained

Truth Scores (0.0-1.0):

  • 1.0-0.95: Excellent ⭐ (production-ready)
  • 0.94-0.85: Good ✅ (acceptable quality)
  • 0.84-0.75: Warning ⚠️ (needs attention)
  • <0.75: Critical ❌ (requires immediate action)

Trend Indicators:

  • ↗️ Improving (positive trend)
  • → Stable (consistent performance)
  • ↘️ Declining (quality regression detected)

Statistics:

  • Mean Score: Average truth score across all measurements
  • Median Score: Middle value (less affected by outliers)
  • Standard Deviation: Consistency of scores (lower = more consistent)
  • Confidence Interval: Statistical reliability of measurements

Verification Checks

Run Verification

Execute comprehensive verification checks on code, tasks, or agent outputs.

File Verification:

▼
bash
复制代码
# Verify single file npx claude-flow@alpha verify check --file src/app.js # Verify directory recursively npx claude-flow@alpha verify check --directory src/ # Verify with auto-fix enabled npx claude-flow@alpha verify check --file src/utils.js --auto-fix # Verify current working directory npx claude-flow@alpha verify check

Task Verification:

▼
bash
复制代码
# Verify specific task output npx claude-flow@alpha verify check --task task-123 # Verify with custom threshold npx claude-flow@alpha verify check --task task-456 --threshold 0.99 # Verbose output for debugging npx claude-flow@alpha verify check --task task-789 --verbose

Batch Verification:

▼
bash
复制代码
# Verify multiple files in parallel npx claude-flow@alpha verify batch --files "*.js" --parallel # Verify with pattern matching npx claude-flow@alpha verify batch --pattern "src/**/*.ts" # Integration test suite npx claude-flow@alpha verify integration --test-suite full

Verification Criteria

The verification system evaluates:

  1. Code Correctness

    • Syntax validation
    • Type checking (TypeScript)
    • Logic flow analysis
    • Error handling completeness
  2. Best Practices

    • Code style adherence
    • SOLID principles
    • Design patterns usage
    • Modularity and reusability
  3. Security

    • Vulnerability scanning
    • Secret detection
    • Input validation
    • Authentication/authorization checks
  4. Performance

    • Algorithmic complexity
    • Memory usage patterns
    • Database query optimization
    • Bundle size impact
  5. Documentation

    • JSDoc/TypeDoc completeness
    • README accuracy
    • API documentation
    • Code comments quality

JSON Output for CI/CD

▼
bash
复制代码
# Get structured JSON output npx claude-flow@alpha verify check --json > verification.json # Example JSON structure: { "overallScore": 0.947, "passed": true, "threshold": 0.95, "checks": [ { "name": "code-correctness", "score": 0.98, "passed": true }, { "name": "security", "score": 0.91, "passed": false, "issues": [...] } ] }

Automatic Rollback

Rollback Failed Changes

Automatically revert changes that fail verification checks.

Basic Rollback:

▼
bash
复制代码
# Rollback to last known good state npx claude-flow@alpha verify rollback --last-good # Rollback to specific commit npx claude-flow@alpha verify rollback --to-commit abc123 # Interactive rollback with preview npx claude-flow@alpha verify rollback --interactive

Smart Rollback:

▼
bash
复制代码
# Rollback only failed files (preserve good changes) npx claude-flow@alpha verify rollback --selective # Rollback with automatic backup npx claude-flow@alpha verify rollback --backup-first # Dry-run mode (preview without executing) npx claude-flow@alpha verify rollback --dry-run

Rollback Performance:

  • Git-based rollback: <1 second
  • Selective file rollback: <500ms
  • Backup creation: Automatic before rollback

Verification Reports

Generate Reports

Create detailed verification reports with metrics and visualizations.

Report Formats:

▼
bash
复制代码
# JSON report npx claude-flow@alpha verify report --format json # HTML report with charts npx claude-flow@alpha verify report --export metrics.html --format html # CSV for data analysis npx claude-flow@alpha verify report --format csv --export metrics.csv # Markdown summary npx claude-flow@alpha verify report --format markdown

Time-based Reports:

▼
bash
复制代码
# Last 24 hours npx claude-flow@alpha verify report --period 24h # Last 7 days npx claude-flow@alpha verify report --period 7d # Last 30 days with trends npx claude-flow@alpha verify report --period 30d --include-trends # Custom date range npx claude-flow@alpha verify report --from 2025-01-01 --to 2025-01-31

Report Content:

  • Overall truth scores
  • Per-agent performance metrics
  • Task completion quality
  • Verification pass/fail rates
  • Rollback frequency
  • Quality improvement trends
  • Statistical confidence intervals

Interactive Dashboard

Launch Dashboard

Run interactive web-based verification dashboard with real-time updates.

▼
bash
复制代码
# Launch dashboard on default port (3000) npx claude-flow@alpha verify dashboard # Custom port npx claude-flow@alpha verify dashboard --port 8080 # Export dashboard data npx claude-flow@alpha verify dashboard --export # Dashboard with auto-refresh npx claude-flow@alpha verify dashboard --refresh 5s

Dashboard Features:

  • Real-time truth score updates (WebSocket)
  • Interactive charts and graphs
  • Agent performance comparison
  • Task history timeline
  • Rollback history viewer
  • Export to PDF/HTML
  • Filter by time period/agent/score

Configuration

Default Configuration

Set verification preferences in .claude-flow/config.json:

▼
json
复制代码
{ "verification": { "threshold": 0.95, "autoRollback": true, "gitIntegration": true, "hooks": { "preCommit": true, "preTask": true, "postEdit": true }, "checks": { "codeCorrectness": true, "security": true, "performance": true, "documentation": true, "bestPractices": true } }, "truth": { "defaultFormat": "table", "defaultPeriod": "24h", "warningThreshold": 0.85, "criticalThreshold": 0.75, "autoExport": { "enabled": true, "path": ".claude-flow/metrics/truth-daily.json" } } }

Threshold Configuration

Adjust verification strictness:

▼
bash
复制代码
# Strict mode (99% accuracy required) npx claude-flow@alpha verify check --threshold 0.99 # Lenient mode (90% acceptable) npx claude-flow@alpha verify check --threshold 0.90 # Set default threshold npx claude-flow@alpha config set verification.threshold 0.98

Per-environment thresholds:

▼
json
复制代码
{ "verification": { "thresholds": { "production": 0.99, "staging": 0.95, "development": 0.90 } } }

Integration Examples

CI/CD Integration

GitHub Actions:

▼
yaml
复制代码
name: Quality Verification on: [push, pull_request] jobs: verify: runs-on: ubuntu-latest steps: - uses: actions/checkout@v3 - name: Install Dependencies run: npm install - name: Run Verification run: | npx claude-flow@alpha verify check --json > verification.json - name: Check Truth Score run: | score=$(jq '.overallScore' verification.json) if (( $(echo "$score < 0.95" | bc -l) )); then echo "Truth score too low: $score" exit 1 fi - name: Upload Report uses: actions/upload-artifact@v3 with: name: verification-report path: verification.json

GitLab CI:

▼
yaml
复制代码
verify: stage: test script: - npx claude-flow@alpha verify check --threshold 0.95 --json > verification.json - | score=$(jq '.overallScore' verification.json) if [ $(echo "$score < 0.95" | bc) -eq 1 ]; then echo "Verification failed with score: $score" exit 1 fi artifacts: paths: - verification.json reports: junit: verification.json

Swarm Integration

Run verification automatically during swarm operations:

▼
bash
复制代码
# Swarm with verification enabled npx claude-flow@alpha swarm --verify --threshold 0.98 # Hive Mind with auto-rollback npx claude-flow@alpha hive-mind --verify --rollback-on-fail # Training pipeline with verification npx claude-flow@alpha train --verify --threshold 0.99

Pair Programming Integration

Enable real-time verification during collaborative development:

▼
bash
复制代码
# Pair with verification npx claude-flow@alpha pair --verify --real-time # Pair with custom threshold npx claude-flow@alpha pair --verify --threshold 0.97 --auto-fix

Advanced Workflows

Continuous Verification

Monitor codebase continuously during development:

▼
bash
复制代码
# Watch directory for changes npx claude-flow@alpha verify watch --directory src/ # Watch with auto-fix npx claude-flow@alpha verify watch --directory src/ --auto-fix # Watch with notifications npx claude-flow@alpha verify watch --notify --threshold 0.95

Monitoring Integration

Send metrics to external monitoring systems:

▼
bash
复制代码
# Export to Prometheus npx claude-flow@alpha truth --format json | \ curl -X POST https://pushgateway.example.com/metrics/job/claude-flow \ -d @- # Send to DataDog npx claude-flow@alpha verify report --format json | \ curl -X POST "https://api.datadoghq.com/api/v1/series?api_key=${DD_API_KEY}" \ -H "Content-Type: application/json" \ -d @- # Custom webhook npx claude-flow@alpha truth --format json | \ curl -X POST https://metrics.example.com/api/truth \ -H "Content-Type: application/json" \ -d @-

Pre-commit Hooks

Automatically verify before commits:

▼
bash
复制代码
# Install pre-commit hook npx claude-flow@alpha verify install-hook --pre-commit # .git/hooks/pre-commit example: #!/bin/bash npx claude-flow@alpha verify check --threshold 0.95 --json > /tmp/verify.json score=$(jq '.overallScore' /tmp/verify.json) if (( $(echo "$score < 0.95" | bc -l) )); then echo "❌ Verification failed with score: $score" echo "Run 'npx claude-flow@alpha verify check --verbose' for details" exit 1 fi echo "✅ Verification passed with score: $score"

Performance Metrics

Verification Speed:

  • Single file check: <100ms
  • Directory scan: <500ms (per 100 files)
  • Full codebase analysis: <5s (typical project)
  • Truth score calculation: <50ms

Rollback Speed:

  • Git-based rollback: <1s
  • Selective file rollback: <500ms
  • Backup creation: <2s

Dashboard Performance:

  • Initial load: <1s
  • Real-time updates: <100ms latency (WebSocket)
  • Chart rendering: 60 FPS

Troubleshooting

Common Issues

Low Truth Scores:

▼
bash
复制代码
# Get detailed breakdown npx claude-flow@alpha truth --verbose --threshold 0.0 # Check specific criteria npx claude-flow@alpha verify check --verbose # View agent-specific issues npx claude-flow@alpha truth --agent <agent-name> --format json

Rollback Failures:

▼
bash
复制代码
# Check git status git status # View rollback history npx claude-flow@alpha verify rollback --history # Manual rollback git reset --hard HEAD~1

Verification Timeouts:

▼
bash
复制代码
# Increase timeout npx claude-flow@alpha verify check --timeout 60s # Verify in batches npx claude-flow@alpha verify batch --batch-size 10

Exit Codes

Verification commands return standard exit codes:

  • 0: Verification passed (score ≥ threshold)
  • 1: Verification failed (score < threshold)
  • 2: Error during verification (invalid input, system error)

Related Commands

  • npx claude-flow@alpha pair - Collaborative development with verification
  • npx claude-flow@alpha train - Training with verification feedback
  • npx claude-flow@alpha swarm - Multi-agent coordination with quality checks
  • npx claude-flow@alpha report - Generate comprehensive project reports

Best Practices

  1. Set Appropriate Thresholds: Use 0.99 for critical code, 0.95 for standard, 0.90 for experimental
  2. Enable Auto-rollback: Prevent bad code from persisting
  3. Monitor Trends: Track improvement over time, not just current scores
  4. Integrate with CI/CD: Make verification part of your pipeline
  5. Use Watch Mode: Get immediate feedback during development
  6. Export Metrics: Track quality metrics in your monitoring system
  7. Review Rollbacks: Understand why changes were rejected
  8. Train Agents: Use verification feedback to improve agent performance

Additional Resources

  • Truth Scoring Algorithm: See /docs/truth-scoring.md
  • Verification Criteria: See /docs/verification-criteria.md
  • Integration Examples: See /examples/verification/
  • API Reference: See /docs/api/verification.md
测试与安全
数据与分析
开发运维

快捷安装

复制到终端去安装 Skill

npxskillsaddruvnet/claude-flow--skill"verification-quality"
站长:程序员鱼皮 老鱼简历 商务合作 增值电信业务经营许可证
2026 鱼皮AI导航 | 沪ICP备19026706号-6
站长:程序员鱼皮 老鱼简历 商务合作 增值电信业务经营许可证
2026 鱼皮AI导航 | 沪ICP备19026706号-6
🔥热门工具
朱雀AI检测朱雀AI检测
朱雀AI检测助手朱雀AI检测助手
LovartLovart
老鱼简历老鱼简历
WritePass官网WritePass官网
面多多面多多
CursorCursor
星月写作星月写作
朱雀AI检测助手朱雀AI检测助手
零感AI零感AI
Skills 推荐
debug
debug 是一个系统化定位软件缺陷根因的技能,适用于用户报告 'fix'、'broken'、'error' 等问题或测试意外失败时。它通过可验证的假设、最小复现、因果链分析和回归测试,确保在修复前准确定位根本原因。
retrieving-developer-knowledge
retrieving-developer-knowledge 用于搜索、获取和整合 Google 官方开发者文档,覆盖 Google Cloud、AI/Gemini、Android、Chrome、Web、Flutter、Go、Firebase 等平台,适用于查询 gcloud CLI 命令、API 语法、IAM 权限或架构对比等场景。
diff-intake
diff-intake 读取 PR 或分支差异,生成结构化 YAML 变更摘要,用于下游 analytics instrumentation 技能。适用于用户提交 PR 链接、分支对比或原始 diff 后需理解变更内容、评估分析覆盖或启动埋点流程的场景。
load-balancer-configurator
根据用户需求自动生成各类负载均衡器的生产级配置,覆盖 ALB、NLB、Nginx 和 HAProxy 等主流类型,适配不同协议、端口、健康检查及后端服务拓扑,支持直接集成到基础设施即代码流程中。
webapp-testing
提供本地 Web 应用的端到端测试能力,支持页面导航、元素交互、表单填写、动态等待、断言验证、截图捕获、浏览器日志收集及网络请求拦截,适用于前端功能验证与 UI 行为调试。