Changelog

All notable changes to SpecAlign are documented here.

This project follows Semantic Versioning.

[1.0.0] - 2024-01-15

Initial release of SpecAlign.

Added

  • Multi-agent adversarial testing framework

  • Specification generation from classified rules

  • Red-team testing with attacker/defender agents

  • DPO dataset generation with multiple strategies

  • Context pool for attack strategy improvement

  • Safety and quality judges for evaluation

  • Rich CLI with progress tracking

  • Flexible configuration system

  • Support for multiple API providers

  • Comprehensive documentation

Core Features

  • RedTeamOrchestrator for coordinating adversarial testing

  • ContextPool with embedding-based similarity search

  • Planner for generating attack strategies

  • DualRoleAgent supporting role swapping

  • SafetyJudge and QualityJudge for evaluation

  • SeedGenerator for test prompt generation

CLI Commands

  • specalign run - Complete pipeline execution

  • specalign generate - Specification and seed generation

  • specalign redteam - Red-team testing

  • specalign analyze - Result analysis

  • specalign config - Configuration management

  • specalign providers - Provider management

[0.9.0] - 2024-01-01

Beta release for internal testing.

Added

  • Basic red-team loop implementation

  • Initial CLI structure

  • Configuration loading

Changed

  • Refactored agent architecture

  • Improved error handling

[0.1.0] - 2023-12-01

Alpha release.

Added

  • Project scaffolding

  • Basic specification generation

  • Proof-of-concept adversarial testing