100,000 multi-turn ShareGPT conversations demonstrating Constitutional AI (CAI) self-critique and revision. Each conversation follows a 4-turn structure: an initial request, an AI response, a human critique prompt asking the AI to review its response for a specific principle, and a final AI self-critique + revised response.
Designed for training models that can identify and correct their own failures across harmlessness, helpfulness… See the full description on the dataset page:
https://huggingface.co/datasets/stindardlogic/constitutional-ai-revisions-sft-100k.