douwmarx/

hh-rlhf-constitutional-sensitivities-of-pms

	Constitutional-Sensitivities of HH-RLHF  dataset




	
	Description

A subset of query-response pairs from the Anthropic hh-rlhf dataset including:

Original query and response Perturbed response using gpt-40-mini according a given constitutional principle from a Collective constitutional AI dataset using a critique and revision step.

Resources for this project are available here: https://github.com/DouwMarx/constitutional_sensitivities_of_preference_models