Measuring 'taste' quantitatively

Can you put a number on good?

Taste feels unquantifiable, yet teams agree on it more than they expect. We turn that agreement into preference data — pairwise judgments that reveal consistent signals beneath the subjectivity.

Those signals become a reward the model can optimize, nudging generations toward what people repeatedly choose rather than what is merely sharp.