"High-quality preference data is crucial for aligning AI systems with human values, but existing datasets are often proprietary or of inconsistent quality," said Zhilin Wang, senior research scientist at NVIDIA.