UltraFeedback

64K prompts with 256K GPT-4-annotated completions — the standard preference set for DPO.

At a glance

• Modality: Text
• Use case: Preference / RLHF
• Rows: 64K
• License: MIT (commercial use OK)
• Format: parquet, jsonl