How LLMs Learn to Be Helpful (RLHF vs DPO)

In this article, we will look at how that learning actually happens, starting with why instruction-following alone falls short, then walking through the two main methods for teaching preferences (RLHF and DPO).