The "Replace playlist and Play" button is right next to the "Add to playlist" button, and both are small, icons-only buttons with small click targets. This makes it easy to accidentally replace your playlist. There is an undo for that, but people might miss it.