You are right that you would have to set chapter points for each song, but to answer you question more fully it would help to know what software you are using.

also is this an audio only dvd or are the music videos on it as well. Its just that if its music only would it not be easier to just burn it to a cd?