Open the Music Library screen, tap the Songs tab, tap (or press) the Menu Key , then tap Delete. Checkmark each of the songs you want to delete, tap Delete at the bottom of the screen, then tap Yes to confirm.
Tap (or press) the Menu Key from another Music tab to delete one or more of the items in that selected tab.