Open the Music library screen, tap the Songs tab, tap the Menu icon (at the upper-right corner of the screen), then tap Delete. Checkmark each of the songs you want to delete, tap Delete (at the bottom of the screen), then tap Yes to confirm.
Tap the Menu icon (at the upper-right corner of the screen) from another Music tab to delete one or more of the items in that selected tab.