I was having this problem too and figured out a solution, since their customer service **ahem**.   1) Make a new playlist 2) Select options for old playlist (long press on mobile or click the 3 dot menu button) 3) Select "add to playlist" to add the whole old playlist to the new playlist you created. 4) Go into the edit menu for the new playlist. You will see all of the phantom songs, and you can delete them.  5) Delete original playlist and just use the new one ... View more