From gigantic loos, scaring British TV viewers and appearing on South Park, it’s amazing to think any music got made at all