Let me be abundantly clear. Throwing Muses was (and is) my favorite band. This has not changed. Kristin Hersh has one of the most unique voices in music, and while the band is better with Tanya Donelly on guitar and 2nd vocal, they're still pretty great. This band got me through a lot of hard times. I take the unpopular-among-Muses-fans opinion that their 1988 album House Tornado is not only their best album, but the best album ever produced - and it is not an easy listen.
The last single the band released before Tanya left to form Belly was the song "Not Too Soon", which featured Tanya on vocal. This song was its B-side - a Beatles cover that had the same title as a Muses song (on their Chains Changed EP) - and it is absolutely beautiful. Kristin takes the clear lead vocal here, but both voices shine through - and it makes the song arguably richer than the original.