Bingo! Dean's knows the price of having to look out for too many people he loves at once. He said as much to Sam when he had to convince him that they shouldn't stick with John.

I wrote a fic that dealt with this exact idea, actually. If you're interested, you can find it here: http://rillaotvalley.livejournal.com/10650.html#cutid1