Considering Joss said that knew after Season 2, David could carry his own show, I would say they shipped him off because Joss wanted to expand upon Angel, not because he didn't fit in the show anymore.
He can be a right hand man of DD and still be big. He would have to be big enough to be at DDs side.