I think that’s the point. Hayward is the guy left after The Snap. Everyone else is either dead, missing, or early retired. He basically rose to Director because he was the only one left in a universe of untold dangers and in his paranoid mind you can’t even trust The Avengers because Wanda has powers and let’s face it a shady as hell history. Hayward would see her as a threat regardless and would want to control, imprison on kill her outright. Having her run around free must be unthinkable for him.
So he needs a weapon and there is no way he would consider Vision a person especially if it meant getting to or at Wanda.