According to this article from their appearance on WWHL in 2020, Tom thought Yakura was the worst guest judge and very aggressive so I wonder if that could be a hint that it was him?
https://www.bravotv.com/the-daily-dish/tom-colicchio-top-chef-worst-guest-judge