If anyone can be and should be that guy, it was Aaron Hernadez. He had at least three drops in the hands, two plays came close to being fumbles.
I agree with your reasoning as well, in that if it hits the WR in the hands, but I'll go further in saying that the chest, face mask, and in the event of a fade or streak route, within arms reach in front of a WR, that it's on the WR. The pass in question was all on Brady. Not that the media OR the Pats faithful would ever EVER point fingers at their boyfriend.
Thanks to VIPER!