I only know this story second-hand, but I think the Miller family relationship worked against Wes and Skip didn't want it to look like the Millers had bought Wes' spot on the team. FWIW I think he played a freshman year at JMU then transferred to UNC.
Prosser was a wise and sensible man.