Yeah the problem becomes how literal the refs feel they have

to be when reviewing a non-PI call. The college basketball replay rule shows some of the downside of this. Many times in these late game situations you'll see some contact on a loose ball or rebound attempt where the refs will decide to just award the ball to the team that was fouled instead of calling the foul. Then they go to the replay and see that the ball actually last touched the finger tip of the team they awarded the ball to. Of course the replay also shows the foul they let slide but there's nothing they can do about that. Sometimes these subjective plays require a human who is skilled at determining what the fair outcome should be, a rule like this risks losing that.