Because the game would stop for 2 minutes every 3 minutes. It's the refs job to spot forward passes.
Most forward passes are in front of the referee and are never pulled up. The video ref shouldn't have anything to do with it. The worst offender is the dummy half with the majority of passes being forward but these are all with the ref in close proximity. I wish the refs would ref a game by the rule book.