If the roller follower is junk fix it now before the rest of the engine is destroyed. If it's just plain wore out, I'd still suggest fixing it because it will eventually cause a misfire which isn't good on the engine. It may also affect injection timing which could cause damage.
What was the original complaint for them to discover the worn lobe?