Thanks for the suggestions on the caulk - that makes total sense. Yes, a simple metal screw through the track should solve this issue. I'll admit I feel a little silly even asking the question now.
Duh, I should thought of that myself - I feel like the caller into Mr. Obvious show for any of you Bob & Tom fans.