And if Valrun's suggestions don't work, my guess would be that you've been using a multiple monitor setup and recently changed the setup in some way. Now when you go to Edit Video your modal dialog is appearing out in space somewhere and you cannot get to it.
Next time Captivate 'freezes', hit the ESCAPE key on your keyboard. If that brings Captivate back, your issue is with your monitor setup.