It has been proposed that the inferior/ventrolateral frontal cortex plays a critical role in the inhibitory control of action during cognitive tasks. However, the contribution of this region to the control of eye movements has not been clearly established. Here, we describe the performance of a group of 23 frontal lobe damaged patients in an oculomotor rule switching task for which the association between a centrally presented visual cue and the direction of a saccade could change from trial to trial. A subset of 16 patients also completed the standard antisaccade task. Ventrolateral damage was found to be a significant predictor of errors in both tasks. Analysis of the rate at which patients corrected errors in the rule switching task also revealed an important dissociation between left and right hemisphere damaged patients. Whilst patients with left ventrolateral damage usually corrected response errors with secondary saccades, those with right hemisphere lesions often failed to do so. The results suggest that the inferior frontal cortex forms part of a wider frontal network mediating inhibitory control over stimulus elicited eye movements. The critical role played by the right ventrolateral region in cognitive tasks may arise due to an additional functional specialization for the monitoring and updating of task rules.