A multi-beam charged particle inspection system and a method of operating a multi-beam charged particle inspection system for wafer inspection can provide high throughput with high resolution and high reliability. The method and the multi-beam charged particle beam inspection system can be configured to extract from a plurality of sensor data a set of control signals to control the multi-beam charged particle beam inspection system and thereby maintain the imaging specifications including a movement of a wafer stage during the wafer inspection task.