Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects