Power efficient image sensing apparatus, method of operating the same and eye/gaze tracking system

Abstract

An image sensing apparatus has a light sensitive area and a control unit. The light sensitive area registers image data in response to an incoming amount of light, and is operable in an active mode wherein image data can be read out there from as well as in a standby mode wherein image data cannot be read out. The control unit produces a control signal setting the light sensitive area to operate in the active mode and the standby mode respectively in a cyclic manner during an operation period, which preferably encompasses multiple data frame read-outs of image data from the light sensitive area.

Claims

1. An image sensing apparatus comprising: a light sensitive area configured to register image data in response to an incoming amount of light, the light sensitive area being operable in an active mode wherein image data can be read out there from and a standby mode wherein image data cannot be read out; a control unit configured to produce a control signal for setting the light sensitive area in the active mode and the standby mode respectively, said control unit configured to produce the control signal such that the light sensitive area transitions from operation in the active mode to the standby mode and back to the active mode in a cyclic manner during an operation period; and an output interface configured to deliver output image data from the light sensitive area, wherein one data frame represents readout of the image data having been registered by the light sensitive area during a capture time, wherein the light sensitive area is configured to feed a sequence of said data frames through the output interface, wherein the control unit is configured to produce the control signal so that the operation period extends over at least one capture time and at least two periods during which the light sensitive area operates in the standby mode, the light sensitive area operating in the active mode during said at least one capture time, and wherein prior to the operation period, the control unit is configured to produce the control signal so that the light sensitive area operates in the active mode during an unbroken period of time exceeding a typical capture time associated with a full readout of image data from the light sensitive area.

2. The image sensing apparatus according to claim 1, wherein the operation period extends over at least two capture times during which the light sensitive area operates in the active mode, said at least two capture times being separated by a respective delay period during which the light sensitive area operates in the standby mode.

3. The image sensing apparatus according to claim 1, wherein the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows, the light sensitive area is controllable to read out image data to the output interface, which image data have been registered exclusively by at least one subset of the first number of columns and/or the second number of rows, and the control unit is further configured to produce the control signal so that said at least one subset of image data is fed to the output interface when the light sensitive area operates in the active mode.

4. The image sensing apparatus according to claim 1, wherein the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows, and the light sensitive area is controllable to read out image data to the output interface such that data from two or more light sensitive elements are combined with one another to form a common data unit and a total number of said data units fed to the output interface is less than the first number times the second number.

5. An image sensing apparatus comprising: a light sensitive area configured to register image data in response to an incoming amount of light, the light sensitive area being operable in an active mode wherein image data can be read out there from and a standby mode wherein image data cannot be read out; a control unit configured to produce a control signal for setting the light sensitive area in the active mode and the standby mode respectively, said control unit configured to produce the control signal such that the light sensitive area transitions from operation in the active mode to the standby mode and back to the active mode in a cyclic manner during an operation period; and an output interface configured to deliver output image data from the light sensitive area, wherein one data frame represents readout of the image data having been registered by the light sensitive area during a capture time, wherein the light sensitive area is configured to feed a sequence of said data frames through the output interface, wherein the control unit is configured to produce the control signal so that the operation period extends over at least one capture time and at least two periods during which the light sensitive area operates in the standby mode, the light sensitive area operating in the active mode during said at least one capture time, and wherein after the operation period, the control unit is configured to produce the control signal so that the light sensitive area operates in the active mode during an unbroken period of time exceeding a typical capture time associated with a full readout of image data from the light sensitive area.

6. The image sensing apparatus according to claim 5, wherein the operation period extends over at least two capture times during which the light sensitive area operates in the active mode, said at least two capture times being separated by a respective delay period during which the light sensitive area operates in the standby mode.

7. The image sensing apparatus according to claim 5, wherein the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows, the light sensitive area is controllable to read out image data to the output interface, which image data have been registered exclusively by at least one subset of the first number of columns and/or the second number of rows, and the control unit is further configured to produce the control signal so that said at least one subset of image data is fed to the output interface when the light sensitive area operates in the active mode.

8. The image sensing apparatus according to claim 5, wherein the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows, and the light sensitive area is controllable to read out image data to the output interface such that data from two or more light sensitive elements are combined with one another to form a common data unit and a total number of said data units fed to the output interface is less than the first number times the second number.

9. An eye/gaze tracking system comprising an image sensing apparatus, said image sensing apparatus comprising: a light sensitive area configured to register image data in response to an incoming amount of light, the light sensitive area being operable in an active mode wherein image data can be read out there from and a standby mode wherein image data cannot be read out, wherein the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows, and wherein the light sensitive area is controllable to read out image data to an output interface, which image data have been registered exclusively by at least one sub-set of the first number of columns and/or the second number of rows; a control unit configured to produce a control signal for setting the light sensitive area in the active mode and the standby mode respectively, said control unit configured to produce the control signal such that the light sensitive area transitions from operation in the active mode to the standby mode and back to the active mode in a cyclic manner during an operation period, wherein the control unit is further configured to produce the control signal so that said at least one subset of image data is fed to the output interface when the light sensitive area operates in the active mode; and an output interface configured to deliver output image data from the light sensitive area, wherein one data frame represents readout of the image data having been registered by the light sensitive area during a capture time, wherein the light sensitive area is configured to feed a sequence of said data frames through the output interface, wherein the control unit is configured to produce the control signal so that the operation period extends over at least one capture time and at least two periods during which the light sensitive area operates in the standby mode, the light sensitive area operating in the active mode during said at least one capture time, wherein prior to the operation period, the control unit is configured to produce the control signal so that the light sensitive area operates in the active mode during an unbroken period of time exceeding a typical capture time associated with a full readout of image data from the light sensitive area, wherein the image sensing apparatus being arranged to capture image data of a subject whose eye and or gaze is tracked, and wherein the control unit is configured to produce the control signal so that said at least one subset of image data represents the image of at least one eye of the subject.

10. A method of controlling an image sensing apparatus having a light sensitive area configured to register image data in response to an incoming amount of light, the light sensitive area being operable in an active mode wherein image data can be read out there from and a standby mode wherein image data cannot be read out, and said image sensing apparatus further having an output interface configured to deliver output image data from the light sensitive area; the method comprising: producing a control signal for setting the light sensitive area in the active mode and the standby mode respectively; producing the control signal such that the light sensitive area transitions from operation in the active mode to the standby mode and back to the active mode in a cyclic manner during an operation period; reading out one data frame representing image data having been registered by the light sensitive area during a capture time; feeding out a sequence of said data frames from the light sensitive area through the output interface; and producing the control signal so that the operation period extends over at least one capture time and at least two periods during which the light sensitive area operates in the standby mode, the light sensitive area operating in the active mode during said at least one capture time, wherein, prior to the operation period, said producing comprises producing the control signal so that the light sensitive area operates in the active mode during an unbroken period of time exceeding a typical capture time associated with a full readout of image data from the light sensitive area.

11. The method according to claim 10, comprising producing the control signal so that the operation period extends over at least two capture times during which the light sensitive area operates in the active mode, said at least two capture times being separated by a respective delay period during which the light sensitive area operates in the standby mode.

12. The method according to claim 10, wherein the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows, and the method further comprises: reading out image data from the light sensitive area to the output interface, which image data have been registered exclusively by at least one subset of the first number of columns and/or the second number of rows; and producing the control signal so that said at least one subset of image data is fed to the output interface when the light sensitive area operates in the active mode.

13. The method according to claim 10, wherein the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows, and the method further comprises: reading out image data from the light sensitive area to the output interface such that data from two or more light sensitive elements are combined with one another to form a common data unit and a total number of said data units fed to the output interface is less than the first number times the second number.

14. A computer program product stored on a non-transitory computer readable medium, comprising software instructions for operation by a computer controller for controlling an image sensing apparatus having a light sensitive area configured to register image data in response to an incoming amount of light, the light sensitive area being operable in an active mode wherein image data can be read out there from and a standby mode wherein image data cannot be read out, and said image sensing apparatus further having an output interface configured to deliver output image data from the light sensitive area, said instructions comprising: first instructions for producing a control signal for setting the light sensitive area in the active mode and the standby mode respectively; second instructions for producing the control signal such that the light sensitive area transitions from operation in the active mode to the standby mode and back to the active mode in a cyclic manner during an operation period; third instructions for reading out one data frame representing image data having been registered by the light sensitive area during a capture time; and fourth instructions for feeding out a sequence of said data frames from the light sensitive area through the output interface, wherein said second instructions includes instructions for producing the control signal so that the operation period extends over at least one capture time and at least two periods during which the light sensitive area operates in the standby mode, the light sensitive area operating in the active mode during said at least one capture time, and wherein said second instructions comprising, prior to the operation period, instructions for producing the control signal so that the light sensitive area operates in the active mode during an unbroken period of time exceeding a typical capture time associated with a full readout of image data from the light sensitive area.

15. The computer program product of claim 14, wherein said second instructions comprises instructions for producing the control signal so that the operation period extends over at least two capture times during which the light sensitive area operates in the active mode, said at least two capture times being separated by a respective delay period during which the light sensitive area operates in the standby mode.

16. The computer program product of claim 14, wherein the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows, wherein said third instructions comprises instructions for reading out image data from the light sensitive area to the output interface, which image data have been registered exclusively by at least one subset of the first number of columns and/or the second number of rows, and said second instructions comprises instructions for producing the control signal so that said at least one subset of image data is fed to the output interface when the light sensitive area operates in the active mode.

17. The computer program product of claim 14, wherein the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows, and the method further comprises: second instructions for reading out image data from the light sensitive area to the output interface such that data from two or more light sensitive elements are combined with one another to form a common data unit and a total number of said data units fed to the output interface is less than the first number times the second number.

18. An eye/gaze tracking system comprising an image sensing apparatus, said image sensing apparatus comprising: a light sensitive area configured to register image data in response to an incoming amount of light, the light sensitive area being operable in an active mode wherein image data can be read out there from and a standby mode wherein image data cannot be read out, wherein the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows, and wherein the light sensitive area is controllable to read out image data to an output interface, which image data have been registered exclusively by at least one sub-set of the first number of columns and/or the second number of rows; a control unit configured to produce a control signal for setting the light sensitive area in the active mode and the standby mode respectively, said control unit configured to produce the control signal such that the light sensitive area transitions from operation in the active mode to the standby mode and back to the active mode in a cyclic manner during an operation period, wherein the control unit is further configured to produce the control signal so that said at least one subset of image data is fed to the output interface when the light sensitive area operates in the active mode; and an output interface configured to deliver output image data from the light sensitive area, wherein one data frame represents readout of the image data having been registered by the light sensitive area during a capture time, wherein the light sensitive area is configured to feed a sequence of said data frames through the output interface, wherein the control unit is configured to produce the control signal so that the operation period extends over at least one capture time and at least two periods during which the light sensitive area operates in the standby mode, the light sensitive area operating in the active mode during said at least one capture time, wherein after the operation period, the control unit is configured to produce the control signal so that the light sensitive area operates in the active mode during an unbroken period of time exceeding a typical capture time associated with a full readout of image data from the light sensitive area, wherein the image sensing apparatus being arranged to capture image data of a subject whose eye and or gaze is tracked, and wherein the control unit is configured to produce the control signal so that said at least one subset of image data represents the image of at least one eye of the subject.

19. A method of controlling an image sensing apparatus having a light sensitive area configured to register image data in response to an incoming amount of light, the light sensitive area being operable in an active mode wherein image data can be read out there from and a standby mode wherein image data cannot be read out, and said image sensing apparatus further having an output interface configured to deliver output image data from the light sensitive area; the method comprising: producing a control signal for setting the light sensitive area in the active mode and the standby mode respectively; producing the control signal such that the light sensitive area transitions from operation in the active mode to the standby mode and back to the active mode in a cyclic manner during an operation period; reading out one data frame representing image data having been registered by the light sensitive area during a capture time; feeding out a sequence of said data frames from the light sensitive area through the output interface; and producing the control signal so that the operation period extends over at least one capture time and at least two periods during which the light sensitive area operates in the standby mode, the light sensitive area operating in the active mode during said at least one capture time, wherein, after the operation period, said producing comprises producing the control signal so that the light sensitive area operates in the active mode during an unbroken period of time exceeding a typical capture time associated with a full readout of image data from the light sensitive area.

20. The method according to claim 19, comprising producing the control signal so that the operation period extends over at least two capture times during which the light sensitive area operates in the active mode, said at least two capture times being separated by a respective delay period during which the light sensitive area operates in the standby mode.

21. The method according to claim 19, wherein the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows, and the method further comprises: reading out image data from the light sensitive area to the output interface, which image data have been registered exclusively by at least one subset of the first number of columns and/or the second number of rows; and producing the control signal so that said at least one subset of image data is fed to the output interface when the light sensitive area operates in the active mode.

22. The method according to claim 19, wherein the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows, and the method further comprises: reading out image data from the light sensitive area to the output interface such that data from two or more light sensitive elements are combined with one another to form a common data unit and a total number of said data units fed to the output interface is less than the first number times the second number.

23. A computer program product stored on a non-transitory computer readable medium, comprising software instructions for operation by a computer controller for controlling an image sensing apparatus having a light sensitive area configured to register image data in response to an incoming amount of light, the light sensitive area being operable in an active mode wherein image data can be read out there from and a standby mode wherein image data cannot be read out, and said image sensing apparatus further having an output interface configured to deliver output image data from the light sensitive area, said instructions comprising: first instructions for producing a control signal for setting the light sensitive area in the active mode and the standby mode respectively; second instructions for producing the control signal such that the light sensitive area transitions from operation in the active mode to the standby mode and back to the active mode in a cyclic manner during an operation period; third instructions for reading out one data frame representing image data having been registered by the light sensitive area during a capture time; and fourth instructions for feeding out a sequence of said data frames from the light sensitive area through the output interface, wherein said second instructions includes instructions for producing the control signal so that the operation period extends over at least one capture time and at least two periods during which the light sensitive area operates in the standby mode, the light sensitive area operating in the active mode during said at least one capture time, and wherein said second instructions comprising, after the operation period, instructions for producing the control signal so that the light sensitive area operates in the active mode during an unbroken period of time exceeding a typical capture time associated with a full readout of image data from the light sensitive area.

24. The computer program product of claim 23, wherein said second instructions comprises instructions for producing the control signal so that the operation period extends over at least two capture times during which the light sensitive area operates in the active mode, said at least two capture times being separated by a respective delay period during which the light sensitive area operates in the standby mode.

25. The computer program product of claim 23, wherein the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows, wherein said third instructions comprises instructions for reading out image data from the light sensitive area to the output interface, which image data have been registered exclusively by at least one subset of the first number of columns and/or the second number of rows, and said second instructions comprises instructions for producing the control signal so that said at least one subset of image data is fed to the output interface when the light sensitive area operates in the active mode.

26. The computer program product of claim 23, wherein the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows, and the method further comprises: second instructions for reading out image data from the light sensitive area to the output interface such that data from two or more light sensitive elements are combined with one another to form a common data unit and a total number of said data units fed to the output interface is less than the first number times the second number.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) The invention is now to be explained more closely by means of preferred embodiments, which are disclosed as examples, and with reference to the attached drawings.

(2) FIG. 1 shows the elements of an image sensing apparatus according to one embodiment that are relevant for the present invention;

(3) FIG. 2 illustrates, via a graph, how the proposed image sensing apparatus may be controlled to switch between an active mode and a standby mode in a cyclic manner;

(4) FIG. 3 shows an eye/gaze tracking system according to one embodiment of the invention;

(5) FIG. 4 illustrates, by means of a flow diagram, the general method according to the invention; and

(6) FIG. 5 illustrates, by means of a flow diagram, how the proposed eye/gaze tracking system may operate according to the invention.

DESCRIPTION OF PREFERRED EMBODIMENTS OF THE INVENTION

(7) Initially, we refer to FIG. 1, which shows an image sensing apparatus according to one embodiment of the invention. FIG. 2 contains a graph showing an example of the control signal Ctrl as a function of time t.

(8) The proposed image sensing apparatus 100 includes a light sensitive area 110, a control unit 120, and preferably an output interface 130.

(9) The light sensitive area 110 is configured to register image data D.sub.img in response to an incoming amount of light. Thus, the light sensitive area 110 may for example be implemented in CMOS or CCD technology (CMOS=complementary metal-oxide-semiconductor; CCD=charge-couple device). The light sensitive area 110 contains a set of light sensitive elements, or pixels, which typically are arranged in a matrix containing a first number of columns and a second number of rows. The aspect ratio expresses the relationship between the first and second numbers, and the total number of light sensitive elements in the light sensitive area 110, i.e. the first number multiplied by the second number, is termed the resolution of the light sensitive area 110. In modern eye-tracking solutions, the resolution is often relatively high, for instance in the order of 5 megapixels or more.

(10) A prior art 5 megapixels image sensor, in a regular-sensor-operation camera application (supporting video, preview and snapshot) typically consumes at least 250 mW, whereas a VGA sensor normally only consumes 50 mW at 30 frames-per-second operation. However, a VGA readout from a 5 megapixels image sensor still consumes almost 250 mW. This, of course, is not satisfactory.

(11) Therefore, according to the invention, the light sensitive area 110 is operable in an active mode ActM, wherein image data D.sub.img can be read out from it; and in a standby mode StdBM in which the light sensitive area 110 has a very low energy consumption. The standby mode StdBM is characterized in that no image data D.sub.img can be read out from the light sensitive area 110. However, with very short delay, the light sensitive area 110 can enter the active mode ActM (where such readout is enabled).

(12) The control unit 120 may be co-located with/integrated into a sensor unit containing light sensitive area 110. In such a case, the control unit 120 can be controlled by an external source, so that in response to a signal from this source, image data D.sub.img are read out and thereafter the light sensitive area 110 automatically enters the standby mode StdBM.

(13) The control unit 120 is configured to produce a control signal Ctrl for setting the light sensitive area 110 to operate in either the active mode ActM or the standby mode StdBM. Specifically, according to the invention, the control unit 120 is configured to produce the control signal Ctrl such that the light sensitive area 110 operates in the active mode ActM and the standby mode StdBM in a cyclic manner during an operation period t.sub.op. Here, the operation period t.sub.op may correspond to anything from a few data frame cycles to a steady-state operation of the image sensing apparatus 100 extending over a substantial period of time, say several minutes or hours.

(14) The output interface 130 is configured to deliver output image data D.sub.img that have been registered by the light sensitive area 110. Normally, the image data D.sub.img are read out in the form of data frames DF, where one data frame DF represents readout of the image data D.sub.img having been registered by the light sensitive area 110 during a prescribed capture time T.sub.frame, or exposure time. Further, the output interface 130 is configured to feed out a series of such data frames DF from the light sensitive area 110, which data frames DF represent moving image data of a video sequence at a given frame rate, say 30 Hz.

(15) Preferably, the control unit 120 is configured to produce the control signal Ctrl so that the operation period t.sub.op extends over at least one capture time T.sub.frame (when the light sensitive area 110 operates in the active mode ActM) and at least two periods during which the light sensitive area 110 operates in the standby mode StdBM.

(16) In some implementations, it is advantageous if the operation period t.sub.op extends over at least two capture times T.sub.frame during which the light sensitive area 110 operates in the active mode ActM, and where the capture times T.sub.frame are separated by a respective delay period T.sub.delay during which the light sensitive area 110 operates in the standby mode StdBM.

(17) In FIG. 2, we see an example where the light sensitive area 110 operates in the Active mode ActM at least three times during the operation period t.sub.op. This may correspond to exclusively reading out image data D.sub.img from one or more subsets of light sensitive elements ROI of the light sensitive area 110. Typically, the light sensitive area 110 includes a set of light sensitive elements arranged in a matrix having a first number of columns and a second number of rows. For example, in a 5 megapixel sensor (having in total 5,090,816 light sensitive elements), the first number columns may be 2,608 and the second number of rows may be 1,952.

(18) The light sensitive area 110 is here controllable to read out image data D.sub.img to the output interface 130, which image data D.sub.img have been registered exclusively by the at least one subset ROI, say 100 rows and 200 columns of the light sensitive area 110. Further, the control unit 120 is configured to produce the control signal Ctrl so that the at least one subset of image data ROI is fed to the output interface 130 when the light sensitive area 110 operates in the active mode ActM, for instance as specified in the diagram of FIG. 2.

(19) To facilitate selecting at least one adequate subset ROI, it is desirable if, prior to the operation period t.sub.op, the control unit 120 is configured to produce the control signal Ctrl so that the light sensitive area 110 operates in the active mode ActM during an unbroken period of time exceeding a typical capture time T.sub.frame associated with a full readout of image data D.sub.img from the light sensitive area 110. Thus, an eye-tracking session may be initiated with video recording, wherein image data D.sub.img are collected from a relatively large portion, or all, of the light sensitive area 110. Based on this data, it is assumed that the image of one or more eyes of a user can be identified. Then, the subset(s) ROI can be selected such that the image of the eye(s) is included therein. Details concerning how eye/gaze tracking can be effected according to one embodiment of the invention will be described below with reference to FIG. 5.

(20) Naturally, also after having identified one or more eyes in an image sequence it may prove necessary to search for eyes in the recorded image data. For example, if the tracking is temporarily lost due to an obstruction between the user's eyes and the camera, a repeated search must be done.

(21) Therefore, the operation period t.sub.op needs to be discontinued. Subsequently, the control unit 120 is configured to produce the control signal Ctrl so that the light sensitive area 110 operates in the active mode ActM during an unbroken period of time exceeding the typical capture time T.sub.frame associated with a full readout of image data D.sub.img from the light sensitive area 110.

(22) Alternatively, the light sensitive area 110 may be controllable to read out image data D.sub.img to the output interface 130 such that data from two or more light sensitive elements are combined with one another to form a common data unit (so-called binning). For example, data from four neighboring light sensitive elements can be combined to form a common data unit. As a result, the sensitivity of the light sensitive area 110 may be increased significantly, and a total number of data units fed to the output interface 130 is reduced to an amount less than the first number times the second number, say the first number times the second number divided by four. Naturally, this, in turn, is beneficial from a bandwidth point-of-view.

(23) According to further embodiments of the invention, various forms of hybrid operation are conceivable involving switching between the above binning-mode operation, subset ROI readout and the standby mode StdBM. For example, first, a subset ROI is read out. Then, follows a frame representing a binned down image (typically larger than the subset ROI, and possibly covering the entire light sensitive area 110). Thereafter, the light sensitive area 110 enters the standby mode StdBM until, again, another subset ROI is read out, and so on in a cyclic manner. Here, the subset ROI may contain image data D.sub.img representing one or more eyes, whereas the binned down image may represent the whole face of a subject.

(24) Alternatively, the standby mode StdBM may be inserted between the subset ROI readout and the binned down image readout, or both.

(25) FIG. 3 shows an eye/gaze tracking system 300 according to one embodiment of the invention. The eye/gaze tracking system 300 includes the proposed image sensing apparatus 100 described above, wherein the image sensing apparatus 100 is arranged to capture image data D.sub.img of a subject S whose eye and/or gaze is tracked. The control unit 120 is here configured to produce the control signal Ctrl so that the subset of image data ROI represents the image of at least one eye 105 of the subject S.

(26) The control unit 120, in turn, may receive a main control signal C.sub.ROI from a data processing unit 310, which is configured to calculate updated eye position estimates based on the data frames DF produced by the image sensing apparatus 100. Normally, the data processing unit 310 is also responsible for deriving estimated gaze data and updates thereof.

(27) Preferably, the control unit 120 contains, or is in communicative connection with a memory unit 125 storing a computer program product PP, which contains software for controlling the control unit 120 to perform the above-described actions when the computer program product PP is run on the control unit 120.

(28) In order to sum up, we will now describe the general method of controlling an image sensing apparatus according to the invention with reference to the flow diagram in FIG. 4. The image sensing apparatus has a light sensitive area 110 configured to register image data D.sub.img in response to an incoming amount of light. Further, in response to a control signal Ctrl, the light sensitive area 110 is operable in an active mode ActM, wherein image data D.sub.img can be read out there from and a standby mode StdBM wherein no image data D.sub.img can be read out.

(29) In a first step 410, the control signal Ctrl is received. A subsequent step 420 checks if the control signal specifies that the light sensitive area 110 shall operate in the active mode ActM or the standby mode StdBM. In the former case, a step 430 follows, and in the latter case the procedure loops back to step 410.

(30) In step 430, image data D.sub.img are read out from the light sensitive area 110. Then, the procedure loops back to step 410. According to the invention, the control signal Ctrl is produced such that the light sensitive area operates in the active mode ActM and the standby mode StdBM in a cyclic manner during an operation period t.sub.op, i.e. the procedure loops several repetitions through the steps 410 to 430. Consequently, the light sensitive area 110 is set in the active mode ActM at least once during the operation period t.sub.op.

(31) Referring to FIG. 5, we will now describe how the proposed eye/gaze tracking system 300 may operate according to one embodiment of the invention.

(32) In a step 505, image data D.sub.img are captured in at least one full data frame DF. This means that, prior to the operation period t.sub.op, the control signal Ctrl is produced in such a manner that the light sensitive area 110 operates in the active mode ActM during an unbroken period of time exceeding the typical capture time T.sub.frame associated with a full readout of image data D.sub.img from the light sensitive area 110. The main reason for this is to allow the eye/gaze tracking system 300 to identify at least one eye 105 of a subject S in the image data D.sub.img.

(33) Thereafter, a step 510 checks if the position for at least one eye 105 has been determined. If so, a step 515 follows, and otherwise the procedure loops back to step 505.

(34) It is presumed that the light sensitive area 110 includes a set of light sensitive elements arranged in a first number of columns and a second number of rows. Moreover, the light sensitive area 110 is controllable to read out image data D.sub.img, which image have been registered exclusively by at least one subset ROI of the first number of columns and/or the second number of rows, i.e. a sub area of the image sensor. In step 515, such a sub area is set up, which represents the image of the at least one eye the position of which was determined in step 510.

(35) Subsequently, in a step 520, the control signal Ctrl is produced so that the image sensor 110 operates in the active mode ActM, Then, in a step 525, image data D.sub.img from this sub area are read out through the output interface 130. Thereafter, in a step 530, the light sensitive area 110 is controlled to operate in the standby mode StdBM to economize power until the next image data D.sub.img readout.

(36) In order to determine when such image data D.sub.img are to be registered, a step 535 calculates a new estimate describing the expected position for the at least one eye 105. Preferably, in connection with this, corresponding gaze data are also calculated. In parallel with step 535, in a step 540, the control signal Ctrl is produced so that the sensor remains in the standby mode StdBM.

(37) Repeatedly, after entering step 540, a step 545 checks if a delay period has expired, which delay period defines a duration until it is time to reactivate the light sensitive area 110. If the delay period has expired, a step 550 follows. Otherwise, the procedure loops back to step 540.

(38) In step 550 it has been determined that it is time to read out another set of image data D.sub.img representing the sub area where the at least one eye 105 is expected to be located. Therefore, in step 550, the control signal Ctrl is generated so that the light sensitive area 110 operates in the active mode ActM again. In connection there with, the coordinates for the sub area in question are updated in a following step 555. Then, the procedure returns to step 525 for repeated image data D.sub.img readout.

(39) According to embodiments of the invention, step 535 may be executed before step 530. I.e. the updated eye position(s) may be calculated before controlling the light sensitive area 110 to operate in the standby mode StdBM. In fact, if the updated eye position(s) is(are) determined based on a previous image, even step 555 may be effected before step 535.

(40) All of the process steps, as well as any sub-sequence of steps, described with reference to FIGS. 4 and 5 above may be controlled by means of a programmed computer apparatus. Moreover, although the embodiments of the invention described above with reference to the drawings comprise a computer apparatus and processes performed in a computer apparatus, the invention thus also extends to computer programs, particularly computer programs on or in a carrier, adapted for putting the invention into practice. The program may be in the form of source code, object code, a code intermediate source and object code such as in partially compiled form, or in any other form suitable for use in the implementation of the process according to the invention. The program may either be a part of an operating system, or be a separate application. The carrier may be any entity or device capable of carrying the program. For example, the carrier may comprise a storage medium, such as a Flash memory, a ROM (Read Only Memory), for example a DVD (Digital Video/Versatile Disk), a CD (Compact Disc) or a semi-conductor ROM, an EPROM (Erasable Programmable Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), or a magnetic recording medium, for example a floppy disc or hard disc. Further, the carrier may be a transmissible carrier such as an electrical or optical signal which may be conveyed via electrical or optical cable or by radio or by other means. When the program is embodied in a signal which may be conveyed directly by a cable or other device or means, the carrier may be constituted by such cable or device or means. Alternatively, the carrier may be an integrated circuit in which the program is embedded, the integrated circuit being adapted for performing, or for use in the performance of, the relevant processes.

(41) The term comprises/comprising when used in this specification is taken to specify the presence of stated features, integers, steps or components. However, the term does not preclude the presence or addition of one or more additional features, integers, steps or components or groups thereof.

(42) This application claim priority from Great Britain Patent Application No. Application No: 1307724.3 filed on Apr. 29, 2013 and entitled: Power Efficient Image Sensing Apparatus, Method of Operating the Same and Eye/Gaze Tracking System; the contents of which are incorporated herein by reference.

(43) The invention is not restricted to the described embodiments in the figures, but may be varied freely within the scope of the claims.