A hand-held or otherwise portable or spatial or temporal performance-based image capture device includes one or more lenses, an aperture and a main sensor for capturing an original main image. A secondary sensor and optical system are for capturing a reference image that has temporal and spatial overlap with the original image. The device performs an image processing method including capturing the main image with the main sensor and the reference image with the secondary sensor, and utilizing information from the reference image to enhance the main image. The main and secondary sensors are contained together within a housing.

Processing for judging whether a face is included in a frame is performed, in a predetermined interval, on each of frames included in a moving image of a subject, displayed on a monitor, until the judgment becomes positive. If it is judged that a face is included in a frame, the facial position is detected in the frame, and stored. Then, judgment is made as to whether a face is included in the next frame after predetermined time. If the judgment is positive, the facial position is detected. The previously stored facial position is replaced by the newly detected facial position, and the newly detected facial position is stored. These processes are repeated until photographing operation is performed by operating a release unit.

A machine-implemented method of processing an input image includes receiving user input that manually identifies a location in the input image that corresponds to a potential redeye artifact. A set of detected redeye artifacts in the input image is received. One of the detected redeye artifacts that is closest to the manually identified location is identified. The identified detected redeye artifact is stored in a list of redeye artifacts that are identified with manual assistance if the identified detected redeye artifact is within a threshold distance from the manually identified location.

An image processing apparatus configured to correct at least part of a face image has an image acquisition unit that acquires an input image, a region extraction unit that extracts a pupil region, which is a region corresponding to an eye of a person, from the input image, a pixel extraction unit that extracts a pixel from the pupil region whose brightness value is higher than a threshold value, a determination unit that determines, based on the result of extraction performed by the pixel extraction unit, whether or not halation has occurred in the pupil region, and a correction unit that performs, based on the result of determination performed by the determination unit, processing for correcting halation on the pupil region. The pixel extraction unit sets the threshold value based on a bias of a brightness distribution of the pixels included in the pupil region.

A hand-held or otherwise portable or spatial or temporal performance-based image capture device includes one or more lenses, an aperture and a main sensor for capturing an original main image. A secondary sensor and optical system are for capturing a reference image that has temporal and spatial overlap with the original image. The device performs an image processing method including capturing the main image with the main sensor and the reference image with the secondary sensor, and utilizing information from the reference image to enhance the main image. The main and secondary sensors are contained together within a housing.

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium for red eye detection are provided. In one aspect, a system includes an image acquisition device, first and second illuminators, and at least one processor. The first illuminator is arranged closer to the image acquisition device than the second illuminator. The image acquisition device is configured to capture a first facial image of a face of a subject with the first illuminator being on and the second illuminator being off and a second facial image of the face of the subject with the second illuminator being on and the first illuminator being off. The processor can process the first facial image based on the second facial image to determine whether at least one eye of the subject is live by determining that the first facial image includes a red eye reflection from the at least one eye.

Processing for judging whether a face is included in a frame is performed, in a predetermined interval, on each of frames included in a moving image of a subject, displayed on a monitor, until the judgment becomes positive. If it is judged that a face is included in a frame, the facial position is detected in the frame, and stored. Then, judgment is made as to whether a face is included in the next frame after predetermined time. If the judgment is positive, the facial position is detected. The previously stored facial position is replaced by the newly detected facial position, and the newly detected facial position is stored. These processes are repeated until photographing operation is performed by operating a release unit.

Processing for judging whether a face is included in a frame is performed, in a predetermined interval, on each of frames included in a moving image of a subject, displayed on a monitor, until the judgment becomes positive. If it is judged that a face is included in a frame, the facial position is detected in the frame, and stored. Then, judgment is made as to whether a face is included in the next frame after predetermined time. If the judgment is positive, the facial position is detected. The previously stored facial position is replaced by the newly detected facial position, and the newly detected facial position is stored. These processes are repeated until photographing operation is performed by operating a release unit.

Processing for judging whether a face is included in a frame is performed, in a predetermined interval, on each of frames included in a moving image of a subject, displayed on a monitor, until the judgment becomes positive. If it is judged that a face is included in a frame, the facial position is detected in the frame, and stored. Then, judgment is made as to whether a face is included in the next frame after predetermined time. If the judgment is positive, the facial position is detected. The previously stored facial position is replaced by the newly detected facial position, and the newly detected facial position is stored. These processes are repeated until photographing operation is performed by operating a release unit.

Example systems and methods for controlling an illumination source are described. An example apparatus for controlling an illumination source may include a memory and a processor implemented in circuitry and coupled to the memory. The processor may be configured to process a first frame captured by a video capture device when an illumination source is active, process a second frame captured by the video capture device when the illumination source is inactive, and compare the first frame and the second frame. The processor may also be configured to instruct the illumination source to be active or inactive, based on the comparison, for capture of a third frame by the video capture device.