A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.

A method and apparatus for capturing digital video includes displaying a preview of a field of view of the imaging device in a user interface of the imaging device. A sequence of images is captured. A main subject and a background in the sequence of images is determined, wherein the main subject is different than the background. A sequence of modified images for use in a final video is obtained, wherein each modified image is obtained by combining two or more images of the sequence of images such that the main subject in the modified image is blur free and the background is blurred. The sequence of modified images is combined to obtain the final video, which is stored in a memory of the imaging device, and displayed in the user interface.

An image sensor capable of capturing an image formed by a lens includes a substrate and a bonding wire. The substrate has a pixel array and a bonding pad on a top surface of the substrate between the pixel array and a substrate edge. The bonding wire is electrically connected to the bonding pad and has a region forming a non-zero angle with respect to the substrate top surface. The non-zero angle is in at least one of a lower and an upper angular range for minimizing reflection of incident light on the region from reaching the image sensor. The lower angular range is selected such that the region reflects the incident light away from the pixel array toward a plane including the lens. The upper angular range is selected such that the region reflects the incident light to a clearance between the bonding pad and the pixel array.

A depth detection apparatus that detects depth information on a depth to an object on the basis of first and second signals corresponding to first and second pupil regions of an exit pupil, including: a first calculation unit that calculates a first shift amount between the first and second signals; a signal processing unit that generates a corrected signal by perfoiining filter processing on at least one of the first and second signals, the filter processing being performed to relatively displace the first and second signals by a displacement amount corresponding to the first shift amount; and a second calculation unit that calculates a second shift amount between the filtered first and second signals or between signals, one of which is filtered in the filter processing and the other one of which is unfiltered.

An image processing apparatus includes a processor that sharpens an input image on the basis a difference between a filter and a low pass filter, which are generated using of information regarding a point spread function of an optical system corresponding to an image pickup condition of the optical system, or a difference between an image obtained by applying the filter to an input image generated by imaging through the optical system and an image obtained by applying the low pass filter to the input image.

The imaging device includes a multiple-property lens that includes a first area having a first property and a second area having a second property different from the first property, an image sensor in which a first light receiving element 25A having a first microlens and a second light receiving element 25B having a second microlens having a different focusing degree from the first microlens are two-dimensionally arranged, and a crosstalk removal processing unit that removes a crosstalk component from each of a first crosstalk image acquired from the first light receiving element 25A of the image sensor and a second crosstalk image acquired from the second light receiving element to generate a first image and a second image respectively having the first property and the second property of the multiple-property lens.

A method and apparatus for capturing digital video includes displaying a preview of a field of view of the imaging device in a user interface of the imaging device. A sequence of images is captured. A main subject and a background in the sequence of images is determined, wherein the main subject is different than the background. A sequence of modified images for use in a final video is obtained, wherein each modified image is obtained by combining two or more images of the sequence of images such that the main subject in the modified image is blur free and the background is blurred. The sequence of modified images is combined to obtain the final video, which is stored in a memory of the imaging device, and displayed in the user interface.

An imaging element incorporates a reading portion, a storage portion, a processing portion, and an output portion. The reading portion reads out image data obtained by imaging from a photoelectric conversion element at a first frame rate. The storage portion stores the image data read out from the photoelectric conversion element. The processing portion processes the image data. The output portion outputs the image data processed by the processing portion at a second frame rate. The processing portion detects first image data indicating a specific image from the image data stored in the storage portion. The output portion outputs second image data based on image data different from the first image data detected by the processing portion in the image data of a plurality of frames. The second frame rate is a frame rate lower than the first frame rate.

One variation of a method for tracking placement of products in a store includes: accessing an image depicting a shelving structure in the store; reading a product identifier of a product from a shelf tag detected in the image; accessing a set of template features associated with the product identifier; based on the shelf tag detected in the image, locating a region in the first image depicting a slot on the shelving structure; confirming presence of a unit of the product in the slot in response to detecting features analogous to the set of template features in the region in the image; detecting absence of the product from the slot based on absence of features analogous to the set of template features in the region in the image; and in response to detecting absence of the product from the slot, generating a prompt to restock the slot.

Provided are systems and methods used for calibration of camera/sensor systems. A calibration target system can include at least one calibration target element and at least one black body source. The calibration target element can include an outer perimeter, a modular transfer function (MTF) testing area, a through hole extending through the at least one calibration target, and a plurality of slots extending through the at least one calibration target. The MTF testing area can comprise a light-absorbing surface and at least one slant edge that is non-orthogonal with respect to any side of the outer perimeter. The black body source can be positioned behind the at least one calibration target elements and configured to emit black body radiation such that the black body radiation passes through the through hole and the plurality of slots.