An image pickup apparatus that is capable of eliminating change of an image pickup direction by a user during an image pickup operation and of easily obtaining an image that records experience while focusing attention on the experience. An observation direction detection unit is worn on a body part other than a head of a user and detects an observation direction of the user. An image pickup unit is worn on a body and picks up an image. A recording direction determination unit determines a recording direction using a detection result of the observation direction detection unit. A deviation detection unit detects a deviation of the image pickup apparatus with respect to the body. An image recording unit records a part of the image picked up by the image pickup unit in a recording area that is determined in accordance with the recording direction and the deviation.

A method includes receiving, from a multiscopic image capture system, a plurality of images depicting a scene. The method includes determining, by application of a neural network based on the plurality of images, a disparity map of the scene. The neural network includes a plurality of layers, and the layers include a rectification layer. The method include determining a matching error of the disparity map based on differences between corresponding pixels of two or more images associated with the disparity map. The method includes back-propagating the matching error to the rectification layer of the neural network. Back-propagating the matching error includes updating one or more weights applied to the rectification layer.

A camera calibration tool for calibrating one or more cameras of a mobile machine comprising calibration targets and a net. Each of the calibration targets comprises identifiable indicia. The net is adapted to be coupled to the mobile machine. The net has one or more configurations that define predetermined target locations, with location markers, in a predetermined layout. The calibration targets are positioned respectively at the predetermined target locations in the predetermined layout to calibrate the one or more cameras by use of the calibration targets.

An optical device and method of forming the optical device include a substrate having an integrated metal pattern proximate a detector or top absorber layer to minimize diffraction effects. The integrated metal pattern is aligned with selective regions of the pixel array structure of the detector layer for masking pixels of the pixel array structure. The pattern of the integrated metal pattern may be used for alignment with modulation transfer function (MTF) structures of the detector layer for MTF testing, for alignment with reference pixels of the detector layer for spatial reference used during calibration of the optical device, or for forming a polarizer grid.

An image sensor system includes an image sensor and a prediction part. The image sensor includes an illumination module and a processing part. The illumination module includes a light emitting part for emitting light and a nonvolatile memory. The processing part stores a first data and a second data in the memory. The first data includes an electric parameter value when the light emitting part is applied with a power and a cumulative power-on time obtained by accumulating a time when the light emitting part is applied with the power. The second data includes a value obtained by multiplying the electric parameter value when the light emitting part is applied with the power by the cumulative power-on time. The prediction part obtains the first data or the second data from the memory and predicts a lifetime of the light emitting part based on the first data or the second data.

According to some embodiments, a portable electronic device is described. The portable electronic device includes a housing member defining an external sidewall, a first glass cover and a second glass cover, where the second glass cover includes a first region having a first exterior surface, a second region having a second exterior surface vertically displaced from the first exterior surface, where the second region includes a first opening, a second opening, and a third opening, and a transition region having an exterior surface that extends between the first exterior surface to the second exterior surface. The portable electronic device further includes a first camera module disposed within the first opening, a second camera module disposed within the second opening, a strobe module disposed within the third opening, and a trim structure having an edge that overlays the second region of the second glass cover.

An image sensing device may include a plurality of test pixel blocks and a signal processing unit. The test pixel blocks may be simultaneously heated to different temperatures. The signal processing unit may be in communication with the test blocks and configured to obtain pixel signals for different colors, respectively, based on dark current information associated with the temperatures of the test pixel blocks.

A method of compensating for color differences between adjacent lens images in a panoramic image is disclosed. The method comprises: calculating color differences of each pair of character regions between any two adjacent lens images out of multiple lens images from a multiple-lens camera according to average color values of the character regions, each character region having a character point; determining color adjustment amounts of character points in each lens image according to the color differences of each pair of character regions; calculating a color adjustment amount of an element according to positions of the element and its two adjacent character points and the color adjustment amounts of the two adjacent character points.

A device includes a digital camera positioned underneath a display of the device that captures images through the display. When capturing images using the digital camera, light emitted by the display can get into the digital camera, interfering with or corrupting the captured images. An enhanced output image is generated from a captured image that mitigates the interference from the display. The enhanced output image is generated, for example, by capturing a different calibration image for each pixel type (e.g., Red, Green, and Blue) included in the display. When an image is subsequently captured, an amount of color emitted by the pixels on the display for the currently displayed image is determined and one or more subtraction images are generated and subtracted from the captured image to mitigate the interference from the display.

A video data processor converts input video data into sub-frame data in which one frame is composed of a plurality of sub-frames. A liquid crystal display device includes a display pixel unit in which a greater number of pixels than the number of pixels of the camera to be evaluated are arranged, and switches a display image to be captured by a camera for each frame asynchronously with the camera based on the sub-frame data to display the display image in a frame-sequential manner. The video data processor includes a sub-frame data conversion table which differs for each of a plurality of pixels corresponding to one pixel of the camera, and a sub-frame data converter configured to convert the video data into the sub-frame data for each of the plurality of pixels based on the sub-frame data conversion table.