H04N5/228

Video geolocation

Systems and methods for identifying root causes for and/or correcting pointing error in moving platform imaging. Scene frames captured by a sensor (e.g., a focal plane array, etc.) are digitally transformed to compensate for relative motion between the scene and platform, then motion residuals are computed based on inter-frame scene gradients, and image eigenfunctions are fit to the motion residuals to compute coefficients that may be used to efficiently correct future image acquisition, determine root cause(s) of pointing (e.g., sensor pointing error, scene mean altitude, platform altitude, etc.) errors, and further digitally correct the captured images. Comparisons may be made to a database of residual transformation coefficients based on known or expected relative motion of the platform to the scene and a known or expected pointing angle. Truly moving targets may be identified, removed and re-added after image digital transformation processing.

Translation display device, translation display method, and control program

A translation display device of the present invention carries out a translation process of translating text extracted from a certain image and displays translated text while a display frame rate is maintained. A translation processing section (5) carries out the translation process in a case where no image other than the certain image is being subjected to the translation process. An image movement analyzing section (7) identifies a displacement of a position of an object in a most recent image which has been most recently obtained, the displacement being measured with respect to a reference position of an object in a reference image for which the translation process most recently ended. A generated image in which translated text obtained by translating extracted text extracted from the reference image is displayed so as to be superimposed on the most recent image in accordance with (i) a position of the extracted text and (ii) information on the displacement.

Image sensor with time overlapping image output
09787917 · 2017-10-10 ·

An image sensor system with an image sensor that generates a first image and a second image. The first and second images are transmitted to a processor in a time overlapping manner. By way of example, the images may be transferred to the processor in an interleaving manner or provided on separate dedicated busses.

Video image stabilization with enforced stabilization constraints

Techniques to improve a digital image capture device's ability to stabilize a video stream—while enforcing desired stabilization constraints on particular images in the video stream—are presented that utilize an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the value of a stabilization strength parameter and/or the weighted contribution of particular frames from the buffer in the determination of stabilization motion values for the current frame. Such techniques keep the current frame within its overscan and ensure that the stabilization constraints are enforced, while maintaining desired smoothness in the video stream. In some embodiments, the stabilization constraint may comprise a maximum allowed frame displacement.

Solid state imaging device, manufacturing method of the same, and electronic equipment

A solid state imaging device that includes a phase difference detection pixel which is a pixel for phase difference detection; a first imaging pixel which is a pixel for imaging and is adjacent to the phase difference detection pixel; and a second imaging pixel which is a pixel for imaging other than the first imaging pixel. An area of a color filter of the first imaging pixel is smaller than an area of a color filter of the second imaging pixel.

Techniques for optical image stabilization using magnetic shape memory actuators
09778480 · 2017-10-03 · ·

Various embodiments are generally directed to techniques for using MSM actuators to minimize the consumption of electric power and/or the quantity of components in implementing OIS in an image capture device. An apparatus may include a camera pivotally mounted within an endpiece of a casing, the camera including an image capture element to capture an image of an object along a line of sight of the image capture element; an actuator of elongate shape coupled to the camera to exert a mechanical force to pivot the camera about an axis, the elongate shape of the actuator extending into a relatively thin and elongate portion of the casing that is coupled to and extends from the endpiece; and a countering movement component to operate the actuator to pivot the camera about the axis in a countering movement to provide OIS to the camera. Other embodiments are described and claimed.

Three dimensional imaging with a single camera
09781405 · 2017-10-03 · ·

Systems and methods provide accurate pixel depth information to be applied to a single image taken by a single camera in generating a three-dimensional (3D) image. In particular, two or more images can be captured during, e.g., lateral movement of a camera to ascertain depth in a scene on a pixel level. Use of an optical image stabilization (OIS) system that can provide at least three axes of stabilization eliminates the variability associated with conventional systems that create problems with image registration. Further still, and because actual pixel depth information is being calculated rather than merely generating stereoscopic images to trick the eyes into perceiving depth, the pixel depth information that is calculated can be leveraged in other ways, such as for providing automated measurements merely by taking a picture of an object or scene.

Electronic image stabilization frequency estimator
09756249 · 2017-09-05 · ·

Disclosed are a system and a method for determining enabling or disabling electronic image stabilization (EIS) for a video frame. An image sensor of a camera system captures a video stream that comprises a plurality of video frames. An image processor determines availability of a computational resource that may process application of EIS on each video frame. Simultaneously, the image processor receives motion data of the camera system from a gyroscope. Based on the computational resource availability, a motion frequency threshold is determined. Based on the gyroscope motion data, a motion frequency of each video frame is estimated. The estimated motion frequency is compared to the determined motion frequency threshold. If the estimated motion frequency is greater than the determined motion frequency threshold, application of EIS is disabled. If the estimated motion frequency is less than or equal to the determined motion frequency threshold, application of EIS is enabled.

Travel control device and travel control method

A travel control device includes ultrasonic obstacle detection sensors detecting an obstacle entering a rear side of a vehicle and a distance to the obstacle, and an image obstacle detection unit detecting the obstacle entering the rear side of the vehicle by using an image of the rear side. If a distance to the obstacle detected by the sensors is equal to or less than an activation threshold for warning, the travel control device issues a warning, and sets the activation threshold larger as the vehicle speed of the vehicle becomes high. If the vehicle is detected preparing to move rearward and the image obstacle detection unit detects the obstacle, the travel control device sets the activation threshold to a constant value regardless of the vehicle speed.

Image shake correcting device and control method therefor, optical apparatus, and image pickup apparatus
09749533 · 2017-08-29 · ·

This image pickup apparatus performs feedback control so that a position of a shake correcting lens converges to a target position. A LPF and a subtracting unit divide a shake signal into low-frequency and high-frequency components. An adding unit combines each output of a high-frequency LPF and a low-frequency LPF and output the target position. A pan/tilt determination unit determines a panning speed from the shake signal. If the panning is fast, the target positions of the low-frequency and the high-frequency are controlled to converge to 0, and calculation for the target position of the high-frequency starts before that of the low-frequency at the end determination. If the panning is slow, only the target position of the low-frequency is controlled to converge to 0. The pan/tilt determination unit changes a determination condition for the detection depending on whether it is at the handheld photographing or the static state.