The various implementations described herein include methods, devices, and systems for detecting motion and persons. In one aspect, a method is performed at a smart home system that includes a video camera, a server system, and a client device. The video camera captures video and audio, and wirelessly communicates, via the server system, the captured data to the client device. The server system: (1) receives and stores the captured data from the video camera; (2) determines whether an event has occurred, including detected motion; (3) in accordance with a determination that the event has occurred, identifies video and audio corresponding to the event; and (4) classifies the event. The client device receives information indicative of the identified events, displays a user interface for reviewing the video and audio stored by the remote server system, and displays the at least one classification for the event.

A system and method for detecting movement of a non-light-of-sight (NLOS) object in a space outside a line-of-sight (LOS) of a camera is disclosed. The camera acquires a sequence of successive images that each include a set of pixels, at least a subset thereof representing a target, being at least part of a visible object located within the LOS of the camera and impacted by light scattered from the NLOS object. The set of pixels of two images of the sequence, acquired from different positions of the camera, are registered into a common coordinate system, giving rise to two registered images. A target light intensity value is calculated for both registered images based on at least part of the set of pixels representing the target in the respective registered image. Movement of the NLOS object is detected based on a variation in the target light intensity value between registered images.

An image processing method and apparatus, and a non-transitory computer-readable storage medium are provided. The method includes: acquiring an exposure duration and at least one motion component corresponding to at least one direction within the exposure duration of a current video frame; performing a first noise reduction operation on the current video frame in a two-dimensional space domain in response to a first motion component of the at least one motion component being greater than a preset motion component threshold; and performing a second noise reduction operation on the current video frame in a three-dimensional space domain in response to the at least one motion component being less than the preset motion component threshold.

An image processing apparatus includes a reception unit that receives an image signal acquired by an image sensor, an acceptance unit that accepts operation input made by a user for driving a device carrying the image sensor, a calculation unit that calculates a movement amount of the image sensor in an entire angle of view according to the image signal and the operation input, and a correction processing unit that performs a correction process for an image constructed from the image signal, according to the movement amount.

A method includes obtaining multiple images of a scene using at least one red-green-blue-white (RGBW) image sensor. The method also includes generating multi-channel frames at different exposure levels from the images. The method further includes estimating motion across exposure differences between the different exposure levels using a white channel of the multi-channel frames as a guidance signal to generate multiple motion maps. The method also includes estimating saturation across the exposure differences between the different exposure levels to generate multiple saturation maps. The method further includes using the generated motion maps and saturation maps to recover saturations from the different exposure levels and generate a saturation-free RGBW frame. In addition, the method includes processing the saturation-free RGBW frame to generate a final image of the scene.

Apparatus for binning an input value into an array of bins, each bin representing a range of input values and the bins collectively representing a histogram of input values, the apparatus comprising: an input for receiving the input value; a memory for storing the array; and a binning controller configured to: derive a plurality of bin values from the input value according to a binning distribution located about the input value, the binning distribution spanning a range of input values and each bin value having a respective input value dependent on the position of the bin value in the binning distribution; and allocate the plurality of bin values to a plurality of bins in the array, each bin value being allocated to a bin selected according to the respective input value of the bin value.

An imaging system according to the present disclosure includes: an imaging device that is mounted in a vehicle, and captures and generates an image of a peripheral region of the vehicle; and a processing device that is mounted in the vehicle, and executes processing related to a function of controlling the vehicle on the basis of the image. The imaging device includes: a first control line, a first voltage generator that applies a first voltage to the first control line, a first signal line, a plurality of pixels that applies a pixel voltage to the first signal line, a first dummy pixel that applies a voltage corresponding to the first voltage of the first control line to the first signal line in a first period, a converter including a first converter that performs AD conversion on the basis of a voltage of the first signal line in the first period to generate a first digital code, and a diagnosis section that performs diagnosis processing on the basis of the first digital code. The above-described processing device restricts the function of controlling the vehicle on the basis of a result of the diagnosis processing.

A method for detecting a jitter in a video includes obtaining video frames of a video, in which the video frames include a target video frame and a plurality of historical video frames before the target video frame, determining moving distances in a preset distance of the video frames relative to corresponding previous video frames, determining a target amplitude and a target period in the preset direction for the target video frame; and determining that there is a jitter in a video in response to the target amplitude in the preset direction determined for the target video frame being greater than a preset amplitude and the target period being less than a preset period.

A method, system, apparatus, and/or device for adjusting or removing frames in a set of frames. The method, system, apparatus, and/or device may include: associating a first frame of a set of frames with motion data that is captured approximately contemporaneously with the first frame; when a sampling rate of the motion data is greater than a frame rate of the set of frames, aggregating a first sample of the motion data captured at the first frame and a second sample of the motion data captured between the first frame and a second frame of the set of frames to obtain a movement value; when the movement value does not exceed a first threshold value, accepting the first frame from the set of frames; and when the movement value exceeds the first threshold value, rejecting the first frame from the set of frames.

A system and method for detecting movement of an object outside a line-of-sight of a camera is disclosed. The camera acquires images of a target that is impacted by light that is scattered from the object and by ambient light, and of a reference that is impacted by the ambient light. A processing circuitry can be configured to detect the movement of the object by calculating, for each of a plurality of acquired images, a compensated light intensity value (LIV), being a target LIV that is based on pixels in the respective acquired image that represent the target, as modified, based on a reference LIV that is based on pixels in the respective acquired image that represent the reference, to reduce an effect, on the target LIV, of changes in the ambient light during a time period between acquiring a given image and the acquiring of the respective acquired image.