The disclosure includes a method for using a doorbell system to detect a presence of a visitor. The doorbell system can comprise a doorbell having a speaker, a microphone, a camera, and a button. The method can include detecting, by the doorbell system, the presence of the visitor while the visitor is located outside a building to which the doorbell is attached. The building can include a door having a lock that is configured to fasten the door to inhibit unauthorized entry into the building. In response to detecting the presence of the visitor, the method can include the step of actuating, by the doorbell system, a first appliance associated with the building.

An image processing device comprises a specification unit configured to specify, among a plurality of frames constituting a moving image, a section in the moving image of frames corresponding to a scene whose shake amount is larger, based on the plurality of frames, and an output unit configured to output information representing the section.

Sensor data captured by one or more sensors may be received at an analysis system. A neural network may be used to detect an object in the sensor data. A plurality of polygons surrounding the object may be generated in one or more subsets of the sensor data. A prediction of a future position of the object may be generated based at least in part on the polygons. One or more commands may be provided to a control system based on the prediction of the future position.

Visual content is captured by an image capture device during a capture duration. The image capture devices experiences motion during the capture duration. The intentionality of the motion of the image capture device is determined based on angular acceleration of the image capture device during the capture duration. A punchout of the visual content is determined based on the intentionality of the motion of the image capture device. The punchout of the visual content is used to generate stabilized visual content.

An electronic device includes: a motion sensor for outputting motion data corresponding to motion of the electronic device; a camera module for performing an OIS function within a operation range when the motion data has a first size; and a processor electrically connected to the motion sensor and the camera module. The processor acquires motion data from the motion sensor while continuously acquiring image frames through the camera module, determines, based on the motion data, a parameter associated with the OIS function such that the camera module performs the OIS function within the operation range using the parameter based on determination that the motion data has the second size lager than the first size, and acquire image frames for which the OIS function has been performed within the operation range using the determined parameter.

An image signal processor (ISP) processes received image frame data. In order to reduce power consumption caused by the processing of substantially similar image tiles of received image frames, differential processing may be used to determine which image tiles of a received image frame should be processed by the ISP, based upon a comparison between the received image tiles and previously received image tile data. In addition, differential processing may be automatically disabled in response to a determination that the image frames are too different from each other to realize any savings in processing resources or memory usage, and reenabled in response to a determination the received image frames are similar enough such that power savings can be realized through differential processing.

A dual mode image sensor is provided. The image sensor includes an on-chip sensing array, on-chip analog-to-digital converters, and an on-chip processor. The sensor array has rows and columns of discrete sensor elements. The dual mode image sensor has a scene sensing mode and an image capture mode, which use the same set of imaging optics. The processor includes a dual context register; one being for the scene sensing mode and the other for image capture mode. The scene sensing mode is configured to output results of object sensing, motion detection, focus evaluation and illumination measurement to the analog-to-digital converters. The image capture mode is configured to output captured images to the analog-to-digital converters, which are configured to send the digital data to the processor. The processor is configured to switch from scene sensing mode to image capture mode based upon the scene sensing mode output results.

A method for detecting motion information includes the following steps. First, a pixel array is provided for detecting an image of a measured object located in a first distance range or in a second distance range, and the pixel array includes a plurality of invisible image sensing pixels and a plurality of visible image sensing pixels. Then, image detection is conducted within the first distance range by using the invisible image sensing pixels to output a plurality of invisible images. Next, the image detection is conducted within the second distance range by using the visible image sensing pixels to output a plurality of visible images. Then, the plurality of invisible images and the plurality of visible images are analyzed by using a processing unit, so as to obtain motion information of the measured object. A pixel array for detecting motion information and an image sensor are also provided.

Devices, systems and methods are disclosed for enabling a standby mode during videoconferencing, the standby mode having reduced bandwidth consumption and configured to indicate whether a person is present while protecting a privacy of the person. For example, a local device may capture low resolution video data at a low sampling rate, downsample the video data and send the downsampled video data to a remote device, which may upsample the downsampled video data and display the upsampled video data on a display. The upsampled video data indicates an environment of the local device while blurring details, enabling a user of the remote device to identify movement or activity while maintaining privacy for anyone near the local device. The local device may identify activity, motion and/or objects of interest in the video data and may apply a special effect emphasizing the activity, motion and/or objects of interest.

A haptic feedback device for providing haptic sensation comprises a haptic feedback interface that includes a plurality of haptic elements. The haptic feedback device detects a speed and a direction of travel associated with a plurality of moving objects in an upcoming scene of a video based on a look-ahead buffer of the video played on an external display device or the haptic feedback device. A haptic feedback is determined for the upcoming scene of the video based on the look-ahead buffer of the video and the detected speed and direction of travel associated with the plurality of moving objects. One or more movable haptic cues are generated on the haptic feedback interface using the plurality of haptic elements in synchronization with a current scene played on the external display device or the haptic feedback device, based on the determined haptic feedback.