Systems, methods, and non-transitory media are provided for tracking operations using data received from a wearable device. An example method can include determining a first position of a wearable device in a physical space; receiving, from the wearable device, position information associated with the wearable device; determining a second position of the wearable device based on the received position information; and tracking, based on the first position and the second position, a movement of the wearable device relative to an electronic device.

A system to process images includes a light source configured to emit a first illumination pattern onto one or more first portions of a scene. The system also includes an image sensor configured to capture light reflected from the scene in response to the emitted first illumination pattern. The system also includes an optimizer configured to perform raytracing of the light reflected from the scene. The system further includes a processor operatively coupled to the optimizer. The processor is configured to determine a parameter of a surface of the scene based on the raytracing, cause the light source to emit a second illumination pattern onto one or more second portions of the scene based at least in part on the parameter of the surface, and refine the parameter of the surface of the scene based on additional raytracing performed on reflected light from the second illumination pattern.

The present invention discloses a control method, system, electronic device and readable storage medium for a capsule endoscope. The method includes: providing a working apparatus, comprising a capsule endoscope, and an external data recorder for cooperating with and controlling the capsule endoscope; monitoring the received ambient power by the external data recorder before wireless transmission of the capsule endoscope or during an intermittence between two transmissions, and/or monitoring the output power of the capsule endoscope by the external data recorder as data is transmitted during wireless transmission; adjusting the operating state of the working apparatus according to the ambient power and/or output power. The present invention can monitor the power during the dormant period before image interaction and/or in the process of image interaction, thus adjust the operating state of the capsule endoscope in real time, which can improve the wireless communication performance and operating time of the capsule endoscope.

Systems, methods, and non-transitory media are provided for adjusting camera settings based on event data. An example method can include obtaining, via an image capture device of a mobile device, an image depicting at least a portion of an environment; determining a match between one or more visual features extracted from the image and one or more visual features associated with a keyframe; and based on the match, adjusting one or more settings of the image capture device.

A novel in-vivo image capture device for capsule endoscope and its method of operation are described. The device includes a wafer level camera module design, high sensitivity backside illumination pixel with high definition image output and LED's to provide illumination, which is synchronized with an image sensor strobe signal. A frame rate of the device can be adjusted based on an angular motion detection from a gyroscope sensor, in which a high frame rate mode is maintained during fast motion while a low frame rate is maintained during slow or no motion. The image capture device also includes machine learning based SOC for image processing, enhancement, and compression. The SOC can process and store zone average of images. The image capture device also includes a high density flash storage to store images in the device, thus no RF transmitter is needed, which make the system more convenient to use.

An image-capturing apparatus according to the present invention includes: an image sensor; a gaze detecting sensor configured to detect a gaze of a user; and at least one memory and at least one processor which function as: an object-detecting unit configured to detect an object from an image captured by the image sensor; and a control unit configured to, if the object-detecting unit detects an object of a specific type in a case where a state of the gaze detecting sensor is a first state for detecting the gaze, change the state of the gaze detecting sensor to a second state in which an electric power consumption of the gaze detecting sensor is less than in the first state.

A mobile device includes an application processor and an image sensor. The application processor includes an imaging subsystem configured to process high resolution image data through a first interface and a sensor hub configured to process sensor data through a second interface. The image sensor operates in one of first and second modes. The image sensor is configured to capture the high resolution image data in response to a request from the imaging subsystem and the imaging subsystem is configured to access the high resolution image data using the first interface for performing a first operation, during the first mode. The image sensor is configured to capture low resolution image data and the sensor hub is configured to access the low resolution image data using the second bus for performing a second operation, during the second mode.

The invention provides an image processing apparatus which comprises a controller which causes an image sensing device to execute either a first mode in which outputs image data of a first resolution, or a second mode in which outputs image data of a second resolution lower than the first resolution; and an evaluating circuit which, by outputting image data of the second resolution in relation to acquired image data, obtains an index value that relates to a spatial frequency of a frequency band in which a signal level decreases in image data of the second resolution more than in image data of the first resolution, wherein the evaluating circuit detects, by machine learning, the index value of image data of the second resolution, and the controller, based on the detected index value, selects either the first or second mode.

An image capturing device includes a first controller operable to control image capturing; an operation section including a switch; a detector operable to detect a change to an image capturing mode and to send a signal representing the change; a second controller operable to monitor and process the sent signal, the second controller having a power consumption less than that of the first controller; and a power supply operable to supply power to the first controller, the second controller, and a functional section of the device. When the second controller receives the signal sent from the detecting section in a power saving state in which power is supplied from the power supply to the second controller, the power saving state is changed to a power supplying state capable of image capturing by supplying power from the power supply to portions of the device including the first controller.

The various implementations described herein include methods, devices, and systems for detecting motion and persons. In one aspect, a method is performed at a smart home system that includes a video camera, a server system, and a client device. The video camera captures video and audio, and wirelessly communicates, via the server system, the captured data to the client device. The server system: (1) receives and stores the captured data from the video camera; (2) determines whether an event has occurred, including detected motion; (3) in accordance with a determination that the event has occurred, identifies video and audio corresponding to the event; and (4) classifies the event. The client device receives information indicative of the identified events, displays a user interface for reviewing the video and audio stored by the remote server system, and displays the at least one classification for the event.