The present disclosure generally relates to engaging in cross device interactions. The method includes at a first device with a first display, while a second device having a second display is placed over a first region of the first display, detecting, via input devices of the first device, a first input. In response to detecting the first input and in accordance with a determination that the first input occurred while focus was directed to the second device, the method includes causing a response to the first input to be displayed on the second display. In response to detecting the first input and in accordance with a determination that the first input occurred while focus was directed to the first device, the method includes displaying, on the first display, a response to the first input without causing a response to the first input to be displayed on the second display.

A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience.

The present disclosure provides method and apparatus for processing a document through a plurality of input modalities. A first input may be received, and input modality and type of the first input may be identified, wherein the type includes command and content. A second input may be received, and input modality and type of the second input may be identified. The document may be processed based at least on an identification result for the first input and an identification result for the second input.

A method of providing an intelligent response on an electronic device and an apparatus therefor are provided. The method includes receiving a command from a user of the electronic device, analyzing the command, generating, based on the analyzed command, at least one intelligent response corresponding to the command and an actual response corresponding to the command, the at least one intelligent response including at least one of a sound effect associated with the command, a vibration effect associated with the command, or a visual effect associated with the command, and outputting the at least one intelligent response and the actual response by the electronic device.

An interactive control system includes: an active pen; and an electronic device configured to wirelessly control the active pen, receive a user command, and generate a control command according to the user command, wherein at least one of the active pen and the electronic device is configured to execute a control function according to the control command.

A method for input detection at a computing device includes receiving, from a camera, a plurality of images depicting a user hand. The plurality of images are processed to detect a plurality of user intent parameters, including a predefined activation gesture performed by the user hand. Responsive to the plurality of user intent parameters satisfying a gesture input activation condition, the plurality of images are processed to detect a movement of the user hand consistent with a predefined input gesture. The predefined input gesture is mapped to a computer control action, and the computer control action is performed in response to the predefined input gesture.

A method for estimating a gaze direction of a user includes acquiring an image of a face of the user, determining an approximate gaze direction based on a current head pose and a relationship between head pose and gaze direction, determining an estimated gaze direction based on detected eye features, determining a precise gaze direction based on glint position and eye features, and combining the approximate gaze direction and at least one of the estimated gaze direction and the precise gaze direction to provide a corrected gaze direction.

Systems, methods, and apparatus for presenting information and performing a task using an electronic device. In some aspects, a device shows content items when a gaze or a shaking act plus a gaze are detected. In some aspects, a device performs a task when a name, a code, and the task are detected in voice input. In some aspects, a user communicates with a selected vehicle via a user device.

There is disclosed devices, systems and methods for nonverbal multi-input and feedback devices for user intended computer control and communication of text, graphics and audio. The system comprises sensory devices comprising sensors to detect a user inputting gestures on sensor interfaces, a cloud system comprising a processor, for retrieving the inputted gestures detected by the sensor on the sensory device, comparing the inputted gestures to gestures stored in databases on the cloud system, identifying at least a text, graphics and/or speech command comprising a word that corresponds to the inputted gesture; showing the command to the user; and transmitting the command to another device.

Button functionalities for user interfaces, e.g., for use with a portable multifunction device, are disclosed. Exemplary button functionalities are described for an electronic device with a display, a rotatable and depressible input mechanism, and/or a button. Different device features may be accessed, depending on whether the rotatable and depressible input mechanism or the button is activated, and further depending on whether the activation represents a single press, a double press, or an extended press on the rotatable and depressible input mechanism or the button.