The present invention provides a mobile terminal and a control method using an intuitive gesture as an input to perform a function. Specifically, the present invention provides a mobile terminal including a sensing unit for sensing movement of the mobile terminal, a wireless communication unit for transmitting/receiving a radio signal to/from an external terminal and a control unit for sensing a distance from the mobile terminal to the external terminal based on the strength of the received radio signal, and performing a specific function when the sensed movement corresponds to specific movement and the sensed distance is within a specific range.

A glasses-type information device configured to execute an application includes at least one memory storing instructions, and at least one processor executing the instructions causing the glasses-type information device to execute display control in such a manner that an image corresponding to an operation unit relating to remote control on the application is projected in a field of vision of a user wearing the glasses-type information device by using the glasses-type information device, the remote control being executed by a linked device held by the user, and execute function control of the application based on a command received from the linked device in accordance with a user operation performed by the user on the linked device.

Systems and methods are provided for determining when to present video data via a head-worn wearable device. A head-wearable device includes a display, one or more processors, and memory. The memory includes instructions that, when executed by the one or more processors, cause a head-wearable device, when worn, to detect an electronic device associated with a user of the head-wearable device. The instructions, when executed by the one or more processors, further cause the head-wearable device, when worn, to in accordance with a determination that the electronic device is in proximity to the head-wearable device and presenting video data, and further in accordance with a determination that sensor data received at the head-wearable device indicates that a video-viewing precondition is present, cease to cause presentation of the video data at the electronic device, and cause the presentation of the video data at the display of the head-wearable device.

A method for managing a user interface in a smart glass is provided. The method includes identifying an eye gesture of the user of the smart glass, based on an eye-tracking signal indicative of a pupil location of the user, assessing a user intention for an application displayed in a user interface in the headset based on the eye gesture, and activating the application based on the user intention. A smart glass for use with the above method is also provided.

The present disclosure relates to systems and methods for defining and modifying behavior in an extended reality environment. The systems and methods include receiving a request to build or modify a rule or policy for a given user or activity, obtaining a template based on the user or the activity, displaying the template and tools for editing the template, receiving a modification to the template via the user interacting with the tools of the user interface, and modifying the template based on the modification to generate the rule or policy. The modification includes changing the initial value for the actions or the conditions of the template and saving the template as a separate instance representative of the rule or policy, and the rule or policy includes one or more conditional statements for executing one or more of the actions based on evaluation of one or more of the conditions.

A virtual assistant system includes a mobile device to receive an input command corresponding to a function to be performed at one or more external services, to translate the input command into a semantic atom representing the command, and to transmit the semantic atom, and an assistant server configured to receive the transmitted semantic atom, the assistant server including a plurality of plugins, each plugin corresponding to a respective one of the external services and configured to generate a proprietary language command corresponding to the received semantic atom for each external service in which the function is to be performed.

A virtual assistant system to control external services via messaging includes a mobile device configured to participate in a messaging session between a plurality of other participants, to receive an input command from a user, to translate the received input command into a semantic atom, and to transmit the semantic atom via a message to the messaging session, and an assistant server configured to receive the semantic atom via the message, the assistant server including at least one plugin, the plugin corresponding to a respective external service and configured to generate a proprietary language command corresponding to the received semantic atom, the proprietary language command controlling the corresponding external service to perform a function corresponding to the input command.

A virtual assistant system includes a mobile device to receive an input command corresponding to a function to be performed at one or more external services, to translate the input command into a semantic atom representing the command, and to transmit the semantic atom, and an assistant server configured to receive the transmitted semantic atom, the assistant server including a plurality of plugins, each plugin corresponding to a respective one of the external services and configured to generate a proprietary language command corresponding to the received semantic atom for each external service in which the function is to be performed.

The disclosure provides a method, a virtual reality system, and a computer-readable recording medium for real-world interaction in a virtual reality environment. The method is applicable to a virtual reality system having a virtual reality headset and a controller, wherein the virtual reality system may receive data from a processing device, and the method includes the following steps. An event signal is triggered on at least one of the virtual reality headset and the controller by the processing device, where the event signal is received from the processing device and the event signal indicates an arrival of a notification associated with a real world. Motion data is generated by the controller. Whether the motion data matches first motion data is determined. If so, a first interaction interface is generated and at least one of the virtual reality headset and the controller is allowed to interact with the notification.

A virtual assistant system to manage a virtual reality (VR) session between a plurality of participants, and includes a mobile device configured to receive an input command from a user participating in the VR session, to translate the input command into a semantic atom representing the command, and to transmit the semantic atom, the input command corresponding to a function to be performed at one or more VR external services, and an assistant server configured to manage the VR session, the assistant server including a plurality of plugins, each plugin corresponding to a respective one of the VR external services and configured to generate a proprietary language command corresponding to the semantic atom, the proprietary language command controlling the corresponding VR external service to perform a function corresponding to the semantic atom.