Implementations set forth herein relate to providing selectable autofill suggestions, which correspond to application actions that are at least partially fulfilled using server command data—prior to a user selecting a particular selectable autofill suggestion. Proactively fulfilling command data in this way mitigates latency between user selection of a suggestion and fulfillment of a particular action. Initially, a partial input can be processed to generate autofill suggestions, which can be communicated to a server device for further processing. The autofill suggestions can also be rendered for selection at a touch display interface, thereby allowing a user to select one of the autofill suggestions. As command fulfillment data is provided by the server, the command fulfillment data can be available to a corresponding application(s) in order that any corresponding actions can be at least partially fulfilled prior to user selection.

A method includes determining, by an assistant executing at one or more processors, a default group of actions that the assistant is configured to execute in response to receiving a particular audible command. The method includes determining, by the assistant, based on the default group of actions and a user profile associated with a particular user, a custom group of actions that the assistant is configured to execute in response to receiving the particular audible command from the particular user. The method also includes receiving, by the assistant, an indication of the particular audible command, and determining, by the assistant, whether the indication of particular audible command originated from the particular user. The method further includes, responsive to determining that the indication of particular audible command originated from the particular user, executing, by the assistant, each action from the custom group of actions.

This disclosure provides a system and method for providing intelligently-selected collections of user-centric content in a web browser. When implemented as a method, the method includes maintaining a user-centric graph with a plurality of user-centric facts derived from user interaction with different computer services. The method further includes recognizing different contexts of interest to the user. For each context, a collection of user-centric facts pertaining to the context are recognized in the user-centric graph, such recognition being based on a relationship between user-centric facts in the user-centric graph. The method further includes, for each context, displaying intelligently-selected content based on the collection of user-centric facts.

A method, performed by a first terminal in a video call process between the first terminal and a second terminal, includes sending an image including a target device to a server, receiving device information corresponding to the target device sent by the server, virtualizing an operation interface based on the received device information, and displaying the operation interface on a current video call screen, where the operation interface is an operation interface of a control panel or a remote control of the target device, and displaying, on the current video call screen based on data from the second terminal, one or more operations performed on the operation interface by a user of the second terminal on the second terminal.

A voice information processing method and an electronic device are provided. The voice information processing method may include: a first device (1100) obtains first voice information, and when the first voice information includes a wakeup keyword, the first device (1100) sends a voice assistant wakeup instruction to a second device (1200), such that the second device (1200) launches a voice assistant; then the first device (1100) obtains second voice information and sends the second voice information to the second device (1200), the second device (1200) determines a voice triggered event corresponding to the second voice information by using the voice assistant, and feeds target information associated with performance of the voice triggered event back to the first device (1100), such that the first device (1100) performs the voice triggered event based on the target information. The method can reduce the computing burden of the first device (1100).

Various aspects of the disclosure relate to a virtual assistant factory that supports back office operations within a computing system. Various internal services (e.g., banking services, user management services, and the like) may be accessible to external application via an application programming interface. In some cases, a virtual assistant factory computing platform may expose services that call on and/or are tied to various back office computing operations. The virtual assistant factory platform may spin up and host robots, controls, and/or processes that may supplement computing operations and other associated back office operations. The application interface may call API functions that may cause the virtual assistant factory to spin up a virtual assistant to perform various functions and interact with both the user and the appropriate back office operations and/or third-party computing systems.

In one embodiment, a method includes receiving a user request from a client system associated with a user, generating a response to the user request which references one or more entities, generating a personalized recommendation based on the user request and the response, wherein the personalized recommendation references one or more of the entities of the response, and sending instructions for presenting the response and the personalized recommendation to the client system.

A smart assistant is disclosed that provides for interfaces to capture requirements for a technical assistance request and then execute actions responsive to the technical assistance request. Example embodiments relate to parsing natural language input defining a technical assistance request to determine a series of instructions responsive to the technical assistance request. The smart assistant may also automatically detect a condition and generate a technical assistance request responsive to the condition. One or more driver applications may control or command one or more computing systems to respond to the technical assistance request.

A transmission-type head mounted display includes a detection unit that detects a first target from outside scenery, an image display unit which is capable of transmitting the outside scenery and is capable of displaying an image, and a display image setting unit that causes the image display unit to display a first moving image which is a moving image associated with the detected first target.

An audio/video (A/V) hub provides feedback to a user of a portable electronic device with a touch-sensitive display (such as a cellular telephone) that is used as a wireless remote control for an audio/video (A/V) display device, the A/V hub and/or a consumer-electronic device. In particular, when the A/V hub receives, from the portable electronic device, user-interface activity information associated with a user interface displayed on a touch-sensitive display, the A/V hub generates visual feedback based on the user-interface activity information. Then, the A/V hub provides the visual feedback to the A/V display device for display on the A/V display device. The visual feedback indicates a position of at least a touch contact point of a user of the portable electronic device relative to a strike area of at least a virtual command icon in the user interface.