An application gateway including application service programming positioned at a user premises can provide voice controlled and managed services to a user and one or more endpoint devices associated with the application gateway. The application gateway can be controlled remotely by the application service provider through a service management center and configured to execute an application service provided from the application service provider. The application gateway can execute the application service at the user premises upon voice command by a user and independent of application services executing on the application service provider's network. An application service logic manager can communicate with an application service enforcement manager to verify that the request conforms with the policy and usage rules associated with the application service in order to authorize execution of the application service on the application gateway, either directly or through endpoint devices.

An example user terminal apparatus includes communication circuitry configured to be connected to a home network comprising a plurality of devices; a display configured to display a UI screen for managing the home network; a sensor configured to sense a user manipulation of the UI screen; and processing circuitry configured to change the UI screen displayed on the display according to the user manipulation. The UI screen is one of a plurality of service pages that are changeable according to a user manipulation in a first direction, the plurality of service pages being pages for respectively providing different home network management services. At least one of the plurality of service pages comprises an area that is displayable on the display according to a user manipulation in a second direction.

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for machine learning for home understanding and notification. In one aspect, a method includes obtaining reference videos from a camera within a premises of a home, determining, from the reference videos, timing of actions in a routine that a particular person performs before leaving the home, determining from a sample video from the camera within the home that the particular person appears to be out of sync in performing a particular action based on the timing of actions in the routine determined from the reference videos, and in response, providing a notification to the particular person.

A system and method for a remote state following device that includes an electronic device with a controllable operating state; an imaging device; and control system that when targeted at a control interface interprets a visual state from the control interface, and modifies the operating state in coordination with the visual state.

Systems and methods are described herein for controlling playback and/or recording of media assets at a media device based on the state of a secondary device. Specifically, while displaying a media asset, a media device receives a signal from the secondary device indicating a change of state of the secondary device. The media device displays a notification of the signal, and the user can interact with the notification. If the user interacts with the notification for more than a threshold amount of time, the media device may begin recording the media asset. Once the user has finished interacting with the notification, the media device may stop recording and the user can see content that they may have missed by reviewing the recorded portion of the media asset.

A system and method for visually automated interface integration that includes collecting image data; detecting a device interface source in the image data; processing the image data associated with the device interface source into an extracted interface representation; and exposing at least one access interface to the extracted interface representation.

Systems and methods for an Internet of Things (IoT), smart home climate control and communication system are provided. The IoT, smart home climate control and communication system includes a first smart home device that receives signal sources from a wide area network, transmits signals, data and commands to one or more smart home devices in a home or building in an IoT LAN. The first smart home device also receives signals, data and commands from the one or more smart home devices in the home or building on the IoT LAN, and transmits signals, data and/or commands to the wide area network. The IoT LAN is distinct from a residential wireless LAN.

A wireless access device can be configured to determine a list of accessory groups corresponding to accessories connected to a network managed by the wireless access device. The wireless access device may also be configured to identify at least one firmware update that corresponds to at least one accessory group of the list of accessory groups and request all firmware updates that correspond to the at least one accessory group. The wireless access device can also be configured to receive one or more firmware updates that corresponds to at least one of the accessories of the at least one accessory group for which a respective firmware update is available and transmit at least one firmware update of the received one or more firmware updates to at least one corresponding accessory of the at least one accessory group.

A service management system communicates via wide area network with gateway devices located at respective user premises. The service management system remotely manages delivery of application services, which can be voice controlled, by a gateway, e.g. by selectively activating/deactivating service logic modules in the gateway. The service management system also may selectively provide secure communications and exchange of information among gateway devices and among associated endpoint devices. An exemplary service management system includes a router connected to the network and one or more computer platforms, for implementing management functions. Examples of the functions include a connection manager for controlling system communications with the gateway devices, an authentication manager for authenticating each gateway device and controlling the connection manager and a subscription manager for managing applications services and/or features offered by the gateway devices. A service manager, controlled by the subscription manager, distributes service specific configuration data to authenticated gateway devices.

Techniques and system configurations for generating and implementing recipes and scripts to enable the orchestration of actions, activities, and configurations within smart devices and device networks (including the Internet of Things “IoT” network topologies) are described herein. In an example, a method for smart device orchestration and configuration includes: obtaining an orchestration recipe that defines a sequence of actions to be performed among multiple types of smart devices; activating the orchestration recipe for use upon multiple smart devices associated with a user, based on at least one condition to perform the sequence of actions; associating the orchestration recipe with respective configurations of the multiple smart devices associated with the user; and initiating the orchestration recipe, to cause the sequence of actions to be performed with the multiple smart devices, including via cloud-based device services that control the multiple smart devices associated with the user.