A method incorporating real environment for virtuality and reality combined interaction includes: step 1: capturing a frame of image in a real environment, and determining a movement state between a previous frame of image and a current image for at least one edge point in the image; step 2: for each of virtual objects in the virtual content, detecting whether the edge point is existed on the periphery of the virtual object, and applying corresponding function on the virtual object according to the movement state of the edge point when the edge point is existed on the periphery of the virtual object; and step 3: displaying the virtual content and the real environment in a superimposed manner according to function effect of the edge point to the virtual object, and returning back to step 1 to proceed until interaction between virtuality and reality is end.

A portable electronic device may be configured for play of a video game, with user controlled game characters operated based on inputs received on first user inputs of the device and a virtual game world modified based on information from motion-related sensors of the device. The modification of the virtual game world may be rotation and/or translation of the virtual game world in a gravitational reference frame. The portable electronic device may also allow for user configuration of the virtual game world.

A portable electronic device may be configured for play of a video game, with user controlled game characters operated based on inputs received on first user inputs of the device and a virtual game world modified based on information from motion-related sensors of the device. The modification of the virtual game world may be rotation and/or translation of the virtual game world in a gravitational reference frame. The portable electronic device may also allow for user configuration of the virtual game world.

Systems, methods and articles of manufacture for controlling electronic devices in an interactive gaming environment. Embodiments detect a first interactive game is playing within the physical environment using one or more electronic devices. User movement is monitored using at least one sensor device within the physical environment and user speech is monitored using one or more microphone sensor devices within the physical environment. Upon determining that the user movement matches a predefined series of user actions and that the user speech matches a corresponding predefined speech pattern, embodiments determine a gameplay action corresponding to both the predefined series of user actions and the predefined speech pattern and transmit an instruction, to at least one of the one or more electronic devices within the physical environment, instructing the electronic device to perform the determined gameplay action.

A directional interface object, including: a top tubular portion; a front tubular portion, a top end of the front tubular portion being joined to a first end of the top tubular portion; a bottom tubular portion, a first end of the bottom tubular portion being joined to a bottom end of the front tubular portion; a rear tubular portion, a top end of the rear tubular portion being joined to a second end of the front tubular portion opposite the first end of the front tubular portion, a bottom end of the rear tubular portion being joined to a second end of the bottom tubular portion opposite the first end of the bottom tubular portion; a trackable object disposed at the first end of the top tubular portion.

A method includes: receiving, from a browser executed by a client device, a request to initiate gameplay of a cloud video game; responsive to the request, transmitting to the client device a web application, and initiating execution of the cloud video game by a cloud game machine to generate a first video stream including video content of the cloud video game that is encoded in a compressed video format and encrypted; transmitting the first video stream from the cloud game machine to a streaming server; decrypting the first video stream by the streaming server to generate encoded video content; transmitting, by the streaming server, the encoded video content using a secure protocol to the web application, thereby defining a second video stream, the web application being configured to receive and process the second video stream to provide the video content of the cloud video game for rendering to a display.

A method includes: receiving, from a browser executed by a client device, a request to initiate gameplay of a cloud video game; responsive to the request, transmitting to the client device a web application, and initiating execution of the cloud video game by a cloud game machine to generate a first video stream including video content of the cloud video game that is encoded in a compressed video format and encrypted; transmitting the first video stream from the cloud game machine to a streaming server; decrypting the first video stream by the streaming server to generate encoded video content; transmitting, by the streaming server, the encoded video content using a secure protocol to the web application, thereby defining a second video stream, the web application being configured to receive and process the second video stream to provide the video content of the cloud video game for rendering to a display.

A human-machine interface system comprises a sensor configured to generate data associated with a human movement, such as measured electrical signals or data from an accelerometer. A measurement unit of the human-machine interface measures user movement over time to generate a sequence of measured user movement data. A processor processes the data associated with a human movement from the sensor using a trained neural network to determine one or more predicted user actions. A comparison unit compares the one or more predicted user actions with one or more user actions obtained from the sequence of measured user movement data. A control unit uses the predicted user actions to control a process in an information processing apparatus in dependence upon the comparison performed by the comparison unit.

A method includes obtaining a set of components that, when collectively rendered, presents an immersive experience, extracting a narrative from the set of components, learning a plurality of details of the immersive experience that exhibit variance, based on an analysis of the set of components and an analysis of the narrative, presenting a device of a creator of the immersive experience with an identification of the plurality of the details, receiving from the device of the creator, an input, wherein the input defines a variant for a default segment of one component of the set of components, and wherein the variant presents an altered form of at least one detail of the plurality of details that is presented in the default segment, and storing the set of components, the variant, and information indicating how and when to present the variant to a user device in place of the default segment.

Systems and methods for facilitating virtual operation of a virtual vehicle within a virtual environment are disclosed. According to aspects, a computing device may access a data model indicative of real-life operation of a real-life vehicle by a real-life operator and, based on the data model, generate a set of virtual vehicle movements that are reflective of a performance of the real-life operation of the real-life vehicle by the real-life operator. The computing device may display, in a user interface, the virtual vehicle undertaking the set of virtual vehicle movements such that the real-life operator may review the virtual movements and potentially be motivated to improve his/her real-life vehicle operation.