A63F13/525

Method and system for generating an image of a subject from a viewpoint of a virtual camera for a head-mountable display

A method and system of generating an image of a subject from the viewpoint of a virtual camera includes obtaining a plurality of source images of a subject and pose data for each source camera or cameras that captured the source images. Virtual camera pose data is also obtained indicating a pose of a virtual camera relative to the subject. Each source image is distorted based on a difference in pose of the corresponding source camera and the pose of the virtual camera. A weighting is determined for each distorted image based on a similarity between the pose of the corresponding source camera and the pose of the virtual camera. The distorted images are then blended together in accordance with the weightings to form an image of the subject from the viewpoint of the virtual camera.

Method and system for generating an image of a subject from a viewpoint of a virtual camera for a head-mountable display

A method and system of generating an image of a subject from the viewpoint of a virtual camera includes obtaining a plurality of source images of a subject and pose data for each source camera or cameras that captured the source images. Virtual camera pose data is also obtained indicating a pose of a virtual camera relative to the subject. Each source image is distorted based on a difference in pose of the corresponding source camera and the pose of the virtual camera. A weighting is determined for each distorted image based on a similarity between the pose of the corresponding source camera and the pose of the virtual camera. The distorted images are then blended together in accordance with the weightings to form an image of the subject from the viewpoint of the virtual camera.

Scaled VR engagement and views in an e-sports event

The present disclosure describes methods and systems directed towards providing scaled engagement and views of an e-sports event. Instead of providing the same distribution of live e-sport event data to all remote viewers of a live e-sports event, features associated with e-sports gaming network could be used to customize the distribution of live e-sport event data to promote immersive viewer experience. The enhanced immersion can also be carried out in a virtual reality or augmented reality setting. The features would be capable of providing additional information, different views, and a variety of different commentators for the e-sports event so that the viewer can be more engaged when viewing the particular e-sports event. With the increased engagement from remote viewers, the distribution of live e-sports event data can also be further modified for monetization by incorporating advertisements as well.

Scaled VR engagement and views in an e-sports event

The present disclosure describes methods and systems directed towards providing scaled engagement and views of an e-sports event. Instead of providing the same distribution of live e-sport event data to all remote viewers of a live e-sports event, features associated with e-sports gaming network could be used to customize the distribution of live e-sport event data to promote immersive viewer experience. The enhanced immersion can also be carried out in a virtual reality or augmented reality setting. The features would be capable of providing additional information, different views, and a variety of different commentators for the e-sports event so that the viewer can be more engaged when viewing the particular e-sports event. With the increased engagement from remote viewers, the distribution of live e-sports event data can also be further modified for monetization by incorporating advertisements as well.

METHOD FOR PREDEFINING ACTIVITY ZONES IN AN EXTENDED REALITY (XR) ENVIRONMENT

A method predefines activity zones in an extended reality (XR) space by: accessing a previously generated spatial mapping mesh (SMM); compiling a record of all exposed surfaces of the physical elements in the XR space, with positions, dimensions, and categories; for each recorded surface, performing a collision analysis at representative positions around its perimeter to determine an available adjacent open space; filter determined open spaces according to one or more predetermined criteria to determine one or more activity zones at corresponding locations; and assigning each activity zone to an activity category based in part on the categorization of the available adjacent surface or surfaces. The method is carried out in advance of user interaction with any virtual element in the XR space.

METHOD FOR PREDEFINING ACTIVITY ZONES IN AN EXTENDED REALITY (XR) ENVIRONMENT

A method predefines activity zones in an extended reality (XR) space by: accessing a previously generated spatial mapping mesh (SMM); compiling a record of all exposed surfaces of the physical elements in the XR space, with positions, dimensions, and categories; for each recorded surface, performing a collision analysis at representative positions around its perimeter to determine an available adjacent open space; filter determined open spaces according to one or more predetermined criteria to determine one or more activity zones at corresponding locations; and assigning each activity zone to an activity category based in part on the categorization of the available adjacent surface or surfaces. The method is carried out in advance of user interaction with any virtual element in the XR space.

Video game processing program and video game processing system
11465046 · 2022-10-11 · ·

A non-transitory computer-readable medium including a video game processing program product for causing a server to realize functions to control progress of a video game in response to an operation of a user is provided. The functions include: a motion control function configured to refer to a storing section to cause an object to carry out a motion specified by the user, a series of actions (hereinafter, referred to as a “motion”) being stored in the storing section in advance, the object being to be caused to carry out the series of actions; a stopping function configured to cause the motion, which the object is carrying out, to stop on the way on the basis of an operation of the user; and a proceeding function configured to cause the video game to proceed in a state where the motion of the object is stopped on the way on the basis of the stopping function.

Video game processing program and video game processing system
11465046 · 2022-10-11 · ·

A non-transitory computer-readable medium including a video game processing program product for causing a server to realize functions to control progress of a video game in response to an operation of a user is provided. The functions include: a motion control function configured to refer to a storing section to cause an object to carry out a motion specified by the user, a series of actions (hereinafter, referred to as a “motion”) being stored in the storing section in advance, the object being to be caused to carry out the series of actions; a stopping function configured to cause the motion, which the object is carrying out, to stop on the way on the basis of an operation of the user; and a proceeding function configured to cause the video game to proceed in a state where the motion of the object is stopped on the way on the basis of the stopping function.

Application processing system, method of processing application, and storage medium storing program for processing application
11467658 · 2022-10-11 · ·

An application processing system provides an interaction with a virtual character to a user, the application processing system having one or more computer processors and being configured to output an image of a virtual space including the virtual character to a head mounted display mounted on a head of the user. In one aspect, the one or more computer processors execute computer-readable instructions to: specify a first action associated with a motion of the head of the user in the virtual space and performed toward the virtual character, based on one or more detection information items obtained by the head mounted display; and specify, in response to selection of a specific object included in the virtual space, a second action not associated with a motion of the head of the user in the virtual space and performed toward the virtual character, based on the one or more detection information items.

Application processing system, method of processing application, and storage medium storing program for processing application
11467658 · 2022-10-11 · ·

An application processing system provides an interaction with a virtual character to a user, the application processing system having one or more computer processors and being configured to output an image of a virtual space including the virtual character to a head mounted display mounted on a head of the user. In one aspect, the one or more computer processors execute computer-readable instructions to: specify a first action associated with a motion of the head of the user in the virtual space and performed toward the virtual character, based on one or more detection information items obtained by the head mounted display; and specify, in response to selection of a specific object included in the virtual space, a second action not associated with a motion of the head of the user in the virtual space and performed toward the virtual character, based on the one or more detection information items.