Systems and methods for improving initial results of a reinforcement learning model are described herein. In an embodiment, a server computer initiates a reinforcement learning model for a modeled system. While executing the reinforcement learning model, the server computer computes a first result value for a particular action using the reinforcement learning model and a second result value for the particular action using a heuristic separate from the reinforcement model. Based, at least in part, on the first result value for the particular action and the second result value for the particular action, the server computer performs the particular action. The server computer determining a result from performing the particular action and updates the reinforcement learning model.

Systems and methods for improving initial results of a reinforcement learning model are described herein. In an embodiment, a server computer initiates a reinforcement learning model for a modeled system. While executing the reinforcement learning model, the server computer computes a first result value for a particular action using the reinforcement learning model and a second result value for the particular action using a heuristic separate from the reinforcement model. Based, at least in part, on the first result value for the particular action and the second result value for the particular action, the server computer performs the particular action. The server computer determining a result from performing the particular action and updates the reinforcement learning model.

A game device including memory an operation device, and circuitry. The memory is configured to store information related to an image of a first object and a virtual space. The operation device is configured to output first operation information and second operation information, based on a motion of a player. The circuitry is configured to display an image of the first object moving in the virtual space, progress a first game when the first operation information is retrieved, determine whether a state of the first object moving in the virtual space satisfies a predetermined condition in the first game, and progress a second game when the second operation information is retrieved within a predetermined period after the state of the first object satisfies the predetermined condition.

A game device including memory an operation device, and circuitry. The memory is configured to store information related to an image of a first object and a virtual space. The operation device is configured to output first operation information and second operation information, based on a motion of a player. The circuitry is configured to display an image of the first object moving in the virtual space, progress a first game when the first operation information is retrieved, determine whether a state of the first object moving in the virtual space satisfies a predetermined condition in the first game, and progress a second game when the second operation information is retrieved within a predetermined period after the state of the first object satisfies the predetermined condition.

A player character is caused to start a continuous action on the basis of an operation input. Every time a predetermined time elapses from the action start, a non-player character included in a predetermined range including a position of the player character and having a size corresponding to an elapsed time from the action start is determined. Then, the non-player character determined to be included in the predetermined range is caused to start the continuous action.

A player character is caused to start a continuous action on the basis of an operation input. Every time a predetermined time elapses from the action start, a non-player character included in a predetermined range including a position of the player character and having a size corresponding to an elapsed time from the action start is determined. Then, the non-player character determined to be included in the predetermined range is caused to start the continuous action.

This application discloses an action execution method in a virtual gaming environment performed at a terminal device. The method includes: setting a key status of a first virtual key to a touchable state in a process of running a round of game when a target object controlled by a user of the terminal device completes an action combination once; monitoring a first touch operation performed on the first virtual key in the touchable state; controlling, when the first touch operation is detected, the target object to perform the acceleration operation, and monitoring, within a target time period, a second touch operation performed on a control key configured to control the target object to perform a target action; and controlling, when the second touch operation is detected within the target time period, the target object to perform the target action in a process of performing the acceleration operation.

This application discloses an action execution method in a virtual gaming environment performed at a terminal device. The method includes: setting a key status of a first virtual key to a touchable state in a process of running a round of game when a target object controlled by a user of the terminal device completes an action combination once; monitoring a first touch operation performed on the first virtual key in the touchable state; controlling, when the first touch operation is detected, the target object to perform the acceleration operation, and monitoring, within a target time period, a second touch operation performed on a control key configured to control the target object to perform a target action; and controlling, when the second touch operation is detected within the target time period, the target object to perform the target action in a process of performing the acceleration operation.

A method for controlling a virtual vehicle includes displaying, on a graphical user interface, a virtual vehicle in a virtual environment, and controlling the virtual vehicle to drive in the virtual environment in response to a control operation input into the graphical user interface. The method further includes determining whether movement of the virtual vehicle in the graphical user interface based on the control operation meets a predefined condition, and, in response to a determination that the movement of the virtual vehicle in response to the control operation meets the predefined condition, controlling the virtual vehicle independently of the control operation to move away from a road boundary.

The present disclosure provides computer-implemented methods for difficulty-adjusted multi-participant interactivity. Also provided are computer readable media and computer devices that find use, e.g., in practicing the methods of the present disclosure. In certain aspects, the disclosure pertains to closed-loop assessment and adaptive methods and systems designed to equilibrate difficulty challenge levels across multiple (two or more) participants in interactive activities. In some embodiments, a first individual presents a first simulated challenge to a second individual and the second individual responds to it. Depending upon the response of the second individual to the first challenge, the second challenge presented by the first individual to the second individual may be unchanged, made ore difficult, or made less difficult so that the modified second challenge is commensurate with the skills of the second individual. Thus, the disclosure provides customized experiences for individuals of disparate physical abilities to enjoyably interact with each other.