A robot controller that controls a robot by automatically obtaining a controller capable of suitably controlling a wide range of robots. An image is acquired from an image capturing apparatus that photographs an environment including the robot. The robot is driven based on an output result obtained by inputting the image to a neural network. The neural network is updated according to a reward generated in a case where a plurality of virtual images photographed while changing an environmental condition of a virtual environment generated by virtualizing the environment and a state of a virtual robot are input to the neural network, and a policy of the virtual robot, which is output from the neural network, satisfies a predetermined condition.

A method for object grasping, including: determining features of a scene; determining candidate grasp locations; determining a set of candidate grasp proposals for the candidate grasp locations; optionally modifying a candidate grasp proposal of the set; determining grasp scores associated with the candidate grasp proposals; selecting a set of final grasp proposals based on the grasp scores; and executing a grasp proposal from the set of final grasp proposals.

A method for object grasping, including: determining features of a scene; determining candidate grasp locations; determining a set of candidate grasp proposals for the candidate grasp locations; optionally modifying a candidate grasp proposal of the set; determining grasp scores associated with the candidate grasp proposals; selecting a set of final grasp proposals based on the grasp scores; and executing a grasp proposal from the set of final grasp proposals.

A method for object grasping, including: determining features of a scene; determining candidate grasp locations; determining a set of candidate grasp proposals for the candidate grasp locations; optionally modifying a candidate grasp proposal of the set; determining grasp scores associated with the candidate grasp proposals; selecting a set of final grasp proposals based on the grasp scores; and executing a grasp proposal from the set of final grasp proposals.

A robot controller that controls a robot by automatically obtaining a controller capable of suitably controlling a wide range of robots. An image is acquired from an image capturing apparatus that photographs an environment including the robot. The robot is driven based on an output result obtained by inputting the image to a neural network. The neural network is updated according to a reward generated in a case where a plurality of virtual images photographed while changing an environmental condition of a virtual environment generated by virtualizing the environment and a state of a virtual robot are input to the neural network, and a policy of the virtual robot, which is output from the neural network, satisfies a predetermined condition.

This learning device provides a learned model to an adjuster including the learned model learned to output a predetermined compensation amount to a controller based on parameters of an object to be processed, in a system including the controller outputting a command value obtained by compensating a target value based on a compensation amount; and a control object performing a predetermined process on the object and outputting a control variable as a response to the command value. The learning device includes: a learning part generating candidate compensation amounts based on operation data including a target value, command value and control variable, learning with the generated candidate compensation amounts and the parameters of the object as teacher data, and generating or updating the learned model; and a setting part providing, to the adjuster, the generated or updated learned model.

A method for object grasping, including: determining features of a scene; determining candidate grasp locations; determining a set of candidate grasp proposals for the candidate grasp locations; optionally modifying a candidate grasp proposal of the set; determining grasp scores associated with the candidate grasp proposals; selecting a set of final grasp proposals based on the grasp scores; and executing a grasp proposal from the set of final grasp proposals.