Convenience and usefulness of a tele-existence system are enhanced taking notice of the possibility by collaboration of tele-existence and a head-mounted display apparatus. A movable member is supported for pivotal motion on a housing. In the housing, a driving motor and a transmission member for transmitting rotation of the driving motor to the movable member are provided. A state information acquisition unit acquires facial expression information and/or emotion information of a user who wears a head-mounted display apparatus. A driving controlling unit controls rotation of the driving motor on the basis of the facial expression information and/or the emotion information.

A method for visualizing data generated by a robotic device is presented. The method includes displaying an intended path of the robotic device in an environment. The method also includes displaying a first area in the environment identified as drivable for the robotic device. The method further includes receiving an input to identify a second area in the environment as drivable and transmitting the second area to the robotic device.

A method for controlling a robotic device is presented. The method includes positioning the robotic device within a task environment. The method also includes mapping descriptors of a task image of a scene in the task environment to a teaching image of a teaching environment. The method further includes defining a relative transform between the task image and the teaching image based on the mapping. Furthermore, the method includes updating parameters of a set of parameterized behaviors based on the relative transform to perform a task corresponding to the teaching image.

A method for training a deep neural network of a robotic device is described. The method includes constructing a 3D model using images captured via a 3D camera of the robotic device in a training environment. The method also includes generating pairs of 3D images from the 3D model by artificially adjusting parameters of the training environment to form manipulated images using the deep neural network. The method further includes processing the pairs of 3D images to form a reference image including embedded descriptors of common objects between the pairs of 3D images. The method also includes using the reference image from training of the neural network to determine correlations to identify detected objects in future images.

A method for controlling a robotic device is presented. The method includes capturing an image corresponding to a current view of the robotic device. The method also includes identifying a keyframe image comprising a first set of pixels matching a second set of pixels of the image. The method further includes performing, by the robotic device, a task corresponding to the keyframe image.

A graphical user interface for a remote controlled robot system that includes a robot view field that displays information provided by a robot and an observer view field that display observer information about one or more observers that can receive the robot information. The interface has various features that allow a master user to control the observation and participation of the observers.

To provide an industrial robot and a method of operating the same which are capable of appropriately handling, when an abnormal state occurs during an automatic operation of the robot, the abnormal state without significantly degrading the work efficiency. The industrial robot includes a robot main body (1) having a robot arm, a robot control device (7) configured to control operation of the robot main body (1) and an abnormal state detecting device (8) configured to detect abnormality in a work state of the robot main body (1). The robot control device (7) includes an automatic operation performing means (9) for controlling the operation of the robot main body (1) to perform an automatic operation based on a given operation program, and an automatic operation correcting means (10) for correcting the operation of the robot main body (1) in the automatic operation based on a manual control performed by an operator according to a detection result of the abnormal state detecting device (8).

A robot system includes a robot including a tactile sensor and a hand having the tactile sensor, a tactile information generator configured to generate tactile information defined by a pressure distribution based on pressures detected by a plurality of pressure sensors and spatial positions of the plurality of pressure sensors, and output the tactile information, a manipulator configured to make an operator sense the pressure distribution according to the tactile information outputted from the tactile information generator, and when the operator manipulates the manipulator, output manipulating information according to the manipulation, and a robot controller configured to control operation of the hand of the robot according to the manipulating information outputted from the manipulator.

Robot main body having robotic arm, remote control device including robotic arm operational instruction input part for operator to control by touching, to input operational instruction for robotic arm, and contactless action detecting part configured to detect contactless action including at least one given operation instructing action of operator, and control device communicably connected to remote control device and configured to control operation of robot main body, are provided. Control device includes memory part configured to store operational instruction content data defining an operation mode of robot main body corresponding to at least one operation instructing action, operational instruction content identifying module to identify operation mode of robot main body of the operation instructing action detected by contactless action detecting part based on operational instruction content data, and motion controlling module configured to control operation of robot main body based on operation mode identified by operational instruction content identifying module.

A robot system includes a robotic arm having an end effector configured to perform a work to a work object, a memory part storing information that causes the end effector to move as scheduled route information, a motion controller configured to operate the robotic arm by using the scheduled route information to move the end effector, a route correcting device configured to generate, by being manipulated, manipulating information to correct a route of the end effector during movement, a camera configured to image the work object, an image generator configured to generate a synthesized image by synthesizing a scheduled route of the end effector obtained from the scheduled route information with a captured image sent from the camera, and a monitor configured to display the synthesized image.