G05B2219/37074

Virtual-world simulator

In one implementation, a virtual-world simulator includes a computing platform having a hardware processor and a memory storing a software code, a tracking system communicatively coupled to the computing platform, and a projection device communicatively coupled to the computing platform. The hardware processor is configured to execute the software code to obtain a map of a geometry of a real-world venue including the virtual-world simulator, to identify one or more virtual effects for display in the real-world venue, and to use the tracking system to track a moving perspective of one of a user in the real-world venue or a camera in the real-world venue. The hardware processor is further configured to execute the software code to control the projection device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a present vantage point of the tracked moving perspective.

Gestural control of an industrial robot

A robot system is configured to identify gestures performed by an end-user proximate to a work piece. The robot system then determines a set of modifications to be made to the work piece based on the gestures. A projector coupled to the robot system projects images onto the work piece that represent the modification to be made and/or a CAD model of the work piece. The robot system then performs the modifications.

VERIFICATION OF TOW PLACEMENT BY A ROBOT

Systems and methods are provided for verifying the placement of tows by a robot. One embodiment includes a robot that includes an end effector that lays up tows, actuators that reposition the end effector, a memory storing a Numerical Control (NC) program, and a robot controller that directs the actuators to reposition the end effector based on the NC program, and instructs the end effector to lay up tows based on the NC program. The system also includes a sensor system comprising an imaging device that acquires images of the tows as the tows are laid-up, a measuring device that generates input as tows are laid-up by the end effector, and a sensor controller that receives images from the imaging device and the input from the measuring device, and updates stored data to correlate the images with instructions in the NC program, based on the input.

Virtual-world simulator

In one implementation, a virtual-world simulator includes a computing platform having a hardware processor and a memory storing a software code, a tracking system communicatively coupled to the computing platform, and a projection device communicatively coupled to the computing platform. The hardware processor is configured to execute the software code to obtain a map of a geometry of a real-world venue including the virtual-world simulator, to identify one or more virtual effects for display in the real-world venue, and to use the tracking system to track a moving perspective of one of a user in the real-world venue or a camera in the real-world venue. The hardware processor is further configured to execute the software code to control the projection device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a present vantage point of the tracked moving perspective.

Virtual-World Simulator

In one implementation, a virtual-world simulator includes a computing platform having a hardware processor and a memory storing a software code, a tracking system communicatively coupled to the computing platform, and a projection device communicatively coupled to the computing platform. The hardware processor is configured to execute the software code to obtain a map of a geometry of a real-world venue including the virtual-world simulator, to identify one or more virtual effects for display in the real-world venue, and to use the tracking system to track a moving perspective of one of a user in the real-world venue or a camera in the real-world venue. The hardware processor is further configured to execute the software code to control the projection device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a present vantage point of the tracked moving perspective.

INFORMATION PROJECTION SYSTEM, CONTROLLER, AND INFORMATION PROJECTION METHOD

The information projection system includes stereo cameras, a controller, and projectors. The controller has a communication device, an analysis unit, a registration unit, and a projection control unit. The communication device acquires sets of appearance information in which each stereo camera detects an appearance of a workplace. The analysis unit analyzes the sets of appearance information, and creates a map information indicating shapes and positions of objects existing in the workplace. The registration unit creates and registers a work status information based on the map information that is individually created from the sets of appearance information respectively detected by the plurality of stereo cameras. The projection control unit creates an auxiliary image for assisting a work based on the work status information, and outputs the auxiliary image to each projector.

Recognition device, system and recognition method
11422537 · 2022-08-23 · ·

A recognition device includes: an image generator configured to acquire a control signal for displaying an image on a display device of a machine tool, the control signal being output from a display control device of the machine tool, and generate an image to be displayed on the display device, based on the acquired control signal; and an information generator configured to recognize at least one of state and control content of the machine tool, contained in the image, and generate machine information.

Virtual-World Simulator

In one implementation, a virtual-world simulator includes a computing platform having a hardware processor and a memory storing a software code, a tracking system communicatively coupled to the computing platform, and a projection device communicatively coupled to the computing platform. The hardware processor is configured to execute the software code to obtain a map of a geometry of a real-world venue including the virtual-world simulator, to identify one or more virtual effects for display in the real-world venue, and to use the tracking system to track a moving perspective of one of a user in the real-world venue or a camera in the real-world venue. The hardware processor is further configured to execute the software code to control the projection device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a present vantage point of the tracked moving perspective.

ROBOT SYSTEM

A robot system includes a robot body having a working part, a robot manipulation device used by an operator to manipulate the robot body, left and right-eye cameras configured to capture left and right-eye capturing images of a work area where the working part performs the work, a stereoscopic display unit configured to display parallax images seen three-dimensionally by the operator with both eyes, an area manipulation device operated by the operator to specify a stereoscopic vision target area to be seen three-dimensionally on the display unit, in an absolute space in a field of view common between the cameras, a robot controlling module that controls operation of the robot body according to manipulation of the robot manipulation device, a stereoscopic display controlling module that extracts images corresponding to the target area, from the left and right-eye capturing images, and display the extracted images on the stereoscopic display unit.

Installation support apparatus, installation support system, and installation support program
11853045 · 2023-12-26 · ·

Accurate wiring work shall be efficiently performed when a module group included in a control system for an industrial machine is installed. An installation support apparatus includes an image information acquisition part configured to acquire a camera image of a module included in a control system for an industrial machine, a design information acquisition part configured to specify the module on the basis of the camera image, and acquire design information relevant to wiring of the module, and a projection information processing part configured to generate a projection image based on the design information, allowing to be projected onto a position corresponding to the camera image.