G05B2219/37572

Robot-based waiter operation based on monitoring of customer consumption activity

A robot service providing system includes a table monitoring terminal associated with one of a plurality of tables in a venue, a central control terminal, and a movable waiter robot. The central control terminal includes a communication interface, a display, an operation panel, and a controller. The controller is configured to control the display to display a screen including an image including a consumable item captured by a camera of the table monitoring terminal based on image data received by the communication interface, and control the communication interface to transmit a service instruction in response to a user operation on the operation panel. The movable waiter robot is configured to move to said one of the tables based on the service instruction.

Intelligent object tracking

A method for object tracking. The method includes capturing, using a camera device, a sequence of images of a scene, detecting, based on a pattern of local light change across the sequence of images, a light source in the scene, comparing, in response to detecting the light source, a location of the light source in at least one image of the sequence of images and a current position of a transport robot to generate a result, and generating, based on the result, a control signal for moving the transport robot toward the light source such that the light source aligns with a target position within the field-of-view.

Method and system for detection of an abnormal state of a machine using image data and artificial intelligence

An object recognition apparatus for automatic detection of an abnormal operation state of a machine including a machine tool operated in an operation space monitored by at least one camera configured to generate camera images of a current operation scene is provided. The generated camera images are supplied to a processor configured to analyze the current operation scene using a trained artificial intelligence module to detect objects present within the current operation scene. The processor is also configured to compare the detected objects with objects expected in an operation scene in a normal operation state of the machine to detect an abnormal operation state of the machine.

SYSTEM AND METHOD OF AUTOMATICALLY PICKING AND HANDLING PARTS
20220177231 · 2022-06-09 · ·

An automated parts handling system includes a conveyor, a robotic arm configured to pick parts from a parts receptacle and place the picked parts on the conveyor, a vision device disposed over or adjacent the conveyor and configured to determine the number of parts picked by the robotic arm from the parts receptacle and placed on the conveyor, a memory, and a processor communicatively coupled to the conveyor, the robotic arm, and the vision device. The memory includes program instructions executable by the processor to implement a pick process configured to receive information from the vision device on the number of parts picked by the robotic arm and placed on the conveyor, based on the received information regarding the number of picked parts, selectively control the robotic arm to retrieve from the conveyor a number of the picked parts, and selectively control the robotic arm to place one or more of the retrieved parts back in the parts receptacle when the number of parts picked by the robotic arm differs from a predetermined number of parts specified in the program instructions.

INTELLIGENT SWITCHING SYSTEM FOR SWITCHING INTERNAL COOLING AND EXTERNAL COOLING BASED ON MINIMAL QUANTITY LUBRICATION AND METHOD

An intelligent switching system for switching internal cooling and external cooling and a method are provided. The system includes a vision system, a cooling system and a control system. The vision system monitors a real-time milling state of a cutter, collects a real-time milling depth image that the cutter mills a workpiece, and transmits the collected real-time milling depth image to the control system. The control system includes a lubrication mode control center, and a motor control center. The lubrication mode control center receives the real-time image transmitted by the image collection control center; analyzes and processes the real-time image to obtain real-time milling depth data of the cutter. The motor control center receives a signal sent by the lubrication mode control center; analyzes and processes the signal, and transmits a control instruction to the cooling system. The cooling system executes a switching command issued by the control system.

DATA GENERATION METHOD AND APPARATUS, AND STORAGE MEDIUM

The present disclosure discloses a data generation method and apparatus, and a computer-readable storage medium, the method including: importing a robot model by using a game engine; simulating a Red-Green-Blue Depth (RGBD) camera by a scene capture component in the game engine; controlling a human hand of the imported robot model to move within a field of view of the RGBD camera by using a joint control module in the game engine; acquiring RGBD image data by using the RGBD camera; and generating an annotated data set with coordinates of 21 key points according to the RGBD image data and coordinate information of a 3D pose of the 21 key points.

STATE MONITORING DEVICE AND STATE MONITORING METHOD FOR INDUSTRIAL MACHINERY
20230241779 · 2023-08-03 · ·

A robot state monitoring device 2 comprises: a camera which captures an image of a robot 3 under the control of a controller; a moving image generation unit which associates video data of the robot 3 acquired by the camera with input/output signals DO[1], AO[1], DI[1], and AI[1] of the controller along a time axis 830, and generates a moving image showing a state change of the robot 3 and the input/output signals DO[1], AO[1], DI[1], and AI[1]; and a moving image playback device which plays back the moving image generated by the moving image generation unit

The moving image generation unit acquires the values of the input/output signals DO[1], AO[1], DI[1], and AI[1] at the recording time of each frame under the same cycle as the frame rate of the video data.

Machine Tool and Method for Preparing a Machining of a Material-removing Rotary Tool
20210364997 · 2021-11-25 ·

At least one coordinate value (z1, z2, α1, α2) of a cutting body (35) can be acquired by means of an acquisition device (27) and transferred to the control device (25). This at least one coordinate value (z1, z2, α1, α2) of each cutting body (35) can be used for the rest of the method in the control device (25). This at least one coordinate value (z1, z2, α1, α2) which is determined on the basis of the at least one image (B) can be directly taken into account during the processing of the rotational tool (13). Alternatively or additionally, this at least one coordinate value (z1, z2, α1, α2) which is determined on the basis of the at least one image (B) can be used to determine at least one further coordinate value, in particular using a sensing device (29).

ROBOT-BASED WAITER OPERATION BASED ON MONITORING OF CUSTOMER CONSUMPTION ACTIVITY
20220274258 · 2022-09-01 ·

A robot service providing system includes a table monitoring terminal associated with one of a plurality of tables in a venue, a central control terminal, and a movable waiter robot. The central control terminal includes a communication interface, a display, an operation panel, and a controller. The controller is configured to control the display to display a screen including an image including a consumable item captured by a camera of the table monitoring terminal based on image data received by the communication interface, and control the communication interface to transmit a service instruction in response to a user operation on the operation panel. The movable waiter robot is configured to move to said one of the tables based on the service instruction.

MEASURING APPARATUS
20220244037 · 2022-08-04 · ·

A measuring apparatus for measuring a planar relative motion between a tool attacher and a work attacher of a machine tool includes at least one image capturing element capable of performing image capturing at a first position, a second position, and a third position, which are not located on the same line. The image capturing elements at the first position, the second position, and the third position are caused to capture a first point, a second point, and a third point, respectively, arranged on at least one plane of an XY-plane, an XZ-plane, and a YZ-plane. The image capturing element at the second position and the image capturing element at the third position are caused to capture the first point, the image capturing element at the first position and the image capturing element at the third position are caused to capture the second point, and the image capturing element at the first position and the image capturing element at the second position are caused to capture the third point. Based on the image capturing result, a value indicating the planar relative motion between the tool attacher and the work attacher is calculated.