An electronic device can include a microphone; a camera module; a short-range communication module supporting short-range wireless communication; a communication module configured to communicate with a voice recognition server; a memory; and a processor. The processor may be configured to: identify whether an object accessing the electronic device is a user; determine whether a voice interaction condition is satisfied on the basis of context information; when the user's access is identified, if the voice interaction condition is satisfied, receive user voice from the microphone, and if the voice interaction condition is not satisfied, output external interaction information that enables an external electronic device to interact with the voice recognition server by using the short-range communication module; receive user voice analysis information from the voice recognition server by using the communication module; and perform at least one operation on the basis of the received user voice analysis information.

Modular, propelled cable-driven robotic platform systems and methods of operation are disclosed. The system includes a robotic platform suspended by a system of overhead cables, motorized cable reels and pulleys. The robotic platform is configured to be equipped with tool modules for performing respective tasks. Additionally, the tool modules each have a multirotor propulsion system. A master control computer coordinates operation of the motorized cable and propulsion systems as a function of sensor data captured by navigation sensors on-board the platform so as to maneuver the robotic platform inside an industrial plant. The system is configured to maneuver around pipings and avoid obstacles in the plant in order to maximize the effective workspace that the robotic platform can reach to perform operations including inspection or repair.

This application discloses a tactile sensor, a detection method for a touch event, a sensing device and a robot, and belongs to the field of sensor design. The tactile sensor includes: a sensing unit, an elastomer support housing and a base; the sensing unit is disposed in an inner cavity enclosed by the elastomer support housing and the base; and the sensing unit includes at least two light sources, a photo detector and a reflector, where the photo detector is disposed on base, the at least two light sources are disposed around the periphery of the photo detector on the base, and the reflector is disposed at the top of an inner cavity of the elastomer support housing. By adopting the combination of a plurality of light sources and one photo detector, the number of photo detectors for use is reduced, so that the volume of the tactile sensor is reduced.

A visual-tactile sensing device includes a visual-tactile sensing pad useful to capture image data related to a work piece during contact with the pad and as it approaches the pad. The sensing device can be used as part of a robotic gripper or other device. One or more lights can be used to illuminate the work piece and/or project light through the pad. The pad includes a rigid base, an elastic layer structured to deform upon contact with the work piece, and a diffraction layer structured to diffract light at different colors depending on the angle of the incoming light rays and camera placement.

A robotic gripper includes a number of fingers useful to grasp a work piece. Each finger can include a visual-tactile contact pad useful to provide contact information related to the work piece when it is grasped by the fingers. The hand and fingers of the robotic gripper can include one or more optical elements such as mirrors/lenses/etc which aid in transmitting optical information from the pad to a camera. A single image sensor can be used to capture the optical data originating from the different pads. The different pads can be configured to project unique wavelengths to permit simultaneous imaging by the single image sensor. The optical paths can be configured to image on different portions of the image sensor to permit simultaneous imaging. In still other forms a shutter or similar device can be used to alternate projection of image data onto the image sensor from the different pads.

A posture of a component is to be accurately determined.

A posture determination method is to determine, based on an image acquired for a component having a plurality of surfaces, a posture of the component. This posture determination method includes recognizing an outer shape of the component from the image, detecting a feature amount of a surface shape in a determination area being a part of the component based on the outer shape of the component recognized in the recognizing, and determining. In the determining, the posture of the component is determined by comparing a first reference amount indicating a reference feature amount in the determination area of a first surface of the component and a second reference amount indicating a reference feature amount in the determination area of a second surface of the component with the feature amount detected in the detecting.

Techniques for retracting an instrument into an entry guide include receiving a retraction command for the instrument, the retraction command commanding movement of the instrument into the entry guide; causing, in response to the retraction command and using an instrument manipulator, movement of a rotational joint of the instrument that is external to the entry guide toward a distal end of the entry guide; actuating, after the rotational joint reaches a minimum distance from the distal end of the entry guide, the rotational joint to orient a link of the instrument so that the link can be retracted into the entry guide, the link being adjacent to and distal to the rotational joint; and causing, after the link is oriented so that the link can be retracted into the entry guide and using the instrument manipulator, further movement of the rotational joint toward the distal end of the entry guide.

A liquid handling robot has a worktable that supports a rack holding a set of pipette tips. The liquid handling robot also has an arm that is operably suspended above the worktable, where the arm includes a tip receiver that is configured to engage the set of pipette tips. A controller of the liquid handling robot is configured to raise the tip receiver away from the worktable to withdraw the engaged set of pipette tips from the rack. A sensor is fixed relative to the worktable and is operable to emit a beam. A microcontroller monitors the sensor with the arm in a checking position to determine if the rack interrupts in the beam to indicate that the rack stuck to the pipette tips, which is autonomously resolved by the liquid handling robot performing a corrective action.

A storage system configured to house a plurality of containers housing inventory items includes support members, a first set of parallel rails to support a mobile, manipulator robot, and a fluid supply line having a plurality of valves disposed within the fluid supply line. Each of the valves having a closed condition in which the supply line is in fluid isolation from an outside environment and an open condition in which the supply line is in fluid communication with the environment such that the supply line is configured to supply fluid to a mobile, manipulator robot. Mobile, manipulator robots for retrieving inventory items stored within the containers and retrieval methods are also disclosed herein.

A transfer system includes a hand that supports a workpiece to be transported; an arm that moves the hand; a scanning controller that moves the hand by the arm along a scanning direction that intersects sides which are provided to be fixed to the hand and not parallel with each other, such that the sides pass a known reference position in a transfer path of the workpiece; and a position detector that detects a positional deviation of the hand in a direction intersecting the scanning direction, based on a timing at which one of the side reaches the reference position and a timing at which the other side reaches the reference position RP, while the scanning controller is moving the hand.