APPARATUS AND METHOD FOR POSITIONING AN OBJECT
20210269257 ยท 2021-09-02
Inventors
- Robert Kenneth Patteson, JR. (Dallas, TX, US)
- Maximilian Sluiter (Thousand Oaks, CA, US)
- Daniel Samarin (Long Beach, CA, US)
- Matthew Michael O'Brien (Hermosa Beach, CA, US)
- Devid Volovskiy (Southfield, MI, US)
- Nicholas Michael Degnan (Redondo Beach, CA, US)
- Eric Michael Cosselman (Santa Barbara, CA, US)
Cpc classification
A23N7/02
HUMAN NECESSITIES
B25J15/106
PERFORMING OPERATIONS; TRANSPORTING
B26D3/26
PERFORMING OPERATIONS; TRANSPORTING
A23N15/00
HUMAN NECESSITIES
B65G47/252
PERFORMING OPERATIONS; TRANSPORTING
B65G47/90
PERFORMING OPERATIONS; TRANSPORTING
A23N15/08
HUMAN NECESSITIES
B26D2210/02
PERFORMING OPERATIONS; TRANSPORTING
B65G47/918
PERFORMING OPERATIONS; TRANSPORTING
International classification
Abstract
The present disclosure provides an apparatus and method for positioning an object. The apparatus can include gripping elements or arms to grip the object and actuators to move the object. Methods for positioning the object can include rotating the object about a first and second axis to achieve the desired position.
Claims
1. An apparatus for positioning an object comprising: four gripping elements comprising two pairs of diametrically opposed gripping elements; four appendages, comprising two pairs of diametrically opposed appendages, operably connected to each of the four gripping elements; a vertical actuator, wherein the vertical actuator is operably connected to the four gripping elements, wherein the vertical actuator moves the four gripping elements vertically relative to the object; a horizontal actuator, wherein the horizontal actuator is operably connected to the four gripping elements, wherein the horizontal actuator moves each of the two pairs of diametrically opposed gripping elements from a first distance apart to a second distance apart, and wherein the second distance apart is sufficient to engage the object; and a rotational actuator operably connected to the four appendages, wherein the rotational actuator rotates a first pair of the two pairs of diametrically opposed appendages in a first common direction about a first axis, wherein the rotational actuator rotates a second pair of the two pairs of diametrically opposed appendages in a second common direction about a second axis, wherein the second axis is perpendicular to the first axis.
2. The apparatus of claim 1, further comprising a camera to capture at least one image of the object; an image processor configured to receive input from the camera; and a controller configured to direct movement of the rotational actuator, wherein the controller determines a rotational profile of the object and directs movement of the rotational actuator based on the rotational profile.
3. The apparatus of claim 2, wherein the rotational profile is based on an object feature.
4. The apparatus of claim 2, wherein the image processor comprises a pattern recognition algorithm.
5. The apparatus of claim 1, further comprising a height sensor operably connected to the vertical actuator, wherein the height sensor measures a height of the object above a surface, and wherein the height of the object above the surface determines the amount of vertical movement of the gripping elements by the vertical actuator.
6. The apparatus of claim 1, further comprising a light fixture.
7. The apparatus of claim 6, wherein the light fixture is arranged in radial symmetry with respect to the camera.
8. The apparatus of claim 6, wherein the light fixture comprises a flat board surrounding the camera.
9. The apparatus of claim 1, further comprising four arms, each arm comprising a first end and a second end, wherein the first end is pivotly connected to a frame, wherein each of the four arms extends vertically from the frame to the second end, wherein the second end is proximal to the object, and wherein the second end of each arm comprises one of the four gripping elements.
10. The apparatus of claim 1, further comprising a controller, wherein the controller is operably connected to the four gripping elements and the four appendages, wherein the controller controls movement of the vertical actuator, the horizontal actuator, and the rotational actuator.
11. A method for positioning an object using the apparatus of claim 1, comprising: measuring the object height with a height sensor; moving the four gripping elements vertically toward the object with the vertical actuator; moving a first pair of the two pairs of diametrically opposed gripping elements horizontally toward the object; gripping the object with the first pair of the two pairs of diametrically opposed gripping elements; lifting the object with the first pair of the two pairs of diametrically opposed gripping elements; rotating the object about the first axis with the first pair of the two pairs of diametrically opposed appendages; gripping the object with a second pair of the two pairs of diametrically opposed gripping elements; releasing of the object by the first pair of the two pairs of diametrically opposed gripping elements; and rotating the object about the second axis with the second pair of the two pairs of diametrically opposed appendages.
12. The method of claim 11, wherein the height sensor senses a height of the object above a surface.
13. The method of claim 11, further comprising the steps of detecting the object with a camera, wherein the camera captures at least one image of the object; and creating the rotational profile of the object to determine the amount of rotation.
14. The method of claim 13, wherein the step of creating the rotational profile of the object comprises extracting a feature of the object and registering the feature of the object along an orientation axis.
15. The method of claim 13, wherein the step of creating the rotational profile of the object is accomplished by a controller.
16. The method of claim 14, wherein the rotational profile is based on the feature of the object.
17. The method of claim 11, further comprising the step of exposing the object to a light.
18. The method of claim 11, wherein the object is a spherical object.
19. The method of claim 11, wherein the object is an onion.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0048]
[0049]
[0050]
[0051]
[0052]
[0053]
[0054]
[0055]
[0056]
[0057]
[0058]
[0059]
[0060]
[0061]
[0062]
DETAILED DESCRIPTION
[0063] The current invention is directed to an apparatus and method for positioning an object. The apparatus and method provide for positioning of objects of non-uniform size and shape to a desired position.
[0064] The present invention comprises four gripping elements capable of three different types of movement. The gripping elements may move vertically toward an object, horizontally toward the object, and rotate in a common direction so as to rotate the object. To provide this movement, the apparatus comprises a vertical actuator, horizontal actuator, and rotational actuator. The apparatus may further comprise a camera to capture at least one image of the object and an image processor configured to receive input from the camera. The image processor may comprise a pattern recognition algorithm that extracts one or more features of the object and registers the one or more features along an orientation axis. The apparatus may further comprise a controller configured to determine a rotational profile of the object features and direct movement of the rotational actuator to rotate the object to the desired position. The apparatus may further comprise a one or more height sensors operably connected to the vertical actuator or a second vertical actuator, measuring the height of the object above or below a surface. The apparatus may further comprise a light fixture to shine light on the object. The apparatus may further comprise four arms extending from a frame, with gripping elements at the ends of the arms that contact the object to be positioned.
[0065] The schematics depicted in
[0066]
[0067]
[0068] In some embodiments, the positions of the first height sensor 20a and the second height sensor 20b determine whether the second vertical actuator 50 engages. By way of example but not limitation, if the object position measured by the first height sensor 20a is below a threshold, the second vertical actuator 50 is engaged to lift the object. If the object position measured by the first height sensor 20a is above a threshold, the second vertical actuator 50 is not engaged and does not lift the object.
[0069]
[0070]
[0071]
[0072]
[0073]
[0074]
[0075]
[0076]
[0077]
[0078]
[0079] In an embodiment, the following steps are carried out: An onion is in position 1 on a surface and it is desired for the object to be in position 2 on the surface. The height of the onion is measured with a height sensor. Four gripping elements move vertically toward the onion. A first pair of diametrically opposed gripping elements grip the onion and lift the onion. A camera captures a first image of the onion. A pattern recognition algorithm is applied to the first image of the onion and registers the X and Y coordinates of one or more features of the onion such as root, node, stem, neck, and meridian an lines, using the dead center of the onion in the first image as the origin of the axes. The controller receives the X and Y coordinates of the one or more features of the onion, generates a first rotational profile that represents the angle that the onion must be rotated to a desired position on a first axis, and converts the first rotational profile to motor counts and commands a first rotational actuator to rotate along the first axis. Two diametrically opposed appendages on the first pair of diametrically opposed gripping elements rotate the onion about a first axis. A second pair of diametrically opposed gripping elements grip the onion. The first pair of diametrically opposed gripping elements release the onion. The camera captures a second image of the onion. The pattern recognition algorithm is run again and the controller generates a second rotational profile that represents the angle that the onion must be rotated to a desired position on a first axis, and converts the second rotational profile to motor counts and commands a second rotational actuator to rotate along the second axis. Two diametrically opposed appendages on the second pair of diametrically opposed gripping elements rotate the onion about a second axis. The vertical actuator lowers the onion to the surface. Optionally, after rotation on each axis, the camera may capture additional images of the onion and additional rotational profiles along each axis may be generated by the controller to determine if the onion is in the desired position on each axis. Optionally, at any step of the preceding method, the controller may determine that there is not enough time to rotate the onion and may signal the vertical actuator to lower the onion to the surface.
[0080] Gripping Elements. The apparatus comprises four gripping elements. The four gripping elements comprise two pairs of diametrically opposed gripping elements. In an embodiment depicted in
[0081] Appendages. In an embodiment, the apparatus comprises four appendages, comprising two pairs of diametrically opposed appendages. In the embodiments depicted in
[0082] Vertical Actuator. The apparatus comprises a vertical actuator that moves the four gripping elements vertically toward the object. The vertical actuator is operably connected to four gripping elements. In the embodiment of the invention where each gripping element 30a, 30b is connected to an arm 60, as depicted in
[0083] Horizontal Actuator. The apparatus comprises a horizontal actuator operably connected to the four gripping elements. The horizontal actuator functions to move each of the two pairs of diametrically opposed gripping elements to clamp onto the object. By way of example but not limitation, as depicted in
[0084] Rotational Actuator. The rotation on a pair of diametrically opposed gripping elements functions to rotate the object in a common direction, meaning that the rotation of the two diametrically opposed gripping elements is opposite, one gripping element rotating in a clockwise fashion and the corresponding diametrically opposed gripping element rotating in a counterclockwise fashion, to achieve rotation of the object in a common direction. By way of example but not limitation, the appendages 35a of the two diametrically opposed gripping elements 30a depicted in
[0085] Camera. In some embodiments, the apparatus comprises a camera. In one embodiment, depicted in
[0086] Image Processor. The apparatus may further comprise an image processor. The image processor receives an image of the object from the camera. The image processor may pre-process images received from the camera, such as removing blurs and shadows. In some embodiments, the image processor comprises a pattern recognition algorithm. The pattern recognition algorithm extracts a feature of the object from the image, and registers the feature location along an orientation axis of the image. In some embodiments, the pattern recognition algorithm registers a feature at X and Y coordinates of a two dimensional image of the object, with the dead center of the object in the two dimensional image being the origin of the X and Y axes. Any one or more recurring features present on the objects to be positioned can be used in the image processor. By way of example but not limitation, different object features that could be used in the image processor include roots (i.e., the bottom of the object), meridian lines (i.e., lines traversing the object between the top and bottom), nodes (i.e., the top of the object), stems, necks, and shape. In some embodiments, the pattern recognition algorithm comprises a neural network-based feature detector comprising a database of tagged features for deep learning and different object topologies. In some embodiments, the pattern recognition algorithm comprises custom software written in the C programming language. In some embodiments, the image processor carries out any or all of the functions of network communications, image capture, image processing, and output filtering.
[0087] Controller. The apparatus may further comprise a controller. The controller functions to translate input from components of the apparatus into movement to achieve desired re-positioning of the object. By way of example but not limitation, the controller may control any or all of the following: amount of vertical movement by the vertical actuator; amount of horizontal movement by the horizontal actuator; amount of rotation by the rotational actuators. In some embodiments, the controller functions to create the rotational profile of the object based on input from the image processor.
[0088] By way of example but not limitation, in controlling vertical movement, the controller may translate the height of the object measured by a height sensor to a desired vertical movement, then command the vertical actuator to move the amount of desired vertical movement. In some embodiments, the controller may use extra modifying terms to artificially optimize the geometry of the object to achieve desired movement. The controller may also include object-to-surface transition code tuning, which can (1) account for non-spherical object shapes; and (2) lower the gripping elements an optimal distance to achieve release of the object without the object becoming misaligned. The controller may also synchronize vertical movement in embodiments where there are two vertical actuators. The controller may synchronize horizontal movement of the horizontal actuator.
[0089] In controlling rotational movement, the controller may create one or more rotational profiles. Such rotational profiles comprises the one or more angles that the object must be rotated to achieve the desired object orientation. In some embodiments, the controller creates the rotational profile by translating feature location along an orientation axis provided by the image processor into an angle that the object must be rotated to move the features into a desired position.
[0090] In an embodiment, the controller generates a first rotational profile to determine the angle that the object must be rotated to achieve the desired object orientation along a first axis, and the controller generates a second rotational profile to determine the angle that the object must be rotated to achieve the desired object orientation along a second axis. The second rotational profile may be based on feature locations from one or more images taken before or after rotation along the first axis.
[0091] In some embodiments, a first rotational profile is created when the controller receives X and Y coordinates of an object feature from the image processor and converts the X and Y coordinates of the feature to a rotation angle along a first axis to achieve the desired position on the first axis by using an approximation of object diameter. By way of example but not limitation, the approximation of object diameter may be based on the height of the object measured by a height sensor. Once the controller has converted X and Y coordinates to rotation angles along the first axis, the controller may either convert the angle to motor counts and command a first rotational actuator to rotate along the first axis; or the controller may switch to control of a second rotational actuator. In some embodiments, the controller may create a second rotational profile for the first axis by receiving a second set of X and Y coordinates of an object feature and converting the second set of X and Y coordinates to a second rotation angle along a first axis. In some embodiments, the controller generates a rotational profile along a second axis by receiving additional X and Y coordinates of an object feature from the image processor and converting the additional set to a rotation angle along a second axis using the same process as conversion of X and Y coordinates to an angle for rotation along the first axis. The controller may either convert the angle to motor counts and command a second rotational actuator to rotate along the second axis; or the controller may switch to control of the vertical actuator and lower the object to the surface. In some embodiments, the controller may create a second rotational profile for the second axis by receiving a second set of X and Y coordinates of an object feature and converting the second set of X and Y coordinates to a second rotation angle along a second axis. The controller decision to command a rotational actuator to rotate along an axis may depend on, by way of example but not limitation, variables such as a set time remaining for rotation or the amount of correction needed along the axis to achieve the desired object position.
[0092] In some embodiments, the controller determines the time remaining for rotation of the object and commands the vertical actuator to lower the object to the surface if there is insufficient time. By way of example but not limitation, the controller may make this determination by a set value of time permitted for each object; how much time each type of action requires; or how fast the surface is moving. In some embodiments, the controller may determine that there is not enough time to perform rotation to achieve the desired position, the object is set down with rotation only along one axis or no rotation at all.
[0093] In some embodiments, the controller may account for errors in the image processor. In some embodiments, the controller creates the rotational profile by translating two-dimensional feature location into an object angle, wherein the geometry of the object is experimentally optimized with extra modifying terms and wherein the controller accounts for errors due to three-dimensional to two-dimensional information loss and changes in trigonometric function sensitivity at large angles. The controller may also include rotation logic tuning for speed; calculating for error by two-dimensional distance or by angle; or mapping the location of features on the object using a polar or a Cartesian approach. In some embodiments, the hardware component of the controller is B&R Industrial Automation's X20 Series Controller.
[0094] Height Sensor. In some embodiments, the apparatus comprises one or more height sensors. In one embodiment, as depicted in
[0095] Light Fixture. The apparatus may further comprise a light fixture. By way of example but not limitation, as depicted in
[0096] Arms. The apparatus may further comprise four arms extending vertically toward the surface. By way of example but not limitation, as depicted in
[0097] Frame. In some embodiments, the apparatus comprise a frame. The frame may connect all components of the apparatus or may just connect select components of the apparatus. The embodiment of the invention depicted in
[0098] Surface. The apparatus functions above a surface. By way of example but not limitation, as depicted in
[0099] Object. The apparatus may position a variety of objects. By way of example but not limitation, as depicted in