End Effector Position Estimation
20220195689 · 2022-06-23
Assignee
Inventors
Cpc classification
E02F9/2033
FIXED CONSTRUCTIONS
E02F3/3414
FIXED CONSTRUCTIONS
E02F9/2203
FIXED CONSTRUCTIONS
E02F3/431
FIXED CONSTRUCTIONS
E02F9/265
FIXED CONSTRUCTIONS
E02F3/32
FIXED CONSTRUCTIONS
E02F9/264
FIXED CONSTRUCTIONS
International classification
Abstract
One example is directed to an end effector position estimation system for an off-road vehicle, which includes at least one inertial measurement unit (IMU) configured to be positioned on at least one of actuators and links of the vehicle that together move the end effector of the vehicle, and configured to generate measurement signals. The position estimation system includes at least one other IMU configured to be positioned on a base of the vehicle, and configured to generate other measurement signals. The position estimation system includes an estimation unit to estimate a position of the end effector of the vehicle based at least in part on the measurement signals and the other measurement signals, wherein the estimation unit is configured to perform an estimation method that removes an influence of terrain-induced vibrations and terrain slope in the measurement signals based on the other measurement signals.
Claims
1. An end effector position estimation system for an off-road vehicle, comprising: at least one inertial measurement unit (IMU) configured to be positioned on at least one of actuators and links of the vehicle that together move the end effector of the vehicle, and configured to generate measurement signals; at least one other IMU configured to be positioned on a base of the vehicle, and configured to generate other measurement signals; and an estimation unit to estimate a position of the end effector of the vehicle based at least in part on the measurement signals and the other measurement signals, wherein the estimation unit is configured to perform an estimation method that removes an influence of terrain-induced vibrations and terrain slope in the measurement signals based on the other measurement signals.
2. The end effector position estimation system of claim 1, wherein the estimation method includes adaptive feedforward disturbance removal.
3. The end effector position estimation system of claim 1, wherein the estimation unit estimates a real-time rotation or translation of each of the actuators and links in order to estimate the position of the end effector.
4. The end effector position estimation system of claim 1, wherein the off-road vehicle is an agricultural vehicle.
5. The end effector position estimation system of claim 1, wherein the off-road vehicle is a construction vehicle.
6. The end effector position estimation system of claim 1, and further comprising: at least one range or linear translational position sensor to generate range information based on translation motions of at least one link of the vehicle with linear translational degrees of freedom; and wherein the estimation unit is configured to estimate the position of the end effector based further on the generated range information.
7. The end effector position estimation system of claim 6, wherein the at least one range or linear translational position sensor includes a low-cost laser sensor.
8. The end effector position estimation system of claim 6, and further comprising: a combination of an inexpensive low bandwidth range sensor located on a translating arm of the vehicle together with an IMU located at a moving end of the translating arm to generate together an estimate of a translational motion of at least one link of the vehicle with linear translational degrees of freedom; and wherein the estimation unit is configured to estimate the position of the end effector based further on the generated estimate of translation motion.
9. The end effector position estimation system of claim 1, wherein the estimation unit is configured to determine whether the vehicle is operating within safe operating limits based at least in part on the estimated position of the end effector.
10. The end effector position estimation system of claim 9, wherein the estimation unit is configured to determine whether the vehicle is operating within safe operating limits based further on an estimated weight of a load carried by the end effector.
11. The end effector position estimation system of claim 1, wherein the system is configured to control the vehicle to prevent vehicle tip over based at least in part on the estimated position of the end effector.
12. The end effector position estimation system of claim 1, wherein the system is configured to prevent motion of the end effector into regions that may cause the vehicle to tip-over.
13. The end effector position estimation system of claim 1, wherein the system is configured to prevent motion of the end effector into a restricted region.
14. The end effector position estimation system of claim 13, wherein the restricted region comprises a wall, and wherein the system is configured to prevent the end effector from contacting the wall.
15. An end effector position estimation system for an off-road vehicle, comprising: at least one inertial measurement unit (IMU) to be positioned on at least one of actuators and links of the vehicle that together move the end effector of the vehicle, and to generate measurement signals; at least one other IMU to be positioned on a base of the vehicle, and to generate other measurement signals; at least one laser range sensor to generate range information based on translation motion of at least one of the links of the vehicle with linear translational degrees of freedom; and an estimation unit to estimate real-time rotation or translation of each of the actuators and links based on the measurement signals, other measurement signals, and range information, and to estimate a position of the end effector of the vehicle based on the estimated real-time rotation or translation of each of the actuators and links.
16. The end effector position estimation system of claim 15, wherein the estimation unit removes an influence of terrain-induced vibrations and terrain slope in the measurement signals based on the other measurement signals.
17. The end effector position estimation system of claim 15, wherein the estimation unit determines whether the vehicle is operating within safe operating limits based at least in part on the estimated position of the end effector.
18. The end effector position estimation system of claim 15, wherein the system controls the vehicle to prevent vehicle tip over based on the estimated position of the end effector and an estimated weight of a load carried by the end effector.
19. A method, comprising: generating measurement signals with at least one inertial measurement unit (IMU) positioned on at least one of actuators and links of an off-road vehicle that together move an end effector of the vehicle; generating other measurement signals with at least one other IMU configured to be positioned on a base of the vehicle; compensating the measurement signals based on the other measurement signals; and estimating a position of the end effector of the vehicle based at least in part on the compensated measurement signals.
20. The method of claim 19, and further comprising: determining whether the vehicle is operating within safe operating limits based at least in part on the estimated position of the end effector.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0011] The accompanying drawings are included to provide a further understanding of embodiments and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments and together with the description serve to explain principles of embodiments. Other embodiments and many of the intended advantages of embodiments will be readily appreciated as they become better understood by reference to the following detailed description. The elements of the drawings are not necessarily to scale relative to each other. Like reference numerals designate corresponding similar parts.
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
DETAILED DESCRIPTION
[0028] In the following Detailed Description, reference is made to the accompanying drawings, which form a part hereof, and in which is shown by way of illustration specific embodiments in which the invention may be practiced. In this regard, directional terminology, such as “top,” “bottom,” “front,” “back,” “leading,” “trailing,” etc., is used with reference to the orientation of the Figure(s) being described. Because components of embodiments can be positioned in a number of different orientations, the directional terminology is used for purposes of illustration and is in no way limiting. It is to be understood that other embodiments may be utilized and structural or logical changes may be made without departing from the scope of the present invention. The following detailed description, therefore, is not to be taken in a limiting sense, and the scope of the present invention is defined by the appended claims.
[0029] It is to be understood that the features of the various exemplary embodiments described herein may be combined with each other, unless specifically noted otherwise.
[0030] Some examples disclosed herein are directed to an inertial measurement unit based end effector position estimation and tip-over prevention system.
[0031] Depending on the exact configuration and type of computing device, the memory 110 may be volatile (such as RAM), non-volatile (such as ROM, flash memory, etc.), or some combination of the two. The memory 110 used by computing device 106 is an example of computer storage media (e.g., non-transitory computer-readable storage media storing computer-executable instructions for performing a method). Computer storage media used by computing device 106 according to one example includes volatile and nonvolatile, removable and non-removable media implemented in any suitable method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and that can be accessed by processor 108.
[0032] In some examples, system 100 utilizes IMUs 102 to provide sensor information for estimation of rotational and translational variables. Each IMU 102 may be implemented as an IMU sensor chip that includes a 3-axis accelerometer and a 3-axis gyroscope. In some examples, the IMUs 102 may also each include a 3-axis magnetometer. Thus, each IMU 102 provides either six or nine measurement signals (i.e., three accelerations from the three accelerometers, three rotational rates from the three gyroscopes, and, in some examples, three magnetic field intensities from the three magnetometers). In some examples, the IMU sensor chip may include a microcontroller, a battery, and a wireless transceiver (e.g., Bluetooth) and antenna. In some examples, the IMU sensor chip may include an Inter-Integrated Circuit (I2C) or Serial Peripheral Interface (SPI) communications interface. The accelerometer in each IMU 102 may measure both linear acceleration and gravity. Measurements of gravity in static positions allow estimation of vertical tilt angle. Measurements of the rotation rates allow dynamic estimation of tilt angle.
[0033] IMUs 102 and laser sensor 104 output sensor information to computing device 106. Processor 108 executes sensor data processing module 112 to perform a position estimation method, and other methods disclosed herein, using the received sensor information. Sensor data processing module 112 outputs position information 120 and alerts and control information 122, based on the processing of the received sensor information. In some examples, system 100 may be used as an IMU-based end effector position estimation system for agricultural vehicles, construction vehicles, and other off-road vehicle systems, and the position information 120 indicates a current position of the end effector. In some examples, the system 100 estimates the position of an end effector of the vehicle, and also detects if a vehicle tip-over is likely to occur, so that such a tip-over event can be prevented. The alerts and control information 122 may include an audible and/or visual alert that a tip-over event is about to occur so that an operator can prevent the occurrence, and/or it may include control information to automatically control the vehicle to prevent the tip-over event from occurring.
[0034] At least one of the IMUs 102 may be located on actuators and/or links that together move the end effector of the vehicle. At least one of the IMUs 102 may be located on a base of the vehicle. The position estimation method performed by sensor data processing module 112 may include removing the influence of terrain induced vibrations and terrain slope (e.g., measured by an IMU 102 on the vehicle base) from the signals of the IMUs 102 located on the actuators or links. In some examples, the position estimation method includes adaptive feedforward disturbance removal and other signal processing methods. Sensor data processing module 112 may estimate the real-time rotation or translation of each actuator or link of the vehicle, in order to estimate the end effector position. Sensor data processing module 112 may also determine if the end effector position and the weight of the load carried by the end effector will cause vehicle tip-over.
[0035]
[0036]
[0037] Commercial track loader vehicle 300 includes two hydraulic actuators 302 and 304 to move the end effector 306, which is a bucket in this example. The two hydraulic actuators include a lift hydraulic actuator 302 and a tilt hydraulic actuator 304. The two actuators 302 and 304 undergo rotational motion when they are used to move the end effector 306. Hence, measuring the rotational angles on these two actuators provides information to estimate the end effector position. As shown in
[0038] While the IMUs 102 on actuators or links can estimate rotational angles of these components, such IMUs 102 may also measure the influence of terrain induced vehicle vibrations. Such terrain-induced vehicle vibrations may cause errors in the estimated orientation angles. Some examples disclosed herein detect and compensate for such terrain induced vehicle vibrations.
[0039]
[0040]
[0041] In some examples, sensor data processing module 112 (
[0042] To determine the vertical tilt angles from the accelerometer signals, the sensor data processing module 112 finds the third column of the direction cosine matrix (DCM) using the following Equation I:
[0044] The third column of the DCM is given by the following Equation II:
[0045] The two vertical angles θ.sub.accels and ϕ.sub.accels can be obtained from the estimate of v.sub.3. Here, θ.sub.accels is the vertical angle of interest (i.e., the tilt angle). The static tilt angle θ.sub.accels from the gravity component can be combined with the gyroscope measurement to obtain a drift-free high bandwidth tilt angle as shown in the following Equation III:
{circumflex over ({dot over (θ)})}={grave over (θ)}.sub.gyro+(θ.sub.accels−{circumflex over (θ)}) Equation III
[0046]
[0047] In some examples, sensor data processing module 112 (
{circumflex over ({dot over (θ)})}.sub.base={grave over (θ)}.sub.base+l.sub.1(θ.sub.base-lowpass−{circumflex over (θ)}) Equation IV
[0048] Let θ.sub.actuator be the estimated inertial tilt angle of the actuator. Then the road induced disturbance on the actuator can be estimated as follows.
[0049] A reference road-disturbance influence vector is obtained as shown in the following Equation V:
x(n)=[{circumflex over (θ)}.sub.base(n) {circumflex over (θ)}.sub.base(n−1) {circumflex over (θ)}.sub.base (n−N)] Equation V
[0050] The parameter vector is given in the following Equation VI:
w(n)=[w.sub.0 w.sub.1 w.sub.N] Equation VI
[0051] The disturbance-free relative tilt angle is given in the following Equation VII:
θ.sub.relative(n)=θ.sub.actuator−w.sup.T(n)×(n) Equation VII
[0052] The adaptive estimator for the filter parameters is given in the following Equation VIII:
w(n+1)=w(n)+μe(n)×(n) Equation VIII
[0053] The desired actuator relative tilt angle is thus obtained as θ.sub.relative.
[0054] In some examples, sensor data processing module 112 (
{circumflex over ({dot over (x)})}={circumflex over (v)}+k.sub.1({circumflex over (x)}−x.sub.laser) Equation IX
{circumflex over ({dot over (v)})}=a.sub.x+k.sub.2({circumflex over (x)}−x.sub.laser) Equation X [0055] where: the gain vector [k.sub.1 k.sub.2].sup.T is chosen so as to stabilize the matrix
[0056] In some examples, sensor data processing module 112 (
[0057] As an example of this method, consider a construction vehicle that includes a vehicle base, and two rotating links (the method holds generally for m links) with an IMU 102 placed on each link. When the vehicle is on flat ground, all link rotation axes are horizontal. Let vectors p.sub.1 and p.sub.2 define the positions of points on the links of the machine. Each vector consists of the three coordinates x, y and z. Let each link have its own local coordinate system, such that p.sub.1 and p.sub.2 expressed in the link frame of reference, p.sub.1.sup.L and p.sub.2.sup.L are as follows, where l.sub.m is the length of the mth link:
p.sub.m.sup.link[l.sub.m0 0].sup.T Equation XI
[0058] Define p.sub.E as the position vector of the end effector, relative to the joint between the base of the vehicle and the first link. Then p.sub.end can be expressed as:
p.sub.end=p.sub.1+p.sub.2 Equation XII
[0059]
[0060] To express p.sub.end in the base frame of reference, p.sub.end.sup.base, the position vector of each link is expressed in the base frame of reference, which can be accomplished with direction cosine matrices. Let R.sub.j.sup.k be the direction cosine matrix that will express a vector in the jth frame to its representation in the kth frame:
p.sup.k=R.sub.j.sup.kp.sup.l Equation XIII
[0061] Thus, the end effector position in the machine coordinate system can be expressed as:
p.sub.end.sup.base=R.sub.ground.sup.baseR.sub.1.sup.groundp.sub.1.sup.link+R.sub.ground.sup.baseR.sub.2.sup.groundp.sub.2.sup.link Equation XIV
[0062] As the method is not concerned with the horizontal plane (yaw) angle in this example, the ground frame of reference is defined such that the ground z-axis is aligned with gravity (pointing downwards), and the ground x-axis is coplanar with the ground z-axis and the base and link x-axes. That is, the ground y-axis will have zero x component when expressed in the base or link frame of reference:
[0063] Equation XV implies that the (1,2) entries of and R.sub.ground.sup.base and R.sub.ground.sup.link are always zero. When using the terrain-induced slope and vibration technique described above, θ.sub.relative(n) is estimated for each link, which fully constrains the rotation matrix of each link relative to the base, R.sub.link.sup.base(n). Thus, the end effector position may be recovered as follows:
p.sub.end.sup.base(n)=R.sub.1.sup.base(n)p.sub.1.sup.link+R.sub.2.sup.base(n)p.sub.2.sup.link Equation XVI
[0064] In the case when a link has a translational component as well as a rotational component, then the position vector in the link frame of reference is no longer a static value. Here, we may use the estimate of actuator linear position to estimate the link length, l(n), and we can write:
p.sub.m.sup.link(n)=[l.sub.m(n)0 0].sup.T Equation XVII
[0065] Suppose in the two link example considered here that the second link has a translational component, then the end effector position can be estimated as:
p.sub.end.sup.base(n)=R.sub.1.sup.base(n)p.sub.1.sup.link+R.sub.2.sup.base(n)p.sub.2.sup.link(n) Equation XVIII
[0066] In some examples, sensor data processing module 112 (
[0067] (1) The end effector position is estimated using a combination of IMUs 102(1)-102(3) and laser sensors 104 (
[0068] (2) The moment arm (tilt inducing moment or torque) of the load carried by the end effector 810 is estimated in real time as a function of the position of the end effector 810 and of the weight carried. The weight carried may be estimated from the actuator hydraulic pressure using hydraulic pressure sensor 808, or by any other means of determining an estimated load weight 806.
[0069] (3) The range of motion of the end effector 810 and the speed of travel of the vehicle 800 may be limited by system 100 (
[0070]
[0071] Based on the received sensor information, base tilt estimation (inertial) unit 918 determines base tilt values, θ.sub.base, which are provided to terrain vibration and slope compensation unit 928. Link 1 tilt estimation (inertial) unit 920 provides tilt values, θ.sub.1,inertial, to terrain vibration and slope compensation unit 928. Link n tilt estimation (inertial) unit 924 provides tilt values, θ.sub.n,inertial, to terrain vibration and slope compensation unit 928. Based on the received information, terrain vibration and slope compensation unit 928 determines tilt values, (θ.sub.1,relative, . . . , θ.sub.n,relative), which are provided to end effector position estimation unit 930.
[0072] Based on received sensor information, link 1 length estimation unit 922 determines a link length l.sub.1, which is provided to end effector position estimation unit 930. Based on received sensor information, link n length estimation unit 926 determines a link length l.sub.n, which is provided to end effector position estimation unit 930. Based on the information received from units 928, 922, and 926, end effector position estimation unit 930 determines an end effector position.
[0073]
[0074]
[0075]
[0076] The IMUs 102 may be used to estimate the angles θ.sub.1, θ.sub.2, and θ.sub.3 shown in
[0077]
[0078] Some applications may involve the estimation of linear position of a structure (e.g., a telehandler arm). An IMU accelerometer may double integrated to obtain linear position changes, but the accelerometer does not determine absolute position, and an accelerometer may have drift when integrated. A laser time of flight sensor or other sensor may be used to measure absolute length, but may be lower bandwidth than an IMU. Some examples of the present disclosure combine an absolute position sensor, such as a laser time of flight sensor, with an IMU to provide inexpensive, accurate, and high bandwidth linear position estimation.
[0079] Some examples disclosed herein include a configuration of IMU sensors in order to be able to compute tilt angles of links on construction or other off-road vehicles. This configuration may include IMUs on individual links plus an IMU on the vehicle base. The inertial angles of the vehicle base and of the link may both be utilized to calculate relative angle of the link, thus removing the influence of terrain slope on tilt angle calculation. Some examples include a combination of an inexpensive laser sensor (e.g., ˜$5) and an inexpensive IMU (e.g., ˜$5) to compute linear position of a piston rod of a translational actuator. Some examples use an IMU on the vehicle base in order to obtain an upstream measurement of vibrations (induced by the road or by the engine), which is then utilized in an adaptive feedforward algorithm to cancel the effect of such vibrations on the IMUs located on the links. Examples disclosed herein include specific methods to calculate inertial tilt angles and to cancel the influence of vibrations. Some examples calculate end effector position using the sensors described herein; use the additional knowledge of load weight to compute real-time propensity of the vehicle to tip over; and prevent the tip-over from occurring by preventing dangerous motions of the vehicle links.
[0080] Some examples are directed to a method of using sensors together to create variables that could not be easily measured otherwise. Some examples provide a low-price alternative to other methods that may be used on agricultural and construction vehicles for end effector position determination.
[0081] Measurements of linear positions and angular positions of links on such actuators are currrently either not done at all, or may be done using more expensive sensors (e.g., over $500), which may require drilling a hole through the entire length of the piston rod in a hydraulic cylinder. Such measurements may also be done using potentiometers, which are contacting sensors and prone to frequent failure. Compared to the such systems, some examples disclosed herein are ten times less expensive, can be installed on a vehicle with very little effort, and include only non-contacting sensors that are robust in performance.
[0082] Although specific embodiments have been illustrated and described herein, it will be appreciated by those of ordinary skill in the art that a variety of alternate and/or equivalent implementations may be substituted for the specific embodiments shown and described without departing from the scope of the present invention. This application is intended to cover any adaptations or variations of the specific embodiments discussed herein. Therefore, it is intended that this invention be limited only by the claims and the equivalents thereof.