Method and apparatus for external operation of an actuator of a vehicle

Abstract

The inventive relates to a method for external operation of an actuator of a vehicle having an optical sensor. The following steps are provided: obtaining an approach of a person in an approach area of the optical sensor; determining, within an obtaining area of the optical sensor, a targeted approach of a person's steps towards an operating area of the optical sensor; and operating the actuator when a step made into the operating area of the optical sensor is determined. It is the object of the invention to simplify the operation of an actuator of a vehicle by a gesture.

Claims

1. A method for external operation of an actuator of a vehicle, having an optical sensor, the method comprising: obtaining an approach of a person in an approach area of the optical sensor; determining, within an obtaining area of the optical sensor, a targeted approach of a person's steps towards an operating area of the optical sensor, wherein the targeted approach is determined based on the detection of a pair of feet, the orientation of said feet, and the sequence of steps of the individual feet; wherein the size of the approach area and/or the size of the obtaining area is dynamically adjusted to environmental conditions detected by the optical sensor; and operating the actuator when a step made into the operating area of the optical sensor is determined.

2. The method of claim 1, wherein determining the targeted approach of the person's steps towards the operating area of the optical sensor further comprises determining the person's walking speed, characterized in that a frame rate of the optical sensor is adjusted to the walking speed determined.

3. The method of claim 1, characterized in that, after the determination of the targeted approach, lines are projected onto the floor indicating the operating area of the optical sensor.

4. The method of claim 3, characterized in that the lines are projected and/or the actuator is operated if the person has successfully been identified by a keyless access system of the vehicle.

5. The method of claim 1, characterized in that trajectory points determined using centroids are used for a movement determination of the sequence of steps.

6. An apparatus for external operation of an actuator of a vehicle, comprising: an optical TOF (Time of Flight) sensor and a control unit, wherein the optical TOF sensor and the control unit are configured to obtain an approach of a person in an approach area of the optical TOF sensor, wherein the optical TOF sensor and the control unit are configured to determine, within an obtaining area of the optical TOF sensor, a targeted approach of a person's steps towards an operating area of the optical TOF sensor, wherein the targeted approach is determined based on the detection of a pair of feet, the orientation of said feet, and the sequence of steps of the individual feet, wherein the size of the approach area and/or the size of the obtaining area is dynamically adjusted to environmental conditions detected by the optical sensor, and wherein the control unit is configured to operate the actuator when a step made into the operating area of the optical TOF sensor is determined.

7. The apparatus of claim 6, characterized in that a light source is provided configured to optically mark the operating area.

8. The apparatus of claim 7, characterized in that the light source is configured to project lines onto the floor.

9. The apparatus of claim 6, characterized in that the control unit is configured to perform an object determination based on data of the optical TOF sensor.

10. A vehicle comprising an actuator and an apparatus for the external operation of said actuator, the apparatus comprising: an optical TOF (Time of Flight) sensor and a control unit, wherein the optical TOF sensor and the control unit are configured to obtain an approach of a person in an approach area of the optical TOF sensor, wherein the optical TOF sensor and the control unit are configured to determine, within an obtaining area of the optical TOF sensor, a targeted approach of a person's steps towards an operating area of the optical TOF sensor, wherein the targeted approach is determined based on the detection of a pair of feet, the orientation of said feet, and the sequence of steps of the individual feet, wherein the size of the approach area and/or the size of the obtaining area is dynamically adjusted to environmental conditions detected by the optical sensor, and wherein the control unit is configured to operate the actuator when a step made into the operating area of the optical TOF sensor is determined.

11. The vehicle of claim 10, characterized in that the actuator operates a tailgate of the vehicle and that the apparatus for external operation of the actuator is arranged in a tailgate area of the vehicle.

Description

(1) The invention is hereinafter explained in embodiments using the associated drawings, in which:

(2) FIG. 1 shows a schematic representation of an apparatus for external operation of an actuator of a vehicle;

(3) FIG. 2 shows a schematic representation of an apparatus for external operation of an actuator of a vehicle with an obstacle;

(4) FIG. 3 shows a schematic representation of sensor data.

(5) FIG. 1 shows an area of a vehicle 10, e.g., a section of a rear bumper of a passenger vehicle. Trucks, buses, motorcycles, rail vehicles as well as aircrafts and watercrafts continue to be deemed to be vehicles.

(6) The vehicle 10 comprises an apparatus 12 for external operation of an actuator 14 of the vehicle 10. For example, the actuator 14 is an electric motor to open and/or to close a trunk lid. The apparatus 12 comprises a control device 16 connected to the actuator 14, directly or via further elements, e.g., further control devices. The apparatus 12 further comprises a light source 18 and an optical TOF sensor 20 (Time of Flight).

(7) The TOF sensor 20 comprises an approach area 22 that may comprise several sub-areas. The approach area may correspond to the maximum range of the sensor 20, which may, for example, be approximately two meters, or may be limited to a range of approximately two meters' distance from the vehicle 10 or the sensor 20. The approach area 22 is, to some extent, a virtual area defined and used, e.g., via image processing and/or object determination in the control device 16. The approach area 22 serves to obtain a first approach of an object, e.g., a person, and to start the method.

(8) An obtaining area 24 laterally surrounded by the approach area 22 as well connects to the approach area 22 in the direction of the vehicle 10. In the obtaining area 24, the sensor 18 and the control device 16 may determine a targeted approach of a person's steps towards the sensor 18. Like the approach area 22, the approach area 22 is, to some extent, a virtual area.

(9) An operating area 26 laterally surrounded by the approach area 22 as well connects to the obtaining area 24 in the direction of the vehicle 10. It is possible to mark the operating area 26 on the floor next to the vehicle 10 using a trapezoidal light projection from the light source 18. Thus, a person wanting to operate the actuator 14 knows where they have to move. The light source 18 may comprise a square optic so that a trapezoidal projection results on the floor due to an angular arrangement in the vehicle 10.

(10) A method for external operation of the actuator 14 of the vehicle 10 is described below. When the vehicle 10 is parked, the sensor 18 monitors the approach area 22. As soon as the sensor 18 perceives something, a signal and/or an image is sent to the control device 16 for an evaluation.

(11) Now the approach of a person is considered. The sensor 18 and/or the control device 16 follows an algorithm to not only determine an approach but also to detect steps and, based on the direction of the steps, to conclude on the person's intention in order to enable quick processing.

(12) A first step 28, here of the person's left foot, already aims in the direction of the vehicle 10. However, it is not yet obtained as it is outside the approach area 22. The next step 30 is made into the approach area 22 and is obtained by the sensor 20. At first, the sensor 20 only sends a message to the control device 16 that now arranges for the person to be identified by a keyless access system of the vehicle 10. If the person has no authorization, the method is not continued. Monitoring by the sensor 20 may be paused for a specified period in order to thus wait for the person to walk on. In case of successful identification of the person, the control device 16 arranges for an activation of the light source 18 so that the trapezoid is projected onto the floor. Likewise, the data of the sensor 20, i.e., distance or 3D data and image or 2D data, is now transferred to the control unit 16 for evaluation.

(13) Based on the direction of the step 30, a person passing by may also be detected. This person's foot is not directed towards the vehicle 10, but turned by 90 degrees. When the control device 16 determines a person passing by, it is proceeded as if no authorization is available.

(14) Meanwhile the person has made a further step 32 in the direction of the sensor 20. The next step 34 is made into the obtaining area 24. Now the person's steps are closely analyzed. The boundary between the approach area 22 and the obtaining area 24 is adaptive and may be adjusted depending on the person's walking speed amongst others. In case of a person moving fast, the obtaining area 24 may, for example, be extended.

(15) The temporal resolution of the sensor data may, for example, be approximately five to thirty images or frames per second. Depending on the person's walking speed, this may be adjusted, e.g., within ten to twenty images per second.

(16) When the next step 36 is made, the apparatus 12 detects a rear standing foot 34 directed at the vehicle 10 and the movement of the front foot in the direction of the vehicle 10. Now the apparatus 12 may already conclude on the request to operate the actuator 14 and may already arrange for an operation while the foot is still moving. This allows a very flowing operation without any dead times or additional movements. The steps stated here may also be considered to be feet.

(17) In FIG. 2, another situation is illustrated, wherein an obstacle 37 is located behind the vehicle 10. Accordingly, the size of the approach area 22 and of the obtaining area 24 were now adjusted in a way that a reduction was performed so that the areas are adjusted to the obstacle 37.

(18) Due to the obstacle 37, the person initially moves in lateral direction towards the vehicle 10 with the steps 38, 40 and 42. These steps are not yet obtained as they are still outside the dynamically adjusted approach area 22. The step 44 is half turned towards the vehicle 10 and is obtained by the sensor 20. Even in case of a successful identification, it may be provided that the light source 18 is not yet activated, as it may be that, even though the person is authorized, they want to walk past the vehicle 10.

(19) The step 46 is fully directed at the vehicle 10 and/or the sensor 20. Now the light source 18 is activated. The person's steps are now closely analyzed, as the step 46 was also made into the obtaining area 24. The next step 48 and/or its determination triggers the actuator 14 in line with the description of FIG. 1.

(20) In FIG. 3, an image or frame of the sensor 20 is illustrated. The sensor 20 comprises thirty times thirty image points or pixels plotted on the edges of the illustration. A first foot 50 and a second foot 52 are illustrated. When the term foot is used here, this may also comprise a part of the leg, e.g., a lower leg. This image does not comprise any direct distance information, but illustrates a 2D image of the foot area of the person approaching.

(21) For the image processing, the relative position and the alignments of both feet are detectable. In a first step, both feet are determined in order to determine the approaching of a person. The two feet 50 and 52 are considered separately to arrive at a better statement concerning the person's direction of movement. For each sensor image, as illustrated in FIG. 3, the corresponding centroid 54 and/or 56 is calculated for each foot 50 and/or 52. Using the chronologically consecutive centroids 54 and 56, movement trajectories are formed based on which the movements of the two feet 50 and 52 may easily be tracked and also predicted.

(22) The method steps described are executed in the control device 16 or in another computing unit of the vehicle 10.

(23) In summary, it is presented a novel method for advance determination and evaluation as to whether an actuator 14 is to be operated on the vehicle 10 in the near future. By this timely determination of the person's intention, dead times in the operation may be omitted.

LIST OF REFERENCE NUMBERS

(24) 10 vehicle 12 apparatus 14 actuator 16 control device 18 light source 20 sensor 22 approach area 24 obtaining area 26 operating area 28 step 30 step 32 step 34 step 36 step 37 obstacle 38 step 40 step 42 step 44 step 46 step 48 step 50 foot 52 foot 54 centroid 56 centroid