UAV OBSTACLE AVOIDANCE SYSTEM AND CONTROL METHOD THEREOF
20200209893 ยท 2020-07-02
Assignee
Inventors
Cpc classification
B64U20/87
PERFORMING OPERATIONS; TRANSPORTING
H04N23/11
ELECTRICITY
G05D1/106
PHYSICS
B64U2201/10
PERFORMING OPERATIONS; TRANSPORTING
B64C39/024
PERFORMING OPERATIONS; TRANSPORTING
B64D2045/0095
PERFORMING OPERATIONS; TRANSPORTING
International classification
G05D1/10
PHYSICS
Abstract
A UAV obstacle avoidance system and a control method thereof are provided. The UAV obstacle avoidance system comprises a cover, at least two obstacle avoidance lens modules and an infrared light source. The infrared light source is located between the at least two obstacle avoidance lens modules. Each obstacle avoidance lens module comprises a sensing unit and an infrared shutter. The sensing unit comprises a filter layer and a sensing element. The filter layer is located between the cover and the sensing element, and the filter layer has at least one filter region, wherein one of the filter regions is an infrared filter region. The infrared shutter is located between the cover and the sensing unit and configured to switch an infrared cut-off filter to a turn-on state or a turn-off state. The UAV obstacle avoidance system and the control method thereof can be used for day and night environments.
Claims
1. A UAV obstacle avoidance system, comprising: a cover, configured to allow infrared and visible light to pass; at least two obstacle avoidance lens modules, wherein each of the obstacle avoidance lens modules comprising: a sensing unit, comprising: a filter layer, comprising at least one filter region, wherein one of the filter regions is an infrared filter region; and a sensing element, wherein the filter layer is located between the cover and the sensing element; and an infrared shutter, located between the cover and the sensing unit and configured to switch an infrared cut-off filter to a turn-on state or a turn-off state; and an infrared light source, providing infrared illumination beams.
2. The UAV obstacle avoidance system according to claim 1, wherein the infrared filter region comprises a filter material allowing infrared light to pass.
3. The UAV obstacle avoidance system according to claim 2, wherein the light wave band penetrating the filter material ranges from 0.75 to 10 micrometers.
4. The UAV obstacle avoidance system according to claim 2, wherein the sensing unit comprises a plurality of infrared filter regions, the plurality of infrared filter regions is provided to allow the infrared light to pass, and the light wave band penetrating the filter material ranges from 0.75 to 3 micrometers.
5. The UAV obstacle avoidance system according to claim 1, wherein another filter region is a visible light filter region, and the area of the infrared filter region is substantially larger than that of the visible light filter region.
6. The UAV obstacle avoidance system according to claim 1, wherein a plurality of visible light filter regions are provided, a part of the plurality of visible light filter regions and the other part of the plurality of visible light filter regions respectively allow visible light of different bands to pass, and the area of the infrared filter region is substantially larger than that of the visible light filter region.
7. The UAV obstacle avoidance system according to claim 1, wherein the infrared filter region comprises a color conversion material for converting visible light into infrared light.
8. The UAV obstacle avoidance system according to claim 1, wherein the light wave band penetrating the cover ranges at least from 0.75 to 10 micrometers.
9. The UAV obstacle avoidance system according to claim 1, wherein the penetration rate of the infrared band penetrating the cover is greater than that of the visible light band penetrating the cover.
10. The UAV obstacle avoidance system according to claim 1, wherein the obstacle avoidance lens module further comprises a lens group, the lens group being located between the cover and the sensing unit.
11. The UAV obstacle avoidance system according to claim 9, wherein in equivalent penetration spectra of the lens group, the penetration rate of the infrared band is greater than that of the visible light band.
12. The UAV obstacle avoidance system according to claim 1, wherein the sensing unit further comprises a microlens array, the microlens array being located on the filter layer.
13. The UAV obstacle avoidance system according to claim 1, wherein the sensing element comprises a global shutter or a rolling shutter.
14. The UAV obstacle avoidance system according to claim 1, further comprising: an environment detecting lens module for capturing environment image information; and a processing unit, electrically connected to the environment detecting lens module, each of the obstacle avoidance lens modules and the infrared light source, wherein the processing unit estimates environment light brightness based on the environment image information, and when the environment light brightness is lower than a preset threshold, the processing unit controls the infrared light source to be turned on, and controls the infrared shutter to switch an infrared cut-off filter to a turn-off state.
15. A control method for a UAV obstacle avoidance system, applied to the UAV obstacle avoidance system, wherein the UAV obstacle avoidance system comprises an infrared light source and at least two obstacle avoidance lens modules, each of the obstacle avoidance lens modules comprises a sensing unit and an infrared shutter, the sensing unit comprises an infrared filter region, the infrared shutter is configured to switch an infrared cut-off filter to a turn-on state or a turn-off state, and the control method for the UAV obstacle avoidance system comprises: estimating whether the environment light brightness is below a preset threshold; and when the environment light brightness is lower than the preset threshold, turning on the infrared light source, and switching, by the infrared shutter, the infrared cut-off filter to a turn-off state, so as to allow the infrared light enters the infrared filter region of the sensing unit.
16. The control method for a UAV obstacle avoidance system according to claim 15, further comprising: when the environment light brightness is higher than the preset threshold, turning off the infrared light source, and switching, by the infrared shutter, the infrared cut-off filter to a turn-on state.
17. The control method for a UAV obstacle avoidance system according to claim 15, wherein the UAV obstacle avoidance system further comprises an environment detecting lens module, and the method of estimating whether the environment light brightness is lower than the preset threshold comprises: capturing environment image information by the environment detecting lens module; estimating the environment light brightness based on the environment image information; and judging whether the environment light brightness is lower than the preset threshold.
18. The control method for a UAV obstacle avoidance system according to claim 15, further comprising: capturing image information by the at least two obstacle avoidance lens modules; and estimating whether an obstacle is in front based on the multiple pieces of image information, and further calculating the distance from the obstacle to the UAV obstacle avoidance system in the presence of the obstacle.
19. The control method for a UAV obstacle avoidance system according to claim 15, wherein the infrared filter region comprises a filter material allowing the infrared light to pass, and the light wave band penetrating the filter material ranges from 0.75 to 10 micrometers for allowing at least the infrared light to pass.
20. The control method for a UAV obstacle avoidance system according to claim 15, wherein the sensing unit further comprises at least one visible light filter region, the infrared filter region comprises a filter material allowing the infrared light to pass, and the light wave band penetrating the filter material ranges from 0.75 to 3 micrometers for allowing at least the infrared light to pass.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0014] The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
DESCRIPTION OF THE EMBODIMENTS
[0026] In the following detailed description of the preferred embodiments, reference is made to the accompanying drawings which form a part hereof, and in which are shown by way of illustration specific embodiments in which the invention may be practiced. In this regard, directional terminology, such as top, bottom, front, back, etc., is used with reference to the orientation of the Figure(s) being described. The components of the present invention can be positioned in a number of different orientations. As such, the directional terminology is used for purposes of illustration and is in no way limiting. On the other hand, the drawings are only schematic and the sizes of components may be exaggerated for clarity. It is to be understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present invention. Also, it is to be understood that the phraseology and terminology used herein are for the purpose of description and should not be regarded as limiting. The use of including, comprising, or having and variations thereof herein is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. Unless limited otherwise, the terms connected, coupled, and mounted and variations thereof herein are used broadly and encompass direct and indirect connections, couplings, and mountings. Similarly, the terms facing, faces and variations thereof herein are used broadly and encompass direct and indirect facing, and adjacent to and variations thereof herein are used broadly and encompass directly and indirectly adjacent to. Therefore, the description of A component facing B component herein may contain the situations that A component directly faces B component or one or more additional components are between A component and B component. Also, the description of A component adjacent to B component herein may contain the situations that A component is directly adjacent to B component or one or more additional components are between A component and B component. Accordingly, the drawings and descriptions will be regarded as illustrative in nature and not as restrictive.
[0027]
[0028] More specifically, as shown in
[0029] More specifically, as shown in
[0030] In the present embodiment, the infrared filter region IV contains a filter material that allows infrared light to pass. More specifically, in the present embodiment, the infrared filter region IV is configured to allow at least the infrared light to pass, and the light wave band penetrating the filter material ranges from 0.75 to 10 micrometers. Further, in the present embodiment, infrared and visible light can be allowed to pass through the cover 120. In another embodiment, at least the light in the light wave band range of 0.75 to 10 micrometers can be allowed to pass the cover 120. Since both the cover 120 and the filter layer 132b allow the infrared and visible light to pass, the infrared and visible light coming from the outside can pass through the cover 120, the lens group 131 and the filter layer 132b, and are imaged on the sensing element 132c of the sensing unit 132. In other words, in the present embodiment, the obstacle avoidance lens modules 130 can be configured to capture visible light images and infrared images.
[0031] Also, for example, in an embodiment, the penetration rate of the infrared band penetrating the cover 120 is greater than that of the visible light band penetrating the cover 120, and in the equivalent penetration spectra of the lens group 131, the penetration rate of the infrared band is also greater than that of the visible light band. Thus, the obstacle avoidance lens modules 130 can capture infrared images with higher definition when the UAV obstacle avoidance system 100 is in the night environment. Further, in an embodiment, the infrared filter region IV contains a color conversion material. For example, in an embodiment, the color conversion material may be a quantum dot material or a wavelength conversion material for converting visible light to infrared light. Thus, it is also helpful to capture infrared images with higher definition when the UAV obstacle avoidance system 100 is in the night environment.
[0032] In this way, the UAV obstacle avoidance system 100 can simultaneously acquire visible light images and infrared images by means of the infrared filter region IV of the filter layer 132b of the sensing unit 132. In the day environment, the UAV obstacle avoidance system 100 can acquire visible light images as the basis for object identification; and in the night environment, the UAV obstacle avoidance system 100 can also acquire infrared images as the basis for object identification, so the system can be used in the day and night environments to realize full-autonomous operation. Moreover, since the UAV obstacle avoidance system 100 can simultaneously acquire visible light images and infrared images by just a single sensing unit 132, there is no need of multiple types of sensors, so that the size and weight of the system can be reduced. In addition, since the UAV obstacle avoidance system 100 can capture infrared images, the number of light sources for reinforcing light can be reduced, and the cost, size and weight of the system are reduced.
[0033] As shown in
[0034] Further description is given below in conjunction with
[0035]
[0036] Specifically, as shown in
[0037] Then, as shown in
[0038] Next, as shown in
[0039] On the other hand, as shown in
[0040] Accordingly, the UAV obstacle avoidance system 100 and the control method thereof can determine that the environment is a day environment or a night environment based on the environment light intensity, and select an operating mode applicable to the environment. In addition, the processing unit 160 can be used to execute an image processing algorithm for image processing on the environment image information acquired by the environment detecting lens module 150 or the image information acquired by the obstacle avoidance lens modules 130 to improve the image capturing quality. After receiving the environment image information of the environment detecting lens module 150, the processing unit 160 can execute an auto gain control based on the environment image information to prevent the acquired image information from being overexposed or too dark. Moreover, the processing unit 160 can perform image processing such as image noise reduction or edge enhancement on the image information acquired by the obstacle avoidance lens modules 130, thereby improving the image capturing quality.
[0041] In the present embodiment, the image information acquired by the environment detecting lens module 150 at night is black and white visible light image information. In this case, the processing unit 160 can also perform AI image coloring on the visible light image information or the infrared image information acquired by the obstacle avoidance lens modules 130 in combination with the training of an AI algorithm, to convert the same into a color image to facilitate the interpretation and identification of the image information.
[0042] In the foregoing embodiment, the filter layer 132b including one type of filter region is used as an example, but the present invention is not limited thereto. In other embodiments, the filter layer 132b may also include multiple types of filter regions. Some examples are given below as an illustration.
[0043]
[0044] Moreover, in the present embodiment, since the sensing unit 432 and the sensing unit 132 of
[0045]
[0046] Moreover, in the present embodiment, since the sensing unit 532 and the sensing unit 432 have a similar structure, when the sensing unit 532 is used for the UAV obstacle avoidance system 100, the UAV obstacle avoidance system can also simultaneously acquire visible light images and infrared images, so as to be used in day and night environments, thereby achieving full-autonomous operation. When the sensing unit 532 is used for the UAV obstacle avoidance system 100, the UAV obstacle avoidance system 100 can also be used to execute the aforementioned control method for the UAV obstacle avoidance system 100 as shown in
[0047] Based on the above, the embodiments of the present invention have at least one of the following advantages or effects. In the embodiments of the present invention, the UAV obstacle avoidance system can simultaneously acquire visible light images and infrared images by means of the infrared filter region of the filter layer of the sensing unit. In the day environment, the UAV obstacle avoidance system can acquire visible light images as the basis for object identification; and in the night environment, the UAV obstacle avoidance system can also acquire infrared images as the basis for object identification, so the system can be used in the day and night environments to realize full-autonomous operation. Moreover, since the UAV obstacle avoidance system can simultaneously acquire visible light images and infrared images by just a single sensing unit, there are no need of multiple types of sensors, so that the size and weight of the system can be reduced. In addition, since the UAV obstacle avoidance system can capture infrared images, the number of light sources for reinforcing light can be reduced, and the cost, size and weight of the system are reduced. In addition, the UAV obstacle avoidance system and the control method thereof can determine that the environment is a day environment or a night environment based on the environment light intensity, and select an operating mode applicable to the environment.
[0048] The foregoing description of the preferred embodiments of the invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form or to exemplary embodiments disclosed. Accordingly, the foregoing description should be regarded as illustrative rather than restrictive. Obviously, many modifications and variations will be apparent to practitioners skilled in this art. The embodiments are chosen and described in order to best explain the principles of the invention and its best mode practical application, thereby to enable persons skilled in the art to understand the invention for various embodiments and with various modifications as are suited to the particular use or implementation contemplated. It is intended that the scope of the invention be defined by the claims appended hereto and their equivalents in which all terms are meant in their broadest reasonable sense unless otherwise indicated. Therefore, the term the invention, the present invention or the like does not necessarily limit the claim scope to a specific embodiment, and the reference to particularly preferred exemplary embodiments of the invention does not imply a limitation on the invention, and no such limitation is to be inferred. The invention is limited only by the spirit and scope of the appended claims. The abstract of the disclosure is provided to comply with the rules requiring an abstract, which will allow a searcher to quickly ascertain the subject matter of the technical disclosure of any patent issued from this disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. Any advantages and benefits described may not apply to all embodiments of the invention. It should be appreciated that variations may be made in the embodiments described by persons skilled in the art without departing from the scope of the present invention as defined by the following claims. Moreover, no element and component in the present disclosure is intended to be dedicated to the public regardless of whether the element or component is explicitly recited in the following claims.