Autonomous Multifunctional Aerial Drone
20220100208 · 2022-03-31
Inventors
Cpc classification
G06V20/58
PHYSICS
G05D1/0094
PHYSICS
B64U50/19
PERFORMING OPERATIONS; TRANSPORTING
B64U2201/104
PERFORMING OPERATIONS; TRANSPORTING
Y02T10/70
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
B64C39/024
PERFORMING OPERATIONS; TRANSPORTING
B64U2201/10
PERFORMING OPERATIONS; TRANSPORTING
H04L67/12
ELECTRICITY
G06N3/008
PHYSICS
B60L50/60
PERFORMING OPERATIONS; TRANSPORTING
B64U2101/30
PERFORMING OPERATIONS; TRANSPORTING
B60L58/13
PERFORMING OPERATIONS; TRANSPORTING
G05D1/1064
PHYSICS
B64U2101/00
PERFORMING OPERATIONS; TRANSPORTING
International classification
G05D1/10
PHYSICS
B60L58/13
PERFORMING OPERATIONS; TRANSPORTING
G05D1/00
PHYSICS
Abstract
An apparatus and methods are provided for an unmanned aerial vehicle that uses artificial intelligence for performing desired tasks without operator intervention. The unmanned aerial vehicle comprises a multi-rotor UAV for aerial navigation and includes internal circuitry that supports an artificial intelligence for using collected data to autonomously perform multiple functions. Cameras, sensors, and speakers coupled with the multi-rotor UAV are configured to provide collected data to the artificial intelligence. The artificial intelligence uses the cameras and sensors to avoid colliding with objects in front of the UAV, route flight paths of the UAV to destination locations based on GPS and GLONASS technology, and change flight paths of the UAV in real-time based on detected obstacles. The artificial intelligence is configured to communicate with other UAVs so as to cooperate and coordinate tasks with the other UAVs.
Claims
1. An unmanned aerial vehicle, comprising: a multi-rotor UAV configured for aerial navigation; one or more cameras, one or more sensors, and one or more speakers for collecting data; and internal circuitry supporting an artificial intelligence for using collected data to autonomously perform multiple functions.
2. The unmanned aerial vehicle of claim 1, wherein the one or more cameras, sensors, and speakers are configured to facilitate detecting nearby objects and interacting with people.
3. The unmanned aerial vehicle of claim 1, wherein the one or more cameras are configured to enable the artificial intelligence to detect targeted objects, conditions, and obstructions nearby a flight path of the UAV.
4. The unmanned aerial vehicle of claim 1, wherein the internal circuitry includes one or more accelerometers, an altimeter, and a wireless modem for providing wireless connectivity suitable for communicating with a flight control system and other UAVs.
5. The unmanned aerial vehicle of claim 1, wherein the one or more sensors are configured to utilize Infrared and ultraviolet wavelengths.
6. The unmanned aerial vehicle of claim 1, wherein at least one of the one or more sensors comprises a triple-IR detector configured for flame detection.
7. The unmanned aerial vehicle of claim 1, wherein at least one of the one or more sensors comprises a 360-degree radar sensor.
8. The unmanned aerial vehicle of claim 1, wherein the one or more speakers are configured to broadcast audio announcements as well as detect sounds and speech near the UAV.
9. The unmanned aerial vehicle of claim 1, wherein the one or more cameras and the one or more sensors may be configured to provide the UAV with any of stereo vision, monocular vision, ultrasonic, Infrared, time of flight, and lidar sensors so as to detect and avoid obstacles.
10. The unmanned aerial vehicle of claim 1, wherein vision and Infrared sensors may be combined to form an Omni-directional Obstacle Sensing vision system.
11. The unmanned aerial vehicle of claim 1, wherein the multiple functions include an Automatic Take-Off function that launches and lands the UAV autonomously.
12. The unmanned aerial vehicle of claim 1, wherein the multiple functions include an Auto Balance function configured to balance the UAV during flight based on detected values for thrust, motion, air drag, and weight of the UAV.
13. The unmanned aerial vehicle of claim 12, wherein the Auto Balance function is configured to calculate rates of change in altitude, geographic location, and the like, so as to determine a precise flight time before an onboard battery must be recharged.
14. The unmanned aerial vehicle of claim 13, wherein an Environmental Factors Processing function is configured to receive collected data and calculate corresponding rates of change in surrounding parameters, such as air pressure, temperature, wind direction, altitude, and the like, so as to assist the Auto Balance function with determining a precise battery life.
15. The unmanned aerial vehicle of claim 14, wherein the Environmental Factors Processing function is configured to adjust the operation of the UAV so as to maximize an existing charge state of the onboard battery.
16. The unmanned aerial vehicle of claim 1, wherein the one or more cameras, one or more sensors, and one or more speakers are configured to be utilized to identify and interface with people.
17. The unmanned aerial vehicle of claim 16, wherein a Facial Recognition function is configured to identify a target person by way of the one or more cameras.
18. The unmanned aerial vehicle of claim 16, wherein a Natural Language Conversion function is configured to enable the UAV to interpret spoken words received by way of the one or more speakers.
19. The unmanned aerial vehicle of claim 18, wherein an Execute Commands function is configured to interpret designated voice commands and operate accordingly.
20. The unmanned aerial vehicle of claim 1, wherein the multiple functions include a Communication With Other Drones function configured to enable the UAV to cooperate and coordinate tasks with other UAVs.
21. The unmanned aerial vehicle of claim 20, wherein the Communication With Other Drones function is configured to communicate a current charge-state of an onboard battery to the other UAVs.
22. The unmanned aerial vehicle of claim 20, wherein the Communication With Other Drones function is configured to enable a multiplicity of UAVs to cooperate with one another.
23. The unmanned aerial vehicle of claim 22, wherein the Communication With Other Drones function enables the multiplicity of UAVs to communicate with one another to prevent their assigned tasks from interfering with one another.
24. The unmanned aerial vehicle of claim 1, wherein the multiple functions include a Thermal Imaging function configured to identify nearby humans.
25. The unmanned aerial vehicle of claim 24, wherein at least one of the one or more cameras comprises a night-vision camera whereby the UAV may navigator in darkened conditions.
26. The unmanned aerial vehicle of claim 24, wherein the Thermal Imaging function is configured to enable firefighters to see areas of heat through smoke, darkness, or heat-permeable barriers.
27. The unmanned aerial vehicle of claim 26, wherein the one or more sensors are configured to utilize Infrared and ultraviolet wavelengths.
28. The unmanned aerial vehicle of claim 27, wherein at least one of the one or more sensors comprises a triple-IR detector configured for flame detection.
29. The unmanned aerial vehicle of claim 1, wherein the multiple functions include an Obstacle Detection function configured to use the one or more cameras and the one or more sensors to identify objects in front of the UAV so as to avoid flying into the objects.
30. The unmanned aerial vehicle of claim 29, wherein the multiple functions include a Location Identification & Routing function configured operate in conjunction with the Obstacle Detection function to route a flight path of the UAV to a destination location based on GPS and GLONASS technology.
31. The unmanned aerial vehicle of claim 30, wherein the multiple functions include an Intelligent Re-Routing function configured to operate in conjunction with the Obstacle Detection function and the Location Identification & Routing function to change the flight path of the UAV in real-time based on detected obstacles.
32. The unmanned aerial vehicle of claim 1, wherein the multiple functions include a Return-to-Home function that is configured to be initiated by an operator pressing a button on a remote controller or in a software application that controls the UAV.
33. The unmanned aerial vehicle of claim 32, wherein the Return-to-Home function is configured to direct the UAV to fly automatically back to a home location when the charge-state of an onboard battery reaches a predetermined low level.
34. The unmanned aerial vehicle of claim 32, wherein the Return-to-Home function is configured to cause the UAV to automatically fly to a home location in the event of a loss of contact between the UAV and a remote controller.
35. The unmanned aerial vehicle of claim 32, wherein the Return-to-Home function is configured to cause the UAV to automatically fly to a home location after having completed one or more assigned tasks.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The drawings refer to embodiments of the present disclosure in which:
[0019]
[0020]
[0021]
[0022]
[0023]
[0024] While the present disclosure is subject to various modifications and alternative forms, specific embodiments thereof have been shown by way of example in the drawings and will herein be described in detail. The invention should be understood to not be limited to the particular forms disclosed, but on the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the present disclosure.
DETAILED DESCRIPTION
[0025] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure. It will be apparent, however, to one of ordinary skill in the art that the invention disclosed herein may be practiced without these specific details. In other instances, specific numeric references such as “first propeller,” may be made. However, the specific numeric reference should not be interpreted as a literal sequential order but rather interpreted that the “first propeller” is different than a “second propeller.” Thus, the specific details set forth are merely exemplary. The specific details may be varied from and still be contemplated to be within the spirit and scope of the present disclosure. The term “coupled” is defined as meaning connected either directly to the component or indirectly to the component through another component. Further, as used herein, the terms “about,” “approximately,” or “substantially” for any numerical values or ranges indicate a suitable dimensional tolerance that allows the part or collection of components to function for its intended purpose as described herein.
[0026] Unmanned aerial vehicles, commonly referred to as “drones,” are becoming increasingly popular for a wide variety of uses, such as broadcasting, logistics, disaster assessment, rescues, as well as leisure. Although many drones are configured to fly autonomously along predefined routes, conventional drones generally are incapable of responding to changing conditions along the route, such as instances of undetected obstructions along the route that may give rise to collisions. Such collisions risk potentially injuring people, damaging property, as well as causing the drone to be lost. Accordingly, embodiments presented herein provide an autonomous aerial drone that uses artificial intelligence for flying and performing a variety of useful tasks without a need for operator intervention.
[0027]
[0028] As further shown in
[0029] As will be appreciated, the fuselage 104 generally houses circuitry, including one or more processors, configured to run software applications suitable for operating the UAV 100 shown in
[0030]
[0031] Once the UAV 100 is airborne, an Auto Balance function 156 may be used to calculate a precise battery life. For example, in some embodiments, the Auto Balance function 156 may balance the UAV 100 during flight based on detected values for thrust, motion, air drag, and weight of the UAV 100. In addition, the Auto Balance function 156 may further calculate rates of change in altitude, geographic location, and the like, so as to determine a precise flight time before the onboard battery must be recharged.
[0032] Moreover, an Environmental Factors Processing function 160 may be configured to receive data from the sensors 132 and calculate corresponding rates of change in surrounding parameters, such as air pressure, temperature, wind direction, altitude, and the like, so as to assist the Auto Balance function 156 with determining a precise battery life. Further, in some embodiments, the Environmental Factors Processing function 160 may be configured to adjust the operation of the UAV 100 to maximize the existing charge state of the battery. It is contemplated that the Environmental Factors Processing function 160 optimizes battery life before directing the UAV 100 to return its home location.
[0033] In some embodiments, the cameras 128, sensors 132, and speakers 136 may be utilized to identify and interface with people. For example, a Facial Recognition function 164 may be configured to identify a target person by way of an aerial view, such that the UAV 100 may monitor the target person. Further, a Natural Language Conversion function 168 may be configured to enable the UAV 100 to interpret spoken words. An Execute Commands function 172 may be configured to interpret designated voice commands and operate accordingly.
[0034] With continuing reference to
[0035] In some embodiments, a Thermal Imaging function 180 may be configured to identify nearby humans, as well as enable firefighters to see areas of heat through smoke, darkness, or heat-permeable barriers. For example, the sensors 132 may be configured to enable the UAV 100 to utilize electromagnetic wavelengths outside the visible light spectrum, such as, for example, Infrared and ultraviolet wavelengths. In some embodiments, at least one of the sensors 132 may comprise a triple-IR (IR3) detector advantageously configured for flame detection, without limitation. Further, in some embodiments, at least one of the cameras 128 may comprise a night-vision camera whereby the UAV 100 may navigator in darkened conditions.
[0036] An Obstacle Detection function 184 may be configured to use the cameras 128 and the sensors 132 to identify objects in front of the UAV 100 so as to avoid flying into the objects. In some embodiments, the UAV 100 may be equipped with any of stereo vision, monocular vision, ultrasonic, Infrared, time of flight, and lidar sensors so as to detect and avoid obstacles. In some embodiments, vision and Infrared sensors may be combined to form an Omni-directional Obstacle Sensing vision system, without limitation. It is contemplated that such a UAV 100 may advantageously fly within a tight indoor space, such as a factory or warehouse, without colliding with any nearby obstacles and people.
[0037] Working in conjunction with the Obstacle Detection function 184, a Location Identification & Routing function 188 may be configured to route a flight path of the UAV 100 to a destination location based on GPS and GLONASS technology. Further, an Intelligent Re-Routing function 192 may be configured to change the flight path of the UAV 100 in real-time based on detected obstacles. As such, the functions 184, 188, and 192 cooperate to direct the UAV 100 from a first location to second location while avoiding detected obstacles and potential dangers along the flight path.
[0038] As shown in
[0039] Turning, now, to
[0040] In an embodiment, illustrated in
[0041] Peripheral interface 228 may include a memory control hub (MCH) and an input output control hub (ICH). Peripheral interface 228 may include a memory controller (not shown) that communicates with a memory 232. The peripheral interface 228 may also include a graphics interface that communicates with graphics subsystem 234, which may include a display controller and/or a display device. The peripheral interface 228 may communicate with the graphics device 234 by way of an accelerated graphics port (AGP), a peripheral component interconnect (PCI) express bus, or any other type of interconnects.
[0042] An MCH is sometimes referred to as a Northbridge, and an ICH is sometimes referred to as a Southbridge. As used herein, the terms MCH, ICH, Northbridge and Southbridge are intended to be interpreted broadly to cover various chips that perform functions including passing interrupt signals toward a processor. In some embodiments, the MCH may be integrated with the processor 224. In such a configuration, the peripheral interface 228 operates as an interface chip performing some functions of the MCH and ICH. Furthermore, a graphics accelerator may be integrated within the MCH or the processor 224.
[0043] Memory 232 may include one or more volatile storage (or memory) devices, such as random access memory (RAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), static RAM (SRAM), or other types of storage devices. Memory 232 may store information including sequences of instructions that are executed by the processor 224, or any other device. For example, executable code and/or data of a variety of operating systems, device drivers, firmware (e.g., input output basic system or BIOS), and/or applications can be loaded in memory 232 and executed by the processor 224. An operating system can be any kind of operating systems, such as, for example, Windows® operating system from Microsoft®, Mac OS®/iOS® from Apple, Android® from Google®, Linux®, Unix®, or other real-time or embedded operating systems such as VxWorks.
[0044] Peripheral interface 228 may provide an interface to IO devices, such as the devices 236-248, including wireless transceiver(s) 236, input device(s) 240, audio IO device(s) 244, and other IO devices 248. Wireless transceiver 236 may be a WiFi transceiver, an infrared transceiver, a Bluetooth transceiver, a WiMax transceiver, a wireless cellular telephony transceiver, a satellite transceiver (e.g., a global positioning system (GPS) transceiver) or a combination thereof. Input device(s) 240 may include a mouse, a touch pad, a touch sensitive screen (which may be integrated with display device 234), a pointer device such as a stylus, and/or a keyboard (e.g., physical keyboard or a virtual keyboard displayed as part of a touch sensitive screen). For example, the input device 240 may include a touch screen controller coupled with a touch screen. The touch screen and touch screen controller can, for example, detect contact and movement or break thereof using any of a plurality of touch sensitivity technologies, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch screen.
[0045] Audio IO device 244 may include a speaker and/or a microphone to facilitate voice-enabled functions, such as voice recognition, voice replication, digital recording, and/or telephony functions. Other optional devices 248 may include a storage device (e.g., a hard drive, a flash memory device), universal serial bus (USB) port(s), parallel port(s), serial port(s), a printer, a network interface, a bus bridge (e.g., a PCI-PCI bridge), sensor(s) (e.g., a motion sensor, a light sensor, a proximity sensor, etc.), or a combination thereof. Optional devices 248 may further include an imaging processing subsystem (e.g., a camera), which may include an optical sensor, such as a charged coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) optical sensor, utilized to facilitate camera functions, such as recording photographs and video clips.
[0046] Note that while
[0047] Some portions of the preceding detailed descriptions have been presented in terms of algorithms and symbolic representations of operations on data bits within a computer memory. These algorithmic descriptions and representations are the ways used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. An algorithm is here, and generally, conceived to be a self-consistent sequence of operations leading to a desired result. The operations are those requiring physical manipulations of physical quantities.
[0048] It should be borne in mind, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise as apparent from the above discussion, it should be appreciated that throughout the description, discussions utilizing terms such as those set forth in the claims below, refer to the action and processes of a computer system, or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system's registers and memories into other data similarly represented as physical quantities within the computer system's memories or registers or other such information storage, transmission or display devices.
[0049] The techniques shown in the figures can be implemented using code and data stored and executed on one or more electronic devices. Such electronic devices store and communicate (internally and/or with other electronic devices over a network) code and data using computer-readable media, such as non-transitory computer-readable storage media (e.g., magnetic disks; optical disks; random access memory; read only memory; flash memory devices; phase-change memory) and transitory computer-readable transmission media (e.g., electrical, optical, acoustical or other form of propagated signals—such as carrier waves, infrared signals, digital signals).
[0050] The processes or methods depicted in the preceding figures may be performed by processing logic that comprises hardware (e.g. circuitry, dedicated logic, etc.), firmware, software (e.g., embodied on a non-transitory computer readable medium), or a combination of both. Although the processes or methods are described above in terms of some sequential operations, it should be appreciated that some of the operations described may be performed in a different order. Moreover, some operations may be performed in parallel rather than sequentially.
[0051] While the invention has been described in terms of particular variations and illustrative figures, those of ordinary skill in the art will recognize that the invention is not limited to the variations or figures described. In addition, where methods and steps described above indicate certain events occurring in certain order, those of ordinary skill in the art will recognize that the ordering of certain steps may be modified and that such modifications are in accordance with the variations of the invention. Additionally, certain of the steps may be performed concurrently in a parallel process when possible, as well as performed sequentially as described above. To the extent there are variations of the invention, which are within the spirit of the disclosure or equivalent to the inventions found in the claims, it is the intent that this patent will cover those variations as well. Therefore, the present disclosure is to be understood as not limited by the specific embodiments described herein, but only by scope of the appended claims.