MULTIROTOR GAME SYSTEM
20180081356 · 2018-03-22
Inventors
- Christopher A. Boden (Grand Rapids, MI, US)
- Paul E. Kidwell (St. Clair Shores, MI, US)
- Samuel M. Clarke (Holland, MI, US)
Cpc classification
A63F13/213
HUMAN NECESSITIES
A63F13/65
HUMAN NECESSITIES
A63F13/323
HUMAN NECESSITIES
B64U2101/05
PERFORMING OPERATIONS; TRANSPORTING
G05D1/0027
PHYSICS
A63F13/327
HUMAN NECESSITIES
A63F13/235
HUMAN NECESSITIES
A63F13/30
HUMAN NECESSITIES
G05D1/0038
PHYSICS
International classification
G05D1/00
PHYSICS
A63F13/213
HUMAN NECESSITIES
A63F13/30
HUMAN NECESSITIES
Abstract
A system enabling remote-controlled piloting of multirotors with first-person-video to play games. Each multirotor has a transmission system and a detection system. The transmission system acts as a gun that transmits an electromagnetic radiation signal and the detection system acts as a shot detector by detecting the electromagnetic radiation signal. Game information can be processed and overlaid on the first person video provided to the player piloting the multirotor. Each multirotor may include a lighting system and a LASER to provide visual cues to other players and observers. Some embodiments utilize flag devices in a capture-the-flag game mode.
Claims
1. A system for remotely controlling a multirotor unmanned aerial vehicle (UAV) comprising: a multirotor UAV equipped with an electromagnetic radiation transmission system, an electromagnetic radiation detection system, a camera, and a multirotor UAV communication system; and a multirotor UAV remote control system including: a control communication system for wirelessly communicating with said multirotor UAV communication system; a display that displays multirotor UAV video information based on output from said camera and that displays video overlay information based on at least one of said electromagnetic radiation transmission system and said electromagnetic radiation detection system; a remote controller that includes a human interface, said human interface accepts inputs to control operation of said multirotor UAV including activation of said electromagnetic radiation transmission system.
2. The system for remotely controlling a multirotor UAV of claim 1 wherein said electromagnetic radiation detection system includes a plurality of separate electromagnetic radiation detectors installed on said multirotor UAV and wherein said video overlay information indicates a direction of received electromagnetic radiation emission based on output from said plurality of separate electromagnetic radiation detectors.
3. The system for remotely controlling a multirotor UAV of claim 1 wherein said electromagnetic radiation transmission system includes an infrared (IR) transmitter and a visible-light LASER, wherein said IR transmitter and said visible-light LASER activate simultaneously in response to input from said human interface of said remote controller.
4. The system for remotely controlling a multirotor UAV of claim 3 wherein said IR transmitter and said visible-light LASER are configured to generate signals along parallel signal paths such that said visible-light LASER generates a human-visible indication of said signal output from said IR transmitter.
5. The system for remotely controlling a multirotor UAV of claim 1 wherein said multirotor UAV includes a lighting system that activates in response to said electromagnetic radiation detection system receiving an electromagnetic radiation signal.
6. The system for remotely controlling a multirotor UAV of claim 1 wherein said multirotor UAV updates video overlay information in response to said electromagnetic radiation detection system receiving an electromagnetic radiation signal.
7. The system for remotely controlling a multirotor UAV of claim 1 wherein said multirotor UAV updates video overlay information in response to said electromagnetic radiation transmission system activation.
8. The system for remotely controlling a multirotor UAV of claim 1 wherein said multirotor UAV includes a human interface for changing quadcopter configuration settings including at least one of a lighting configuration, multirotor UAV identifier, multirotor UAV game mode, and battery configuration.
9. The system for remotely controlling a multirotor UAV of claim 1 wherein said electromagnetic radiation detection system receives an electromagnetic radiation signal encoded with a multirotor UAV identifier and wherein said video overlay information is updated based on said multirotor UAV identifier.
10. A multirotor unmanned aerial vehicle (UAV) game system comprising: a plurality of multirotor UAVs each equipped with an electromagnetic radiation transmission system, an electromagnetic radiation detection system, a camera, and a multirotor UAV communication system; and a plurality of multirotor UAV remote control systems each associated with one of said plurality of multirotor UAVs, each of said plurality of multirotor UAV remote control systems including: a control communication system for wirelessly communicating with said associated multirotor UAV; a display that displays first-person-video information based on output from said camera of said associated multirotor UAV and that displays video overlay information based on at least one of said electromagnetic radiation transmission system and said electromagnetic radiation detection system of said associated multirotor UAV; a remote controller that includes a human interface, said human interface accepts inputs to control operation of said associated multirotor UAV including activation of said electromagnetic radiation transmission system of said associated multirotor UAV.
11. The multirotor UAV game system of claim 10 wherein each of said multirotor UAV electromagnetic radiation detection systems include a plurality of separate electromagnetic radiation detectors and a processor, and in response to receiving an electromagnetic radiation signal said processor in each multirotor UAV determines a direction of said received electromagnetic radiation signal based on output from said plurality of separate electromagnetic radiation detectors installed on that multirotor UAV and updates video overlay information for that multirotor UAV to indicate said direction of said received electromagnetic radiation signal for display on said multirotor UAV remote control system associated with that multirotor UAV.
12. The multirotor UAV game system of claim 10 wherein each electromagnetic radiation transmission system includes an infrared (IR) transmitter and a visible-light LASER, wherein each of said IR transmitter and said visible-light LASER activate simultaneously in response to input from said human interface of a remote controller.
13. The multirotor UAV game system of claim 10 wherein each of said plurality of multirotor UAVs includes a lighting system and wherein said lighting system activates in a predefined pattern in response to said electromagnetic radiation detection system receiving an electromagnetic radiation signal from another of said plurality of multirotor UAVs.
14. The multirotor UAV game system of claim 10 wherein each of said multirotor UAVs updates video overlay information in response to said electromagnetic radiation detection system receiving an electromagnetic radiation signal from another of said plurality of multirotor UAVs.
15. The multirotor UAV game system of claim 10 wherein each of said multirotor UAVs updates video overlay information in response to said electromagnetic radiation transmission system activation.
16. The multirotor UAV game system of claim 10 wherein each electromagnetic radiation transmission system generates an electromagnetic radiation signal, wherein said electromagnetic radiation signal is encoded with a multirotor UAV identifier that identifies the origin of said electromagnetic radiation signal.
17. The multirotor UAV game system of claim 16 wherein each multirotor UAV electromagnetic radiation detection system includes a processor capable of decoding said multirotor UAV identifier from said electromagnetic radiation signal and updating video overlay information based on said multirotor UAV identifier in response to receiving said electromagnetic radiation signal.
18. The multirotor UAV game system of claim 16 including two or more flag devices for implementing a multirotor UAV capture the flag game, each flag device having an electromagnetic radiation detection system and an electromagnetic radiation transmission system.
19. The multirotor UAV game system of claim 18 wherein each flag device, in response to receiving an electromagnetic radiation signal and decoding a predefined multirotor UAV identifier, activates said electromagnetic radiation transmission system to generate a flag device electromagnetic radiation signal.
20. The multirotor UAV game system of claim 19 wherein a multirotor UAV in response to receiving said flag device electromagnetic radiation signal reconfigures its electromagnetic radiation transmission system to output a different electromagnetic radiation signal.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
DESCRIPTION OF THE CURRENT EMBODIMENT
[0039] The current embodiment of the present invention is directed to a multirotor game system. Players remotely pilot multirotor UAVs using remote controllers and first-person-video (FPV) displays. A variety of different games can be played using the game system in which players shoot (transmit electromagnetic radiation) at one another's multirotors or other game objects using the electromagnetic transmission system installed on each multirotor.
[0040] Perhaps as best shown in
[0041] As each quadcopter flies, it can stream video wirelessly to an associated display 300, providing a first-person-view from the quadcopter perspective to the operator. The quadcopter can also wirelessly transmit game information to the associated display 300, which can overlay the streaming video in the first-person-view (FPV) display 300. In one exemplary FPV display, offensive game information such as virtual ammo and defensive game information such as virtual shields can be displayed in the FPV display.
[0042] The player can control the quadcopter using an associated remote control by transmitting wireless control signals to the quadcopter. These signals can include navigation signals that steer and operate the quadcopter itself as well as game signals. For example, one game signal is a shoot signal, which activates the electromagnetic transmission system 106 to fire the IR transmitter 02 and LASER 03 from the quadcopter.
[0043] There are a variety of different game components installed on the quadcopter in the depicted in the illustrated embodiment. In alternative embodiments, additional or fewer game components can be installed on the quadcopter. In the depicted embodiment, the quadcopter game components include a circuit board 01, a camera 04, an electromagnetic transmission system 106, an electromagnetic receiver system 108 (in this case installed directly on the circuit board 01), a communication system (i.e. a video transmitter 06, video transmitter antenna 07, receiver 09, and remote receiver antenna 10), a battery 00A, and a lighting system 05. Some or all of these components can be retrofit onto an off the shelf quadcopter or alternatively some or all of these components can be integrated during manufacture of a quadcopter or other multirotor craft.
[0044] Each quadcopter is equipped with an electromagnetic transmission system 106. In the depicted embodiment the electromagnetic transmission system 106 includes an infrared (IR) transmitter 02 and a visible-light LASER 03.
[0045] The IR transmitter 02 and the visible-light LASER 03 are configured to simultaneously activate in response to a shoot signal from an associated remote control 200. Essentially any off the shelf IR transmitter and LASER can be configured to work with the game system. The IR transmitter 02 emits an infrared signal that can be detected by an electromagnetic detection system 108 installed on another quadcopter (such as the one or more IR detectors 01A depicted in
[0046] Each quadcopter is also equipped with a detection system. In the current embodiment, each quadcopter is equipped with an electromagnetic radiation detection system 108 that includes four or more IR detectors installed around the perimeter of the quadcopter. The position and orientation of the IR detectors 01A in one embodiment are shown in
[0047] The IR signal received by the IR detectors 01a may be encoded with information such as a quadcopter identifier, team identifier, or other game information. In the current embodiment, the processor 200 installed on the main board 01 can decode received IR signals and provide game information to the display 300 associated with the quadcopter. This enables the quadcopter to wirelessly transmit and display to the player meaningful game information such as an indication of the origin of the IR signal received by the quadcopter including the direction from which the IR signal was received. The video overlay circuitry 01b, depicted in
[0048] One example of a video overlay is depicted in
[0049] Shot indicators 08A, 08B, 08C, and 08D assist the player in quickly assessing the direction from which they are being shot. These shot indicators correspond to the position of the respective IR detectors installed on the quadcopter. For example, in the current embodiment, the 08A shot indicator indicates a signal received by the front-left IR sensor, the 08B shot indicator indicates a signal received by the front-right IR sensor, the 08C shot indicator indicates a signal received by the rear-right IR sensor, and the 08D shot indicator indicates a signal received by the rear-left IR sensor. In the current embodiment, the rear sensors are angled to look forward and outward at a 45 degree angle. The front sensors are angled to look backwards and outward at a rear facing 45 degree angle. The software running on the UAVs game processor is capable of keeping track of which sensor is looking where, which can provide a bit of overlap in coverage to the sides.
[0050]
[0051] Referring back to
[0052] The overlay in
[0053] Other pieces of game information can also be displayed on the overlay. For example, an indicator to tell whether the quadcopter is currently charging its shields and/or ammunition, whether the IR transmitter is currently activated, or neither. The overlay can also include a reticle 12 for targeting the IR transmitter. Information can be displayed on the overlay to let the player know when the player is dead (for example, shot a predetermined number of times) or is carrying a flag signal, which is utilized in some variant game modes discussed below. The overlay can display the number of times the quadcopter has been killed 13A in variants where the quadcopter returns to the game after a deactivation period upon death. The overlay can also indicate the player ID, sometimes referred to as the quadcopter ID or multirotor ID, of the opposing quadcopter that last successfully shot this quadcopter. Finally, in this embodiment, the overlay can also include battery information, such as the voltage remaining 15 and a low battery warning indicator 16.
[0054] Referring back to
[0055] Each quadcopter includes a communication system. For example, in the current embodiment, each quadcopter includes a video transmitter 06, video transmitter antenna 07, receiver 08, and remote receiver antenna 10. The video transmitter and antenna can transmit the video stream and game information to a video receiver antenna on the display 300. Essentially any video transmitter and antenna can be configured to work with the system. The remote receiver and antenna can receive navigation and game signals from the remote control transmitter and antenna 200. Essentially any remote receiver 09 and antenna 10 can be configured to work with the system. In some embodiments, a single transceiver can handle both the communication with the display 300 and the communication with the remote controller 200.
[0056] Each quadcopter includes a power source such as a battery. A variety of different types and sizes of batteries can be used to power the various rotorcraft.
[0057] Perhaps as best shown in
[0058] The circuit board 01 of the depicted embodiment is a GG17 main board. Components on the circuit board can collect, processes, and transmit game information between various game components. Some of the game components may be installed directly on the main board, while others may be in communication with or through the circuit board.
[0059] The processor receives information from various game components. For example, the camera, the electromagnetic detection system 108, the electromagnetic transmission system 106, and the receiver 09 can all provide information to the processor. For example, in the current embodiment the CSO, MOSTO, MISCO, and SCKO signals are a serial data link (SPI) between the processor and video overlay chip. In the current embodiment, the electromagnetic detection system includes four IR detectors 01A. By processing the output from these IR detectors, the processor can determine the direction from which an IR signal is received. Further the receiver 09 provides a shoot command from a remote control, which is used to trigger activation of the electromagnetic transmission system 106.
[0060] The game rules can be programmed into the processor. For example, the processor tracks the information relating the shields and ammunition and can prevent the activation of the IR transmitter and laser if there is no virtual ammunition or if the quadcopter has been deactivated due to being hit while the shield meter was depleted. The processor can provide all data displayed on the FPV video system. For example, this may include hit direction, shield and laser meter values, battery level, low battery alert, number of times hit, color displayed by LEDs, codes sent by the IR LEDs, codes detected by the IR receivers, activation of the laser, and essentially any other game or system information.
[0061] There are a variety of different game modes that can be implemented with the multirotor UAV game system. Some of the game modes utilize additional objects besides the multirotor crafts. For example, one example is a capture-the-flag game mode that includes a flag device that can respond to an IR signal from an enemy quad copter by transmitting a flag IR signal, and can record a point when a friendly quadcopter transmits a flag signal to the friendly flag device.
[0062]
[0063] The flag device receives and decodes IR signals from the quadcopters and reacts differently to those signals depending on the information encoded in the IR signal. During the configuration of the game system, the quadcopters can be divided into teams associated with the flag devices. A friendly flag device is one associated with a friendly quadcopter identifier while an enemy flag device is one not associated with an enemy quadcopter identifier.
[0064] In the current embodiment of the capture the flag, the IR transmission signals in the game can be encoded with several pieces of game information. For example, each IR signal can be encoded with a category that identifies the signal as a damage signal or a flag signal. In response to receiving an IR signal from an enemy quadcopter, the flag device is configured to activate its IR emittersin the depicted embodiment all 6 IR emitters. In this way, the flag device transmits a multi-directional IR signal. This signal is encoded with game information for enemy quadcopters indicating that its category is a flag signal (as opposed to a damage signal). Any enemy quadcopter that receives the IR signal from the flag device are configured to respond by encoding different game information into any further IR transmissions. That is each enemy quadcopter that receives this IR signal is configured to change transmission of IR signals encoded with a damage signal to instead be encoded with a flag signal category. In this way, quadcopters that receive an IR signal from an enemy flag device can no longer damage enemy quadcopters, but can score points by shooting a friendly flag device with the IR signal encoded with the flag signal. Quadcopters carrying the flag signal (that is configured to transmit IR signals encoded with the flag information) can be reconfigured to transmit IR signals encoded with the damage information after being shot or killed (i.e. shot a predetermined number of times or shot while virtual shield meter is empty) by an enemy quadcopter. Further, the quadcopter lighting systems can be reconfigured to display a predetermined lighting pattern (various colors and/or blinking patterns) in order to provide a visual indicator of the quadcopters carrying the flag signal.
[0065] There are a variety of different alternative embodiments. For example, in some game systems, receiving an IR signal encoded with flag information does not reconfigure your IR transmission signals to be encoded as flag signals, but rather reconfigures your IR transmission signals to be encoded with both damage and flag signals. In this variant, ships carrying the flag can still shoot at enemy quadcopters. In one embodiment, a hand held gun may be provided to spectators, whom can shoot UAVs that get too close. This could affect game play of the ongoing combat, or only record hits so spectators could play a concurrent game of competitive target shooting.
[0066] An example of air-to-air combat between two quadcopters in one embodiment of a multirotor UAV game system will now be described in connection with
[0067] As shown in
[0068] When hit, the quadcopter that was shot (Player 6 in this instance) can process the IR signal, decode game information, and communicate with an associated remote display 300 to display the following: [0069] The direction the shot came from in 2D space (in alternative embodiments in 3D space). [0070] Who shot (displays player ID number 14). Depending on the configuration of the game system, friendly fire can be turned or off. If it is off then shooting a teammates quadcopter will not have an effect and won't display damage from players on the same team. The game system can still display the player ID number and the direction the shot came from. [0071] How much damage taken (in this example indicated by the depletion of the shield meter). In the current embodiment of the game system, it takes multiple shots to kill a quad. [0072] The quadcopters lighting system turns solid white, to show other players that it's taken damage.
[0073]
[0077] In the current embodiment, the quadcopter is dead (for example certain quadcopter components are deactivated or limited in functionality) for a certain amount of time. The amount of time can change depending on a variety of factors. For example, the more times that your quadcopter is killed in a round the timer may increase. During this deactivation period the IR emitter and laser do not react to players pressing the shoot button 21 and the quadcopter lighting system continues to flash white.
[0078] After the deactivate period, the quadcopter returns to functionality with full shields and ammo and the lighting system returns to normal. For example, in a team game the quadcopter lighting system may return to a solid color depending on the team.
[0079] After the game is over a score can be tabulated based on whose quadcopter was killed the least. In a free for all game, the winner is the quadcopter that was killed the least among all quadcopters, in a team game the winner is the team with the least deaths when the deaths of all quadcopters on each team are summed.
[0080] An example of one embodiment of a capture the flag game system will now be described in connection with
[0081] The capture the flag game works similarly to the air-to-air combat game. That is, quadcopters can shoot at each other and accumulate kills that deactivate the enemy quadcopters. However, victory is not related to which team died the least, but instead which team captures the most flags.
[0082] In this example, Player 6 is on Team 1. Player 6's quadcopter flies toward Team 2's flag and as shown in
[0083] Player 6 presses shoot button 21, which activates the electromagnetic radiation transmission system including the LASER 03 and the IR emitter 02, as shown in
[0084] As shown in
[0087] In this example, each team 1 quadcopter that received the IR signal from the enemy flag reconfigures its quadcopter transmitter to shoot an encoded IR signal with flag information.
[0088] As shown in
[0089] In the depicted embodiment, if the player shoots and does not hit their own flag, the flag is lost, no point is rewarded, and the player's quadcopter reverts to shooting an IR signal that does not include the encoded flag information. Further, as depicted in
[0090] In the current embodiment of the capture the flag game system, quadcopters do not have to complete a round trip before another team member collects another flag.
[0091]
[0092] After turning on the quadcopter, display and remote control, Players can use the quadcopter buttons 01C, 01D to configure the quadcopter through the menu displayed on the display 300 associated with that quadcopter. During normal operation, pressing 01C will fire the LASER and IR emitter as if a shoot command were received from the transmitter. This can allow easy testing to see that the laser and IR emitter are functioning properly. It can also be used to shoot at another quad to verify that the other quadcopter's IR receivers are working.
[0093] During normal operation, pressing the other button 01D will put the quad in Editor mode. This mode allows for the alteration of several software settings. When Editor mode is entered, Editor can be displayed on the on screen display of display 300. Below the word Editor, the OSD can display the particular parameter being altered, as shown in
[0094] In the current embodiment the editable parameters are [0095] LED ColorPressing 01C will cycle through off and six different colors that are displayed on the quad's RGB LEDs. In the current embodiment, the quadcopters can be configured to display solid lighting colors of Red, Green, Blue, Yellow, Purple, and Cyan. The lighting system can also be turned off. In this embodiment, White is reserved for game functionality and is not available as a quadcopter base color. [0096] IDPressing 01C will cycle through seven different ID numbers. In one embodiment, the ID numbers are 0 through 7. In alternative embodiments, different, fewer, or additional ID numbers may be available. [0097] Team NamePressing 01C will cycle through four different preset Team numbers/names. This can also be used to select a free for all game mode. [0098] CellsPressing 01C will cycle through the number of cells in the quadcopter's battery. This number can be used by the circuit board's low battery level indicator to display accurate information about the battery. In the current embodiment, low battery is indicated when the battery voltage falls below 3.4 volts times the number of cells.
[0099] If playing a Capture the Flag game, each Flag device's buttons can be used to set the color and team number for that flag. The flag can be configured without an on screen display. In the current embodiment, the first flag button 17B selects LED 19 color. Flag color does not necessarily correlate to quadcopter colors. Further, the other flag button 17C can be used to set the team number. As the button 17C is pressed, the LEDs 19 flash a number of times to indicate selection (e.g. twice for team 2, three times for team 3, etc.).
[0100] Directional terms, such as vertical, horizontal, top, bottom, upper, lower, inner, inwardly, outer and outwardly, are used to assist in describing the invention based on the orientation of the embodiments shown in the illustrations. The use of directional terms should not be interpreted to limit the invention to any specific orientation(s).
[0101] The above description is that of current embodiments of the invention. Various alterations and changes can be made without departing from the spirit and broader aspects of the invention as defined in the appended claims, which are to be interpreted in accordance with the principles of patent law including the doctrine of equivalents. This disclosure is presented for illustrative purposes and should not be interpreted as an exhaustive description of all embodiments of the invention or to limit the scope of the claims to the specific elements illustrated or described in connection with these embodiments. For example, and without limitation, any individual element(s) of the described invention may be replaced by alternative elements that provide substantially similar functionality or otherwise provide adequate operation. This includes, for example, presently known alternative elements, such as those that might be currently known to one skilled in the art, and alternative elements that may be developed in the future, such as those that one skilled in the art might, upon development, recognize as an alternative. Further, the disclosed embodiments include a plurality of features that are described in concert and that might cooperatively provide a collection of benefits. The present invention is not limited to only those embodiments that include all of these features or that provide all of the stated benefits, except to the extent otherwise expressly set forth in the issued claims. Any reference to claim elements in the singular, for example, using the articles a, an, the or said, is not to be construed as limiting the element to the singular.