MULTI-VEHICLE AUDIO SYSTEM

Abstract

Methods and systems for using audio output devices to output audio content are provided. The audio output devices are provided in autonomously controllable vehicles. The vehicles are instructed to move to respective locations based on an audio output mode. For example, the vehicles may be arranged in a first configuration for a stereo sound mode and instructed to play left-channel or right channel audio data according to their location. The vehicles may be autonomously controlled to move into a different configuration for outputting audio content in another audio mode, for example, a surround sound mode. Where the audio output device is provided in a vehicle interior, such as internal speakers in a car, the vehicle may be instructed to, while playing the audio content, open the door and/or window.

Claims

1. A method for presenting audio content in an audio output mode, comprising: determining respective desired locations for a plurality of audio output devices based on the audio output mode, wherein the plurality of audio output devices are located in respective vehicles; transmitting, to each of said vehicles, an instruction for moving the vehicle to the respective location; determining, based on the audio output mode, one or more audio settings for output of the audio content by respective ones of the plurality of audio output devices; and transmitting, to each vehicle of the plurality of vehicles, an instruction to play audio content through the audio output device located in the respective vehicle based on the determined settings.

2. The method of claim 1, wherein the instruction includes an instruction to move the respective vehicle into a particular orientation.

3. The method of claim 1, further comprising transmitting, to at least one vehicle in the plurality of vehicles, an instruction to, when playing the audio content, open at least one of a door, window, or roof of the vehicle.

4. The method of claim 1, wherein the instruction to play the audio content includes respective settings for multiple audio output devices in one of the vehicles.

5. The method of claim 1, further comprising: transmitting, to a display device, an instruction to display a video component of a multimedia asset; wherein the audio content is an audio component of the multimedia asset.

6. The method of claim 1, further comprising: receiving location information from a first one of the vehicles, wherein the location information indicates the location of the first vehicle relative to a user and/or another vehicle of the plurality of vehicles; determining an updated location for the audio output device in the first vehicle based on the received location information; and transmitting, to the first vehicle, an instruction to move to the updated location.

7. The method of claim 1, further comprising: determining updated locations for the plurality of audio output devices based on a different audio mode; and transmitting, to at least one of the vehicles, an instruction to move to the updated location.

8. A non-transitory computer-readable medium on which is stored computer-readable instructions comprising: an instruction to determine respective locations for a plurality of audio output devices based on the audio output mode, wherein the plurality of audio output devices are located in respective vehicles; an instruction to transmit, to each of said vehicles, an instruction for moving the vehicle to the respective location; an instruction to determine, based on the audio output mode, one or more audio settings for output of the audio content by respective ones of the plurality of audio output devices; and an instruction to transmit, to each vehicle of the plurality of vehicles, an instruction to play audio content through the audio output device located in the respective vehicle based on the determined settings.

9. A device for presenting audio content in an audio output mode, comprising: control circuitry configured to: determine respective desired locations for a plurality of audio output devices based on the audio output mode, wherein the plurality of audio output devices are located in respective vehicles; transmit, to each of said vehicles, an instruction for moving the vehicle to the respective location; determine, based on the audio output mode, one or more audio settings for output of the audio content by respective ones of the plurality of audio output devices; and transmit, to each vehicle of the plurality of vehicles, an instruction to play audio content through the audio output device located in the respective vehicle based on the determined settings.

10. The device of claim 9, wherein the control circuitry is configured to include, in the instruction to move the vehicle, an orientation of the respective vehicle.

11. The device of claim 9, wherein the control circuitry is further configured to transmit, to at least one vehicle in the plurality of vehicles, an instruction to, when playing the audio content, open at least one of a door, window or roof of the vehicle.

12. The device of claim 9, wherein the control circuitry is further configured to include, in the instruction to play the audio content, respective settings for multiple audio output devices in one of the vehicles.

13. The device of claim 9, wherein the control circuitry is further configured to transmit, to a display device, an instruction to display a video component of a multimedia asset, wherein the audio content is an audio component of the multimedia asset.

14. The device of claim 9, wherein the control circuitry is further configured to: receive location information from a first one of the vehicles, wherein the location information indicates the location of the first vehicle relative to a user and/or another vehicle of the plurality of vehicles; determine an updated location for the audio output device in the first vehicle based on the received location information; and transmit, to the first vehicle, an instruction to move to the updated location.

15. The device of claim 9, wherein the control circuitry is further configured to: determine updated locations for the plurality of audio output devices based on a different audio mode; and transmit, to at least one of the vehicles, an instruction to move to the updated location.

16. The device of claim 9, in the form of a smartphone, tablet, or laptop computer.

17. A vehicle comprising the device of claim 9.

18. A system comprising: the device of claim 9; and said plurality of vehicles.

19. The system of claim 18, wherein each of the plurality of vehicles includes control circuitry configured to: receive the instruction to move the vehicle to the respective location; and move the vehicle to the respective location using a driver assistance system.

20. The system of claim 19, wherein the control circuitry of each of the plurality of vehicles is further configured to: receive an instruction to open a door and/or a window while playing the audio content; and while playing the audio content, open said door and/or window.

Description

FIGURES

[0019] Examples will now be described by way of example only, with reference to the Figures, in which:

[0020] FIG. 1 depicts a system according to an example when operating in a first mode;

[0021] FIG. 2 depicts the system of FIG. 1 when operating in a second mode;

[0022] FIG. 3 depicts the system of FIG. 1 when operating in a third mode;

[0023] FIG. 4 depicts a system according to another example when operating in a fourth mode;

[0024] FIG. 5 is a block diagram of the system of FIG. 1;

[0025] FIG. 6 is a block diagram of a control system of a vehicle in the system of FIG. 1;

[0026] FIG. 7 is a block diagram showing further components of a vehicle in the system of FIG. 1;

[0027] FIG. 8 is a flowchart of a method performed by a master device in the system of FIG. 1;

[0028] FIG. 9 is a flowchart of a method performed by a slave device in the system of FIG. 1; and

[0029] FIG. 10 is a block diagram of a system according to yet another example.

DETAILED DESCRIPTION

[0030] FIG. 1 depicts a system 100 according to a first example, in which an audio component of a video displayed on a screen 102 for consumption by a group 104 of users.

[0031] Multiple speakers 106a-d are provided in respective vehicles 108a-d. In this particular example, the speakers 106a are mounted onto trucks 108a-d.

[0032] In FIG. 1, the audio component is output in a single channel mode. In this mode, multiple speakers 106a-d produce the same output, based on the same audio data.

[0033] FIG. 2 depicts the system of FIG. 1 when outputting audio in a stereo mode. In this example, two of the speakers 106a, 106b are assigned to a first channel (“left” channel, indicated in FIG. 2 by the label “L”), while the other two speakers 106c, 106d are assigned to a second, different channel (“right” channel, indicated in FIG. 2 by the label “R”). Although the audio data provided to the speakers 106a-d is the same, the output from the left channel speakers 106a, 106b differs slightly from the output of the right channel speakers 106c, 106d, to provide the group of users with stereo sound.

[0034] FIG. 3 depicts the system of FIG. 1 when outputting audio in a surround sound mode. In this example, each of the speakers is assigned a different channel. Speakers 106a, 106b are assigned to a “left rear” channel and a “left front” channel respectively, indicated in FIG. 3 by the labels “LR” and “LF”, while the speakers 106c, 106d are assigned to a “right rear” channel and a “right front” channel, indicated in FIG. 3 by the labels “RR” and “RF”, and each provide slightly different output to provide the surround sound effect.

[0035] In addition, vehicles 108b, 108c are in different positions relative to their positions in the single channel and stereo modes shown in FIGS. 1 and 2. In this manner, the system 100 can switch to or from the surround sound mode by changing the audio output from at least some of the speakers 106a-d and, depending on the mode, causing at least some of the vehicles 108a-d to move to another position. In particular, autonomous control is used to place the vehicles 108a-d in suitable positions relative to one another and/or relative to the group of users according to the audio output mode.

[0036] Although the system 100 shown in FIGS. 1-3 includes a display screen 102, in other examples, the speakers 106a-d may be used to provide audio content without video being presented on such a screen. For example, the speakers 106a-d may be used to output audio content that is streamed or broadcast, or obtained from an amplification system through which live music is being played. In addition, the system 100 may include other vehicles, e.g., drones, instead of, or in combination with, one or more of the trucks 106a-d. Furthermore, the invention is not limited to the specific audio output modes shown in FIGS. 1-3. Indeed, the system may be used to provide different audio output modes in addition to, or instead of, one or more of the modes described with reference to FIGS. 1-3.

[0037] FIG. 4 depicts an alternative system 400 using different vehicles 110a-110d, in which audio content is presented in yet another mode. In the “auditorium mode” depicted in FIG. 4, the vehicles 110a-d are cars that are positioned so that they surround the group of users 104. Each of the cars 110a-d contain one or more speakers 112a-d that are normally used for providing audio content to users located within the car. For example, the system shown in FIG. 4 includes a car 110a equipped with two speakers 112a, 112a′.

[0038] In a similar manner to that described above in relation to FIG. 3, the cars 110a-d can be controlled to move into a configuration for providing a desired audio output mode. Similarly, an auditorium mode may be provided using the system 100 of FIGS. 1-3 by controlling the trucks 106a-d into the respective ones of the positions of the cars 1 10a-d shown in FIG. 4.

[0039] Where a car 110a-d is equipped with multiple speakers, the audio output of each speaker 112a-d, 112a′ within the car 110a-d may be adjusted to provide further control over the audio output of the system 100. Additionally or alternatively, the doors and/or windows of each car 110a-d may be controlled to provide control over the audio output experienced by the group of users 104. For example, the door 114a and/or window 116a of car 110a may be opened to a particular extent, or closed, to change how the group of users 104 hears the output of the one or more speakers 112a, 112a′. Similarly, where a vehicle 108d is equipped with a roof 118d that can be opened, then the roof 118d may be controlled to open or close, partially or fully, to change how the group of users 104 hears the output of the speaker 112d.

[0040] FIG. 5 is a block diagram of the system 100 of FIG. 1. As shown in FIG. 5, each vehicle 108a-d has a control system 500a-d that includes a driver assistance system 502a-d that can autonomously control the movement of that vehicle 108a-d.

[0041] Driver assistance systems provide autonomous control of a vehicle, by controlling the speed and steering of a vehicle. Such systems are conventionally used to maneuver a vehicle to allow hands-off driving while avoiding obstacles, pedestrians, and other vehicles. Examples of driver assistance systems are disclosed in US 2015/0344027 A1, US 2016/0272201 A1, US 2016/0176397, US 9,238,467, US 9,463,806, and US 10,843,705, the disclosures of which are incorporated herein by reference. In the present example, the driver assistance systems 502a-d are used to position the vehicles 500a-d in a position and, optionally, in an orientation, to provide audio content in a particular audio output mode.

[0042] In this particular example, the control system 500d of one of the vehicles 108d acts as a master device that instructs the control systems 500a-d of the vehicles 108a-d to play audio content and cooperates with the driver assistance systems 502a-d to cause the vehicles 108a-d to move to a particular position and, optionally, adopt a particular orientation. In addition, the control system 500d, as the master device, may transmit the audio content to be played to the other vehicles 108a-d and/or may control the playing of content on the screen 102, where provided.

[0043] The control systems 500a-d can communicate with each other and, where provided, an external server and/or screen 102. The communication network 504 may be, or may include one or more of a BLUETOOTH network, a Wi-Fi network, a cellular communication network, a Local Area Network, a Wide Area Network and the Internet. Although multiple communication networks may be used, only one network 504 is shown in FIG. 5 to avoid complicating the drawing.

[0044] FIG. 6 is a block diagram of a control system 500d. The control system 500d includes control circuitry 602. The control circuitry includes a processor arrangement 604 and memory 606. The processor arrangement comprises one or more processors, such as microprocessors, for executing applications based on software stored in the memory 604. The control system 500d also includes memory 608 for storing other data, such as map data, driving history data, etc. The control system 500d also includes one or more input/output paths 610 for transmitting data to, and receiving data from, other components of the vehicle 108a. 610...?

[0045] FIG. 7 is a block diagram showing other components of the vehicle 108d with which the control system 500d may communicate via input/output path 608. The other components include an on-board transceiver 700 for transmitting and receiving data via the one or more communication networks 504, shown in FIG. 5, and speaker(s) 106a. The transceiver 700 may also receive location data, for example, Global Positioning System (GPS) data, from a GPS network and/or other data via the Internet.

[0046] The transceiver 700 may also receive location information from the other vehicles 108b-d, for example, via a BLUETOOTH or Wi-Fi connection. Such location information may be used to determine an updated location for the vehicle 108d based on the locations of the other vehicles, in order to improve the effect of the audio output mode.

[0047] A display 704 may be provided for presenting map data, vehicle condition data, navigation instructions or other information to the driver. The display may be a touch-screen display that can receive instructions from a user. For example, Where the control system 500d is used to instruct the vehicles 108a-d to move to locations based on the audio output mode, the display 704 may be used to receive user input indicating audio content to be played and the audio output mode to be used when playing that audio content.

[0048] The vehicle 108d also includes vehicle control actuators 702 that are used to move and steer the vehicle 108d based on instructions received from the driver assistance system 502a. One or more sensors 706 may provide data to the control system for use in driver assistance. For example, the one or more sensors 706 may include cameras to capture images of areas in front of and/or behind the vehicle for use in detecting obstructions and hazards. When maneuvering the vehicle 108d into a desired location for audio output, the sensors may be used to determine a position of the vehicle 108d relative to the group of users 104 and/or one or more of the other vehicles 108a-c. The relative position may then be used to update the instruction by adjusting the desired location and/or orientation of the vehicle 108d, for example, to assist in achieving the desired effect of the audio output mode at the location of the group of users 104.

[0049] FIG. 8 is a flowchart of a method that may be performed by the control system 500d of vehicle 108d which, in this example, is acting as a master device with respect to vehicles 108a-c.

[0050] Starting at 800, the control circuitry 602 transmits a message to the control systems 500a-c of the other vehicles 108a-c, inviting them to join a session for outputting audio content. The join message may be sent in response to receiving a command, for example, received via display 704, identifying one or more vehicles 108a-d with audio output devices to be used for playing audio content.

[0051] A desired audio output mode is determined (step 802). The audio output mode may be identified in a command received from the user. Alternatively, the audio output mode may be determined based on a type of audio content, e.g., spoken work, music, audio component of a specific multimedia content item. In another example, the audio output mode may be determined based on the identified vehicles 108a-d. For instance, if only two vehicles 108a, 108d are to be used to output audio, then either a stereo output mode may be selected. If four or more vehicles are to be used, then a surround sound mode may be selected.

[0052] If the audio output mode is not a single channel mode (step 806), then the control circuitry 602 assigns a channel to each of the identified vehicles 108a-d (step 808). If, instead, the audio output mode is a single channel mode (step 806), then each of the vehicles 108a-d will output the audio content with the same settings, regardless of their location.

[0053] Desired locations of the vehicles 108a-d are then determined (step 810), based on the audio output mode and instructions are transmitted to move the vehicles 108a-d to those locations (step 812). For example, to use the configuration shown in FIG. 2, a left channel in a stereo output mode is assigned to two vehicles 108a, 108b, while a right channel is assigned to two other vehicles 108c, 108d, and the vehicles 108a, 108b, 108c, 108d are instructed to move into locations based on those assigned channels, and based on the location of the screen 102 and/or group of users 104. In another example, using the surround sound mode configuration shown in FIG. 3, the vehicles 108a-108d are assigned LF, LR, RR and RF channels respectively and instructed to move into the respective locations relative to the screen 102 and/or group of users 104.

[0054] The location may be indicated in the instruction as a geographical location, for example, using GPS data. Alternatively, or additionally, a location may be indicated to one of the vehicles 108a as a location relative to one or more of the other vehicles 108b-d, in which case the driver assistance system of vehicle 108a may use output from sensors 706 and/or communications received from the other vehicles 108b-d to move the vehicle 108a to the location.

[0055] The desired location determined at step 810 may include an orientation for the vehicle, in which case the instruction transmitted at step 812 may also include the determined orientation.

[0056] In some examples, if it is determined that the selected mode is a single channel mode (step 806) then steps 810, 812 may, optionally, be omitted. Alternatively, as shown in FIG. 8, the vehicles 108a-d may be instructed to move to particular locations even if the audio output mode is a single channel mode, for example, to ensure that the vehicles 108a-d are within a certain distance of each other and/or the group of users 104, so that the audio content is not output at an excessive volume.

[0057] When it is determined that the vehicles 108a-108d are in the desired locations, or if steps 810 and 812 have been omitted, then the audio content and an instruction to play the audio content are transmitted to the vehicles (step 814). For example, the control circuitry 602 may upload the audio content to the control systems 500a-c of the other vehicles 108a-c via the communication network 504. Alternatively, the control circuitry 602 may stream the audio content to the other vehicles 108a-c over the communication network 504.

[0058] The audio content transmitted to the vehicles 108a-d may be identical, or may differ depending on the audio mode and, in multi-channel modes, on the channel assigned to the vehicles 108a-d. For example, in the surround sound mode, the audio content provided to vehicle 108b (left forward channel) may differ from the audio content provided to vehicles 108c, 108d (right rear and forward channels respectively).

[0059] The play instruction may include audio settings for the audio output devices 106a-d, such as volume, equalization settings and so on. In another example, such settings may be transmitted separately from the play instruction.

[0060] Where a particular vehicle 108a includes multiple speakers, such as speakers 112a, 112a′ in vehicle 110a of FIG. 4, then the play instruction may include different settings for the respective speakers 112a, 112a′.

[0061] Where one or more of the audio output devices are inside the vehicles, such as the speakers 112a-d inside the cars 1 10a-d of FIG. 4, then an instruction to, while playing the audio content, open a door 114a and/or a window 116a may be transmitted to a vehicle 110a. That instruction may be included in either of the instructions transmitted in steps 812 and 814 or transmitted as a separate instruction.

[0062] When the audio content has been played, the process ends (step 816). In other examples, however, further instructions may be transmitted to the vehicles after step 814, for example, to adjust the audio settings of the audio output device 106a, to open/close a door or window, to change the orientation of the vehicle or to move to another position, for example, when the system 100 is switched to a different audio mode.

[0063] FIG. 9 is a flowchart of a method that may be performed by at least one of the vehicles 108a, 108b, 108c when responding to instructions received from a master device such as the control system 500d of vehicle 108d.

[0064] Starting at 900, the control circuitry of the control system 500a responds to the join message sent by the control system 500d (step 902).

[0065] The control circuitry of the control system 500a then receives the instruction to move to a desired location (step 902). The driver assistance system 502a then uses the vehicle actuators 702 to move the vehicle 108a to the location indicated in the instruction and, if instructed to do so, into a desired orientation. As discussed above in relation to step 812 of FIG. 8, the location may be indicated in the instruction as a location relative to one or more of the other vehicles 108b-d, an intended location for the group of users 104, or the screen 102, and/or as a geographical location. The driver assistance system 502a may thus use any one or more of GPS data, output from the sensors 706, and data received from the other vehicles 108a-c or screen 102 when moving to the location.

[0066] If further instructions are received (step 908), then the control system 500a responds accordingly (step 906). For example, an instruction to move to an updated location may be received from the control system 500d, to accommodate divergences between the other vehicles 108b-d and their intended locations and/or to change audio mode. Such a further instruction may specify an orientation for the vehicle 108a, as discussed above in relation to step 904, in which case the driver assistance system 502a is used to reposition the vehicle 108a with the requested orientation. The further instruction may be an instruction to open a door and/or a window of the vehicle while playing the audio content, in which case the control system 500a responds by opening the specified door and/or window.

[0067] At step 910, the control system 500a begins receiving the audio content from the control system 500d with an instruction to play the audio content. As discussed in relation to step 814 of FIG. 8, the play instruction may include audio settings such as volume, equalization settings, and so on. Where a vehicle 110a includes multiple speakers 112a, 112a′, then the play instruction may include different settings for the respective speakers 112a, 112a′. The audio content may be uploaded or streamed from the control system 500d.

[0068] The control system 500a then plays the audio content in accordance with the play instruction (step 912).

[0069] FIG. 9 shows the process 900 ending at step 914. However, in other examples, further instructions may be received after playing of the audio content has begun at step 912. Such instructions may be instructions to adjust the audio settings of the audio output device 106a, to open/close a door or window, to change the orientation of the vehicle or to move to another position, for example, when the system 100 is switched to a different audio mode.

[0070] FIG. 10 is a block diagram of the system 1000 according to another example. The system 1000 of FIG. 10 differs from the system 500 of FIG. 5 through the provision of a separate master device 1002 that is external to the vehicles 108a-d. For example, the master device 1002 may be part of the screen 102, a separate server or a user equipment device, such as a smartphone, tablet or laptop computer, executing an application for playing audio and/or video content.

[0071] The master device 1002 includes components corresponding to the control circuitry 602, processing arrangement 604, memory 606 and input/output path 608 as shown in FIG. 6 but, unlike the control system 500a, does not include a driver assistance system. In this particular example, the control circuitry 602 of the master device 1002 is arranged to perform the method shown in FIG. 8.

[0072] In this example, the master device 1002 can communicate with the control systems 500a-d of the vehicles 108a-d and, optionally, with a screen 102, via the one or more communication networks 504. In this manner, the master device 1002 can control the output of content through the speakers 106a-d and, where provided, the screen 102, and control the movement of the vehicles 108a-d to provide audio output in a desired mode. The master device 1002 may also provide the audio content to be played to the vehicles 108a-d, for example, by transmitting it via the communication network 502.

[0073] It will be understood that the invention is not limited to the examples described above and various modifications and improvements can be made without departing from the concepts described herein. Except where mutually exclusive, any of the features may be employed separately or in combination with any other features and the disclosure extends to and includes all combinations and sub-combinations of one or more features described herein.