Bi-Directional Autonomous Vehicle
20190146494 ยท 2019-05-16
Inventors
Cpc classification
B62D63/00
PERFORMING OPERATIONS; TRANSPORTING
B60N2/01
PERFORMING OPERATIONS; TRANSPORTING
B60N2/0028
PERFORMING OPERATIONS; TRANSPORTING
International classification
Abstract
System and method for bi-directional autonomous vehicle. In one aspect, a vehicle's forward direction and front end are determined by a user's command or sitting orientation. In another aspect, a vehicle's forward direction and front end are determined by a user's records or prearrangements. Moreover, a vehicle's shape is adjustable according to front end selection.
Claims
1. A method performed for operating a bi-directional autonomous vehicle, comprising: 1) monitoring a user after the user gets in the autonomous vehicle; 2) ascertaining whether the user takes a seat; 3) detecting the user's sitting orientation; 4) determine the autonomous vehicle's forward direction and front end based on the user's sitting orientation; and 5) starting driving the autonomous vehicle.
2. The method according to claim 1, further including determining the autonomous vehicle's forward direction and front end based on the user's voice and/or gesture instructions.
3. The method according to claim 1, further including determining the autonomous vehicle's forward direction and front end based on destination info.
4. The method according to claim 1, further including determining the autonomous vehicle's forward direction and front end based on road conditions.
5. The method according to claim 1, further including changing exterior shape of the autonomous vehicle based on forward direction and front end selection.
6. The method according to claim 1, further including determining the autonomous vehicle's forward direction and front end based on sitting orientation of a specific user.
7. The method according to claim 1, further including determining the autonomous vehicle's forward direction and front end based on instructions given by a specific user.
8. A method performed for operating a bi-directional autonomous vehicle, comprising: 1) monitoring a user after the user gets in the autonomous vehicle; 2) ascertaining whether the user gives any voice and/or gesture instructions; 3) collecting and analyzing the user's voice and/or gesture instructions; 4) determine the autonomous vehicle's forward direction and front end based on the user's voice and/or gesture instructions; and 5) starting driving the autonomous vehicle.
9. The method according to claim 8, further including determining the autonomous vehicle's forward direction and front end based on the user's sitting orientation.
10. The method according to claim 8, further including determining the autonomous vehicle's forward direction and front end based on destination info.
11. The method according to claim 8, further including determining the autonomous vehicle's forward direction and front end based on road conditions.
12. The method according to claim 8, further including changing exterior shape of the autonomous vehicle based on forward direction and front end selection.
13. The method according to claim 8, further including determining the autonomous vehicle's forward direction and front end based on sitting orientation of a specific user.
14. The method according to claim 8, further including determining the autonomous vehicle's forward direction and front end based on instructions given by a specific user.
15. A method performed for operating a bi-directional autonomous vehicle, comprising: 1) monitoring a user after the user gets in the autonomous vehicle; 2) sending the user's info to a remote facility, 3) receiving information on the user from the remote facility, wherein the information includes the user's records and/or prearrangements; 4) determine the autonomous vehicle's forward direction and front end based on the information; and 5) starting driving the autonomous vehicle.
16. The method according to claim 15, further including determining the autonomous vehicle's forward direction and front end based on the user's sitting orientation.
17. The method according to claim 15, further including determining the autonomous vehicle's forward direction and front end based on the user's voice and/or gesture instructions.
18. The method according to claim 15, further including determining the autonomous vehicle's forward direction and front end based on destination and/or road conditions.
19. The method according to claim 15, further including changing exterior shape of the autonomous vehicle based on forward direction and front end selection.
20. The method according to claim 15, further including determining the autonomous vehicle's forward direction and front end based on sitting orientation or command of a specific user.
Description
DRAWING FIGURES
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
TABLE-US-00001 REFERENCE NUMERALS IN DRAWINGS 10 Processor 12 Computer Readable Medium 14 Communication Network 16 Server 18 Bi-Directional Vehicle 20 Processing Module 22 Database 24 Control System 26 Speed Control Module 28 Steering Module 30 Braking Module 32 Bi-Directional Vehicle 34 Driving System 36 Bi-Directional Vehicle 38 Bi-Directional Vehicle 40 Bi-Directional Vehicle 42 Object 44 Object 46 Flexible Sheet 48 Seat 50 Seat 100-128 are exemplary steps.
DETAILED DESCRIPTION
[0022] The following exemplary embodiments are provided for complete disclosure of the present invention and to fully inform the scope of the present invention to those skilled in the art, and the present invention is not limited to the schematic embodiments disclosed, but can be implemented in various types.
[0023]
[0024] In addition, system 24 may have a display (not shown in the figure for brevity reason) and a graphical user interface (GUI). The display may have a liquid crystal display (LCD) screen or light emitting diode (LED) screen and may be arranged sensitive to touches, i.e., sensitive to haptic and/or tactile contact with a user. The display may serve as the main display of system 24 and the interface may be used to show vehicle status, driving conditions, current driving route, and certain options. A user may use the interface to search and retrieve information, view surrounding area maps, enter input or instructions, interact with system 24, and so on.
[0025] Driving system 34 comprises modules 26, 28, and 30 for implementing driving maneuvers which are determined by system 24. Speed control module 26 is configured to regulate the driving force or speed of vehicle 18. For a gasoline or diesel powered vehicle with an internal combustion engine, module 26 contains a throttling system which controls the speed of the engine which in turn determines the speed of the vehicle via a transmission system. For an electric vehicle, module 26 may contain a driver system to control the speed of an electric motor. The motor speed determines the vehicle speed. Steering module 28 is arranged to control the steering torque which then adjusts the heading of the vehicle. Braking module 30 is designed to use a hydraulic brake system to decelerate the vehicle.
[0026] In practice, an electric autonomous vehicle may be favored for bi-directional driving. First, an electric motor can rotate in opposite directions and needs just one gear. An internal combustion engine, however, only rotates in one direction, and thus needs both forward gear and reverse gear. For instance, a conventional gasoline powered vehicle may have multiple forward gears and a single reverse gear. The single reverse gear limits the vehicle to low backward speeds. Second, a bi-directional automobile may be steered using front wheels when driving along one direction and using rear wheels when driving along the opposite direction. It may become an issue since many users may find it hard to control when rear wheels are used to maneuver a vehicle. The control difficulties may be resolved by fine-tuned programs in autonomous mode. Therefore, an electric autonomous vehicle may be preferred when bi-directional driving is implemented.
[0027] Many autonomous vehicles are likely owned, serviced, and managed by business entities. Assume that vehicle 18 is administered by Service Center and server 16 is installed at Service Center. The word server means a system or systems which may have similar functions and capacities as one or more servers. Main components of a server may include one or more processors, which control and process data and information by executing software, logic, code, or carrying out any other suitable functions. Server 16 may be divided exemplarily into two blocks, represented by a processing module 20 and a database 22. Processing module 20 may include processing and communication functions. Database 22 may store vehicle service records and information, map data and geographic info of certain areas, user account information, user transaction records, user activity records, etc. The database may include a cluster of aforementioned and other memory chips and/or storage modules.
[0028] Vehicle 18 may include multiple sensors (Not shown in the figure) to detect the external environment that surrounds the vehicle and users inside. The sensors may include multiple cameras, a radar system, a light detection and ranging (LIDAR) system, a GPS device, a speed sensor, an accelerometer, an electronic compass, a suspension sensor, etc. Some cameras may be located on or exposed to the exterior of the vehicle. These cameras may be used to take images and videos of the surroundings to detect and recognize road signs, road marks, pedestrians, obstacles, other vehicles, buildings, land marks, etc. Some other cameras may be arranged inside the vehicle to sense a user or occupant, like whether a user has settled down after getting in the vehicle. The radar and LIDAR systems may detect the surroundings and create a three-dimensional image which is advantageous over two-dimensional images generated by cameras. Three-dimensional images are especially useful to sense and recognize pedestrians and other vehicles. The GPS device provides the present location of vehicle 18. GPS data may be combined with info acquired by cameras, radar and LIDAR to obtain a precise location of the vehicle.
[0029] Furthermore, vehicle 18 may have a voice recognition system to receive and interpret a user's voice command or vocal input. The system may employ multiple microphones which may be configured at several places inside the vehicle. Arrangement of the microphones may be optimized for efficient collection of voice input. Vehicle 18 may also have a gesture detection sensor to sense a user's gesture instructions. In addition, vehicle 18 may contain a facial recognition system which may recognize the identity or certain features of a user. Both the gesture sensor and the facial recognition system rely on pictures and/or videos captured by cameras installed inside the vehicle. It is noted that voice, gesture, and facial recognition technologies are all mature nowadays.
[0030]
[0031]
[0032] In
[0033] In
[0034] When vehicle 36 drives to the right direction at the next moment, the control system may adjust both ends' exterior shape. Results after the adjustment are shown in
[0035] Like a conventional automobile, an autonomous vehicle designed for personal use may have two rows of seats due to a small interior space. Since there is no driver and no steering wheel, the front seats may face backward and the two rows may be in a face-to-face configuration, as shown exemplarily in
[0036] Inside an autonomous vehicle, face-to-face seats may be identical. On the other hand, the seats may also be designed different to provide multiple options to a user. The seats may have different styles, structures, finish, or functions. For instance, both velvet and leather seats may be arranged in a vehicle. Some seats may have massaging functions and some may provide virtual reality (VR) or augmented reality (AR) goggles. Whether the seats are identical or not, a user may have a preference and may take a seat of choice after getting in a vehicle. For instance in
[0037] Assume that destination info is known. After the control system determines via algorithm that the user has settled down on seat 48, it may decide which direction it should drive along. As many users may favor facing the driving direction, the control system may be configured to decide the left direction should be the forward direction. So the left side becomes the front end and the right side becomes the rear end. In summary, a bi-directional vehicle may determine which direction should be the forward direction based upon a user's sitting orientation. When measurement data indicates a user faces a direction, the direction may be chosen as the forward direction. Thus a user may take any seat in a bi-directional vehicle and always face a forward direction.
[0038]
[0039] In
[0040] Besides a user's sitting orientation, a bi-directional vehicle's forward direction may also be determined by other factors.
[0041] At step 104, the user may say a word or sentence as a voice command with or without a gesture. The user may also make gestures without saying anything. For instance, the user may say Go that way and then use hand and fingers to point to a direction. The user may say Go forward or Go ahead too, meaning to go along a direction the user faces. The user may also gesture without saying a word, like using a finger to point at a direction. The user's voice input may be sensed by a microphone and interpreted by a voice recognition system. The user's gesture may be recorded as pictures and videos by one or more cameras and analyzed by a gesture recognition system. The interpreted voice and gesture messages may be sent to the control system. The control system may analyze the messages to identify a direction which the user selects. Then that direction is chosen as the forward direction and the front side of the vehicle along the selected direction becomes the front end. Alternatively, the user may also say Front, Forward, or Front end while pointing to one side of the vehicle.
[0042] At step 106, sitting orientation of the user is employed to decide a forward direction and front end. As aforementioned, many users may prefer facing a forward direction. Thus if it is detected that a user or multiple users all face one direction after taking a seat in a vehicle, the direction may be chosen as the forward direction. It is noted that a user may select one end as the front end regardless of road or parking lot conditions. For instance, assume a vehicle is parked with one end against a wall. A user may still choose the end as front end. Then the vehicle may drive out of the parking spot first and then change driving direction to make the selected end as the front end.
[0043] When user instructions are not detected and there are users sitting face to face or facing opposite directions, the control system may determine a forward direction based upon destination and road conditions as shown at step 108. For instance, if a destination is located in the left direction, that direction may be selected as the forward direction. If the vehicle is parked at a one-way street, the allowable driving direction may be chosen as the forward direction. When a vehicle is at a parking spot with one end over against a barrier, the side facing the barrier may be considered as the rear end and the other side as the front end.
[0044] After a forward direction is determined, the control system may display a sign or symbol to show a user at step 110. The sign or symbol, such as a lighted arrow, may indicate which direction is the forward direction and assure the user before the vehicle moves. At step 112, the control system starts navigating the vehicle and begins a journey in autonomous mode.
[0045]
[0046] Assume that the control system can't decide which direction should be the forward direction based on information obtained from Service Center. At step 120, the system may detect whether the user gives any input. The system may monitor the user and collect any voice or gesture command after it is generated. If sensors at the vehicle detect that the user gives a voice or gesture command, the control system may use it to select a forward direction and front end. Then the process may proceed with step 126. It is noted that a user's voice or gesture command may overwrite a decision made at step 118. For instance, assume a user preselected a side as the front end during reservation. If the user points to the other side and says Front, the control system may follows instructions made on site and discard the prearrangement.
[0047] If the user doesn't give any instructions, the control system may determine the forward direction and front end based on the user's sitting orientation at step 122. As discussed in the above, since many users prefer facing a forward direction, the control system may detect which direction the user faces after taking a seat and then make that direction as the forward direction. Next the process may proceed with step 126.
[0048] If the control system can't decide the forward direction and front end at step 122, which may happen when there are multiple users in a vehicle and the users take face-to-face seats, the system may utilize destination info, parking conditions, and/or road conditions to do it at step 124. For instance, if a vehicle has one end facing a destination, the end may be chosen as the front end. If a vehicle sits at a parking space with one end facing a curb, the other end may be selected as the front end, which enables the vehicle to head for a destination without stopping and then changing driving direction. It makes a journey smoother and more efficient.
[0049] At step 126, one or more signs showing the selected forward direction may be displayed inside the vehicle. One or more signs may also be displayed on the exterior of the vehicle to show its driving direction to pedestrians around it and users in other vehicles. The signs may comprise a LED system which may remain invisible and become a conspicuous arrow or moving arrows only after being lighted. Finally at step 128, the control system may start driving the vehicle autonomously.
CONCLUSION, RAMIFICATIONS, AND SCOPE
[0050] Thus it can be seen that systems and methods are introduced to select a forward direction and front end properly, which may improve user experience of bi-directional autonomous vehicles.
[0051] The improved systems and methods have the following main features and advantages: [0052] (1) A vehicle's forward direction and front end may be determined by a user's voice and gesture instructions; [0053] (2) A vehicle's forward direction and front end may be determined by a user's past records or prearrangements; [0054] (3) A vehicle's forward direction and front end may be determined by a user's sitting orientation; [0055] (4) A vehicle's forward direction and front end may be determined by destination info and/or road conditions; and [0056] (5) A vehicle's exterior shape may be adjustable according to front end selection.
[0057] Although the description above contains many specificities, these should not be construed as limiting the scope of the invention but as merely providing illustrations of some of the presently preferred embodiments. Numerous modifications will be obvious to those skilled in the art.
Ramifications:
[0058] In
[0059] A control system of a bi-directional vehicle may also take an order to change front end during a journey. Cameras and microphones may be arranged to monitor a user inside a vehicle continuously. Once a user says Switch front end in the middle of a trip, for example, the command may be received by microphones and translated by a voice recognition system. Then the message is sent to the control system, which in turn calculates a route segment. The vehicle may take the route segment, stop at an appropriate place, and then drive with the opposite side as the front end. Thus, front and rear ends may be switched at any time when road conditions are suitable. The change may benefit users who don't like to move to another seat but want to face the opposite direction during a journey.
[0060] As aforementioned, after a check-in process is over, a vehicle's control system may ascertain a user's sitting orientation to decide which direction should be the forward direction and which side should be the front end. In some cases the control system may detect that there are multiple users sitting in a face-to-face configuration. Then the system may not be able to use sitting orientation to do it anymore. The dilemma may be overcome with a facial recognition method. It may be designed that after multiple users enter a vehicle, the users may be observed by a facial recognition system. The recognition system may recognize each user's identity or estimate the age of the users via facial features. Then the vehicle's control system may use age info to label a user, for instance, as child, adult, or senior citizen.
[0061] As used herein, word child may mean a minor, for instance, a person below the age of eighteen. Word adult may mean a young or middle-aged adult. Adult may include a senior citizen when senior citizen is not mentioned. Certain rules may be made based on the age info. For instance, when a child and an adult sit face to face, the control system may decide a front end based on the adult's sitting orientation. When an adult and a senior citizen are face to face, the senior citizen's position prevails and may be used for front end determination. The rule applies to child versus senior citizen scenario too. Thus, a decision may be made based on sitting orientation of a specific user. The decision, however, may be voided by a user's voice or gesture command. For instance, a user may submit voice and/or gesture instructions anytime to overwrite a decision made by the control system based on sitting orientation or other factors.
[0062] Furthermore, a vehicle's control system may monitor multiple users' voice and gestures at the same time. Any input detected may be analyzed to find out whether it contains any user command. When a user gives a voice and/or gesture command, the control system may obey the order and perform a task accordingly. But when there are multiple users, a control system may receive contradictory orders from different users consecutively. For instance, a user may say Go this way while pointing to a direction. However, another user may say Go that way and point to the opposite direction within, for instance, two to five seconds after the first user finishes speaking. When the control system receives the orders, it may not be able to figure out which one it should follow. Thus, certain rules may be designed. Like discussed, the control system may estimate each user's age using data obtained from a facial recognition system. The users may be categorized, like aforementioned, as child, adult, and senior citizen. When voice orders are received from a child and an adult or senior citizen respectively, the adult's or senior citizen's order prevails. In addition, when contradictory voice orders are from multiple adults or senior citizens, the order which is submitted last prevails. Similarly, when multiple orders are all from children, the last one prevails.
[0063] The age of a user may also be estimated roughly using a voice recognition system. Everyone has his or her unique voice. Voice may be analyzed to identify a user or estimate a user's age roughly. In applications mentioned herein, a user's voice may be ascertained to find out whether the user is a child. The method may be especially effective when a target user is a small child. It provides another way to categorize a user as child or adult when facial recognition means is not available. Rules about selecting a user's order after receiving multiple orders may apply not only to autonomous vehicles, but also smart voice-controlled devices like smart speakers or intelligent speakers. Autonomous vehicles and certain smart devices may employ the same method, since they are all configured to implement a task based upon voice and/or gesture input from users.
[0064] After an autonomous vehicle or a smart device receives a voice order from a user, it doesn't act immediately. Instead, it may wait for a given time, like two to five seconds. If no other user input is detected within the given time, an order receiving process is concluded and the order may be carried out. If another order is received within the given time, the vehicle or device may identify users involved using a facial and/or voice recognition system. The main goal is to recognize whether a user is a child. If it is detected that one order is issued by a child while the other by an adult, the adult's order may prevail and be implemented. If the orders are from two children or two adults, the second order may prevail. When there are more than two orders, the last order may prevail if the users are all children or all adults. When there are multiple orders coming from children and multiple orders from adults, the last adult order may prevail. In addition, when a child's order is implemented, certain restrictions may apply. For instance, some preselected actions or tasks may become off limits. As used herein, word order may mean a request to do a task which a vehicle or device is configured to handle.
[0065] Assume that a name Speaker is assigned to a smart speaker. Speaker is also designed as a wake word. When it is detected that a user says Speaker, the speaker is arranged to treat voice and/or gesture input of the user or other users, which follows the wake word within a given time, as an order or orders it has to process. Assume that the speaker detects the following voice messages. User A said Speaker, turn on TV. Then within a given time interval, user B said No, don't turn on. Then within the given time interval after user B completes the sentence, user A said Yes, please turn on. When the speaker is collecting the voice input, it also estimates the age of the users. If it is detected that user A is a child and user B is an adult, user Bs order prevails and the speaker won't turn on the TV. If both are children or adults, the third or the last order prevails. The speaker may send a signal to turn on the TV. The example applies to an autonomous vehicle too.
[0066] Lastly, when a vehicle is parked beside a curb waiting for users, it may display signs to show that it is bi-directional. The signs may include two arrows pointing to opposite directions and an optional word Bi-Directional. The vehicle may have a symmetric shape or asymmetric shape with an adjustable appearance. The signs may be helpful for some users who like to ride on a bi-directional vehicle.
[0067] Therefore the scope of the invention should be determined by the appended claims and their legal equivalents, rather than by the examples given.