According to one aspect, driver management is provided. One or more speech segments of a driver of an autonomous vehicle may be recorded. A position, a destination, or a previous destination of a driver or an autonomous vehicle may be tracked. An estimated state of the driver may be determined based on one or more of the speech segments, the position, the destination, or the previous destination, and a calendar event associated with the driver or a passenger of the autonomous vehicle. Autonomous driving features may be automatically enabled, disabled, or operation of the autonomous vehicle may be enabled or disabled in different modes based on the estimated state of the driver. Additionally, notifications may be displayed, rideshare applications may be launched, or warnings may be sent based on the estimated state of the driver.

Method and apparatus are disclosed for accelerometer-based external sound monitoring for voice controlled autonomous parking. An example vehicle includes a body control module, an infotainment head unit, and an autonomy unit. The example body control module communicatively couples to a mobile device. The example infotainment head unit communicatively couples to an accelerometer mounted on a window of the vehicle. The example autonomy unit autonomously parks the vehicle in response to a first key word detected by the accelerometer when (i) a button is activated on the infotainment head unit and (ii) a message from the mobile device is being periodically received.

A context-based operation determination apparatus includes a context information obtainer configured to obtain context information; a context awareness database constructed using data related to a previously performed action; a processor configured to determine a recommendation index that corresponds to a recommended operation and the recommended operation using the context information, and data obtained from the context awareness database; and a selection history database constructed using the final operation, the recommendation index, and an actual operation in a state where the final operation is presented, where the processor verifies the recommended operation using the selection history database.

Systems and methods are provided for detecting an object in front of a vehicle. In one implementation, an object detecting system includes an image capture device configured to acquire a plurality of images of an area, a data interface, and a processing device programmed to compare a first image to a second image to determine displacement vectors between pixels. The processing device is also programmed to search for a region of coherent expansion that is a set of pixels in at least one of the first image and the second image, for which there exists a common focus of expansion and a common scale magnitude such that the set of pixels satisfy a relationship between pixel positions, displacement vectors, the common focus of expansion, and the common scale magnitude. The processing device is further programmed to identify presence of a substantially upright object based on the set of pixels.

A vehicular control system includes a forward viewing camera disposed at an in-cabin side of a windshield of a vehicle and viewing forward of the vehicle. Road curvature of a road along which the vehicle is traveling is determined responsive at least in part to processing by an image processor of image data captured by the camera. Responsive at least in part to processing of captured image data, a traffic lane of the road along which the vehicle is traveling is determined. Responsive at least in part to processing of captured image data, another vehicle present on the road and forward of the vehicle may be detected. Responsive at least in part to processing of captured image data, the system may determine that the detected other vehicle is travelling in a traffic lane to the left or to the right of the traffic lane along which the vehicle is traveling.

An autonomous vehicle including a sensor system that outputs a sensor signal indicative of a condition of the autonomous vehicle. The vehicle also includes a communication system including a speaker. Based upon a profile of the passenger, the autonomous vehicle can determine that support is to be provided audibly to the passenger when the support is provided to the passenger. Moreover, the autonomous vehicle can detect occurrence of an event that has been identified as potentially causing discomfort to the passenger based upon the sensor signal output by the sensor system. Responsive to detecting the occurrence of the event, and in accordance with the profile of the passenger, the autonomous vehicle can cause the speaker to output an audible support message. Content of the audible support message is based on the detected event, and the audible support message solicits feedback from the passenger of the autonomous vehicle.

The present disclosure is generally related to a data processing system to validate vehicular functions in a voice activated computer network environment. The data processing system can improve the efficiency of the network by discarding action data structures and requests that invalid prior to their transmission across the network. The system can invalidate requests by comparing attributes of a vehicular state to attributes of a request state.

Disclosed is a method for separating a speech based on artificial intelligence in a vehicle. The method includes separating a speech signal using at least one sound beam-forming or source separation; and performing a speech recognition function by detecting a speaker (user) of the separated signal, and accordingly, other users in the vehicle in addition to a driver may use the speech recognition function. A device and method for separating speech based on artificial intelligence in vehicle of the present disclosure can be associated with artificial intelligence modules, drones (unmanned aerial vehicles (UAVs)), robots, augmented reality (AR) devices, virtual reality (VR) devices, devices related to 5G service, etc.

The invention assists a person in acting in a dynamic environment. A method and a system for assisting a person operating an ego-vehicle a person supporting the operation of the ego-vehicle in a dynamic environment such as a traffic environment is proposed. The method encompasses determining a gaze direction of the person and identifying a target object based thereon, generating prediction information predicting a future behavior of the target object and the ego-vehicle, estimating a time-to-event or a distance or a distance variation for the ego-vehicle and the target object and generating a signal for driving an actuator and indicative of the estimated time-to-event, distance or distance variation. The actuator causes a stimulation being perceivable by the person by its perceptual capabilities based on the generated signal. The method determines whether assistance for assessing the dynamic situation is requested, for example by monitoring a gaze behavior of the person.

Method and apparatus are disclosed for speech recognition for vehicle voice commands. An example vehicle includes a microphone to collect a signal including a voice command, memory, and a controller. The controller is configured to determine an initial identification by feeding the signal into a first automatic speech recognition (ASR) engine and determine habits by feeding user history into a habits engine. The controller also is configured to identify the voice command by feeding the signal, the initial identification, and the habits into a second ASR engine. The controller also is configured to perform a vehicle function based on the voice command.