According to one aspect, driver management is provided. One or more speech segments of a driver of an autonomous vehicle may be recorded. A position, a destination, or a previous destination of a driver or an autonomous vehicle may be tracked. An estimated state of the driver may be determined based on one or more of the speech segments, the position, the destination, or the previous destination, and a calendar event associated with the driver or a passenger of the autonomous vehicle. Autonomous driving features may be automatically enabled, disabled, or operation of the autonomous vehicle may be enabled or disabled in different modes based on the estimated state of the driver. Additionally, notifications may be displayed, rideshare applications may be launched, or warnings may be sent based on the estimated state of the driver.

A navigation system includes a detector configured to detect a situation in a movable object, a determiner configured to determine a degree of activity of conversation in the movable object on the basis of a detection result by the detector, a movement plan setter configured to set a movement plan on the basis of setting information which is set by a user, and to change at least part of the set movement plan on the basis of a determination result by the determiner, and a navigator configured to navigate the movable object on the basis of the movement plan which is set or changed by the movement plan setter.

The present embodiments relate to selection and execution of one or more output actions relating to a modification of at least one feature of a vehicle. A series of sensors on a vehicle can acquire data that can be used to identify vehicle environment characteristics indicative of a status of a vehicle environment and an emotional state of the user. The vehicle environment characteristics and the emotional state can be processed using a user model that corresponds to a user to generate one or more selected output actions. The output actions can be executed on the vehicle to increase user experience. The output actions can relate to any of entertainment features, safety features, and/or comfort features of the vehicle.

A processor associated with a vehicle receives sensor data from a plurality of sensors associated with a vehicle, where each sensor generates data corresponding to a different parameter of a passenger in the vehicle. Based on the sensor data, one or more primitive emotional indications are generated. The processor applies a model to the one or more primitive emotional indications that when applied outputs a contextualized emotional indication associated with the passenger that includes an assessment of an emotional state of the passenger and a reason for the emotional state. A contextual response is selected based on the contextualized emotional indication, and the processor causes an output by the vehicle to enact the contextual response.

The present embodiments relate to selection and execution of one or more output actions relating to a modification of at least one feature of a vehicle using a user-specific profile model. A user-specific profile model associated with a user can be modified based on matching detected user characteristic data with any of a series of predetermined profile types. Vehicle environmental data can be processed using the user-specific profile model to generate an output action that modifies one or more vehicle features. The generated output action can be executed on the vehicle. The output actions can relate to any of entertainment features, safety features, and/or comfort features of the vehicle.

The present embodiments relate to selection and execution of one or more output actions relating to a modification of at least one feature of a vehicle. A series of sensors on a vehicle can acquire data that can be used to identify vehicle environment characteristics indicative of a status of a vehicle environment and an emotional state of the user. The vehicle environment characteristics and the emotional state can be processed using a user model that corresponds to a user to generate one or more selected output actions. The output actions can be executed on the vehicle to increase user experience. The output actions can relate to any of entertainment features, safety features, and/or comfort features of the vehicle.

A sensor fusion system associated with a vehicle includes a sensor interface communicatively coupled to a plurality of sensors in the vehicle and a vehicle experience system. The sensor interface comprises an input receiving data from each of the plurality of sensors and an output configured to output fused vehicle data based on the data received from the plurality of sensors. The vehicle experience system is coupled to the output of the sensors interface to receive the fused vehicle data. The vehicle experience system includes one or more processors and a non-transitory computer readable storage medium storing instructions that when executed by one or more processors cause the one or more processors to control at least one parameter of the vehicle based on the fused vehicle data.

Techniques are disclosed for utilizing passenger attention data captured in vehicles for vehicle localization and location-based services. In an embodiment, a method includes receiving sensor data from one or more sensors of an autonomous vehicle operating in an environment, and generating passenger attention data for a passenger of the autonomous vehicle using the sensor data. A processing circuit determines one or more physical features in the environment based on the passenger attention data. The processing circuit obtains physical feature data associated with the physical feature(s) and initiates one or more actions on the AV based at least in part on the physical feature data. The actions include but are not limited to requesting content for physical features(s) and assisting in localization of the autonomous vehicle.

A vehicle tracker (102) and a method for monitoring vehicle's activity are described. The vehicle tracker (102) has a connection port (216) which provides plug and play functionality. The vehicle tracker (102) further has a plurality of sensors (504) for sensing various parameters associated with the vehicle. The sensing results in generation of current parameter values (518) which are processed in relative to plurality of parameter threshold values (520). The parameter threshold values (520) define minimum and maximum range of the parameters. Based on the processing, the vehicle tracker (102) determines anomalies in the operation of the vehicle. Once the anomaly is detected, the vehicle tracker (102) generates an alert and sends it to the concerned person or user.

A feeling estimation device includes: a first acquirer configured to acquire sound data of an utterance of a user; a second acquirer configured to acquire text data obtained by converting the sound data acquired by the first acquirer into text; a first estimator configured to merge an index value based on the sound data acquired by the first acquirer and an index value based on the text data acquired by the second acquirer via first fusion and estimate a feeling of the user on the basis of the merged index value; and a second estimator configured to merge an index value indicating a result of the estimation performed by the first estimator and the index value based on the text data acquired by the second acquirer via second fusion and estimate a feeling of the user on the basis of the merged index value.