A drowsiness sign notification system applied to a vehicle includes a driver monitor and a controller. The driver monitor detects a driver state being a state of a driver of the vehicle. The controller executes a drowsiness sign determination process that determines whether or not the driver shows a drowsiness sign based on the driver state. When it is determined that the driver shows the drowsiness sign, the controller executes a first drowsiness sign notification process that gives a first drowsiness sign notice to the driver through display or vibration without using audio. When it is determined again that the driver shows the drowsiness sign after the first drowsiness sign notification process, the controller executes a second drowsiness sign notification process that gives a second drowsiness sign notice to the driver through audio.

A car seat includes an actuator capable of changing an orientation of a rest surface of a seat back laterally by turning and moving at least a side portion frame that is part of the car seat frontward and rearward, and a controller configured to exercise control over the actuator. The controller includes a run-time posture support unit configured to execute a run-time posture support control under which when a car makes a turn, the actuator is regulated to cause the rest surface of the seat back to be oriented in a direction of the turn. The run-time posture support unit is configured to regulate the actuator in accordance with a placement of the seat in the car, when the run-time posture support unit executes the run-time posture support control.

State information can be determined for a subject that is robust to different inputs or conditions. For drowsiness, facial landmarks can be determined from captured image data and used to determine a set of blink parameters. These parameters can be used, such as with a temporal network, to estimate a state (e.g., drowsiness) of the subject. To improve robustness, an eye state determination network can determine eye state from the image data, without reliance on intermediate landmarks, that can be used, such as with another temporal network, to estimate the state of the subject. A weighted combination of these values can be used to determine an overall state of the subject. To improve accuracy, individual behavior patterns and context information can be utilized to account for variations in the data due to subject variation or current context rather than changes in state.

An object of the present invention is to more appropriately extrapolate a sign of a state that may affect a movement of a user. A state extrapolation device according to the present invention includes a vital sign acquisition unit that acquires a vital sign of a user, and a sign detection unit that uses a learned model that has learned, as training data, sign data about the vital sign related to a predetermined physical condition abnormality, and detects a sign by determining whether or not the vital sign of the user corresponds to a sign of the predetermined physical condition abnormality.

Systems and methods for testing driver awareness within a vehicle are disclosed herein. In an embodiment, the system includes an audio device, a memory, and a controller. The audio device is configured to output audible sentences to a driver of the vehicle and receive audible responses from the driver. The memory stores a plurality of dialog trees, each dialogue tree triggering a plurality of audible sentences. The controller is programmed to (i) cause the audio device to output a first audible sentence to the driver, (ii) receive response data relating to a first audible response provided by the driver to the audio device, (iii) select a dialogue tree of the plurality of dialogue trees based on the response data, and (iv) cause the audio device to output a plurality of second audible sentences from the selected dialogue tree.

An embodiment method of providing a mobility sharing service includes generating initial control information of a shared mobility in correspondence with an identified user, monitoring driving environment information, generating a driving environment change event based on the driving environment information, and generating control information of the shared mobility based on the driving environment change event.

Systems and methods are provided for intelligent driving monitoring systems, advanced driver assistance systems and autonomous driving systems, and providing alerts to the driver of a vehicle, based on anomalies detected between driver behavior and environment captured by the outward facing camera. Various aspects of the driver, which may include his direction of sight, point of focus, posture, gaze, is determined by image processing of the upper visible body of the driver, by a driver facing camera in the vehicle. Other aspects of environment around the vehicle captured by the multitude of cameras in the vehicle are used to correlate driver behavior and actions with what is happening outside to detect and warn on anomalies, prevent accidents, provide feedback to the driver, and in general provide a safer driver experience.

Techniques are described for cognitive analysis for directed control transfer for autonomous vehicles. In-vehicle sensors are used to collect cognitive state data for an individual within a vehicle which has an autonomous mode of operation. The cognitive state data includes infrared, facial, audio, or biosensor data. One or more processors analyze the cognitive state data collected from the individual to produce cognitive state information. The cognitive state information includes a subset or summary of cognitive state data, or an analysis of the cognitive state data. The individual is scored based on the cognitive state information to produce a cognitive scoring metric. A state of operation is determined for the vehicle. A condition of the individual is evaluated based on the cognitive scoring metric. Control is transferred between the vehicle and the individual based on the state of operation of the vehicle and the condition of the individual.

An awakening degree detecting device outputs awakening degree information corresponding to an awakening degree of a driver of a vehicle. A stimulus providing device provides the driver with a stimulus including at least one of a visual stimulus, an audible stimulus, an electrical stimulus, a warm stimulus, a cold stimulus, and an action-inducing stimulus prompting an action of the occupant with respect to an appliance installed in the vehicle. A control device outputs, based on the awakening degree information, a first control signal causing the stimulus providing device to provide the stimulus in a case where the awakening degree is less than a first threshold, and to output a second control signal causing the stimulus providing device to provide the stimulus after the first control signal is outputted.

A vehicle may include: a feedback device; a bio-signal sensor configured to measure a bio-signal of a user; and a controller operatively coupled to the feedback device and the bio-signal sensor, the controller including a memory configured to store at least one program instruction and processor configured to execute the at least one program instruction. The controller may be configured to: determine information characterizing a current emotional state of the user based on the bio-signal; calculate, based on a difference value between the current emotional state and a target emotional state, an operation ratio between a first mode for controlling operation of the feedback device to decrease a degree of excitability of the user and a second mode for controlling the operation of the feedback device to increase a degree of positivity of the user; and control the operation of the feedback device for a predetermined time based on the operation ratio.