Implementations relate to interactions, over a wireless communication modality, between an automated assistant of an automobile computer system, and separate client device(s). In some of those implementations, the client device(s) can be paired with the automobile computer system, and the client device(s) and the automobile computer system can include separate instances of an automated assistant, which can be associated with different user accounts. In some additional or alternative implementations, particular actions to be performed by a local application of a client device can be advanced via user interaction with the automobile automated assistant, despite a counterpart to the local application not being installed directly on automobile computer system. For example, despite an automobile computer system not having a third-party messaging application installed, the automobile automated assistant can access requested actions to be performed by the third-party messaging application in order to further a requested action. The automobile computer system can transmit, via the wireless communication modality, content to cause the third-party application to further the requested action.

Implementations relate to interactions, over a wireless communication modality, between an automated assistant of an automobile computer system, and separate client device(s). In some of those implementations, the client device(s) can be paired with the automobile computer system, and the client device(s) and the automobile computer system can include separate instances of an automated assistant, which can be associated with different user accounts. In some additional or alternative implementations, particular actions to be performed by a local application of a client device can be advanced via user interaction with the automobile automated assistant, despite a counterpart to the local application not being installed directly on automobile computer system. For example, despite an automobile computer system not having a third-party messaging application installed, the automobile automated assistant can access requested actions to be performed by the third-party messaging application in order to further a requested action. The automobile computer system can transmit, via the wireless communication modality, content to cause the third-party application to further the requested action.

A method and system for diagnosing and communicating events associated with one or more components of vehicle is described. In general, a vehicle may provide information regarding its recorded and/or monitored system and component states via a self-diagnostic and/or reporting capability.

A method and an apparatus for controlling a mobile terminal. The apparatus includes a receiving module for receiving gesture information from a first mobile terminal with an image capturing device, wherein the gesture information is from a user; and a sending module for sending a particular operation instruction to a second mobile terminal whose graphic user interface is being currently displayed on a display screen of a display device to instruct the second mobile terminal to execute an operation corresponding to the particular operation instruction, wherein the particular operation instruction is related to the received gesture information.

A method, device, and a vehicle information system are provided for persisting application context from the mobile device to the vehicle information system. An operating context is determined for at least one application executing on the mobile device. A user interface view for display by the vehicle information system is generated and provided to the vehicle information system. The user interface view comprises at least one application user interface element associated with the at least one application, and the application user interface element comprises an application entry point defined by the operating context for the at least one application.

A system or method for tracking items proximate a user interface device include a user interface device having at least one solid-state touch-sensitive region and a receiver for wirelessly receiving a signal from at least one item to determine proximity of the item relative to the user interface device. The device may also include a display screen for displaying controls and information. The user interface device may be permanently or removably mounted in a vehicle and used to interface with vehicle systems and personal electronic devices. Tracked items or objects may include passive or active data tags and communicate identification information and optionally position information. The device may alert the user to movement of tracked objects, and/or confirm presence of a group of objects. The device may use various wired or wireless devices to control selections and/or a cursor on the display.

This DA device is installed in a vehicle and works in tandem with a portable information terminal in outputting information, said DA device being provided with: a main body section; a display section that can be opened and closed relative to the main body section; a holder part for holding the information terminal, said holder part being connected to the back surface of the display section and opening and closing together with the display section; an electric circuit that is housed in the main body section; and an opening and closing mechanism for switching the display section between an open state in which the holder part is exposed to the outside of a case and a closed state in which the holder part is inside the case.

The disclosure includes a system and method for wireless data sharing between a mobile client device and a three-dimensional heads-up display unit. A system may include a three-dimensional heads-up display unit (3D HUD) installed in a vehicle. The system may include a memory storing instructions that, when executed, cause the system to: establish a peer-to-peer video stream between a mobile client device and the vehicle; generate live video data for providing a video stream for causing a screen of the mobile client device to display visual content of the 3D HUD that includes substantially live images depicting what the driver of the vehicle sees when looking at the 3D HUD; and stream the live video data to the mobile client device to cause the screen of the mobile client device to display the video stream that depicts what the driver of the vehicle sees when looking at the 3D HUD.

A sound output and text display device for a vehicle, including: an output unit that, in a case in which sound to be output inside the vehicle has been decided, outputs the sound inside the vehicle; and a display unit that displays text corresponding to the sound on a windshield in accordance with a state of use of the vehicle.

A system includes a processor configured to detect a presence of a docked phone and responsively determine whether a vehicle is in a predetermined safe-state for mobile office functionality. The processor is also configured to engage desktop functionality on a vehicle display, responsive to determining that the vehicle is in the safe-state. The processor is additionally configured to engage an application to translate keyboard and mouse controls into phone controls and enable a wireless keyboard and a mouse for control of the vehicle display.