Techniques are described that facilitate remotely interfacing with a vehicle touchscreen. According to an embodiment, a method is provided comprising determining touch controls included in a GUI configured for displaying on a touchscreen of the vehicle, wherein the touch controls provide for controlling functions of the vehicle based on first interaction with the touch controls as displayed on the touchscreen. The method further comprises generating a representation of the GUI for display via an auxiliary display of the auxiliary device, the representation comprising one or more graphical controls corresponding to one or more touch controls of the touch controls, and enabling remote control of one or more functions of the functions of the vehicle by the auxiliary device based on second interaction with the one or more graphical controls as displayed via the auxiliary display.

Implementations relate to interactions, over a wireless communication modality, between an automated assistant of an automobile computer system, and separate client device(s). In some of those implementations, the client device(s) can be paired with the automobile computer system, and the client device(s) and the automobile computer system can include separate instances of an automated assistant, which can be associated with different user accounts. In some additional or alternative implementations, particular actions to be performed by a local application of a client device can be advanced via user interaction with the automobile automated assistant, despite a counterpart to the local application not being installed directly on automobile computer system. For example, despite an automobile computer system not having a third-party messaging application installed, the automobile automated assistant can access requested actions to be performed by the third-party messaging application in order to further a requested action. The automobile computer system can transmit, via the wireless communication modality, content to cause the third-party application to further the requested action.

A system and method for disabling distracting apps on a driver's personal devices while allowing passengers travelling in the same vehicle to have full use of their personal devices. The system works by first identifying all the personal devices that are in the vehicle and then establishing a loose mesh network between those devices. Once the mesh network is established, the system identifies which of the personal devices is associated with the driver, and ensures that any distracting apps on the driver's personal device are disabled, while allowing full functionality for any passenger's personal devices.

A system may include an in-vehicle component, including a first control set to configure the component, configured to identify a device associated with a user approach to the component; and send an interaction request to the device to cause the device to display a user interface for the component including a second control set to configure the component, the second control set including at least one function unavailable in the first control set. A personal device may receive, from an in-vehicle component including a first control set to configure the component, a user interface definition descriptive of a second control set to configure the component; and receive, from the component, a request to display a user interface for the component including the second control set to configure the component, the second control set including at least one function unavailable in the first control set.

A sound output and text display device for a vehicle, including: an output unit that, in a case in which sound to be output inside the vehicle has been decided, outputs the sound inside the vehicle; and a display unit that displays text corresponding to the sound on a windshield in accordance with a state of use of the vehicle.

Implementations relate to interactions, over a wireless communication modality, between an automated assistant of an automobile computer system, and separate client device(s). In some of those implementations, the client device(s) can be paired with the automobile computer system, and the client device(s) and the automobile computer system can include separate instances of an automated assistant, which can be associated with different user accounts. In some additional or alternative implementations, particular actions to be performed by a local application of a client device can be advanced via user interaction with the automobile automated assistant, despite a counterpart to the local application not being installed directly on automobile computer system. For example, despite an automobile computer system not having a third-party messaging application installed, the automobile automated assistant can access requested actions to be performed by the third-party messaging application in order to further a requested action. The automobile computer system can transmit, via the wireless communication modality, content to cause the third-party application to further the requested action.

Techniques are described that facilitate remotely interfacing with a vehicle touchscreen. According to an embodiment, a method is provided comprising determining touch controls included in a GUI configured for displaying on a touchscreen of the vehicle, wherein the touch controls provide for controlling functions of the vehicle based on first interaction with the touch controls as displayed on the touchscreen. The method further comprises generating a representation of the GUI for display via an auxiliary display of the auxiliary device, the representation comprising one or more graphical controls corresponding to one or more touch controls of the touch controls, and enabling remote control of one or more functions of the functions of the vehicle by the auxiliary device based on second interaction with the one or more graphical controls as displayed via the auxiliary display.

Techniques are described for remotely controlling functions of a vehicle without an integrated touchscreen. According to an embodiment, an auxiliary device is provided comprising a display and a processor that executes computer executable components stored in at least one memory. The computer executable component can comprise a feature acquisition component that determines electronic features of the vehicle that are respectively controlled by electromechanical controls of the vehicle, and a display component that displays a graphical user interface via the display wherein the graphical user interface comprises one or more graphical controls for controlling one or more features of the electronic features of the vehicle. The computer executable components further comprising a remote-control component that remotely controls the one or more features via interaction with the one or more graphical controls as rendered via the display.

Techniques are described that facilitate remotely interfacing with a vehicle touchscreen. According to an embodiment, a method is provided comprising determining touch controls included in a GUI configured for displaying on a touchscreen of the vehicle, wherein the touch controls provide for controlling functions of the vehicle based on first interaction with the touch controls as displayed on the touchscreen. The method further comprises generating a representation of the GUI for display via an auxiliary display of the auxiliary device, the representation comprising one or more graphical controls corresponding to one or more touch controls of the touch controls, and enabling remote control of one or more functions of the functions of the vehicle by the auxiliary device based on second interaction with the one or more graphical controls as displayed via the auxiliary display.

A system or method for tracking items proximate a user interface device include a user interface device having at least one solid-state touch-sensitive region and a receiver for wirelessly receiving a signal from at least one item to determine proximity of the item relative to the user interface device. The device may also include a display screen for displaying controls and information. The user interface device may be permanently or removably mounted in a vehicle and used to interface with vehicle systems and personal electronic devices. Tracked items or objects may include passive or active data tags and communicate identification information and optionally position information. The device may alert the user to movement of tracked objects, and/or confirm presence of a group of objects. The device may use various wired or wireless devices to control selections and/or a cursor on the display.