Customizable and reconfigurable virtual instrument panel
11907439 ยท 2024-02-20
Assignee
Inventors
- Bran Ferren (Beverly Hills, CA)
- W. Daniel Hillis (Cambridge, MA)
- Randall Adam Yates (Ventura, CA, US)
- Ira M. Lichtman (Simi Valley, CA, US)
- Clint Blake Hope (Los Angeles, CA, US)
Cpc classification
G06F3/04847
PHYSICS
G06F3/0488
PHYSICS
B60K2360/1442
PERFORMING OPERATIONS; TRANSPORTING
G06F3/167
PHYSICS
B60K2360/11
PERFORMING OPERATIONS; TRANSPORTING
B60K35/00
PERFORMING OPERATIONS; TRANSPORTING
B60K2360/145
PERFORMING OPERATIONS; TRANSPORTING
G09G5/00
PHYSICS
B60K35/10
PERFORMING OPERATIONS; TRANSPORTING
International classification
B60Q1/00
PERFORMING OPERATIONS; TRANSPORTING
B60K35/00
PERFORMING OPERATIONS; TRANSPORTING
G06F3/02
PHYSICS
G06F3/041
PHYSICS
G06F3/04847
PHYSICS
G06F3/0488
PHYSICS
Abstract
The invention provides an instrument control panel that is easily customized and reconfigured, and yet provides the familiar tactile sensation of physical knobs, sliders, and buttons. The instrument control panel comprises one or more interface components that are removably coupled to an interface display wherein the interface components communicate with one or more control components disposed behind the interface display. The present invention lends itself particularly well to an instrument panel.
Claims
1. An instrument panel comprising: a display device configured with a first surface side and a second surface side; one or more tactile interface components configured to be removably and adjustably coupled to the first surface side of the display device; one or more control components configured to be coupled to the second surface side of the display device, wherein the one or more tactile interface components are further configured to be in operable communication with the one or more control components; and a processor operably coupled to each of: the display device, the one or more control components, and one or more instrument panel controlled devices which are controllable with the instrument panel in response to displacement of the one or more tactile interface components.
2. The instrument panel of claim 1, wherein the one or more control components are further configured to be in operable communication with the one or more instrument panel controlled devices such that the one or more control components produce control signals that control aspects of the instrument panel controlled devices respectively.
3. The instrument panel of claim 2, wherein the display device is further configured to receive, and display, communicated display information from the processor, on the first surface side of the display device.
4. The instrument panel of claim 3, wherein the communicated display information comprises background image display data, which when displayed on the display device of the instrument panel, further configures the first surface side of the display device to illustrate any of: people, places, logos, and advertisements, as background images.
5. The instrument panel of claim 3, wherein the communicated display information comprises alphanumeric display data, which when displayed on the display device of the instrument panel, configures the first surface side of the display device to illustrate any of user specified: colors, sizes, and fonts.
6. The instrument panel of claim 3, wherein the communicated display information comprises instrument interface display data, which when displayed on the display device of the instrument panel, configures the first surface side of the display device to illustrate attributes representing any of: a speedometer, an odometer, a fuel gauge, a temperature gauge, a multimedia device, and a GPS communication system.
7. The instrument panel of claim 3, wherein the communicated display information comprises control ability assignment data, which when displayed on the display device of the instrument panel, configures the first surface side of the display device to indicate a function control ability related to an instrument panel controlled device to which a particular control component is associated.
8. The instrument panel of claim 3, wherein the communicated display information comprises placement location data, which when displayed on the display device of the instrument panel, configures the first surface side of the display device to indicate placement areas for the coupling of the tactile interface components.
9. The instrument panel of claim 8, wherein the placement location data comprises locations of displayed empty boxes.
10. The instrument panel of claim 8, further comprising one or more of the tactile interface components coupled to the configured first surface side of the display device at one or more indicated placement areas respectively.
11. An instrument panel comprising: a display device configured with a first surface side and a second surface side; one or more tactile interface components configured to be removably and adjustably coupled to the first surface side of the display device; one or more control components configured to be coupled to the second surface side of the display device, wherein the one or more tactile interface components are further configured to be in operable communication with the one or more control components; a processor operably coupled to each of the display device, the one or more control components, and one or more instrument panel controlled devices which are controllable with the instrument panel, in response to displacement of the one or more tactile interface components, wherein the processor is further configured to provide one or more display skins to the display device, and the first surface side of the display device displaying one or more provided display skins.
12. The instrument panel of claim 11 integrated into a dashboard of a vehicle.
13. The instrument panel of claim 11 integrated into a center console of a vehicle.
14. The instrument panel of claim 11 integrated into a headrest of a vehicle.
15. The instrument panel of claim 11 integrated into a rear-passenger console.
16. A media device interface comprising: a display device configured with a first surface side and a second surface side; one or more interface components configured to be removably and adjustably coupled to the first surface side of the display device; one or more control components configured to be coupled to the second surface side of the display device, wherein the one or more interface components are further configured to be in operable communication with the one or more control components; and a processor operably coupled to each of: the display device, the one or more control components, and one or more media devices which are controllably associated with the media device interface.
17. The media device interface of claim 16, wherein the one or more control components are further configured to be in operable communication with the one or more associated devices such that the one or more control components produce control signals that control aspects of the associated devices respectively.
18. The media device interface of claim 17, wherein the display device is further configured to receive, and display, communicated display information from the processor, on the first surface side of the display device.
19. The media device interface of claim 18, wherein the communicated display information comprises display skin data, which when displayed on the display device of the media device interface, configures the first surface side of the display device to illustrate identification and instructive information for the interface components.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
DETAILED DESCRIPTION OF THE INVENTION
(18) The invention comprises a user interface that is easily customized and reconfigured, and yet provides the familiar tactile feel of physical knobs, sliders, and buttons. The user interface comprises one or more interface components that are removably coupled to an interface surface. The interface components communicate with one or more control components disposed behind the interface surface. In some embodiments of the invention, the interface surface is substantially flat. In some embodiments the interface surface is passive, meaning it is not a display. In some other embodiments, the interface surface is further configured to display information. According to these embodiments, the interface displays information related to the function of the interface components. The invention lends itself particularly well to an instrument panel, for example in a vehicle, such as an automobile.
(19) Customizable Instrument Panel
(20)
(21) In some embodiments of the invention, the media device 100 comprises a multimedia receiver that is coupled to an audiovisual output (not shown). According to these embodiments, the removable interface components 107, 108, and 109 control various functions of the multimedia device, e.g. volume, terrestrial radio tuning, satellite radio tuning, balance, frequency response, etc.
(22) The removable interface components 107, 108, and 109 are depicted as knobs. However, it will be readily apparent to those having ordinary skill in the art having the benefit of this disclosure that a number of other interface components are equally applicable. For example and as explained below, slider and button interface components are especially applicable and useful in some embodiments of the invention.
(23) In some embodiments of the invention, the user interface components 107, 108, and 109 are positioned by the end user in a desired location on a media device interface display 199. The interface display 199 may be chosen from among standard structural materials such as, for example, aluminum, stainless steel, or plastic. In the presently preferred embodiments, the interface display 199 is a liquid crystal display (LCD).
(24) In the case of interface display 199 as an LCD, a number of labels and/or other identifying and instructive information for the interface components 107, 108, and/or 109 may be added by the user through an input (not shown) or may be preloaded in the form of one or more skins (explained below). For example, when coupling an individual component 107, a prompt is automatically displayed on the interface display 199 which requests that the user choose a function for dedicating to that component 107, for example volume control. By choosing the volume control, the user dedicates that component 107, to volume control and the word Volume is preferably displayed next to the component 107.
(25) In some other embodiments, the components 107, 108, and/or 109 automatically communicate a dedicated function to the display 199, such that the display automatically depicts its function on the LCD when it is coupled with the interface display 199.
(26) The interface components control a particular function and/or an auxiliary component of the media device. In some embodiments of the invention, positional data is output from the interface component and is communicated to the device. The positional data is then translated into a signal that is used to control the particular device or function. For example, a scalar value representing the absolute angular position of a knob within its rotational range is detected and is then associated with a particular device or function. Various means for the determination of interface component position are explained below.
(27) Referring again to
(28) Determination of Interface Component Position
(29) The angular position of a knob, or linear position of a slider, may be determined in any of several different ways. For example, a grid of sensors and a set of reflective markings can be used to determine the position of the interface components. According to these embodiments, a set of sensors are positioned around the perimeter of the interface display surface. Additionally, the interface components include a set of reflective marks used by the sensors. The sensors detect the position of markings placed on the edges of the interface components. For example, markings reflective at IR wavelengths may be applied to the perimeter of a knob and, when illuminated by IR emitters proximal to the sensors, used to determine the angular position of the knob. Patterned markings (e.g. variations in spacing or thickness) can uniquely identify the knob from among other knobs on the interface display surface.
(30) Alternatively, the position of an interface component can be determined by the interface display surface directly. For example, the information gathered by the scanning elements within an optical scanning display can be analyzed to determine the translational and rotational position of a knob based on patterned markings on the surface of the knob closest to the display. An example of such an optical scanning display is achieved by a compact multi-touch panel developed by Sharp Electronics Corporation, located in Romeoville, Illinois, the panel having an approximate 1-mm depth with an optical sensor integrated into each pixel.
(31) In some other embodiments, one or more pairs of orthogonal Hall effect sensors may be placed within a control component located behind the interface display surface, and a magnet may be placed within an interface component. The magnet within the interface component produces a magnetic field that varies as the interface component is rotated or otherwise displaced. The orthogonal sensors measure these variations in the magnetic field to determine the orientation of the magnet and therefore the rotational position of the knob. According to these embodiments, the determined position of each knob is preferably transmitted wirelessly back to a processor or directly to the associated device or function. Various means for wireless communication include, but are nor limited to an RF signal, an IEEE 802.11 protocol signal and a Bluetooth signal.
(32) In some embodiments of the invention an LCD is used as the interface display surface. The LCD displays a regular pattern beneath the knob, which can be analyzed by an optical sensor within the knob to determine the knob's angular position, using techniques similar to those used by optical mice. According to these embodiments, the determined position of each knob is preferably transmitted wirelessly back to a processor or directly to the associated device or function.
(33) While explicit examples of position determination means are provided, it will be readily apparent to those with ordinary skill in the art having the benefit of this disclosure that a wide variety of position determination means, now known or later developed, could be equally applicable to yield same or similar results.
(34) Additionally, in some embodiments, the mechanical rotation of the knob by a user generates inductive power for one or more optical encoders located in the control component that is behind the control panel surface. A voltage is induced that is used to power an encoder. The encoder then determines the rotational position of the knob. According to these embodiments, the determined position of each knob is preferably transmitted wirelessly back to a processor or directly to the associated device or function.
(35)
(36) To further guard against damage to the interface display surface, some embodiments of the invention incorporate a transparent protective layer between the interface components and the interface display surface. For example, a thin acrylic or polycarbonate sheet can be affixed to the interface display surface. The sheet protects the potentially delicate surface (e.g, in the case of an LCD) from damage by contact from the moving surfaces and edges of the interface components. In those embodiments in which the interface display comprised an LCD, the sheet additionally mitigates impairments to the rendered image caused by compression of the liquid crystal material during operation of the interface components.
(37) The encoder apparatus 220 is disposed opposite of the knob apparatus 208 through the interface display surface 299. The encoder comprises an encoder housing 221 that encases an encoder body 222 that has one or more magnets 223 disposed within. As shown, the magnets 223 are flush mounted in the encoder body 222. The encoder body 222 rotates within the encoder housing 221 within one or more bearings 225. Also on the encoder body 222 are encoder markings 224. An offset 298 is disposed between the magnets 223 and the interface display surface 299, such that the magnets 223 cannot damage the interface display surface 299 as they move. In some embodiments, the magnets 223 are fully embedded within the encoder body 222 such that the gap 298 exists between the encoder body 222 and the interface display surface 299.
(38) The knob apparatus 208 and the encoder apparatus 220 are configured such that the magnets 212 and 223 magnetically couple the knob apparatus 208 to the encoder apparatus 220 through the interface display surface 299. The magnets 212 also relay an angular displacement of the knob 210 to the encoder body 222 within the encoder apparatus 220. As such, the encoder markings 224 are displaced as the knob rotates.
(39) Also within the encoder housing 221 are an emitter 226 and a detector 227. The emitter 226 and the detector 227 establish the position of the encoder body 222 by determining the position of the encoder markings 224.
(40) In some embodiments of the invention, this position information is communicated through a housing shaft 228 to an umbilical cord 229 and to a processor (not shown). In some other embodiments, the position information is communicated wirelessly.
(41)
(42)
(43) In those embodiments of the invention incorporating a rotating magnet placed behind the display, force feedback and/or damping sensations may be provided to the knob in front of the display. One method of providing damping comprises enclosing the knob or encoder body within a viscous fluid.
(44) Specific Implementation of a Re-Configurable Interface
(45) As explained above, the mechanical rotation of a knob by a user generates power that is provided to an optical encoder which is located behind the interface display. The positional information determined by the encoder is transmitted wirelessly back to a processor. In some embodiments, the encoder on the backside of the interface display may be connected to a power supply and a processor by an umbilical cord. The umbilical cord provides power to the encoder and carries the encoder measurements back to the processing unit.
(46)
(47)
(48) In some embodiments of the invention, the interface display 301 displays a representation of an empty grid of boxes 375. According to these embodiments, the empty boxes 375 indicate an available location for an interface component to be placed. In some embodiments, each box 375 is assigned with the ability to control one particular function. For example, a particular box 375 may be assigned with the ability to control the volume level of a multimedia device to which the control interface 301 is coupled. According to these embodiments, a prepackaged skin is displayed on the control interface 301 to indicate which box 375 controls which function.
Implementation Examples
(49)
(50)
(51) Although specific implementations are explicitly disclosed in
(52) Examples of Specific Reconfigurable Interface Controls
(53) As explained above, reconfigurable knobs are used to control a device through an interface display surface.
(54) In some embodiments of the invention, one or more removable and reconfigurable buttons are used to control a device.
(55) In some embodiments of the invention, the button 502 is implemented in conjunction with a transmitting and receiving antenna located within a control apparatus (not shown) on the backside of the display surface (not shown). The button comprises an LC circuit within the base 503 of the button on the front side of the display surface. The antenna transmits an RF signal at the resonant frequency of the LC circuit, thereby establishing a ringing within the LC circuit. The antenna is configured to listen to hear if the LC circuit is ringing. When the user presses the button 502, the LC circuit is shorted and no ringing is possible. If no ringing is heard by the antenna, the button 502 is determined to be depressed. The control apparatus then communicates that the button has been actuated to the device that the button is configured to control. Although a specific example of button control is explicitly disclosed, it will be readily apparent to those with ordinary skill in the art having the benefit of this disclosure, that numerous other button control implementations are able to be taken advantage of to yield similar results.
(56) In some embodiments of the invention, a slider control is used as an interface component to control one or more device, such as a media device.
(57)
(58)
(59) As shown, the backside of the interface display 600 contains the control components 611, 621, and 631, which magnetically, and/or inductively couple with the slider handles 610, 620, and 630. In some embodiments, the control components 611, 621, and 631 are the moving elements within linear encoders 613, 623, 633 (shown in phantom). According to these embodiments, the control components 611, 621, and 631 determine the position of the handles 610, 620, and 630. It will be apparent to those with ordinary skill in the relevant art having the benefit of this disclosure that various other means for determining the position of the handles 610, 620, and 630, now known or later developed can be implemented to accomplish the invention.
(60) Spring fixtures 612, 622, and 632 are also disposed below the control components 611, 621, and 631 and couple with the control components 611, 621, and 631, respectively. The spring fixtures include springs and are configured to cause the control components 611, 612, and 613 to return to a rest position when magnetically de-coupled from the handles 610, 620, and 630. In some other embodiments gravity accomplishes returning the control components 611, 612, and 613 to their rest positions.
(61) In some other embodiments, a group of linear encoders are configured horizontally on the back side of a display interface. The linear encoders include control components having rest positions at the left or right edge of the display interface. According to these embodiments, a user can place a handle at various vertical positions on the display interface and slide them horizontally. In other embodiments, a group of linear encoders are disposed in a grid for tracking both horizontal and vertical motion of the control component through the grid. According to these embodiments, a magnetic slider handle placed on the front side of the display interface magnetically couples with the control component. Moving the slider handle causes the control component to move through the grid. This motion is tracked by the linear encoders and serves as a two-dimensional control input.
(62) Other Variations of Interface Component Control
(63) In some other embodiments of the invention, users purchase specific interface components to extend the functionality of the controlled device. Each interface component is equipped with a passive RFID chip. An excitation coil behind the display provides power to the RFID chips, and the transmitted RFID is a key that identifies the interface component and unlocks the desired functionality. (That is, the controlled device is capable of the functionality upon manufacture, but the functionality is locked until an appropriate interface component is detected.) Key pairs allow a specific interface component to be programmed for use on a specific device, thus preventing the sharing or theft of interface components that extend functionality.
(64) Preferably, an excitation coil and RFID receiver are located within or very near each control component to which an interface component can be magnetically coupled. Additionally, the transmitting antenna within the interface component preferably shapes the transmitted RFID signal such that it is only receivable by the receiver within the most proximal control component. These localization techniques allow each control component to determine the identity of the individual interface component to which it is coupled and, therefore, how the position information determined by the control component signal should be interpreted. For example, if an interface component containing an RFID indicating that it is a volume knob is attached to an encoder, the output from the encoder is used to control the volume.
(65) In another variation of the invention, the front side of the display may be fitted with a touch sensing technology, for example a capacitive or an infrared breakbeam, that allows the position of the attached knobs to be determined directly. If combined with the RFID localization techniques, the interface displayed beneath the knobs can be adjusted automatically. For example, a VOLUME label and scale may be placed behind the sensed location of a knob, identifying it to the user as a volume knob.
(66) In another variation of the invention, the advantages of reconfigurable and customizable interface components are synergistically combined with the advantages of speech recognition technology to yield extremely user friendly interfaces. For example, a media device having an LCD interface may be configured with the reconfigurable interface components and speech recognition functionality. According to these embodiments, a user declares an intended function of an interface component as the physical component is placed onto the LCD interface. The previous example is especially beneficial when the user is not presently able to look at the interface to configure the appropriate control with the desired function. Therefore, these particular embodiments particularly lend themselves to automobile interface applications.
(67) Reconfigurable and Customizable Automobile Interface
(68) As explained above, it is extremely useful to implement the reconfigurable and customizable interface applications of the invention in an automobile, such that a driver can easily control a media device, a GPS device, or the like.
(69)
(70) Reconfigurable Instrument Indicators
(71) In some embodiments of the invention, changes in the attributes controlled by the interface components are communicated to and displayed on the interface display. Specifically, the control components are driven and thereby cause a magnetically coupled interface component to move, thus indicating the changed status of the attribute. In some embodiments, a knob and encoder apparatus are located on opposite sides of an interface display, as explained in
(72) Customizable Appearance Themes/Skins
(73) In some embodiments of the invention, a driver specifies characteristics such as the color, size, and font of the alphanumeric data displayed on the control panel. Notably, the font may be increased for drivers or passengers with below average visual acuity. Similarly, the shape and size of the soft controls may be specified. For convenience, predefined sets of controls may be selected as themes or skins.
(74) Further, background images may be placed on the instrument panel in digital form, such as pictures of family, pictures of familiar places, corporate logos, and/or advertisements. Slide show functionality similar to computer screen savers can be selected. Instrument panel skins can also be offered. The invention is applicable to nearly any instrument, such as speedometers, odometers, fuel and temperature gauges, radios, and others.
(75)
(76)
(77)
(78) As will be understood by those familiar with the art, the invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. Likewise, the particular naming and division of the members, features, attributes, and other aspects are not mandatory or significant, and the mechanisms that implement the invention or its features may have different names, divisions and/or formats. Accordingly, the disclosure of the invention is intended to be illustrative, but not limiting, of the scope of the invention, which is set forth in the following Claims.