In-vehicle control apparatus using smart key provided with display and method of controlling the same
10850708 ยท 2020-12-01
Assignee
Inventors
Cpc classification
G06F3/04845
PHYSICS
B60K35/53
PERFORMING OPERATIONS; TRANSPORTING
B60K35/212
PERFORMING OPERATIONS; TRANSPORTING
G06F3/1423
PHYSICS
B60K2360/128
PERFORMING OPERATIONS; TRANSPORTING
B60K2360/122
PERFORMING OPERATIONS; TRANSPORTING
G06F3/04886
PHYSICS
G07C2009/00761
PHYSICS
G07C9/00309
PHYSICS
B60K2360/126
PERFORMING OPERATIONS; TRANSPORTING
G08C2201/32
PHYSICS
G06F3/0487
PHYSICS
B60R25/24
PERFORMING OPERATIONS; TRANSPORTING
G06F3/0362
PHYSICS
B60K35/10
PERFORMING OPERATIONS; TRANSPORTING
G07C2009/00952
PHYSICS
International classification
B60R25/24
PERFORMING OPERATIONS; TRANSPORTING
G06F3/14
PHYSICS
G07C5/08
PHYSICS
Abstract
A user interface capable of controlling various functions in a vehicle is disclosed. The vehicle control method using a smart key includes an integrated operation unit detecting attachment of the smart key through a smart key detector disposed in a predetermined attachment area inside a vehicle, the integrated operation unit transmitting information on a controlled function corresponding to a vehicle state to the smart key, outputting a first user interface corresponding to the information on the controlled function on a first display of the smart key, transmitting information on a result of operation from the smart key to the integrated operation unit when an operation unit provided in the smart key is operated, and the integrated operation unit controlling the controlled function based on the information on the result. The smart key is fixed in the attachment area using magnetic force.
Claims
1. A vehicle control method using a smart key, the vehicle control method comprising: an integrated operation unit detecting attachment of the smart key through a smart key detector disposed in a predetermined attachment area inside a vehicle; the integrated operation unit transmitting information on a controlled function corresponding to a vehicle state to the smart key; outputting a first user interface corresponding to the information on the controlled function on a first display of the smart key; transmitting information on a result of operation from the smart key to the integrated operation unit when an operation unit provided in the smart key is operated; and the integrated operation unit controlling the controlled function based on the information on the result, wherein the smart key is fixed in the attachment area using magnetic force.
2. The vehicle control method according to claim 1, wherein the smart key has a cylindrical appearance, and wherein the first display is disposed at a center of the smart key in a circular shape.
3. The vehicle control method according to claim 2, wherein the operation unit includes a ring-shaped dial surrounding the first display.
4. The vehicle control method according to claim 3, wherein the dial includes one or more coils at the inside or the back surface thereof, and wherein the smart key further includes: one or more permanent magnets disposed in a predetermined shape; and a battery charged with power generated by an electromagnetic induction phenomenon by the permanent magnets in the one or more coils when the dial rotates.
5. The vehicle control method according to claim 1, further comprising: determining a slope through a detector for detecting a direction in which the smart key is disposed; and aligning a first user interface to correspond to the determined slope in the smart key.
6. The vehicle control method according to claim 5, wherein the aligning includes: rotating the first user interface based on the determined slope until the detected slope satisfies a predetermined stabilization condition; and fixing the slope of the first user interface when the stabilization condition is satisfied.
7. The vehicle control method according to claim 1, wherein the smart key recognizer includes an electromagnet, wherein the method further includes: an integrated controller detecting whether the smart key has entered the vehicle; and the integrated controller activating the electromagnet as the smart key has entered the vehicle.
8. The vehicle control method according to claim 1, wherein the integrated operation unit further includes a second display disposed around the smart key detector, and wherein the method further includes outputting a second user interface corresponding to the information on the controlled function through the second display.
9. The vehicle control method according to claim 8, wherein the first user interface and the second user interface integrally configure a user interface corresponding to the controlled function.
10. A non-transitory computer-readable recording medium having recorded thereon a program for executing the vehicle control method using the smart key according to claim 1.
11. An in-vehicle operation system comprising: an integrated operation unit including a smart key detector disposed in a predetermined attachment area in a vehicle, a first display disposed around the smart key detector to display a first user interface for a controlled function corresponding to a vehicle state and a controller configured to perform control to transmit information on the controlled function to the smart key when attachment of the smart key in the attachment area is detected through the smart key detector, wherein the integrated operation unit receives information on a result of operation through an operation unit provided in the smart key from the smart key and controls the controlled function based on the information on the result, and wherein the smart key detector includes an electromagnet for fixing the smart key in the attachment area at the rear surface of the first display.
12. The in-vehicle operation system according to claim 11, further comprising a smart key including a second display for displaying a second user interface corresponding to the information on the controlled function and the operation unit, wherein the smart key has a cylindrical appearance, and wherein the second display is disposed at a center of the smart key in a circular shape.
13. The in-vehicle operation system according to claim 12, wherein the operation unit includes a ring-shaped dial surrounding the second display.
14. The in-vehicle operation system according to claim 13, wherein the dial includes one or more coils at the inside or the back surface thereof, and wherein the smart key further includes: one or more permanent magnets disposed in a predetermined shape; and a battery charged with power generated by an electromagnetic induction phenomenon by the permanent magnets in the one or more coils when the dial rotates.
15. The in-vehicle operation system according to claim 11, wherein the smart key: determines a slope through a detector for detecting a direction in which the smart key is disposed; and aligns a second user interface to correspond to the determined slope.
16. The in-vehicle operation system according to claim 15, wherein the smart key rotates the second user interface based on the determined slope until the detected slope satisfies a predetermined stabilization condition and fixes the slope of the second user interface when the stabilization condition is satisfied.
17. The in-vehicle operation system according to claim 11, wherein an integrated controller activates the electromagnet as the smart key has entered the vehicle.
18. The in-vehicle operation system according to claim 11, wherein the integrated operation unit outputs a first user interface corresponding to the information on the controlled function through the first display.
19. The in-vehicle operation system according to claim 18, wherein the first user interface and a second user interface integrally configure a user interface corresponding to the controlled function.
20. The in-vehicle operation system according to claim 11, wherein the integrated operation unit gradually increases magnetic force of the electromagnet when the smart key approaches within a predetermined distance.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the disclosure and together with the description serve to explain the principle of the disclosure. In the drawings:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
DETAILED DESCRIPTION
(17) Hereinafter, the embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so as to be easily implemented by those skilled in the art. However, the present disclosure may be variously implemented and is not limited to the embodiments described herein. In the drawings, in order to clearly describe the present disclosure, portions which are not related to the description of the present disclosure will be omitted and similar portions are denoted by similar reference numerals throughout the specification.
(18) In the entire specification, when a certain portion includes a certain component, this indicates that the other components are not excluded, but may be further included unless specially described. The same reference numbers will be used throughout the drawings to refer to the same or like parts.
(19) In the embodiments of the present disclosure, in control of a vehicle function, when a smart key provided with a display is attached to a predetermined point inside a vehicle, it is possible to control various vehicle functions.
(20) First, the structure of an in-vehicle operation system including a smart key applicable to the embodiments of the present disclosure will be described with reference to
(21) Referring to
(22) The integrated operation unit 100 may include a wired communication unit 110, a display 120, a smart key recognizer 130, a memory 140, a wireless communication unit 150, and a controller 160. Hereinafter, these components will be described in detail.
(23) The wired communication unit 110 may exchange data with a controller for controlling at least a plurality of controlled functions inside the vehicle. For example, the wired communication unit 110 may support at least one of vehicle communication schemes such as CAN (controller area network), CAN-FD (CAN with flexible data rate), LIN (Local Interconnect Network) or Ethernet. In another example, the wired communication unit 110 may receive operation state information from an air conditioner for controlling an air conditioning function, a body controller for performing a convenience function such as a seat and an audio/video/navigation (AVN) system and transmit a control command.
(24) The display 120 serves to visually output a vehicle operation state such as a navigation guidance screen, operation state information of an air conditioner system, playback state information of a multimedia function or a variety of information necessary for a driver, and may display a virtual operation system for controlling at least some functions and detect a touch command input to the virtual operation system, when the display is a touchscreen.
(25) The smart key recognizer 130 may detect whether the smart key 200 is detached. For example, the smart key recognizer 130 may include at least one of a Hall sensor for detecting magnetic force, an NFC transceiver for performing NFC communication or a wireless charging transmitter for detecting a wireless charging receiver. That is, the smart key 200 may be detected by the Hall sensor when a permanent magnet is provided in the smart key 200, the smart key 200 may be detected by the NFC transceiver when an NFC tag is provided in the smart key 200, and the smart key 200 may be detected by the wireless charging transmitter when the wireless charging receiver is provided in the smart key 200. Of course, such a detection unit is an example and the present disclosure is not limited thereto. In addition, the smart key recognizer 130 detects whether the smart key 100 is attached to the integrated operation unit 100 at a specific position separately from a smart key controller for controlling whether the smart key is present inside the vehicle.
(26) The memory 140 may store an operating system for driving the integrated operation unit 100, various application programs operating on the operating system, multimedia content, input/output control information, etc.
(27) The wireless communication unit 150 may be connected to at least a wireless communication unit 250 of the smart key 200 using a short-range communication protocol (e.g., Bluetooth, Wi-Fi, ZigBee, NFC, etc.) or a 3/4/5G protocol to perform data exchange. Of course, the wireless communication unit 150 may communicate with another component inside the vehicle, such as an AVN system.
(28) The controller 160 performs overall control of the above-described components and may perform determination and operation necessary to control controlled functions through interworking with the smart key 200 according to the below-described embodiments of the present disclosure.
(29) Meanwhile, the smart key 200 may include a dial 210 (or a wheel), a display 220, an attachment portion 230, a memory 240, a wireless communication unit 250, a controller 260, and a sensor unit 270.
(30) First, the memory 240 may store an operating system for driving the smart key 200, identification information of each controlled function, a graphical user interface to be output on a display for each controlled function, input/output control information of the smart key 200, etc.
(31) The wireless communication unit 250 may be connected to at least a wireless communication unit 150 of the integrated operation unit 100 using a short-range communication protocol (e.g., Bluetooth, Wi-Fi, ZigBee, NFC, etc.) or a 3/4/5G protocol to perform data exchange. Of course, in some embodiments, the wireless communication unit 250 may be configured to perform communication with a telematics server or another smart device (e.g., a smartphone, a tablet, etc.). In addition, the wireless communication unit 250 may include a RF (e.g., UHF, LF, etc.) communication module for performing wireless communication with a smart key controller SMK of the vehicle in order to perform the general functions of the smart key, such as door lock setting/releasing, or other functions performed outside the vehicle.
(32) The controller 260 performs overall control of the other components and may perform determination and operation necessary to control controlled functions through interworking with the integrated operation unit 100 according to the below-described embodiments of the present disclosure.
(33) The sensor unit 270 may include at least one sensor capable of detecting a direction in which the smart key 200 is disposed. For example, the sensor unit 270 may include at least one of a gyro sensor or an acceleration sensor. Since the smart key 200 has a cylindrical appearance and includes a circular display 220, when the smart key 130 is attached at an attachment position corresponding to the smart key recognizer 130, a display state is adjusted such that a user interface is displayed on the display 220 in a forward direction from the viewpoint of a driver.
(34) Here, the forward direction means a direction in which text or image configuring a user interface displayed on the display 220 is predicted to be displayed by the driver. For example, when the shape of the display 220 or the smart key is rectangular, the driver may intuitively attach the smart key such that the long or short side of the rectangle is parallel to a vertical direction and the displayed user interface always satisfies the forward direction in a landscape mode or a portrait mode. However, when the smart key 200 has a cylindrical appearance and a circular display 220, it is difficult for the driver to intuitively attach the smart key 200 at a specific angle. Accordingly, in the display 220 of the smart key 200 according to the embodiment, when text of one row extending in the horizontal direction is aligned and displayed in a direction perpendicular to the direction of gravity, the text may be regarded as being displayed in the forward direction. As a result, when the attachment direction of the smart key detected by the sensor unit 270 is detected, the controller 260 may control the display 220 to rotate, realign or reconfigure a UI such that the user interface is displayed in the forward direction based on the detected direction. Such a function will be described below in greater detail.
(35) The dial 210, the display 220, and the attachment portion 230 will be described with reference to
(36) Referring to
(37) The dial 210 may be configured to rotate about the display 220 and to detect at least a direction and degree of rotation (e.g., displacement or angle) when a user grabs and rotates the dial. Of course, the present disclosure is not limited to a detailed unit or method for detecting rotation.
(38) The display 220 has a circular appearance. An actual display area does not necessarily correspond to an outer area defined by the inner diameter of the dial 210 and does not necessarily have a circular shape. In addition, the display 220 is implemented in the form of a touchscreen and may be configured to receive a touch command input to the display 220 and the display 220 may be configured to include a push button function. In addition, a detection member formed of a piezoelectric material is disposed on the lower surface of the display 220 in a predetermined array form and a fingerprint sensor is provided by connecting electrodes. The substrate 350 on which the memory 240 and the controller 260 are mounted may be disposed on the back of the display 220.
(39) As described above, the attachment portion 230 may include a portion to be recognized (e.g., one or more permanent magnets 320, an NFC tag, a wireless charging reception coil 330, etc.) corresponding to the smart key recognizer 130. At this time, the permanent magnets 320 may be arranged in correspondence with the magnetic materials disposed in the peripheral area of the display 120 or the rear surface of the display 120 of the integrated operation unit 100, thereby being attached to the magnetic materials such as the permanent magnets or the electromagnets 132 by magnetic force. Of course, the position of the wireless charging reception coil 330 may correspond to the position of the wireless charging transmission coil 131 of the integrated operation unit 100.
(40) At this time, the magnitude of the magnetic force may be greater than rotation resistance of the dial 210 while detachment does not occur by vibration generally occurring in traveling of the vehicle when the smart key 200 is attached to a predetermined area, in order to prevent a phenomenon wherein the smart key 200 itself rotates (e.g., the display 220 also rotates) without moving the dial from the viewpoint of the smart key 200 in the case where magnetic force is less than rotation resistance when the user rotates the dial 210.
(41) Of course, it is apparent to those skilled in the art that the magnitude of the magnetic force may vary according to the weight of the smart key 200, an angle between the position where the smart key 200 is attached inside the vehicle and the ground and the rotation resistance of the dial 210.
(42) In addition, the integrated operation unit 100 may gradually increase the magnetic force of the electromagnets 132 to induce attachment, when the smart key approaches the attachment area within a predetermined distance while the smart key recognizer 130 detects whether the smart key approaches.
(43) Referring to
(44) Next, the operation method of an operation system according to the embodiment will be described with reference to
(45) First, when the smart key 200 has a push button, the front surface of the dial 210 or the display 220 may be pressed. For example, when the display 220 is pressed as shown in
(46) Alternatively, as shown in
(47) Hereinafter, a process of performing the interworking function of the smart key and the integrated operation unit based on the configuration of the apparatus will be described with reference to
(48)
(49) Referring to
(50) The integrated operation unit 100 may transmit information on the controlled function according to the current vehicle state to the smart key 200 through the wireless communication unit 150 (S420). Here, the information on the controlled function may include the type of the controlled function and the current state information of the function. For example, the controlled function according to the vehicle state may be a start button function before starting the vehicle after the driver rides in the vehicle or a function for welcoming the owner of the vehicle, but is merely an example and the present disclosure is not limited thereto.
(51) The smart key 200 may output a graphical user interface (UI) corresponding to the controlled function and the current state on the display 220 based on the received information (S430).
(52) Thereafter, when the dial 210 is operated or when user input such as touch input or push input is received on the display 220 (S440), the smart key 200 may output a user interface corresponding to the operation (that is, change in state information output through the user interface) on the display 220 (S450). Information on the operation (e.g., an operation amount, a control amount, an operation direction, the type of a changed function, etc.) may be transmitted to the integrated operation unit 100 through the wireless communication unit 250.
(53) The integrated operation unit 100 may apply the result of operation to the controlled function based on the information on the operation (S460).
(54) Meanwhile, before the smart key 200 is attached, a predetermined function may be performed in the vehicle when the driver rides in the vehicle in a state of carrying the smart key 200. This will be described with reference to
(55) The process shown in
(56) Referring to
(57) As entrance of the smart key 200 into the vehicle is detected, the integrated operation unit 100 may activate the smart key recognizer 130 (S404A). For example, power may be applied to the wireless charging transmission coil 131 and the electromagnets 132 of the smart key recognizer 130.
(58) In addition, when the entrance notification signal is received, the AVN system may enter standby operation (S404B). For example, the AVN system may perform pre-booting for rapid operation or output a predetermined welcome message when booting is completed.
(59) Next, a detailed example of attaching a smart key will be described with reference to
(60) First, referring to
(61) In this state, when the smart key 200 is attached to the lower central area 510 of the display 120 as shown in
(62) Of course, the area 510, to which the smart key 200 will be attached, needs to include a permanent magnet or an electromagnet as a portion for fixing the smart key by magnetic force, along with the smart key detector 130, as described above. The fixing unit will be described with reference to
(63) In
(64) Two or more electromagnets or permanent magnets may be provided such that the smart key 200 itself does not rotate by operation of the dial 210 after the smart key 200 is attached. In addition, the electromagnets or permanent magnets may be symmetrically disposed with respect to the center of the attachment position 610. Therefore, the smart key is easily attached at an accurate position, only by disposing the smart key 200 to be close to the attachment position. Of course, the position and number of electromagnets or permanent magnets within the attachment position 610 may be equally applied to the attachment portion 230 of the smart key 200.
(65) In addition, when the electromagnets are used, the electromagnets may be configured to generate magnetic force only when the smart key 200 is detected by the smart key detector 130, in order to reduce power consumption.
(66) Next, the welcome and start functions using the smart key will be described with reference to
(67) Referring to
(68) In this state, when the driver rides in the vehicle and the smart key 200 is attached to the center of the display 120 as shown in
(69) At this time, when the display of the smart key 200 is provided with a fingerprint recognition sensor, as shown in
(70) Meanwhile, unlike
(71) In the above-described embodiments, the attachment area is disposed on or near the display 120 of the integrated operation unit 100 located at the lower end of the center fascia. However, this is an example and the attachment area may be variously changed. This will be described with reference to
(72) Referring to
(73) Of course, in some embodiments, as shown in
(74) Next, a user interface provided when a smart key is attached will be described with reference to
(75) First, referring to
(76) In addition, referring to
(77) Hereinafter, alignment of the user interface in the forward direction will be described in greater detail with reference to
(78)
(79) The process of
(80) Referring to
(81) As the slope is determined, the controller 260 may rotate the user interface displayed on the display 220 according to the determined slope (S1020).
(82) This process will be described with reference to
(83) After the smart key 200 is attached, in a state in which the user interface aligned according to a predetermined direction value is displayed on the display as shown in the left side of
(84) Returning to
(85) Upon determining that the slope is stabilized, the controller 260 may stop rotation of the user interface and fix an angle (S1040). Otherwise, slope determination (S1010) and user interface rotation (S1020) may be repeated until the slope is stabilized.
(86) In addition to the above-described functions, various controlled functions shown in Table 1 below may be performed when the smart key 200 according to the embodiment is attached to the vehicle.
(87) TABLE-US-00001 TABLE 1 Menu item Controlled function Profile loading Loading of profile through user fingerprint recognition of display Home Menu movement/menu selection Media Volume/music change/source change Navigation Zoom in & out/go to preferred destination Vehicle Drive mode setting/ADAS integrated setting Air conditioning Air volume/temperature/mode setting Settings Menu selection/list movement/detailed increase/decrease setting
(88) Meanwhile, the smart key 200 according to the embodiments of the present disclosure may provide various functions using the display 220 even outside the vehicle. This will be described with reference to
(89) Referring to
(90) In addition, an automatic parking mode is activated through predetermined menu item operation, automatic parking may be performed through rotation of wheels as shown in
(91) In addition, as shown in
(92) In addition, as shown in
(93) In addition to the above-described functions, the smart key 200 according to the embodiment may perform various functions shown in Table 2 below outside the vehicle. In order to control such functions, the smart key 200 may communicate with the vehicle through the telematics center or cellular communication.
(94) TABLE-US-00002 TABLE 2 Classification Menu item Main functions Smart key Door Lock/unlock/trunk function Automatic parking Remote start, unparking/parking Telematics Vehicle state Door open/air conditioning, etc. checking Vehicle remote Air conditioning/hot wire/window operation control Other content Bio recognition Checking of user through display fingerprint recognition Vehicle monitoring Use of surround view monitor (SVM) Monitoring of situation around vehicle Interworking with Sharing of Schedule/weather/destination/battery smartphone state Loss notification Checking of position of key
(95) Some of the functions shown in Table 2 will be described in greater detail with reference to
(96)
(97) For example, while the smart key 200 is used as an operation system inside the vehicle, wireless charging is possible. However, when the vehicle is not used for a long time and the remaining battery level is at a predetermined level (e.g., less than 15%), information indicating that the smart key 200 needs to be charged may be transmitted to the smart device of the pre-registered driver through cellular communication. Therefore, as shown in
(98) In another example, when the smart key 200 includes a GPS module and a speaker, as shown in
(99) Meanwhile, although the smart key 200 outputs a user interface through interworking with the display 120 of the integrated operation unit 100 in the above-described embodiment, the present disclosure is not limited thereto and the smart key may be attached to the periphery of a touch panel without a display function to configure the operation system of the vehicle along with the touch panel.
(100) The vehicle control method using the smart key according to the above-described embodiments of the present disclosure may have the following effects.
(101) First, the number of switches may be reduced, thereby increasing the degree of freedom in design of the smart key and the operation system of the vehicle and enhancing intuitive usability. For example, a smart key physical key button may be simplified. In another example, a center fascia and floor console switches may be integrated through function combination.
(102) In addition, since the smart key is attached/detached using magnetic force, usability is enhanced. That is, since the magnetic force of the permanent magnet or electromagnet is used instead of a mechanical structure for fixing the smart key to the attachment area, it is possible to conveniently attach the smart key to the attachment area, only by disposing the smart key to be close to the attachment area.
(103) In addition, when a wireless charging function is included in the smart key, since wireless charging is automatically performed by attaching the smart key, a separate charging slot need not be prepared or a battery need not be replaced.
(104) In addition, it is not necessary for the driver to see a degree of operation without keeping eyes forward while driving the vehicle through a feeling of operation of a physical dial.
(105) The in-vehicle control apparatus according to at least one embodiment of the present disclosure having the above-described configuration can provide a more convenient user interface in connection with the smart key provided with the display.
(106) In addition, the present disclosure provides a function which varies according to the position of the smart key provided with the display inside the vehicle. In particular, the smart key configures a portion of the operation system inside the vehicle, thereby controlling various functions according to the state of the vehicle.
(107) The effects of the present disclosure are not limited to the above-described effects and other effects which are not described herein may be derived by those skilled in the art from the above description of the embodiments of the present disclosure.
(108) The disclosure can also be embodied as computer readable code on a computer readable recording medium. The computer readable recording medium is any data storage device that can store data which can thereafter be read by a computer system. Examples of the computer readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks and optical data storage devices.
(109) The above exemplary embodiments are therefore to be construed in all aspects as illustrative and not restrictive. The scope of the disclosure should be determined by the appended claims and their legal equivalents, not by the above description, and all changes coming within the meaning and equivalency range of the appended claims are intended to be embraced therein.