Apparatus for searching using multiple displays
12019846 ยท 2024-06-25
Assignee
Inventors
Cpc classification
B60K35/00
PERFORMING OPERATIONS; TRANSPORTING
B60K35/60
PERFORMING OPERATIONS; TRANSPORTING
B60K35/10
PERFORMING OPERATIONS; TRANSPORTING
International classification
B60K35/00
PERFORMING OPERATIONS; TRANSPORTING
B60K35/60
PERFORMING OPERATIONS; TRANSPORTING
Abstract
The present invention relates to an apparatus for searching using multiple displays. The apparatus for searching using multiple displays includes an input part configured to receive an integrated search command signal, a memory in which a program for controlling an integrated search function to be displayed on at least one of an upper display and a lower display according to the integrated search command signal is stored, and a processor configured to execute the program, wherein the processor controls display of an integrated search window for at least one of the lower display disposed in a cockpit and the upper display disposed above the lower display.
Claims
1. A system for conducting a search using multiple displays, the multiple displays comprising a lower display positioned at a cockpit and an upper display positioned above the lower display, the system comprising: a processor; and a computer-readable medium in communication with the processor and storing instructions that, when executed by the processor, cause the processor to control the system to perform: receiving, from a user via a user interface, a first user input requesting to initiate an integrated search session; in response to receiving the first user input, performing: displaying, on the upper display, a plurality of first lists respectively corresponding to a plurality of menu categories, each first list including a plurality of selectable items of the corresponding menu category that are arranged in an order of usage recency; displaying, on the lower display, (1) an integrated search window configured to display a search word provided by the user and (2) a plurality of buttons respectively corresponding to the plurality of menu categories, each button being associated with the most frequently used selectable item of the corresponding menu category; receiving, from the user via the user interface, a second user input containing a search word including one or more characters; and in response to receiving the second user input, performing: displaying, on the integrated search window, the one or more characters of the received search word; and replacing the plurality of first lists displayed on the upper display with a plurality of second list, respectively, each second list including a plurality of selectable items of the corresponding menu category that are relevant to the one or more characters of the received search word.
2. The system of claim 1, wherein the instructions, when executed by the processor, further cause the processor to control the system to perform: receiving, from the user via the user interface, a user input identifying a user profile; and in response to receiving the user input, displaying a search result for each of the plurality of menu categories relevant to the identified user profile and a search word.
3. The system of claim 1, wherein, for displaying the integrated search window on the lower display, the instructions, when executed by the processor, further cause the processor to control the system to perform: detecting that an app function is being executed on the upper display; and in response to detecting the app function being executed on the upper display, displaying the integrated search window on the lower display.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The above and other objects, features, and advantages of the present invention will become more apparent to those of ordinary skill in the art by describing exemplary embodiments thereof in detail with reference to the accompanying drawings, in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
(19)
(20)
(21)
(22)
(23)
(24)
(25)
(26)
(27)
(28)
(29)
(30)
(31)
(32)
(33)
(34)
(35)
(36)
(37)
(38)
(39)
(40)
(41)
(42)
(43)
(44)
(45)
(46)
(47)
(48)
(49)
(50)
(51)
(52)
(53)
(54)
(55)
(56)
(57)
(58)
(59)
(60)
(61)
(62)
DETAILED DESCRIPTION
(63) Advantages and features of the present invention and methods for achieving them will be made clear from embodiments described in detail below with reference to the accompanying drawings.
(64) However, the present invention may be implemented in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, the embodiments are provided in order to fully explain the present invention and fully explain the scope of the present invention for those skilled in the art. The scope of the present invention is defined by the appended claims.
(65) Meanwhile, terms used herein are for the purpose of describing the embodiments and are not intended to limit the present invention. As used herein, the singular forms include the plural forms as well unless the context clearly indicates otherwise. The term comprise or comprising used herein does not preclude the presence or addition of one or more other elements, steps, operations, and/or devices other than stated elements, steps, operations, and/or devices.
(66)
(67) According to an embodiment of the present invention, a 12.3-inch upper display and a controller integrated with a 13.2-inch monitor are disposed in the integrated cockpit.
(68) The 12.3-inch upper display may be operated in a passenger mode, and the controller integrated with a 13.2-inch monitor is connected to a cluster, driver state warning (DSW), blooming sound, the 12.3-inch upper display, three-dimensional (3D) pattern lighting, a headrest speaker, a surround view module (SVM), a knob operation system, an air vent, gradient lighting, and a camera monitor system (CMS) camera.
(69) Hereinafter, an exemplary embodiment of the present invention will be described by naming the 12.3-inch display of
(70)
(71) According to an embodiment of the present invention, the apparatus for searching using multiple displays includes an input part 110 configured to receive an integrated search command signal, a memory 120 in which a program for controlling an integrated search function to be displayed on at least one of the upper display and the lower display according to the integrated search command signal is stored, and a processor 130 configured to execute the program. The processor 130 controls display of an integrated search window for at least one of the lower display disposed in a cockpit and the upper display disposed above the lower display.
(72) The processor 130 controls to display a search result for each menu corresponding to a user profile using selection information about the user profile.
(73) When an integrated search request is received, the processor 130 controls to display a list of the items in the menu according to a recent use order for each menu according to the user profile.
(74) When the integrated search request is received and a search word is input, the processor 130 controls to display a list corresponding to the search word according to a predetermined order.
(75) The processor 130 controls to arrange and display a list for each predetermined menu on the upper display and to display information having high usage frequency for each predetermined menu on the lower display.
(76) The processor 130 controls to display information according to a recent use order for each predetermined menu on the upper display, and when a search word is input to the lower display, the processor 130 controls to display a list corresponding to the search word on the upper display according to a predetermined order.
(77) When an app function is being executed on the upper display, the processor 130 controls such that the integrated search window is displayed using the lower display.
(78) The processor 130 controls such that the integrated search window is displayed using the upper display when the passenger mode is being executed.
(79)
(80) In the upper display, a temperature, a phrase (e.g., Life Is Good), and current time information (e.g., 11:23) are displayed.
(81) Contents displayed on the upper display are not limited to those illustrated in
(82) Referring to
(83) Each configuration of the global menu shown in
(84) TABLE-US-00001 TABLE 1 No. Component Function execution form Global menu state 1 User Profile Pop-up Reduce 2 Search Pop-up Reduce 3 Front Camera 12.3: execute App Maintain 4 SVM 12.3: execute App 12.3: Maintain 13.2: execute App 13.2: Reduce 5 Mode Change Global menu toggle Maintain 6 Apps Pop-up Reduce 7 ASCC Widget Reduce 8 Drive Mode Global menu toggle Maintain 9 Settings Pop-up Reduce
(85)
(86) Referring to
(87)
(88) Each configuration of the user profile shown in
(89) TABLE-US-00002 TABLE 2 No. Component Description 1 Close button When touched, pop-up disappeared 2 Title Display user profile text 3 Current set profile Focus process Display registered image + name 4 Profile list Previously registered profile list When profile is added, corresponding profile list is enlarged When touched, apply corresponding profile 5 Guest profile Display default image + geust When touched, apply guest profile 6 Profile add button When touched, enter profile addition screen Dummy button 7 Right fixed button {circle around (4)} dispose [Guest] and [Add Profile] buttons on right side of profile list 8 Edit button When touched, enter edit mode Dummy button
(90)
(91) When a profile name of Eric is selected from the global menu of the lower display, a user profile screen is displayed and a screen whose content is focused on Eric is displayed.
(92) Here, when the user selects Aaron, a user is changed to Aaron.
(93) When a profile name of Aaron is selected from the global menu of the lower display, a user profile screen is displayed and a screen whose content is focused on Aaron is displayed.
(94) Here, when the user selects Guest, a user is changed to Guest.
(95) According to the selection in the user profile, a profile image and name corresponding to the changed profile are displayed.
(96)
(97)
(98) In the integrated cockpit according to an embodiment of the present invention, it is possible to move a widget up from the lower display to the upper display, or to move the widget down from the upper display to the lower display.
(99) When an integrated search is conducted, an integrated search screen is displayed on an upper display screen and a lower display screen.
(100) Referring to
(101) Referring to
(102) At this point, the media, the contacts, and the destinations may each be displayed in consideration of both a usage frequency and an alphabetical order.
(103) The configuration of the integrated search screen shown in
(104) TABLE-US-00003 TABLE 3 No. Component Description 1 Close button When touched, pop-up disappeared 2 Search window Display prompt 3 Frequently Always display one frequently search word for searched search each category word button When touched, execute corresponding function 4 Media recent Title + list structure search result list Music: thumbnail + 1.sup.st line song title + 2.sup.nd line artist name Video: thumbnail + video title When touched, execute corresponding media 5 Contacts recent Title + list structure search result list Thumbnail + 1.sup.st line contact name + 2.sup.nd line phone number Dummy list touch not allowed 6 Destination recent Title + list structure search result list Destination icon + destination name When touched, execute navigation 7 List scroll bar When there are more than N lists, display scroll bar 8 Search word Display color for word matched for input search matching display word
(105)
(106) Navigation information is displayed on the upper display, and the integrated search screen is displayed on the lower display.
(107)
(108) Referring to
(109) Referring to
(110) At this point, the media, the contacts, and the destinations may each be displayed in consideration of both a usage frequency and an alphabetical order.
(111) The configuration of the integrated search screen shown in
(112) TABLE-US-00004 TABLE 4 No. Component Description 1 Close button When touched, pop-up disappeared 2 Search window Display prompt 3 Media recent search Title + list structure result list Music: thumbnail + 1.sup.st line song title + 2.sup.nd line artist name Video: thumbnail + video title When touched, execute corresponding media 4 Contacts recent Title + list structure search result list Thumbnail + 1.sup.st line contact name + 2.sup.nd line phone number Dummy list touch not allowed 5 Destination recent Title + list structure search result list Destination icon + destination name When touched, execute navigation 6 List scroll bar When there are more than N lists, display scroll bar 7 Search word Display color for word matched for input search matching display word
(113)
(114) Referring to
(115) As described above, when the integrated search screen is provided using the upper display and the lower display, the media, the contacts, and the destinations are displayed in recent usage order or alphabetical order on the upper display and a frequently searched search word button may be displayed on the lower display.
(116) When the specific media are selected from the integrated search screen, the corresponding media are reproduced in a media widget, and when the contact is selected, a function of making/transmitting a phone call/message to the corresponding contact may be selected, and when the specific destination is selected, a navigation widget enters a preview screen for a route to the corresponding destination.
(117) When an execution app for the search result is in the screen of the lower display, the execution app is executed following the search and the search result in the corresponding position. When the execution app for the search result is not in the screen, the navigation is executed on the leftmost side. When the navigation is not in the screen, a media or phone widget is executed on the leftmost side, and when the navigation is in the screen, the media or phone widget is executed in a position on the right side of the navigation.
(118) Referring to
(119) Referring to
(120) When a destination is selected by inputting a search word in the search window of the lower display, summary information about a route to the selected destination is displayed in the navigation widget of the lower display.
(121) When a selection for start is input in the route summary information displayed on the navigation widget of the lower display, the navigation information is displayed through the upper display and route guidance information is also displayed through the navigation widget of the lower display.
(122)
(123) Referring to
(124) The configuration of the integrated search in the passenger mode shown in
(125) TABLE-US-00005 TABLE 5 No. Component Description 1 Close button When touched, pop-up disappeared 2 Search window Display prompt 3 Media recent search Title + list structure result list Music: thumbnail + 1.sup.st line song title + 2.sup.nd line artist name Video: thumbnail + video title When touched, execute corresponding media 4 Navigation recent Title + list structure search result list Destination icon + destination name When touched, execute navigation 5 List scroll bar When there are more than N lists, display scroll bar 6 Search word Display color for word matched for input search matching display word
(126) Referring to
(127) In the search result of the integrated search window of the upper display, when a selection for the media is input, the corresponding media are reproduced, and when a selection for the specific destination is input, a preview screen for a navigation route to the corresponding destination is displayed.
(128) According to the related art, information is provided using an image of a front-facing camera, and information about surrounding objects of a vehicle is provided using a surround-view monitoring device, but there is a problem in that a captured image of a limited area is displayed through a display of a fixed area.
(129) In order to solve the above problem, the present invention is directed to providing an apparatus capable of intuitively recognizing an image, which is obtained according to an image capturing angle, by a driver using multiple displays, and providing a surround-view monitoring screen according to display settings and a driving situation.
(130)
(131) According to an embodiment of the present invention, the apparatus for controlling monitoring a front-facing camera image and a surround view using multiple displays includes an input part 210 configured to receive a vehicle surroundings confirmation request signal, a memory 220 in which a program for controlling to display a front image and a surround-view monitoring image upon receiving the vehicle surroundings confirmation request signal is stored, and a processor 230 configured to execute the program. The processor 230 controls to display the image using at least one of the lower display disposed in the cockpit and the upper display disposed above the lower display, and controls an image capturing angle or an image display area to be adjusted according to the operation of a knob.
(132) In displaying the front image, the processor 230 adjusts the image capturing angle of the front-facing camera or the display area of the acquired front image in response to knob angle operation in a preset range.
(133) The processor 230 controls to display an image acquired through an under-vehicle recognition camera in response to knob angle operation deviating from the preset range.
(134) The processor 230 controls to overlay and display at least one of an overall width of the vehicle and a guideline for a wheel position of the vehicle on the image.
(135) The processor 230 controls to display a surround-view monitoring image on the upper display in the case of a driver mode, and controls to display the surround-view monitoring image on the lower display in the case of a passenger mode.
(136) The processor 230 controls the surround-view monitoring image to be displayed on the upper display or the lower display according to a request for displaying the surround-view monitoring image, or a reverse gear R.
(137) As the knob moves to a predetermined area, the processor 230 controls a pop-up screen to be called and to wait for a request for displaying an image.
(138)
(139) An image acquired using the front-facing camera is displayed on the upper display, and a widget is displayed on the lower display.
(140) On the upper display, a warning phrase is displayed in an overlay form, angle information of the camera acquiring a current image is displayed, object detection information is displayed, and vehicle overall width information is displayed.
(141) The configuration of the front-facing camera screen of the upper display shown in
(142) TABLE-US-00006 TABLE 6 No. Component Description 1 Warning phrase Display warning phrase in overlay form 2 Camera angle When knob rotated, display view angle adjustment icon 3 Object Detection detect animal (vehicle/pedestrian) and express real- time in overlay box form 4 Vehicle overall Display vehicle overall width guide in overlay width guide form
(143)
(144) According to an embodiment of the present invention, an upper display area is 1920?720, and a lower display area is 1920?1080.
(145) When a resolution of the image acquired through the camera is 1620?1250, the image is enlarged according to a horizontal width of 1920 of the display.
(146) As shown in
(147) As shown in
(148) According to knob operation information, it is possible to adjust which portion of the image acquired using the camera is to be displayed.
(149) For example, as shown in
(150)
(151) Referring to
(152) When front-facing camera image display is performed, an angle of the knob is adjusted to adjust an image capturing angle of the front-facing camera in real time according to the angle.
(153) When the knob is rotated beyond a predetermined range, the camera for recognizing the underside of the vehicle is activated, and an under-vehicle image is displayed on the upper display.
(154) Through this, a driver may intuitively recognize an obstacle under the vehicle.
(155) In displaying the image acquired through the front-facing camera and the under-vehicle recognition camera, at least one of a guideline for the overall width and a guideline for a vehicle wheel position is overlayed on the image and the overlayed image is displayed, thereby supporting the driver to easily avoid an obstacle.
(156) When the knob is pressed while the front-facing camera image is displayed on the upper display, the front-facing camera image display is ended.
(157) Referring to
(158) At this point, when there is no operation for a predetermined time (e.g., 10 seconds) after the pop-up screen is called, the pop-up screen disappears.
(159) When the front-facing camera is focused on the pop-up screen and the knob is pressed, an image acquired using the front-facing camera is displayed on the upper display.
(160) As described above, as the angle of the knob is adjusted, the display area of the image acquired using the front-facing camera is selected, or the image capturing angle of the front-facing camera is adjusted.
(161) When the knob is operated beyond a predetermined range, the image acquired through the under-vehicle recognition camera is displayed on the upper display, and at least one of the guide information about the overall width of the vehicle and the guide information about the vehicle wheel position is overlayed on the image and the overlayed image is displayed.
(162)
(163) In the driver mode, widget information is displayed on the lower display and an SVM screen is displayed on the upper display.
(164) In the passenger mode, the upper display is linked with a mobile phone of a passenger, and the SVM screen is displayed on the lower display.
(165) The SVM screen is automatically displayed on the upper or lower display in the case of the reverse gear R.
(166) Warning phrases and a vehicle top view image as shown in Table 7 below are displayed in the SVM screen.
(167) TABLE-US-00007 TABLE 7 No. Component Description 1 Warning phrase Display warning phrase in overlay form 2 Vehicle image Display vehicle top view image
(168) Referring to
(169) When the reverse gear R is released, the upper display returns to a previous screen.
(170) In the passenger mode, when a request for displaying an SVM screen through the lower display is received or the reverse gear R is engaged, the SVM screen is displayed on the lower display.
(171) When the reverse gear R is released or a signal, which is generated by touching any one point in the entire area of the lower display on which the SVM screen is displayed, is received, the lower display returns to the previous screen.
(172) According to the related art, there is a limitation in which navigation information is displayed only in a limited audio video navigation (AVN) display area.
(173) In order to solve the above problem, the present invention is directed to providing a navigation control apparatus capable of supporting a driver to easily check route guidance information by controlling navigation according to a situation using multiple displays.
(174)
(175) The navigation control apparatus using multiple displays according to an embodiment of the present invention includes an input part 310 configured to receive a navigation request signal, a memory 320 in which a program for controlling to display navigation information using multiple displays upon receiving the navigation request signal is stored, and a processor 330 configured to execute the program. The processor 330 controls to display the navigation information using at least one of the lower display disposed in the cockpit and the upper display disposed above the lower display.
(176) In a case in which the processor 330 controls to display the navigation information on the lower display and the upper display, when a navigation application is operated in any one area of the lower display and the upper display, the processor 330 controls search and menu buttons to not be exposed in the other area.
(177) The processor 330 uses response information according to the calling of the pop-up window to display a 3D driving image or an augmented reality (AR) driving image on the upper display.
(178) In a case in which the navigation information is displayed on the lower display and the upper display, when the mode is changed to a passenger mode, the processor 330 changes the upper display to an area for passenger content viewing and maintains the display of the navigation information through the lower display.
(179) In a case in which a navigation widget is being executed in an area outside the screen of the lower display, when the mode is changed to the passenger mode, the processor 330 moves the navigation widget to an area in the screen of the lower display.
(180) In setting a destination, the processor 330 provides 3D image information and provides a destination confirmation function using a rotation function to support route guidance setting for a specific point of the destination.
(181) In the passenger mode, when the navigation application is executed through the upper display, and a request to send route guidance information to the driver who has set destination information is received, the processor 330 controls to provide the route guidance information through the lower display.
(182)
(183) Before driving, on the upper display, a map image is displayed, and, when there is a touch event, a search button, an enlargement/reduction button, and a menu button are displayed.
(184) On the lower display, the map image is displayed, and the search, enlargement/reduction, and menu buttons are always displayed.
(185) The configuration and definition of the navigation display before driving shown in
(186) TABLE-US-00008 TABLE 8 No. Component Description 1 12.3 navigation Map image app 2 12.3 button Display when there is driving image touch event (disappear after 5 sec) 3 13.2 navigation Map image app 4 13.2 button Always display
(187)
(188) During driving, on the upper display, a 3D driving image is displayed, and, when a touch event is generated, a search button, an enlargement/reduction button, and an end button are displayed.
(189) During driving, on the lower display, a 2D driving image is displayed, and the search, enlargement/reduction, and end buttons are always displayed.
(190) The configuration and definition of the navigation display during driving shown in
(191) TABLE-US-00009 TABLE 9 No. Component Description 1 12.3 navigation 3D driving image app 2 12.3 button Display when there is driving image touch event (disappear after 5 sec) 3 13.2 navigation 2D driving image app 4 13.2 button Always display
(192)
(193) Referring to
(194) Referring to
(195) The configuration and definition of the navigation widget screen shown in
(196) TABLE-US-00010 TABLE 10 No. Component Description 1 12.3 screen Display driving route 2 Current position icon Display current driving position icon 3 Widget title Display navigation text 4 Search button Enter search screen 5 Map Enlarge/reduce map at specific ratio enlargement/reduction button 6 Compass button Due-north direction fixed button Operate button on/off toggle 7 Menu button Display destination list: 1/2/3 Setting button
(197)
(198) In a situation in which navigation information is displayed on the upper display, when a destination is set, a 3D map image for the destination is displayed.
(199) In the upper display on which the 3D map image is displayed, a user may check 3D information through an operation of rotating a building, and as a result of the check, the user may set a point to reach even for the same destination (e.g., the destination may be set, such as an entrance of an underground parking lot at a front door of a department store, an entrance of an outdoor parking lot at a back door of a department store, or the like)
(200) When the route setting is completed as the destination is checked, a route preview screen is provided, and here, a destination name, an estimated required time/distance, an estimated residual battery power upon arrival at the destination, a route guidance start button, a button for returning to the previous screen, and the like are displayed on the upper display.
(201) The upper display displays a 3D route guidance screen as the route guidance start button is pressed, and returns to the destination setting screen as the end button is pressed on the corresponding screen.
(202) The configuration and definition of the navigation widget screen shown in
(203) TABLE-US-00011 TABLE 11 No. Component Description 1 Destination map Destination map image image 2 3D destination map Building rotate operation image 3 Parking lot POI Parking lot information: Pin icon + name When building rotate, rotate together (TBD) 4 Route preview map 2D map image image 5 Main Route Display suggested route: blue Estimated required time/distance pop-up: 00 min/00.0 miles 6 Alternate Routes Display suggested route: Gray Estimated time/distance pop-up: 00 min/ 00.0 miles 7 Destination name Display text 8 Estimated required Estimated required time/distance pop-up: time/distance 00 min/00.0 miles 9 Estimated residual Icon + 00% battery power when arriving at destination 10 Start button When button is touched, start driving image 11 End button When button is touched, end driving image 12 Back button When button is touched, return to previous screen
(204)
(205) Referring to
(206) When the mode is returned to the driver mode from the passenger mode, the upper display resumes navigation screen display that was previously executed.
(207) Referring to
(208) At this point, when the mode is changed to the passenger mode, the navigation guidance on the upper display is ended, and the lower display moves the navigation widget to the leftmost side.
(209) When the mode is returned to the driver mode from the passenger mode, the upper display resumes the navigation screen display that was previously executed.
(210)
(211) When the navigation is not executed on the upper and lower displays, the widget arrangement on the lower display is maintained even when the mode is changed to the passenger mode.
(212) When the mode is returned to the driver mode from the passenger mode, the upper display resumes wallpaper display that was previously executed.
(213)
(214) When the default screen is displayed on the upper display, and the navigation is dragged from the lower display to the upper display, navigation information is displayed on the upper display.
(215) At this point, when a touch is input to an area of the upper display, pieces of information about the search, the enlargement/reduction, and the menu are displayed, and when 1 is selected after the menu selection is made, 3D map image information around the destination is provided according to the execution of a predetermined function.
(216) Vertical linkage is not allowed according to pinch in and pinch out, and panning.
(217) Since 3D map image information of the destination is provided through the upper display before the driving starts, the driver may register a desired point as the destination using the 3D map image information.
(218) According to the destination registration, the upper display displays route information, and when the route guidance start button is pressed, the upper display displays 3D navigation information and the lower display displays 2D navigation information.
(219)
(220) When the default screen is displayed on the upper display, and the navigation is dragged from the lower display to the upper display, navigation information is displayed on the upper display.
(221) At this point, when a touch is input to an area of the upper display, pieces of information about the search, the enlargement/reduction, and the menu are displayed, and when 1 is selected after the menu selection is made, 3D map image information around the destination is provided according to the execution of a predetermined function.
(222) Since 3D map image information of the destination is provided through the upper display before the driving starts, the driver may register a desired point as the destination using the 3D map image information.
(223) Vertical linkage is not allowed according to pinch in and pinch out, and panning.
(224) As the destination is registered, the upper display displays route information, and when the route guidance start button is pressed, the upper display displays 3D navigation information and the lower display displays 2D navigation information.
(225)
(226) When a menu button and a setting button of the upper or lower display are pressed in sequence, a navigation setting window is displayed to receive a selection for 3D navigation or AR navigation.
(227)
(228)
(229) In a user mobile device linked with the upper display, when navigation app execution is selected, 2D image information about the destination and 3D image information about the destination are displayed on the screen of the upper display.
(230) The passenger rotates a place displayed as an object on the screen of the upper display to request route guidance to a final destination place.
(231) In the passenger mode, the upper display displays guidance information about a route to the destination and displays a Toss button.
(232) When the user presses the Toss button, a pop-up window asking whether to send route guidance information to the driver is displayed.
(233) As the user presses a yes button, the route guidance information is displayed in the 2D driving image on the navigation app of the lower display.
(234) According to the related art, there is a limitation in simply using content using AVN in the vehicle.
(235) In order to solve the above problem, the present invention is directed to providing a media sound multi-connection control apparatus using multiple displays capable of simultaneously reproducing different media through AVN and a mobile device and selecting a sound source output device, simultaneously reproducing media through the multiple displays, and forming sound bubbles to prevent sound source interference between a vehicle speaker and a headrest speaker.
(236)
(237) The media sound multi-connection control apparatus using multiple displays according to an embodiment of the present invention includes an input part 410 configured to receive a content execution request signal, a memory 420 in which a program for controlling media and sound multi-connection using multiple displays upon receiving the content execution request signal is stored, and a processor 430 configured to execute the program. The processor 430 controls to display a player screen according to the content execution request signal using at least one of the lower display disposed in the cockpit and the upper display disposed above the lower display.
(238) The processor 430 controls such that a sound source is output to an in-vehicle speaker and a headrest speaker using a sound path setting signal.
(239) When a request for moving a media application from the lower display to the upper display is input, the processor 430 controls to display a player screen on the upper display and to display a list screen on the lower display.
(240) When a pull-down button is touched on the upper display, the processor 430 moves the player screen to the lower display, and controls to maintain the sound source reproduction during the movement.
(241) When an image full-screen reproduction button is touched on the lower display, the processor 430 controls the upper display to be turned off and controls the lower display to reproduce the entire screen.
(242) When a command for moving the entire screen from the lower display to the upper display is input, the processor 430 controls the entire screen to be reproduced on the upper display, and controls to display an existing widget on the lower display and display a display-off button on the lower display.
(243) When the display-off button displayed on the lower display is touched, the processor 430 turns off the lower display. When a touch signal is applied to an area of the lower display, the processor 430 controls the upper display to be turned off and the entire screen to be reproduced on the lower display
(244) The processor 430 controls to display a function bar on the lower display when a knob disposed at a lower end of the lower display is operated or a touch is input to the lower display.
(245) When different pieces of content are reproduced on the lower display and the upper display in the passenger mode, the processor 430 controls a sound source of the content being reproduced on the upper display to be output through the headrest speaker, and controls a sound source of the content reproduced on the lower display to be output through the in-vehicle speaker.
(246)
(247) According to an embodiment of the present invention, on the upper display and the lower display, universal serial bus (USB) music and video may be reproduced simultaneously, but the same file may not be reproduced.
(248) On the upper display or the lower display, and Bluetooth audio and video casts of a smartphone may be reproduced simultaneously with the USB music and video reproduction.
(249) On the upper display and the lower display, Bluetooth audio and video casts of the smartphone may be simultaneously reproduced, and the same file may not be reproduced.
(250) An input for setting a sound source output to the vehicle speaker or the headrest speaker is received from a user through a sound path setting button of the lower display.
(251) An input for setting a sound source output to the vehicle speaker or the headrest speaker is received from a user through a sound path setting button of a smartphone.
(252)
(253)
(254) The configuration and function in the Bluetooth audio screen shown in
(255) TABLE-US-00012 TABLE 12 No. Component Description 1 Widget title Display media text 2 Source tab Bluetooth/USB Music/USB Video button When each tab is touched, display player screen 3 Song 1.sup.st line: Song title information 2.sup.nd line: Artist name 3.sup.rd line: Album name 4 Favorites When button is touched, favorites add/delete button toggle 5 Album art Display current album jacket Display previous/next song album jacket When swiping leftward and rightward, change song 6 Control button Rewind/Play&Pause/Fast Forward/Repeat/Shuffle 7 Progress bar Current position Reproduced time: MM:SS Total time: MM:SS 8 Menu button Search/Favorites/List/Sound settings 9 Sound path Display current set sound path (vehicle/seat) setting button When button is touched, display sound path change pop-up 10 .Math. Button When button is touched, end 12.3 app When button is touched while music is reproduced, reproduce music continuously
(256)
(257) The Bluetooth audio list includes a button for returning to a previous screen, an area for displaying information about Bluetooth-connected devices, and a song information area.
(258) The sound path setting button is used when setting a sound path as the in-vehicle speaker or the headrest speaker.
(259) The configuration and function in the Bluetooth audio list screen shown in
(260) TABLE-US-00013 TABLE 13 No. Component Description 1 Back button When touched, return to previous screen 2 BT device Display information about two connected BT name tab devices Icon + device name 3 Song 1.sup.st line: Song title information 2.sup.nd line: Artist name 4 Sound path Display current set sound path (vehicle/seat) setting button When button is touched, display sound path change pop-up 5 Sound path Vehicle/seat selection pop-up pop-up
(261)
(262) The default screen is displayed on the upper display, and navigation information and media information are displayed on the lower display.
(263) When the sound path setting button on the lower display is pressed, the setting may be changed such that the path is changed to the in-vehicle speaker or the headrest speaker.
(264) When an operation for moving the media app from the lower display to the upper display is input, a media player app is displayed on the upper display, and the screen is changed to the list screen on the lower display.
(265) In the lower display, when the connected device is changed to other Bluetooth connected devices, a list of other Bluetooth connected devices is displayed.
(266) When the sound path setting button is pressed in the upper display, the setting may be changed such that the path is changed to the in-vehicle speaker or the headrest speaker.
(267) When the pull-down button on the upper display is pressed, the media player app is moved to the lower display and the sound source reproduction is maintained while the player is moving.
(268)
(269)
(270) The configuration and function in the USB music reproduction screen shown in
(271) TABLE-US-00014 TABLE 14 No. Component Description 1 Widget title Display media text 2 Source tab Bluetooth/USB Music/USB Video button When each tab is touched, display player screen 3 Song 1.sup.st line: Song title information 2.sup.nd line: Artist name 3.sup.rd line: Album name 4 Favorites When button is touched, favorites add/delete button toggle 5 Album art Display current album jacket Display previous/next song album jacket When swiping leftward and rightward, change song 6 Control button Rewind/Play&Pause/Fast Forward/Repeat/Shuffle 7 Progress bar Current position Reproduced time: MM:SS Total time: MM:SS 8 Menu button Search/Favorites/List/Sound settings 9 Sound path Display current set sound path (vehicle/seat) setting button When button is touched, display sound path change pop-up 10 .Math. Button When button is touched, end 12.3 app When button is touched while music is reproduced, reproduce music continuously
(272)
(273) The configuration and function in the USB music reproduction list screen shown in
(274) TABLE-US-00015 TABLE 15 No. Component Description 1 Back button When touched, return to previous screen 2 Folder list Folder icon + folder name 3 Song list 1.sup.st line: Song title 2.sup.nd line: Artist name
(275)
(276) The default screen is displayed on the upper display, and navigation information and media information are displayed on the lower display.
(277) When the sound path setting button on the lower display is pressed, the setting may be changed such that the path is changed to the in-vehicle speaker or the headrest speaker.
(278) When an operation for moving the media app to the upper display from the lower display to the upper display is input, the media player app is displayed on the upper display, and the screen is changed to the list screen on the lower display.
(279) When the pull-down button on the upper display is pressed, the media player app is moved to the lower display and the sound source reproduction is maintained while the player is moving.
(280) When the sound path setting button on the upper display is pressed, the setting may be changed such that the path is changed to the in-vehicle speaker or the headrest speaker.
(281)
(282)
(283) The configuration and function in the video reproduction screen shown in
(284) TABLE-US-00016 TABLE 16 No. Component Description 1 Widget title Display media text 2 Source tab Bluetooth/USB Music/USB Video button When each tab is touched, display player screen 3 Video title Video title 4 Favorites When button is touched, favorites add/delete button toggle 5 Player Display in fit-to-screen When screen is enlarged, display in fill-screen 6 13.2 control Rewind/Play&Pause/Fast Forward/Repeat button 7 Progress bar Current position Reproduced time: MM:SS Total time: MM:SS 8 Menu button Search/Favorites/List/Screen settings 9 Sound path Display current set sound path (vehicle/seat) setting button When button is touched, display sound path change pop-up 10 12.3 control Rewind/Play&Pause/Fast Forward/Repeat button 11 Display off When button is touched, turn 12.3 display off button 12 Video thumbnail 12.3, Display reproducing video thumbnail image image 13 .Math. Button When button is touched while music is reproduced, reproduce music continuously
(285)
(286) The configuration and function in the USB video reproduction list shown in
(287) TABLE-US-00017 TABLE 17 No. Component Description 1 Back button When touched, return to previous screen 2 Folder list Folder icon + folder name 3 Video list 1.sup.st line: Video title 2.sup.nd line: Duration Time - HH:MM:SS
(288)
(289) A situation in which the default screen is displayed on the upper display and navigation information and media information are displayed on the lower display is assumed.
(290) When a full-screen mode button on the lower display is touched, the upper display is turned off and the entire screen is reproduced on the lower display.
(291) When a button for moving an image from the lower display to the upper display is touched, the entire screen is reproduced on the upper display, and the navigation information and the media information are displayed on the lower display.
(292) When a display-off button is touched in a media information display area of the lower display, the lower display is turned off, and when an area of the lower display that is turned off is touched, the upper display is turned off and the entire screen is reproduced on the lower display.
(293)
(294) In a situation in which the default screen is displayed on the upper display and the navigation information and the media information are displayed on the lower display, when the full-screen mode button on the lower display is touched, the upper display is turned off and the entire screen is reproduced on the lower display.
(295) When the knob is operated or a screen touch is made on the lower display, a function bar appears and is displayed on the lower display.
(296)
(297) In the passenger mode, the upper display is linked to a passenger's mobile device, and navigation information and media information are displayed on the lower display.
(298) When a full-screen mode button on the lower display is touched, the entire screen is reproduced on the lower display, and the upper display is linked to the passenger's mobile device to play back content selected on the passenger's mobile device.
(299) In the passenger mode, a media sound source reproduced on the lower display is output through blooming sound (in-vehicle speaker), and a media sound source reproduced on the upper display is output through the headrest speaker.
(300) In the passenger mode, each speaker forms a sound bubble to prevent sound sources provided to the driver and the passenger from interfering each other.
(301) According to the related art, there is a limitation in which a function of simply adjusting the color of ambient light in the vehicle is provided, but a function that allows a vehicle passenger to meditate is not provided.
(302) In order to solve the above problem, the present invention is directed to providing an apparatus capable of providing a function that allows a vehicle passenger to meditate by controlling the multiple displays, the speaker, and a mood lamp in the vehicle.
(303)
(304) The meditation function-providing apparatus using multiple displays according to an embodiment of the present invention includes an input part 510 configured to receive a meditation function request signal, a memory 520 in which a program for providing a meditation function using multiple displays upon receiving the mediation function request signal is stored, and a processor 530 configured to execute the program. The processor 530 uses at least one of the lower display disposed in the cockpit and the upper display disposed above the lower display and provides the meditation function in conjunction with the speaker and the mood lamp.
(305) In the driver mode, the processor 530 controls to turn off the lower display and to display a meditation app execution screen on the upper display.
(306) When a knob is operated, the processor 530 controls to perform an event operation on the meditation app execution screen according to a knob operating direction.
(307) In the passenger mode, the processor 530 controls to display the meditation app execution screen on the upper display.
(308) The processor 530 controls to display a meditation multi-tasking screen on the upper display, and controls to display a media thumbnail screen when an app drawer button is touched and the meditation app is selected.
(309) The processor 530 controls the sound source, which is linked with the meditation app displayed on the upper display, to be output through the passenger headrest speaker, and controls a sound source of media, whose execution screen is displayed on the lower display, to be output through the in-vehicle speaker.
(310) The processor 530 controls the headrest speaker and the in-vehicle speaker to form sound bubbles.
(311)
(312) According to an embodiment of the present invention, a meditation app execution screen is displayed on the upper display, the lower display is turned off, and a knob display is also turned off.
(313) The mood lamp and the blooming speaker are linked to the meditation app so that the color and sound thereof are set.
(314) The configuration and definition in the execution screen shown in
(315) TABLE-US-00018 TABLE 18 No. Component Description 1 12.3 Display Execute meditation app 2 13.2 Display Screen Off 3 Knob display Screen Off 4 Mood Lamp Changing color and dimming of lamp in conjunction with screen 5 Blooming Speaker Reproduce meditation app sound
(316)
(317) In the passenger mode, the meditation app is executed on the upper display, and the lower display displays navigation information, media information, or the like as a normal screen operation, and a normal operation is performed on the knob display.
(318) The blooming speaker reproduces a sound source of content displayed through the lower display, and a passenger seat headrest speaker reproduces a meditation app sound.
(319) The configuration and definition in the execution screen shown in
(320) TABLE-US-00019 TABLE 19 No. Component Description 1 12.3 Display Execute meditation app 2 13.2 Display Normal screen operation 3 Knob display Normal operation 4 Mood Lamp Changing color and dimming of lamp in conjunction with screen 5 Blooming Speaker Reproduce 13.2 content 6 Headrest Speaker Reproduce meditation app sound
(321)
(322) It is assumed that the default screen is displayed on the upper display and the meditation function is selected on the lower display.
(323) As the meditation app is executed, sound and mood lamps for each image are linked to the application, and when the knob is operated, an event operation for a touch/drag operation is performed according to a knob operating direction in a random area.
(324) When a touch signal is applied to the lower display screen, an end button is displayed, and when the end button is touched, the default screen is displayed on the upper display, and previously executed widgets are displayed on the lower display.
(325)
(326) In the passenger mode, the meditation screen displayed on the upper display displays a button for returning to the previous screen when touched, an area in which a title is displayed, an app drawer button, a meditation thumbnail button, and a meditation icon.
(327) The configuration and definition in the screen shown in
(328) TABLE-US-00020 TABLE 20 No. Component Description 1 Back button When touched, return to previous screen 2 Title Display text 3 App drawer button App drawer open/close button 4 Meditation When touched, execute entire meditation thumbnail button screen 5 Meditation icon In case of interactive meditation content, display icon
(329)
(330) In the passenger mode, the upper display displays information about a linked passenger mobile device.
(331) When the meditation app is executed, the meditation screen shown in
(332) As the meditation app is executed, the headrest speaker and the mood lamp of the passenger seat are linked with the execution of the app so that a sound source and a mood light thereof are set.
(333)
(334) In the meditation multi-tasking screen in the passenger mode, an app drawer button provides an app drawer open/close button.
(335) When a meditation thumbnail button is touched, an entire meditation screen is executed.
(336)
(337) When the app is being executed on the upper display in the passenger mode, apps such as a navigation app, a media app, a meditation app, and the like are displayed according to a touch on the app drawer button, a meditation function is provided according to the execution of the meditation app and the touch on the meditation thumbnail button, and in conjunction with the meditation app, a sound source is reproduced by the passenger seat headrest speaker and the mood lamp is set.
(338)
(339) According to an embodiment of the present invention, when the upper display is linked with the mobile device of the passenger in the passenger mode to display the meditation app execution screen, the passenger seat headrest speaker outputs a sound source according to the execution of the meditation app.
(340) The media sound source reproduced on the lower display is output through the blooming speaker.
(341) In the passenger mode, the headrest speaker and the blooming speaker form sound bubbles to prevent sound sources provided to the driver and the passenger from interfering with each other.
(342) According to the related art, there has been proposed a technique of connecting an in-vehicle system and a mobile device so that media reproduced in the mobile device may be viewed through the in-vehicle system. As an in-vehicle display is provided in various aspects, there is a need for a technique related to media cast between an in-vehicle infotainment (IVI) system and the mobile device.
(343) In order to achieve the above object, the present invention is directed to providing a control apparatus for media cast between a mobile device and an IVI system capable of continuously reproducing media running on the mobile device, in the IVI system, selecting the in-vehicle speaker or the headrest speaker as an output device, and preventing sound source interference between the in-vehicle speaker and the passenger headrest speaker.
(344)
(345) The control device for media cast between an IVI system and a mobile device according to the present invention includes an input part 610 configured to receive a cast request from the mobile device, a memory 620 in which a program for reproducing content of the mobile device on the in-vehicle display according to the cast request is stored, and a processor 630 configured to execute the program. The processor 630 controls to provide a cast service using the upper display disposed above the lower display disposed in the cockpit.
(346) When the mobile device is linked with the upper display according to the cast request, the processor 630 controls the reproduction of content in response to a signal input through a controller screen displayed on the mobile device.
(347) The processor 630 controls a sound path to be set as the in-vehicle speaker or the headrest speaker according to an input on a sound path setting button.
(348) The processor 630 controls to display the sound path setting button when the cast is successful.
(349) When the cast is ended, the processor 630 controls to display a screen previous to the cast on the upper display.
(350) When the mode is the passenger mode and a passenger screen app is being executed on the upper display, the processor 630 controls the corresponding content to be directly executed on the upper display according to the cast request.
(351)
(352) A smartphone app screen according to an embodiment of the present invention includes a title area, a menu button, a video tab, a music tab, a thumbnail, a motion-sickness reduction operation button, a casting flag, and a mini player.
(353) When the motion-sickness reduction operation button is touched, visual, auditory, tactile feedback operations are performed to reduce motion sickness.
(354) The configuration and definition of the smartphone app screen is as summarized in Table 21 below.
(355) TABLE-US-00021 TABLE 21 No. Component Description 1 Title area Display current selected media position Phone: display media in terminal Vehicle: display media in vehicle 2 Menu button When selected, extend menu bar 3 Video tab List of video files in app 4 Music tab List of sound source files in app 5 Thumbnail Media thumbnail file 6 Motion-sickness When button is touched, visual, auditory, reduction and tactile feedback operations for operation button reducing motion sickness 7 Casting Flag Display flag of content being cast 8 Mini Player Display mini player when there is content being cast Same specification in video/music Fix bottom Thumbnail File name Previous/Next/Play/Pause Cast button: when touched, execute in app after cast end
(356)
(357) The smartphone app video player screen includes a button for returning to a previous screen when touched, a video title, a cast button, a control button, and a progress bar, and when a hardware volume button of the mobile device is operated, the volume of content being reproduced is adjusted.
(358) When the cast button is touched, the content is displayed on the upper display through the cast function.
(359) The configuration and definition of the smartphone app video player screen are as summarized in Table 22 below.
(360) TABLE-US-00022 TABLE 22 No. Component Description 1 Back button When touched, return to previous screen 2 Title Display video title 3 Cast button When button is touched, 12.3 cast function on/off toggle operation 4 Control button Previous/Play&Pause/Next 5 Progress bar Current position Reproduced time: H:MM:SS Total time: H:MM:SS 6 H/W volume When hardware volume button of phone terminal button is controlled, adjust volume of reproducing content
(361)
(362) The smartphone app music player screen includes a minimization button for minimizing to a mini-player when touched, a sound source thumbnail image, content information, a progress bar, a control button, a volume control bar, a sound path setting button, and a cast button
(363) When the cast button is touched, the content is displayed on the upper display through the cast function.
(364) In the sound path setting button, a current set sound path (the in-vehicle speaker or the headrest speaker) is displayed, and when the button is touched, a sound path change pop-up window is displayed, and when the cast is performed, the default sound path is a headrest speaker.
(365) The configuration and definition of the smartphone app music player screen are as summarized in Table 23 below.
(366) TABLE-US-00023 TABLE 23 No. Component Description 1 Minimization When button is touched, minimize to mini- button player 2 Thumbnail image Display sound source thumbnail image 3 Content 1.sup.st line: Song title information 2.sup.nd line: Artist name 4 Progress bar Current position Reproduced time: H:MM:SS Total time: H:MM:SS 5 Control button Previous/Play&Pause/Next 6 Volume control When handler is dragged leftward and bar rightward, set volume steps 7 H/W volume When hardware volume button of phone button terminal is controlled, adjust volume of reproducing content 8 Sound path Display current set sound path (vehicle/seat) setting button When button is touched, display sound path change pop-up During cast, default sound path is seat speaker 9 Cast button When button is touched, 12.3 cast function on/off toggle operation
(367)
(368) During the smartphone app cast, the controller screen includes a button for minimizing to a mini-player when touched, a sound video or source thumbnail image, content information, a progress bar, a control button, a volume control bar, a sound path setting button, and a cast button
(369) When the cast button is touched, the content is displayed on the upper display through the cast function.
(370) In the sound path setting button, a current set sound path (the in-vehicle speaker or the headrest speaker) is displayed, and when the button is touched, a sound path change pop-up window is displayed, and when the cast is performed, the default sound path is the headrest speaker.
(371) The configuration and definition of the controller screen during the smartphone app cast are as summarized in Table 24, below
(372) TABLE-US-00024 TABLE 24 No. Component Description 1 Minimization When button is touched, minimize to mini- button player 2 Thumbnail image Display video/sound source thumbnail image 3 Content Video: Video title information Sound source 1.sup.st line: Song title 2.sup.nd line: Artist name 4 Progress bar Current position Reproduced time: H:MM:SS Total time: H:MM:SS 5 Control button Previous/Play&Pause/Next 6 Volume control When handler is dragged leftward and bar rightward, set volume steps 7 H/W volume When hardware volume button of phone button terminal is controlled, adjust volume of reproducing content 8 Sound path Display current set sound path (vehicle/seat) setting button When button is touched, display sound path change pop-up During cast, default sound path is seat speaker 9 Cast button When button is touched, 12.3 cast function on/off toggle operation
(373)
(374) As an upper left button is touched, a position for searching for content may be changed to the mobile device and the vehicle.
(375)
(376) A video selected in the mobile device is displayed on the upper display according to a cast request, and during the cast, a minimization button, a thumbnail image, content information, a progress bar, a control button, a volume control bar, a sound path setting button, and a cast button are displayed on the controller screen.
(377) As the minimization button is touched, media thumbnail files are displayed on a video tab, and information about a currently reproducing video is displayed on a minimization screen.
(378) When the cast button is touched again, the linkage is ended, and the screen displayed before the cast request is received is displayed again on the upper display.
(379) At the end of the cast, the video is seamlessly reproduced on the mobile device. In the case of the passenger mode, as the cast is ended, the screen in the upper display is returned to a widget screen of the mobile device of the passenger.
(380) A local video may be reproduced on the lower display, and when the cast button is touched, the video is immediately reproduced even when the passenger screen app is being executed in the passenger mode.
(381)
(382) As one moves to the music tab on the app home screen of the mobile device, when the media thumbnail is selected, the corresponding music is reproduced.
(383) When the cast button is touched, the cast is performed on the upper display, the sound path setting button is displayed when the cast is successful.
(384) As the minimization button is touched, the currently reproducing player screen is changed to the minimization screen and displayed, and the app home screen is displayed.
(385) According to the related art, a driver state is monitored to provide warnings, but there is a limitation in that criteria for providing the warnings are not subdivided, and there is a problem in that the warnings are limited to being provided only to the driver.
(386) In order to solve the above problems, the present invention is directed to providing an apparatus for providing a stepwise warning according to a driver state capable of determining whether to provide a warning by subdividing criteria for providing warnings according to the driver state, and notifying a passenger of an inattentive state of a driver.
(387)
(388) The apparatus for providing a stepwise warning according to a driver state according to an embodiment of the present invention includes an input part 710 configured to receive a driver state detection result, a memory 720 in which a program for classifying warning steps using the driver state detection result and providing a predetermined warning according to the driver state detection result is stored, and a processor 730 configured to execute the program. The processor 730 provides a warning using a warning message output, a warning sound output, lamp lighting, and the like.
(389) The processor 730 outputs a warning message using the upper display disposed above the lower display disposed in the cockpit, and controls to output the warning message when a predetermined warning step is on the upper display that moved to a passenger side according to a passenger mode.
(390) The processor 730 controls to output a warning sound to a passenger headrest speaker according to a predetermined warning step.
(391) The processor 730 provides a warning for a predetermined period of time according to warning steps classified using the driver state detection result.
(392) The processor 730, as a first step, outputs a warning message to a cluster and turns a cluster ambient lamp on.
(393) The processor 730, as a second step, controls an interior mood lamp to be additionally turned on, and to output a warning sound.
(394) The processor 730, as a third step, controls to change and display colors of the cluster ambient lamp and the interior mood lamp, controls a beep to be output at a faster reproduction speed, and turns an emergency light on.
(395)
(396) When negligence in keeping eyes forward, fatigue, or drowsiness is detected in the driver mode, the cluster is provided with a warning message through a warning pop-up.
(397) The cluster ambient lamp flashes with different colors according to the warning step.
(398) The mood lamp flashes with different colors according to the warning step.
(399) The blooming sound is reproduced with a different warning sound according to the warning step.
(400) Whether the emergency light flashes is determined according to the warning step.
(401) The configuration and definition in DSW implementation in the driver mode are as summarized in Table 25 below.
(402) TABLE-US-00025 TABLE 25 No. Component Description 1 Cluster warning Display negligence in keeping eyes forward pop-up warning phrase Display fatigue/drowsiness warning phrase Cluster ambient First/second warning steps: flash default lamp color Third warning step: flash red color 3 Mood lamp Second warning step: flash default color Third warning step: flash red color 4 Blooming sound Second/third warning steps: reproduce warning sound 5 Emergency light Third step warning: flash emergency light
(403)
(404) When negligence in keeping eyes forward, fatigue, or drowsiness is detected in the passenger mode, the cluster is provided with a warning message through warning pop-up.
(405) The cluster ambient lamp flashes with different colors according to the warning step.
(406) The mood lamp flashes with different colors according to the warning step.
(407) The blooming sound is reproduced with a different warning sound according to the warning step.
(408) Whether the emergency light flashes is determined according to the warning step.
(409) The upper display is in a state of being moved toward the passenger side according to the passenger mode, and a driver state classification result and a warning message according to the driver state classification result are provided to the upper display.
(410) The passenger headrest speaker outputs different warning sounds due to the warning steps according to the driver state.
(411) The configuration and definition in the DSW implementation in the passenger mode are as summarized in Table 26 below.
(412) TABLE-US-00026 TABLE 26 No. Component Description 1 Cluster warning Same as driver mode pop-up Cluster ambient lamp 3 Mood lamp 4 Blooming sound 5 Emergency light 6 12.3 passenger Display negligence in keeping eyes forward display warning phrase Display fatigue/drowsiness warning phrase 7 Headrest Speaker Second/third step warnings: reproduce warning sound
(413)
(414) When negligence in keeping eyes forward, fatigue, or drowsiness is detected during driving, as a first step warning, a cluster pop-up phrase is displayed and a cluster ambient lamp is turned on.
(415) As a second step warning, a cluster pop-up phrase is displayed, the cluster ambient lamp is turned on, the interior mood lamp is turned on, and a warning sound is reproduced using the in-vehicle speaker.
(416) As a third step warning, a cluster pop-up phrase is displayed, the cluster ambient lamp is turned on in a color (e.g., red color) different from that in the second step, and the interior mood lamp is turned on in a color (e.g., red color) different from that in the second step, and a warning sound (e.g., a warning sound reproduced with a faster period), which is different from that in the second step, is reproduced using the in-vehicle speaker, and the emergency light is turned on.
(417)
(418) When negligence in keeping eyes forward, fatigue, or drowsiness is detected during driving, as a first step warning, a cluster pop-up phrase is displayed and the cluster ambient lamp is turned on.
(419) As a second step warning, a cluster pop-up phrase is displayed, the cluster ambient lamp is turned on, the interior mood lamp is turned on, and a warning sound is reproduced using the in-vehicle speaker. In addition, a warning message is provided using the upper display moved to the passenger side according to the passenger mode.
(420) As a third step warning, a cluster pop-up phrase is displayed, the cluster ambient lamp is turned on in a color (e.g., red color) different from that in the second step, and the interior mood lamp is turned on in a color (e.g., red color) different from that in the second step, and a warning sound (e.g., a warning sound reproduced with a faster period), which is different from that in the second step, is reproduced using the in-vehicle speaker, and the emergency light is turned on. In addition, a warning message is provided to the upper display, and a warning sound is output through the passenger headrest speaker.
(421) Meanwhile, the method according to an embodiment of the present invention may be implemented in a computer system or recorded in a recording medium. The computer system may include at least one processor, a memory, a user input device, a data communication bus, a user output device, and a storage. Each of the components described above performs data communication over the data communication bus.
(422) The computer system may further include a network interface coupled to a network. The processor may be a central processing unit (CPU), or a semiconductor device that processes instructions stored in the memory and/or storage.
(423) The memory and storage may include various types of volatile or non-volatile storage media. For example, the memory may include a read-only memory (ROM) memory and a random access memory (RAM).
(424) Accordingly, the method according to an embodiment of the present invention may be implemented as a computer-executable method. When the method according to an embodiment of the present invention is performed in a computer device, computer-readable instructions may perform the method according to the present invention.
(425) According to the present invention, an integrated search is performed using upper/lower displays arranged in an integrated cockpit, so that there is an effect of increasing search convenience of a driver and a passenger.
(426) It should be noted that objects of the present invention are not limited to the above-described object, and other objects of the present invention will be apparent to those skilled in the art from the following descriptions.