User terminal device and control method thereof
11782595 ยท 2023-10-10
Assignee
Inventors
- Jong-hyun Ryu (Daejeon, KR)
- Youn-Ho Choi (Seoul, KR)
- Yong-ho Kim (Seoul, KR)
- Jin La (Suwon-si, KR)
- Yong-gook Park (Yongin-si, KR)
- Yu-dong Bae (Suwon-si, KR)
- Ae-young Lim (Yongin-si, KR)
- Kyung-ho Jeong (Seoul, KR)
Cpc classification
G06F1/1694
PHYSICS
H04M1/0269
ELECTRICITY
G06F3/0488
PHYSICS
G06F3/017
PHYSICS
G06F2200/1637
PHYSICS
G06F2203/04808
PHYSICS
G06F3/002
PHYSICS
G06F3/04886
PHYSICS
G06F1/1692
PHYSICS
G06F3/165
PHYSICS
G06F2203/04803
PHYSICS
G06F3/04847
PHYSICS
G06F1/165
PHYSICS
G06F2200/1614
PHYSICS
H04M1/72454
ELECTRICITY
G06F3/0481
PHYSICS
G06F1/1626
PHYSICS
International classification
G06F3/04886
PHYSICS
G06F3/00
PHYSICS
G06F3/0354
PHYSICS
G06F3/0481
PHYSICS
G06F3/04847
PHYSICS
G06F3/0488
PHYSICS
Abstract
A portable device having a display, the display including a main surface area, a first curved surface area extending from a first side of the main surface area, and a second curved surface area extending from a second side of the main surface area that is opposite the first side, a sensor configured to detect a state of the portable device, and a controller configured to control the display to display a user interface (UI) on one of the first curved surface and the second curved surface based on the state detected by the sensor.
Claims
1. An electronic device, comprising: a touch display comprising a main region and curved regions, the curved regions comprising a first curved region extending from the main region in a first direction towards a left side of a front surface of the electronic device and a second curved region extending from the main region in a second direction towards a right side of the front surface of the electronic device; and one or more processors configured to: display a first screen corresponding to a first application on the main region, and control the touch display to display a first user interface (UI) element on at least one of the first curved region or the second curved region; and based on the first UI element being touched and dragged in a direction toward a physical location of the main region, control the touch display to display a second UI element corresponding to the first UI element.
2. The electronic device as claimed in claim 1, wherein the one or more processors are further configured to, based on the first UI element being touched and dragged in the direction of the main region, control the touch display to display the second UI element corresponding to the first element on the main region.
3. The electronic device as claimed in claim 1, wherein the second UI element is displayed on the first screen.
4. The electronic device as claimed in claim 1, wherein the second UI element is displayed near the first UI element in the main region.
5. The electronic device as claimed in claim 1, wherein the second UI element is displayed in full screen.
6. A method of displaying different applications on an electronic device, the electronic device comprising a touch display comprising a main region and a curved regions, the curved regions comprising a first curved region extending from the main region in a first direction towards a left side of a front surface of the electronic device and a second curved region extending from the main region in a second direction towards a right side of the front surface of the electronic device, the method comprising: displaying a first screen corresponding to a first application on the main region, and control the touch display to display a first user interface (UI) element on at least one of the first curved region or the second curved region; and based on the first UI element being touched and dragged in a direction toward a physical location of the main region, displaying a second UI element corresponding to the first UI element.
7. The method as claimed in claim 6, wherein the displaying the second screen comprises, based on the first UI element being touched and dragged in the direction of the main region, displaying the second UI element corresponding to the first element on the main region.
8. The method as claimed in claim 6, wherein the second UI element is displayed on the first screen.
9. The method as claimed in claim 6, wherein the second UI element is displayed near the first UI element in the main region.
10. The method as claimed in claim 6, wherein the second UI element is displayed in full screen.
11. The electronic device as claimed in claim 1, wherein the first screen is displayed such that a left side and a right side of the first screen respectively correspond to the left side and the right side of the front surface.
12. The method as claimed in claim 6, wherein the first screen is displayed such that a left side and a right side of the first screen respectively correspond to the left side and the right side of the front surface.
13. An electronic device, comprising: a touch display comprising a main region and curved regions, the curved regions comprising a first curved region extending from the main region in a first direction towards a first side of a front surface of the electronic device and a second curved region extending from the main region in a second direction towards a second side of the front surface of the electronic device; and one or more processors configured to: in response to a first touch interaction to touch one point of one of the first and second curved regions and move in a direction toward a physical location of the main region being detected, control the touch display to display a first UI at a first area corresponding to the touched curved region, and control the touch display to remove the first UI displayed in the first area and display a second UI including a plurality of icons corresponding to a plurality of applications on a second area corresponding to the touched curved region.
14. The electronic device of claim 13, wherein the second UI is displayed near the first area where the first UI is displayed.
15. The electronic device of claim 13, wherein the at least one processor is further configured to, in response to a second touch interaction to touch one point of the main region and move in a direction toward the touched curved region being detected while the second UI is being displayed, control the touch display to remove the second UI.
16. The electronic device of claim 13, wherein the at least one processor is further configured to, in response to one of the plurality of icons being selected while the second UI is being displayed, control the touch display to display an application screen corresponding to the selected icon on at least a part of the main region.
17. The electronic device of claim 16, wherein the at least one processor is further configured to: in response to the one of the plurality of icons being selected while the second UI is being displayed, control the touch display to display a first screen of an application corresponding to the selected icon on a part of the main region, and in response to the first screen being selected, control the touch display to display a second screen of the application corresponding to the selected icon on the main region, wherein the second screen is larger than the first screen.
18. The electronic device of claim 13, wherein the first area comprises a part of the main display area adjacent to the touched curved region and the second area comprises a part of the main display area adjacent to the touched curved region.
19. A method of displaying applications on an electronic device, the electronic device comprising touch display comprising a main region and curved regions, the curved regions comprising a first curved region extending from the main region in a first direction towards a first side of a front surface of the electronic device and a second curved region extending from the main region in a second direction towards a second side of the front surface of the electronic device, the method comprising: in response to a first touch interaction to touch one point of one of the first and second curved regions and move in a direction toward a physical location of the main region being detected, displaying a first UI at a first area corresponding to the touched curved region; and removing the first UI displayed in the first area and displaying a second UI including a plurality of icons corresponding to a plurality of applications on a second area corresponding to the touched curved region.
20. The method of claim 19, wherein the second UI is displayed near the first area where the first UI is displayed.
21. The method of claim 19, comprising: in response to a second touch interaction to touch one point of the main region and move in a direction toward the touched curved region being detected while the second UI is being displayed, removing the second UI.
22. The method of claim 19, comprising: in response to one of the plurality of icons being selected while the second UI is being displayed, displaying an application screen corresponding to the selected icon on at least a part of the main region.
23. The method of claim 22, wherein the displaying the screen of the application on at least a portion of the main region comprises: in response to the one of the plurality of icons being selected while the second UI is being displayed, displaying a first screen of an application corresponding to the selected icon on a part of the main region; and in response to the first screen being selected, controlling the touch display to display a second screen of the application corresponding to the selected icon on the main region, wherein the second screen is larger than the first screen.
24. The method of claim 19, wherein the first area comprises a part of the main display area adjacent to the touched curved region and the second area comprises a part of the main display area adjacent to the touched curved region.
25. A non-transitory computer-readable recording medium having embodied thereon a program, which when executed by a processor of an electronic device causes the electronic device comprising touch display comprising a main region and curved regions, the curved regions comprising a first curved region extending from the main region in a first direction towards a first side of a front surface of the electronic device and a second curved region extending from the main region in a second direction towards a second side of the front surface of the electronic device, the method comprising: in response to a first touch interaction to touch one point of one of the first and second curved regions and move in a direction toward a physical location of the main region being detected, displaying a first UI at a first area corresponding to the touched curved region; and removing the first UI displayed in the first area and displaying a second UI including a plurality of icons corresponding to a plurality of applications on a second area corresponding to the touched curved region.
26. The non-transitory computer-readable recording medium according to claim 25, wherein the second UI is displayed near the first area where the first UI is displayed.
27. The non-transitory computer-readable recording medium according to claim 25, comprising: in response to a second touch interaction to touch one point of the main region and move in a direction toward the touched curved region being detected while the second UI is being displayed, removing the second UI.
28. The non-transitory computer-readable recording medium according to claim 25, in response to one of the plurality of icons being selected while the second UI is being displayed, displaying an application screen corresponding to the selected icon on at least a part of the main region.
29. The non-transitory computer-readable recording medium according to claim 28, wherein the displaying the screen of the application on at least a portion of the main region comprises: in response to the one of the plurality of icons being selected while the second UI is being displayed, displaying a first screen of an application corresponding to the selected icon on a part of the main region; and in response to the first screen being selected, controlling the touch display to display a second screen of the application corresponding to the selected icon on the main region, wherein the second screen is larger than the first screen.
30. The non-transitory computer-readable recording medium according to claim 25, wherein the first area comprises a part of the main display area adjacent to the touched curved region and the second area comprises a part of the main display area adjacent to the touched curved region.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The above and/or other aspects of the present inventive concept will be more apparent by describing certain exemplary embodiments of the present inventive concept with reference to the accompanying drawings, in which:
(2)
(3)
(4)
(5)
(6)
(7)
DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS
(8) Certain exemplary embodiments of the present inventive concept will now be described in greater detail with reference to the accompanying drawings.
(9) In the following description, same drawing reference numerals are used for the same elements even in different drawings. The matters defined in the description, such as detailed construction and elements, are provided to assist in a comprehensive understanding of the present inventive concept. Accordingly, it is apparent that the exemplary embodiments of the present inventive concept can be carried out without those specifically defined matters. Also, well-known functions or constructions are not described in detail since they would obscure the invention with unnecessary detail.
(10) The terms such as โfirstโ and โsecondโ may be used herein to describe various elements, but should not be construed as limiting the elements. Terms should be used only to distinguish one element from the other.
(11) The terms and expressions are used herein only to describe specific embodiments, but not intended to limit the scope of the disclosure. A singular form may include a plural form, unless otherwise stated specifically. As used herein, it should be understood that the expression โcompriseโ or โconsist ofโ intends to designate existence of characteristics, numbers, steps, operations, elements, components or combinations thereof, but not to foreclose existence or possibility of addition of one or more other characteristics, numbers, steps, operations, elements, components or combinations thereof.
(12) Throughout the embodiments, โmoduleโ or โunitโ is the one that is configured to perform one or more functions or operations, and may be implemented as a combination of hardware and software. Further, a plurality of โmodulesโ or a plurality of โunitsโ may be integrated, except for the โmodulesโ or โunitsโ which do not have to be implemented on specific hardware, into one or more modules and implemented as one processor (not illustrated).
(13) Further, throughout the embodiments, a โuser interface (UI)โ may include one or more of configuration to receive user interactions and configurations indicating notification information. The UI may include a UI element and the UI element may include not only an element that can interact with a user to provide visual, auditory or olfactory feedbacks, but also an element that provides notification information. The UI element may be expressed in one of image, text and video forms, or an area which does not display the information mentioned above, but is capable of providing feedback in response to user input may be considered a UI element.
(14) Certain exemplary embodiments will be explained below with reference to the accompanying drawings.
(15)
(16) The curved display 100 may be divided into a main region (e.g., main display area, main display region) and a plurality of sub regions (e.g., sub display regions, sub display areas, auxiliary display regions, auxiliary display areas). The โmain regionโ and โsub regionโ may be defined in various ways. For example, one in relatively larger size among the regions may be defined as a main region, while the other smaller one may be defined as a sub region. Or, a main region may be the region that is placed on the same plane (i.e., flat plane) as a home button to return to home screen or as a front speaker, while the sub region may be the one that is placed on a side (i.e., area adjacent to or connecting with the flat plane). Or, the main region may represent the region where it is possible to directly control the UI in the region, while the sub region may represent the region where it is possible to control the UI of the main region.
(17) In certain exemplary embodiment, the curved display 100 may include a main region provided on a front surface of the user terminal device 100, a first sub region extended from the main region and bent toward a first side of the user terminal device 1000, and a second sub region extended from the main region and bent toward a second side of the user terminal device 1000. Meanwhile, the first and second sub regions may include only the regions that are bent to a direction of the sides of the user terminal device 100 and fixed, but not limited thereto. Accordingly, the first and second sub regions may include not only the regions that are bent toward the sides of the user terminal device 1000 and fixed, but also portion of planar (flat) area positioned in front (i.e., front surface) of the user terminal device 1000.
(18) In the above example, the plurality of sub regions may each have area smaller than the main region. Further, the plurality of sub regions may form different planes than the main region. For example, when the main region is arranged on a front surface of the user terminal device 1000, one or more sub regions may be arranged on different surfaces, such as right side surface, left side surface, upper side surface or lower side surface, among the surfaces that form an outer shape of the user terminal device 1000. The surface including the main region and the surface including one or more sub regions may be fixed so as to form obtuse angle therebetween. Shapes, positions and number of the sub regions may vary depending on embodiments. This will be explained in detail below in the relevant description with reference to the drawings. Meanwhile, when the sub regions are on a side surface among the surfaces forming the outer shape of the terminal device 1000, the sub region may be referred to as an โedge region.โ
(19) The detector 400 detects motion of the user terminal device 1000. The detector 400 may particularly detect a rotational motion of the user terminal device 1000 using a plurality of sensors. To be specific, the detector 400 may use a tilt detecting sensor, such as a gyro sensor or acceleration sensor, to detect rotational tilting and variation in the tilting (i.e., rotational motion) on x, y, and z axes of the user terminal device 1000.
(20) The controller 200 may control the overall functions of the user terminal device 1000 using the main region and a plurality of sub regions of the curved display 100.
(21) That is, the controller 200 may control the curved display 100 to display a user interface (UI) on one or more of the plurality of sub regions, in response to a motion of the user terminal device 1000 detected through the detector 400. First, the controller 200 may acquire information about the rotational motion of the user terminal device 1000 through the detector 400.
(22) Additionally, the controller 200 may determine a sub region on which to display the UI, among the plurality of sub regions, according to the motion of the user terminal device 1000. The controller 200 may then control the curved display 100 to display the UI on the determined sub region. At this time, the UI may include UI elements to control the user terminal device 1000, UI elements to control application or UI elements that includes event information, but is not limited thereto.
(23) In one embodiment, when the first UI is provided on the first sub region and the second UI is provided on the second sub region, in response to detecting a rotational movement beyond a preset angle in a first direction, the controller 200 may control the curved display 100 to remove the first UI provided on the first sub region and to provide only the second UI on the second sub region. Then, while the second UI is provided on the second sub region, in response to detecting a rotational motion beyond a preset angle in a second direction which is opposite to the first direction, the controller 200 may control the curved display 100 to remove the second UI provided on the first sub region and to again control display of the first UI on the first sub region.
(24) In another embodiment, while the first UI is provided only on the first sub region, in response to detecting a rotational motion of the user terminal device 1000, the controller 200 may control the curved display 100 to remove the first UI provided on the first sub region and to provide the first UI on the second sub region. When a screen to execute an application is displayed on the main region, the first UI may include a UI element to control the application.
(25) In yet another embodiment, after a notification event is detected, in response to detecting a rotational motion of the user terminal device 1000, the controller 200 may control the curved display 100 to provide a notification UI corresponding to the notification event on either the first sub region or the second sub region, in accordance with the rotational motion. The notification event may include one of message reception event indicating reception of a message, e-mail reception event indicating reception of e-mail, SNS reception event indicating reception of SNS, phone call request event indicating reception of a phone call, push service information reception event indicating reception of a push notification, notification event indicating reception or occurrence of an event, and battery amount notification event indicating a battery notification related to battery usage.
(26) While the notification UI is being provided, in response to detecting a touch input in a preset time, the controller 200 may control the curved display 100 to provide an application execution screen corresponding to the notification event on the main region. For example, when the notification event is a message reception event, the controller 200 may control the curved display 100 to provide a message application execution screen on the main region.
(27) In yet another embodiment, the controller 200 may control the curved display 100 so that among a plurality of sub regions, a first type of UI is displayed on a first sub region located on a first side and a second type of UI is displayed on a second region located on a second side. The controller 200 may control the curved display 100 to display a first type of UI on the first sub region and display a second type of UI on the second sub region, according to the type of application provided on the main region.
(28) For example, the controller 200 may control the curved display 100 to display a UI associated with a previously-performed task on the first sub region and display a UI associated with a frequently used task by a user on the second sub region. For another example, the controller 200 may control the curved display 100 to display a UI associated with a task requiring low level of security on the first sub region and display a UI associated with a task requiring high level of security on the second sub region. For yet another example, when the user terminal device 100 is concurrently executing first and second applications, the controller 200 may control the curved display 100 to display a UI associated with a first application on the first sub region and display a UI associated with a second application on the second sub region. For yet another example, the controller 200 may control the curved display 100 to display a UI including a first depth menu item on the first sub region and display a second depth menu item subordinate to the first depth, on the second sub region.
(29) In one embodiment, the controller 200 may control the curved display 100 to provide a first UI associated with a first application on the first sub region, while the first application is being executed. When a specific even occurs while the first application is being executed, the controller 200 may control the curved display 100 to provide a second UI associated with a second application corresponding to the specific event on the second sub region, while providing an execution screen of at least one of the first and second applications on the main region.
(30) In a state that the execution screen for the first application is provided on the main region, that the first UI is provided on the first sub region, and that the second UI is being provided on the second sub region, in response to receiving a touch interaction on the second UI, the controller 200 may control the curved display 100 to provide a second application execution screen on the main region.
(31) In a state that the execution screen for the first application is provided, that the first UI is provided on the first sub region and that the second UI is provided on the second sub region, in response to detecting a touch interaction on one of a plurality of UI elements included in the second UI, the controller may execute the function of the second application that corresponds to the UI element associated with an input touch interaction. For example, when the second application is a music application and when the second UI includes a plurality of UI elements to control the music application, in response to detecting a touch interaction at a position of a volume adjustment UI element among a plurality of UI elements to control the music application, the controller 200 may control currently-outputted volume in accordance with the touch interaction inputted to the volume adjustment UI element.
(32) Meanwhile,
(33)
(34)
(35)
(36)
(37)
(38) Meanwhile,
(39) Meanwhile, the user terminal device 1000 may have a triangular cross-section, in which case the plane including the main region 1010 and the plane including the sub region 1020 may be connected to form obtuse angle (ฮธ) at the boundary line 1050. Additionally, trapezoidal cross section, pentagonal cross section or cross sections in various other shapes may be configured.
(40) Further, although it is illustrated above that the curved display is bent horizontally relative to a front surface of the user terminal device, the embodiments are not strictly limited thereto. That is, the curved display may be vertically bent relative to the front surface of the user terminal device.
(41)
(42) Further, although
(43) Meanwhile, although
(44) Additionally, the user terminal device may have various other configurations.
(45)
(46) As described above, the curved display may be divided into a main region and a plurality of sub regions. The curved display may be implemented as a liquid crystal display (LCD), an organic light emitting diodes (OLED) display, a plasma display panel (PDP, or various forms of displays. The curved display may also include therein a driving circuit which may be implemented as a a-si TET, a low temperature poly silicon (LTPS) TFT, or an organic TFT (OTFT) and a backlight unit. Meanwhile, the curved display may be implemented as a touch screen by being combined with a touch detector included in the detector 400.
(47) The touch detector may include at least one of touch panel and pen recognition panel. The touch panel may detect a gesture input by a user's finger and output a touch event value corresponding to the detected touch signal. The touch panel may be mounted below all of the main region and the sub regions of the curved display, or mounted only under the sub regions of the curved display. The touch panel may perceive the gesture input by the user's finger in capacitive manner or resistive manner. The capacitive manner involves sensing micro currents induced by user's body and calculating touch coordinates. The resistive manner involves using two electrode plates built in a touch panel in which upper and lower plates at a point of touch are brought into contact with each other, thus sensing flow of electric current and calculating it as touch coordinates.
(48) The pen recognition panel may detect pen gesture input by a user as the user manipulates a touch pen (e.g., stylus pen, a digitizer pen, etc.), and output a pen proximity event value or a pen touch event value. The pen recognition panel may be mounted under at least one of the main region and a plurality of sub regions of the curved display. The pen recognition panel may be implemented in EMR manner, according to which it is possible to detect touch or proximity input based on a change in the magnitude of electromagnetic field in response to approach or touch of the pen. To be more specific, the pen recognition panel may be configured to include a grid structure of electromagnetic inductive coil sensor (not illustrated) and an electric signal processor (not illustrated) which provides AC signal with a predetermined frequency sequentially to respective loop coils of the electromagnetic inductive coil sensor. When a pen with a resonance circuit built therein is present in a proximity to the loop coils of the pen recognition panel, magnetic field transmitted from corresponding loop coils generate electric currents based on mutual electromagnetic induction at the resonance circuit inside the pen. Based on these electric currents, inductive magnetic field is generated from the coils that form the resonance circuit in the pen, and the pen recognition panel can detect location at which the pen is approaching or touching by detecting this inductive magnetic field at the loop coil which is in signal reception state.
(49) Meanwhile, according to one embodiment, the user terminal device 1000 may be implemented as a curved display which includes a main region and a plurality of sub regions, but not limited to this example only. Accordingly, in an alternative embodiment, it is possible to construct a main region and a plurality of sub regions by using a plurality of general displays. When this is the case, it is possible to construct a bent form of display by connecting a plurality of displays together.
(50) The storage 310 may store various programs and data necessary for the operation of the user terminal device 1000. To be specific, the storage 310 may store programs and data to construct various screens to be displayed on the main region and the sub regions. The controller 200 displays the contents on the main region and the respective sub regions of the curved display, using the programs and data stored at the storage 310. In other words, the controller 200 may control so that the curved display displays the contents. Further, in response to a user's touch inputted with respect to the main region, the sub region and the boundary line serving as a boundary therebetween, the controller 200 performs a corresponding control operation.
(51) The controller 200 includes a RAM 210, a ROM 220, a CPU 230, a graphic processing unit (GPU) 240, and a bus 250. The RAM 210, the ROM 220, the CPU 230, and the GPU 240 may be connected together via the bus 250.
(52) The CPU 230 accesses the storage 310 and performs booting using O/S stored at the storage 310. The CPU 230 then performs various operations, using various programs, contents or data stored at the storage 310.
(53) The ROM stores instruction set for system booting, or the like. In response to input of turn-on command and power-on, the CPU 230 copies the O/S stored at the storage onto the RAM 210 according to the instruction stored at the ROM 230 and boots up the system by executing the O/S. When booting completes, the CPU 230 copies various programs stored at the storage 310 onto the RAM 210 and performs various operations by executing the programs copied onto the RAM 210. When the user terminal device 1000 is finished with the booting, the GP 240 displays a UI screen on an activated region among the main region and the sub regions. To be specific, the GPU 240 may generate a screen including various objects such as icon, image or text, using a calculator (not illustrated) and a renderer (not illustrated). The calculator calculates attribute values such as coordinate value, shape, size or color with which the respective objects are to be displayed according to a layout of the screen. The renderer generates screens of various layouts including objects, based on the attribute values calculated at the calculator. The screen generated at the renderer is provided to the curved display and displayed on the main region and the sub regions, respectively.
(54) The GPS chip 320 is configured to receive a GPS signal from a global positioning system (GPS) satellite and calculate current position of the user terminal device 1000. The controller 200 may calculate the user's position by using the GPS chip 320, when using navigation program or when user's current position is necessary.
(55) The communicator 330 is configured to perform communication with various types of external devices according to various types of communication methods. The communicator 330 includes a Wi-Fi chip 331, a Bluetooth chip 332, a wireless communication chip 333, and a nFC chip 334. The controller 200 performs communication with various external devices using the communicator 330.
(56) The Wi-Fi chip 331 and the Bluetooth chip 332 perform communications with Wi-Fi method and Bluetooth method, respectively. When using Wi-Fi chip 331 or the Bluetooth chip 332, various connection information such as SSID and session keys are first exchanged to connect communication, after which various data can be transmitted and received. The wireless communication chip 333 refers to a chip that performs communication according to various communication standards such as IEEE, Zigbee, 3rd generation (3G), 3rd generation partnership project (3GPP) or long term evolution (LTE). The NFC chip 334 refers to a chip operating in near field communication (NFC) manner, using 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860-960 MHz, and 2.45 GHz.
(57) The video processor 340 is configured to process video data included in the contents received via the communicator 330 or the contents stored at the storage 310. The video processor 340 may perform various image processing of video data such as decoding, scaling, noise filtering, frame rate conversion, or resolution conversion.
(58) The audio processor 350 is configured to process audio data included in the contents received via the communicator 330 or the contents stored at the storage 310. The audio processor 350 may perform various processing of the audio data such as decoding, amplification, or noise filtering.
(59) When a playback program for multimedia contents is executed, the controller 200 may play back corresponding contents by driving the video processor 340 and the audio processor 350.
(60) The curved display 100 may display the image frame generated at the video processor 340 on at least one of the main region and the sub regions.
(61) Further, the speaker 390 outputs the audio data generated at the audio processor 350.
(62) The button may be various types of button such as mechanical button, touch pad or wheel, which may be formed on arbitrary area including front side, side surface or rear surface of an outer side of the body of the user terminal device 1000.
(63) The microphone 370 is configured to receive user voice or other sound and convert this into audio data. The controller 200 may use the user voice inputted through the microphone 370 in a call process or may convert the user voice into audio data and store the same at the storage 310.
(64) The photographer 380 is configured to photograph still image or video image under control of the user. The photographer 380 may be implemented as a plurality of front camera, rear camera, or the like. As described, the photographer 380 may be used as a means to acquire a user's image in an embodiment to follow a gaze of the user.
(65) When the photographer 380 and the microphone 370 are provided, the controller 200 may perform control operation in response to a user's voice inputted through the microphone 370 or a user's motion recognized through the photographer 380. That is, the user terminal device 1000 may operate in motion control mode or voice control mode. In motion control mode, the controller 200 may activate the photographer 380 to photograph the user, and follows a change in motion of the user to perform corresponding control operation. In voice control mode, the controller 200 analyzes the user's voice inputted through the microphone 370 and performs control operation according to analysis on the user's voice.
(66) The user terminal device 1000 that supports motion control mode or voice control mode may adopt voice recognition technology or motion recognition technology in various embodiments described above. For example, when a user makes a motion as if he/she is selecting an object displayed on a home screen, or when a user pronounces a voice instruction that corresponds to the object, it may be determined that the corresponding object is selected so that a control operation matching the object is performed.
(67) The detector 400 detects various states of the user terminal device 1000 and user's interactions. To be specific, the detector 400 may detect a grip state in which the user is gripping the user terminal device 1000. That is, the user terminal device 1000 may be rotated or tilted to various directions. At this time, the detector 400 may use at least one of the various sensors such as electromagnetic sensor, gyro sensor or acceleration sensor to detect rotational motion or tilting degree of the user terminal device 1000 held by the user relative to a direction of gravity. Further, the detector 400 may detect touch area and grip pressure distribution with respect to the sub regions.
(68) Additionally, although not illustrated in
(69) Meanwhile, as described above, the storage 310 may store various programs.
(70) The OS 1110 performs function of controlling and managing the overall operation of the hardware. That is, the OS 1110 is a layer that is responsible for the basic functions such as hardware management, memory or security.
(71) The kernel 1120 serves as a passage through which various signals including touch signal detected from the detector 400 are delivered to the middleware 1120.
(72) The middleware 1120 includes various software modules to control the operation of the user terminal device 1000. Referring to
(73) The X II module 1130-1 receives various event signals from various hardware provided in the user terminal device 1000. The event may be set to be an event of sensing user's gesture, an event of generating system alarm, an event of executing or finishing a specific program, or various others.
(74) The APP manager 1130-2 manages the state of executing various applications 1140 installed on the storage 310. Upon sensing an event of executing application from the X II module 1130-1, the APP manager 1130-2 calls an application corresponding to the event and executes the same.
(75) The connection manager 1130-3 supports wired or wireless network connection. The connection manager 1130-3 may include various sub modules such as DNET module or UPnP module.
(76) The security module 1130-4 supports hardware certification, permission for request, secure storage, or the like.
(77) The system manager 1130-5 monitors states of the respective elements in the user terminal device 1000 and provides the result of monitoring to other modules. For example, in case of low battery or error, or sever in communication, the system manager 1130-5 may provide the result of monitoring to the main UI framework 1130-7 or the sub UI framework 1130-9 to output warning message or sound.
(78) The multimedia framework 1130-6 is provided to play back multimedia contents stored at the user terminal device 1000 or provided from an external source. The multimedia framework 1130-6 may include a player module, a camcorder module, or a sound processing module. Accordingly, it is possible to perform various multimedia playback operations to generate screen and sound and play the same.
(79) The main UI framework 1130-7 provides various UIs to be displayed on the main region of the curved display 100, and the sub UI framework 1130-9 provides various UIs to be displayed on the sub regions. The main UI framework 1130-7 and the sub UI framework 1130-9 may include an image compositor module to configure various objects, a coordinate combiner to calculate coordinates at which an object is displayed, a rendering module to render the configured object at the calculated coordinates, and a 2D/3D UI toolkit to provide tools to configure 2D or 3D form of UI.
(80) The window manager 1130-8 may detect a touch event or an input event made with user's body or pen. When sensing such event, the window manager 1130-8 delivers an event signal to the main UI framework 1130-7 or to the sub UI framework 1130-9 to perform operation corresponding to the event.
(81) Additionally, various program modules may be stored, such as a writing module to draw a line according to a trajectory of dragging made by the user who may touch on a screen and drag, or an angle calculation module to calculate pitch, roll, yaw or the like based on the detected values obtained at the detector 400.
(82) The application module 1140 includes applications 1140-1ห1140-n to support various functions. For example, the application module 1140 may include program modules to provide various services such as, for example, navigation program module, game module, electronic book module, calendar module or notification management module. These applications may be installed by default, or the user may arbitrarily install and use it during process.
(83) The software structure illustrated in
(84) Meanwhile, as described above, the user terminal device 1000 may be implemented as various types of devices such as a mobile phone, a tablet PC, a laptop PC, a PDA, a MP3 player, an electronic frame device, a TV, a PC, or a kiosk. Accordingly, the exemplary configurations described with reference to
(85) As described, the user terminal device 1000 may be implemented to have various forms and configurations. The controller 200 of the user terminal device 1000 may support various user interactions depending on embodiments.
(86) In one embodiment, the controller 200 may determine a sub region to display a UI, among a plurality of sub regions, based on the motion or tilting degree of the user terminal device 1000.
(87) The controller 200 may detect motion or tilting of the user terminal device 1000 by using one or more sensors. It is assumed herein that the detector 400 is an acceleration sensor and the operation of detecting tilting degree or motion of the user terminal device 1000 will be explained below with reference to
(88) The acceleration sensor of the detector 300 may measure acceleration speed of the user terminal device 1000 to generate electric signal and deliver the generated electric signal to the controller 200. For example, if it is assumed that the acceleration sensor is three-axis acceleration sensor, the acceleration sensor may measure gravitational acceleration with respect to X, Y and Z axes, respectively. While the acceleration sensor measures acceleration, which is acceleration of motion added with gravitational acceleration, when the user terminal device 1000 does not make motion, it is possible that only the gravitational acceleration is measured. In explaining an example below, it is assumed that the direction in which the front surface of the user terminal device 1000 faces upward is positive (+) direction of the gravitational acceleration, while the direction in which the rear surface of the user terminal device 1000 faces upward is negative (โ) direction.
(89) As illustrated in
(90) Additionally, when it is assumed that the user terminal device 1000 is placed diagonally to the surface of the table, the gravitational acceleration is measured by the acceleration sensor such that at least one axis is a value other than 0 m/sec.sup.2, and the square root of the sum of the squares of the three axis components, i.e., the size of the vector sum may be the specific value (e.g., 9.8 m/sec.sup.2). In the above example, the acceleration sensor detects accelerations in each of the X, Y and Z axis directions on the coordinate system. Of course, respective axes and corresponding gravitational accelerations may vary depending on locations at which the acceleration sensor is attached.
(91) When the gravitational acceleration delivered from the acceleration sensor is measured by one or more axis components, the controller 200 may confirm (compute) the tilting degree of the user terminal device 1000 using the accelerations with respect to the respective axes. The tilting degree may be expressed by roll angle, pitch angle and yaw angle. The roll angle may represent angle of rotation about X axis in
(92) In the example illustrated in
(93) Particularly, in response to the rotational motion of the user terminal device 1000 as detected through the detector 400, the controller 200 may control the curved display 100 to display UI on one of the two sub regions included in the curved display 100.
(94) To be specific, referring to
(95) As illustrated in
(96) As illustrated in
(97) Further, in response to sensing rotational motion of the user terminal device 1000 while the first UI is provided only to the first sub region, the controller 200 may control the curved display 100 to remove the first UI provided to the first sub region and provide the first UI to the second sub region.
(98) To be specific, as illustrated in
(99) As illustrated in
(100) Further, after sensing notification event, in response to sensing rotational motion of the user terminal device 1000, the controller 200 may control the curved display 100 to provide a notification UI corresponding to the notification event to one of the first sub region and the second sub region, according to the detected rotational motion.
(101) To be specific, as illustrated in
(102) While the UI 1530 to notify the reception of message is being displayed on one side of the main region as illustrated in the left-hand side of
(103) Alternatively, while a UI 1530 to notify the reception of message is being displayed on one side of the main region as illustrated in the left-hand side of
(104) Then in response to sensing a touch input within a preset time during provisioning of the notification UI, as illustrated in
(105) Meanwhile, although it is described above that the user terminal device 1000 rotates about X axis or Z axis, embodiments are not limited thereto. Accordingly, rotation about Y axis can also be included in the present technical inventive concept.
(106) According to another embodiment, the photographer 380 may photograph a user in which case the controller 200 may analyze the image of the user as photographed through the photographer 380 to follow the gaze of the user. The controller 200 may also determine a sub region to display the UI, among a plurality of sub regions, according to the followed user's gaze and the tilting degree of the user terminal device 1000. To be specific, when the user moves or rotates the user terminal device 1000, the controller 200 may follow the user's gaze in accordance with the motion or the rotation of the user terminal device 1000 to determine a sub region that is closest to the user's gaze. The controller 200 may then control the curved display 100 to display the UI on the sub region that is closest to the user's gaze, among the plurality of sub regions. For example, referring to
(107) In yet another embodiment, the controller 200 may control the curved display 100 to display UI on one of the plurality of sub regions, using only the tilting degree of the user terminal device 1000. For example, when the roll angle is within first range (e.g., 0 to 180 degrees) with reference to the direction of gravity, the controller 200 may ON the first sub region to display the UI, while not outputting information on the second sub region. Further, when the roll angle is within a second range (e.g., 180 to 360 degrees) with reference to the direction of gravity, the controller 200 may ON the second sub region to display the UI, while not outputting information on the first sub region.
(108) According to yet another embodiment, the controller 200 may detect the user terminal device 1000 in gripped state and determine a sub region to display the UI among a plurality of sub regions, according to how the user terminal device 1000 is gripped.
(109) To be specific, the detector 400 may detect an area of touch and a distribution of grip pressure of a touch detecting portion included in the sub region. The detector 400 may output information about the area of touch and grip pressure distribution from the touch detecting portion included in the sub region to the controller 200. Using the area of touch and grip pressure distribution as received from the detector 400, the controller 200 may determine a hand with which a user is gripping the user terminal device 1000. That is, when sensing one touch area in the sub region on the left side to the front surface and sensing four touch areas in the sub region on the right side, the controller 200 may determine that the user is gripping the user terminal device 1000 with his left hand. Further, when sensing one touch area in the sub region on the right side to the front surface and sensing four touch areas on the sub region on the left side, the controller 200 may determine that the user is gripping the user terminal device 1000 with his right hand.
(110) When determining that the user is gripping the user terminal device 1000 with his left hand, as illustrated in
(111) As described above, user is able to control the user terminal device 1000 more conveniently and intuitively through the sub regions, by displaying UI on one of the plurality of sub regions depending on rotational motion, tilting degree, or gripping state of the user terminal device 1000.
(112) According to yet another embodiment, the controller 200 may control the curved display 100 so that, among a plurality of sub regions, a first type UI is displayed on a first sub region positioned on a first side surface, and a second type UI is displayed on a second sub region positioned on a second side surface. For example, the controller 200 may control the curved display 100 to display a UI associated with a previously-performed task on the sub region 1510 on the left side surface, and display user's frequently-used task on the sub region 1520 on the right side surface. For another example, the controller 200 may control the curved display 100 to display a UI with low level of security on the sub region on the left side surface, while displaying a task with high level of security on the sub region 1520 on the right side surface. For yet another example, when the user terminal device 1000 is concurrently executing the first and second applications, the controller 200 may control the curved display 100 to display a UI associated with the first application on the sub region 1510 on the left side surface, while displaying a UI associated with the second application on the sub region 1520 on the right side surface. For yet another example, the controller 200 may control the curved display 100 to display a UI including a first depth menu item on the sub region 1510 on the left side surface, while displaying a UI including a second depth menu item, which is subordinate depth to the first depth, on the sub region 1520 on the right side surface.
(113) Further, depending on a type of application provided on the main region, the controller 200 may control the curved display 100 to display a first type UI on the sub region 1510 on the right side surface, while displaying a second type UI on the sub region 1520 on the right side surface.
(114) A control method of a user terminal device 1000 according to various embodiments will be explained below, with reference to
(115) The controller 200 may control the curved display 100 to display a UI associated with a previously-performed task on a first sub region among a plurality of sub regions, while displaying a UI associated with a user's frequently-used task on a second sub region. For example, as illustrated in
(116) However, displaying taps corresponding to recently-used applications on the sub region on the left side surface and displaying icons corresponding to user's frequently-used applications on the sub region on the right side surface, as described above, is merely an example, and the controller 200 may display on the sub region on the left side surface UIs associated with the previously-performed tasks such as a history-related UI element of the application, a UI element regarding visited sites, or a UI element regarding recently-contacted contact, and may control the curved display 100 to display, on the sub region on the right side surface, the UIs associated with the tasks that are likely to be used frequently by the user, such as, a UI element associated with favorites, a UI element associated with tools, or a widget UI element.
(117) Further, while the UI is displayed on the sub regions on the left and right side surfaces, in response to sensing a drag interaction that drags one of the plurality of UI elements included in the UI to the main region, the controller 200 may perform a function corresponding to the UI element for which the drag interaction is detected.
(118) For example, as illustrated on the left-hand side of
(119) For another example, as illustrated in the left-hand side of
(120) Meanwhile, although it is described above with reference to
(121) Further, while a UI is displayed on two sub regions, in response to sensing a specific user interaction for one of the plurality of UI elements included in the UI, the controller 200 may control the curved display 100 to provide a preview screen for a job corresponding to the UI element for which the user interaction is detected.
(122) That is, while a bank application execution screen 2100 is displayed on the main region, in response to sensing a hovering interaction by a stylus pen that approaches the second tab 1820, as illustrated in the left-hand side of
(123) Additionally, while the second web screen corresponding to the second tab 1820 is displayed, in response to sensing a hovering interaction by the stylus pen, which moves to a proximity to the fifth tab 1850, as illustrated in the right-hand side of
(124) For yet another example, while the bank application execution screen 2100 is displayed on the main region and the UI is displayed on the sub regions of the left and right side surfaces, in response to sensing a touch interaction touching on the second tab 1820, as illustrated in the left-hand side of
(125) While the second web screen corresponding to the second tab 1820 is displayed, in response to sensing a touch interaction touching on the fifth tab 1850, as illustrated in the right-hand side of
(126) As illustrated in
(127) Further, while preview screen is displayed on the main region, in response to sensing a specific interaction, the controller 200 may fix the preview screen and control the application screen displayed on the main region according to a user command.
(128) For example, as illustrated in the left-hand side of
(129) For yet another example, as illustrated in the left-hand side of
(130) Further, while the UI is displayed on the sub regions on the left and right side surfaces, in response to sensing a specific interaction, the controller 200 may remove a UI element included in the sub region for which the specific interaction is detected, from the sub region, and end the task corresponding to the UI element included in the sub region for which the specific interaction is detected.
(131) To be specific, as illustrated in the left-hand side of
(132) Further, while the UI is displayed on the sub regions on the left and right side surfaces, in response to sensing a specific interaction for two or more UI elements among a plurality of UI elements, the controller 200 may control the curved display 100 to simultaneously display the work screens corresponding to the two or more UI elements on the main region.
(133) To be specific, as illustrated in the left-hand side of
(134) Further, while the UI is displayed on the sub regions on the left and right side surfaces, in response to sensing a specific interaction, the controller 200 may control the curved display 100 to switch the screen on the main region into a home screen.
(135) That is, as illustrated in the left-hand side of
(136) Further, while the UI is displayed on the sub regions on the left and right side surfaces, in response to sensing a specific interaction, the controller 200 may control the curved display 100 to extend the screen displayed on the main region so that the screen is displayed over to the plurality of sub regions.
(137) For example, as illustrated in the upper half of
(138) As described above with reference to
(139)
(140) First, when the user terminal device 1000 is connected to one or more other user terminal devices for communication, the controller 200 may enter the share mode to perform sharing operation with the one or more other user terminal devices. Accordingly, in response to entering the share mode to perform sharing operation with the one or more other user terminal devices, the controller 200 may control the curved display 100 to display a UI element corresponding to the one or more other user terminal devices on the first sub region among a plurality of sub regions, while displaying a UI element associated with a sharing operation on the second sub region.
(141) To be specific, to perform a sharing operation with the other user terminal devices (e.g., first to fourth user terminal devices) using drawing application, as illustrated in
(142) Further, while connecting to a plurality of other user terminal devices, in response to sensing a specific interaction for one of the plurality of other user terminal devices, the controller 200 may perform a sharing operation with the other user terminal device 1000 for which the specific interaction is detected.
(143) That is, as illustrated in
(144) When the user of the user terminal device 1000 share the drawing work with the first user, editions made by the users may be indicated in different manners. For example, the edition by the user of the user terminal device 1000 may be expressed in black, while the edition by the first user may be expressed in blue. This manner of expressing may be included in an icon corresponding to each user. For example, an icon 2910 corresponding to the first user may have blue background screen.
(145) Further, while the sharing operation is performed, in response to receiving a message from the other user terminal device 1000, the controller 200 may control the curved display 100 to display the message received from the other user terminal device 1000 on the main region.
(146) That is, during a sharing operation with the first to fourth user terminal devices with the drawing application, in response to receiving a message from the fourth user terminal device 1000, as illustrated in
(147) For another example, when the first to fourth user terminal devices execute the same map application in connection with each other, the controller 200 may control the curved display 100 to display a map screen 3200 on the main region, display icons 3210 to 3240 corresponding to the other users on the sub region on the left side surface, and display icons 3250 to 3270 to control the map application on the sub region on the right side surface. In response to receiving a message from the third user terminal device 1000, as illustrated in
(148) Further, the controller 200 may perform a sharing operation with the other user terminal devices using a variety of applications. To be specific, as illustrated in
(149) At this time, when a user of the other user terminal device 1000 writes a note on the schedule application, the controller 200 may control the curved display 100 to receive the written note and display the same on the current screen. That is, the user may instantly set an appointment with a plurality of users, using the schedule application.
(150) For another example, the controller 200 may control the communicator 330 to send image contents to the other connected user terminal devices, using a gallery application. To be specific, when the gallery application is executed in the share mode, the controller 200 may control the curved display 100 to display a content list screen 3400 on the main region, display icons 2910 to 2940 corresponding to the other users on the sub region on the left side surface, and display icons 2950 to 2990 to control the gallery application on the sub region on the right side surface. Further, as illustrated in
(151) For another example, the controller 200 may generate a shared playlist for the other currently connected user terminal devices. To be specific, when a music application is executed in share mode, the controller 200 may control the curved display 100 to display a music play screen 3500 on the main region, display icons 3510 to 3540 corresponding to the other users on the sub region on the left side surface, and display icons 3550 to 3590 to control the music application on the sub region on the right side surface. Further, as illustrated in
(152) For another example, the controller 200 may allow the user to execute a video content by using a video application, while exchanging dialogues with a plurality of other users. To be specific, when the video application is executed in the share mode, the controller 200 may control the curved display 100 to display video content 3600 on the main region, and display icons 3610 to 3640 corresponding to the other users on the sub region on the lower side surface. While viewing the same video content with the plurality of other users, in response to receiving a text message from a first user, the controller 200 may control the curved display 100 to display the text message in a proximity to an icon 3610 corresponding to the first user, among the plurality of icons 3610 to 3640.
(153) For another example, the controller 200 may share a document file with a plurality of other users during a meeting, by using a document application 3700. To be specific, when the document application is executed in the share mode, as illustrated in
(154) As described in the embodiments of
(155)
(156) The controller 200 may control the curved display 100 to display a UI associated with tasks sharable with the other users, on the first sub region among a plurality of sub regions, and display UIs associated with private tasks on the second sub region.
(157) For example, as illustrated in
(158) Accordingly, after a specific content is touched, in response to dragging to one of a plurality of icons included in the sub region 3810 on the upper side surface, the controller 200 may control the communicator 330 to upload the specific content to a peripheral or an application corresponding to the dragged icon. Further, after the specific content is touched, in response to dragging to one of the plurality of icons included in the sub region 3820 on the lower side surface, the controller 200 may control the communicator 330 to upload the specific content to a peripheral or an application corresponding to the dragged icon.
(159) For another example, as illustrated in
(160) To be specific, in normal circumstance, the controller 200 may control the curved display 100 not to display an icon corresponding to an application requiring a high level of security, on the sub region 3920 on the lower side surface. However, when user authentication is conducted, the controller 200 may control the curved display 100 to display an icon corresponding to an application requiring a high level of security.
(161) For example, as illustrated in the first screen of
(162) Meanwhile, the controller 200 may determine icons to display on the sub region on the upper side surface and icons to display on the sub region on the lower side surface, depending on the required level of security, but is not limited thereto. Accordingly, the above may be determined based on user input.
(163) Further, in response to receiving an external message, the controller 200 may control the curved display 100 to display on different sub regions according to required levels of security of the received messages.
(164) To be specific, in response to receiving a general text message requiring lower level of security from outside, as illustrated in the left-hand side of
(165) However, in response to receiving a message requiring a high level of security from outside, as illustrated in the left-hand side of
(166) For another example, in response to receiving from outside a request for telephone call from a telephone number requiring a higher level of security, as illustrated in the left-hand side of
(167) As illustrated in
(168)
(169) When a plurality of applications are executed, the controller 200 may control the curved display 100 to display UIs associated with the plurality of applications on plurality of sub regions, respectively.
(170) That is, while the video application is executed, in response to receiving a request for a call from outside, as illustrated in
(171) In one embodiment, when the music application is executed, as illustrated in
(172) At this time, in response to executing a web application according to a user command, as illustrated in
(173) While the main region 4500โฒ currently does not display the music application execution screen, in response to sensing a touch interaction for one of the plurality of UI elements included in the sub region 4510 on the left side surface, the controller 200 may control the function of the music application according to the touch interaction detected for the UI element. For example, in response to sensing a touch interaction for a volume adjustment UI element among a plurality of UI elements included in the sub region 4510 on the left side surface, the controller 200 may adjust the volume of the currently-played music, in accordance with the touch interaction as detected for the volume adjustment UI element.
(174) Further, as illustrated in
(175) According to another embodiment, when the video application is executed, as illustrated in
(176) In response to receiving a request to receive a call from an external device, as illustrated in
(177) Further, as illustrated in
(178) When a plurality of execution screens corresponding to a plurality of applications are displayed on the main region of the curved display 100, the controller 200 may control the curved display 100 to display a UI corresponding to a specific application, on a sub region in a proximity to the execution screen of the specific application.
(179) To be specific, as illustrated in
(180) For another example, as illustrated in
(181) For another example, as illustrated in
(182) As described above, user is able to more conveniently and more intuitively perform multitasking, because UIs to control a plurality of applications are simultaneously displayed on a plurality of sub regions.
(183)
(184) First, in response to sensing a preset user interaction to the main region, the controller 200 may control the curved display 100 to divide the plurality of sub regions and display UI.
(185) That is, as illustrated in the left-hand side of
(186) Further, the controller 200 may move the divided UIs in response to user commands.
(187) That is, as illustrated in the first drawing of
(188) Then when the drag interaction for the sub region on the right side surface continues to the upward direction, as illustrated in the third drawing of
(189) Then when the drag interaction for the sub region on the right side surface is ceased, as illustrated in the fourth drawing of
(190) Further, as illustrated in FIG. in
(191)
(192) The controller 200 may control the curved display 100 to display a UI including a menu item with a first depth on a first sub region, and display a UI having a menu item with a second depth, which is subordinate depth to the first depth, on the second sub region.
(193) That is, as illustrated in the upper half of
(194) Further, when one of the menu items with the second depth is selected, when the selected menu item does not have a menu item with subordinate depth, the controller 200 may display, on the main region, information about the selected menu item, or when the selected menu item has a menu item with subordinate depth, the controller 200 may control the curved display 100 to display, on the sub region on the left side surface, menu items included in the subordinate depth of the selected menu item.
(195)
(196) First, while the web browsing screen is displayed as illustrated in the first drawing of
(197) As illustrated in the second drawing of
(198) As illustrated in the fifth drawing of
(199) As illustrated in the first drawing of
(200) Further, as illustrated in the fifth drawing of
(201) As explained above with reference to
(202)
(203) First, as illustrated in the first drawing of
(204) Then, as illustrated in the third drawing of
(205) For another example, as illustrated in the first drawing of
(206) Accordingly, a user is able to control applications executed on the background or basic functions with increased convenience, using the swipe interaction as described with reference to
(207)
(208) First, as illustrated in the first drawing 5610 of
(209) The control method of the user terminal device 1000 according to embodiments will be explained below with reference to
(210)
(211) First, at step 5710, the user terminal device 1000 detects motion of the user terminal device 1000. That is, the user terminal device 1000 may detect rotational motion of the user terminal device 1000, using various sensors including acceleration sensor or gyro sensor.
(212) At step 5720, on one of the plurality of sub regions, the user terminal device 1000 displays a UI to control the user terminal device 1000 according to the detected motion of the user terminal device 1000. To be specific, in response to sensing that the user terminal device 1000 is rotated in a first direction, the user terminal device 1000 may display the UI on the first sub region, and in response to sensing that the user terminal device 1000 is rotated in a second direction, the user terminal device 1000 may display the UI on the second sub region.
(213)
(214) First, at step 5810, while the first application is executed, the user terminal device 1000 provides the first sub region with the first UI corresponding to the first application.
(215) Then at step 5820, the user terminal device 1000 detects for a specific event. The specific event may include an event to execute application by user input, text message reception event, SNS reception event, request to call event, or battery amount display event.
(216) At step 5820-Y, when sensing a specific event, at step 5830, the user terminal device 1000 may provide the UI corresponding to the second application corresponding to the specific event to the second sub region, and provide an execution screen of at least one of the first and second applications to the main region.
(217) According to various embodiments, user is provided with various user experiences using a plurality of sub regions.
(218) Referring now to
(219) When the user is not grasping the user terminal device 1000, that is, when the user terminal device 1000 is lying on a floor or in default state, the controller 200 may control the curved display 100 to activate only one of a plurality of sub regions to display information. When displaying information on one sub region, the controller 200 may output the information in a horizontal arrangement. To be specific, when message is received from another device, as illustrated in
(220) Further, while the user is not grasping the user terminal device 1000, the controller 200 may control the curved display 100 to activate all of a plurality of sub regions to display information on the respective sub regions. The first sub region among a plurality of sub regions herein may correspond to a concept of a main region among a plurality of sub regions, and the second sub region may correspond to a concept of sub region among a plurality of sub regions.
(221) In one embodiment, while the user is not grasping the user terminal device 1000, in response to executing a message application, the controller 200 may control the curved display 100 to display the content of the message on the first sub region 6010 and display additional information such as sender information and sending time on the second sub region 6020, as illustrated in
(222) In another embodiment, while the user is not grasping the user terminal device 1000, in response to executing a phone application, the controller 200 may control the curved display 100 to display sender information, call duration and button to end call on the first sub region 6030 and display audio telephony menus (mute, speakerphone, effect, view keypad, etc.) on the second sub region 6040, as illustrated in
(223) In another embodiment, while the user is not grasping the user terminal device 1000, in response to executing a camera application, the controller 200 may control the curved display 100 to display photographing button (or video shooting button) on the first sub region 6050 and display camera menus (brightness adjustment, resolution, facial recognition, flash, etc.) on the second sub region 6060, as illustrated in
(224) In another embodiment, while the user is not grasping the user terminal device 1000, in response to executing a music application, the controller 200 may control the curved display 100 to display music control menus (e.g., stop/play, rewind, fast forward, volume adjustment, progress bar, etc.) on the first sub region 6070 and display album jacket image, title, lyrics, etc. on the second sub region 6080, as illustrated in
(225) In another embodiment, while the user is not grasping the user terminal device 1000, in response to executing a video application, the controller 200 may control the curved display 100 to display video control menus (e.g., stop/play, rewind, fast forward, volume adjustment, progress bar, etc.) on the first sub region 6090 and display video images, subtitles, etc. on the second sub region 6095, as illustrated in
(226) Further, the controller 200 may control the curved display 100 to display different information on the sub regions, depending on whether the user is grasping the user terminal device 1000.
(227) That is, while the user is not grasping the user terminal device 1000, for example, while the user terminal device 1000 is lying on a floor, in response to receiving a message from another device, the controller 200 may control the curved display 100 to display guidance message informing one or more of a plurality of sub regions 6110, 6120 of reception of a message from outside, as illustrated in
(228) Further, while the user is not grasping the user terminal device 1000, for example, while the user terminal device 1000 is lying on a floor, in response to executing a music application, the controller 200 may control the curved display 100 to display music information, lyrics, etc. on one or more of a plurality of sub regions 6210, 6220, as illustrated in
(229) Further, while the user is not grasping the user terminal device 1000, e.g., while the user terminal device 1000 is laying on a floor, in response to executing a video application, the controller 200 may control the curved display 100 to display subtitles, video image title, etc. on one or more of a plurality of sub regions 6210, 6220. Further, while the user is grasping the user terminal device 1000, in response to executing the video application, the controller 200 may control the curved display 100 to also display icons (e.g., play/stop, rewind, fast forward, etc.) to control the video on one or more of a plurality of sub regions 6210, 6220.
(230) Further, the controller 200 may control the curved display 100 to display text displayed on the sub region in a horizontal direction, regardless of whether the user terminal device 1000 is in horizontal mode or vertical mode. However, the controller 200 may change a direction of displaying images and icons, depending on whether the user terminal device 1000 is in horizontal mode or vertical mode. That is, when the user terminal device 1000 is in horizontal mode, the controller 200 may control the curved display 100 to display images and icons in horizontal direction, while, when the user terminal device 1000 is in vertical mode, the controller 200 may control the curved display 100 to display images and icons in vertical direction.
(231) To be more specific, as illustrated in
(232) Further, the controller 200 may determine left-hand mode or right-hand mode according to a direction of rotation, and control the curved display 100 to activate only one of a plurality of sub regions to display information on the activated sub region.
(233) To be specific, as illustrated in the left-hand side of
(234) Further, as illustrated in the left-hand side of
(235) Further, the controller 200 may determine left-hand mode or right-hand mode based on determination on a hand with which the user is grasping the user terminal device 1000. The controller 200 may determine whether the user is grasping the user terminal device 1000 with his left hand or right hand, using touch region and touch distribution, etc.
(236) In response to determining that the user is grasping the user terminal device 1000 with his left hand, as illustrated in
(237) If the application being executed is the message application, the UI element may be the content of the message, or if it is the telephone application that is being executed, the UI element may be a voice notification of telephone reception. If the application being executed is the camera application, the UI element may be camera control menus, or if it is the music application that is being executed, the UI element may be music control menus. If the video application is being executed, the UI element may be video control menus.
(238) While the user terminal device 1000 maintains the vertical mode, in response to detecting rotational movement about Z axis of the user terminal device 1000, the controller 200 may determine a sub region to display UI element according to the rotational movement.
(239) That is, while the user terminal device 1000 maintains the vertical mode, in response to grasping the user terminal device 1000 with user's left hand, the controller 200 may control the curved display 100 to display the UI element on the left-side sub region 6710, as illustrated in the upper half of
(240) Further, while the user terminal device 1000 maintains the vertical mode, in response to grasping the user terminal device 1000 with user's right hand, the controller 200 may control the curved display 100 to display the UI element on the right-side sub region 6720, as illustrated in the upper half of
(241) While the user terminal device 1000 maintains the horizontal mode, in response to detecting rotational movement about X axis of the user terminal device 1000, the controller 200 may determine a sub region to display UI element according to the rotational movement.
(242) That is, while the user terminal device 1000 maintains the horizontal mode, in response to detecting rotational movement to flip backward about X axis, the controller 200 may control the curved display 100 to display the UI element on the lower-side sub region 6820, as illustrated in
(243) As illustrated in
(244) Further, the controller 200 may control the curved display 100 to display a variety of UI elements on a plurality of sub regions, according to application being executed.
(245) In one embodiment, in response to executing a plurality of remote control applications to control a plurality of external devices (e.g., DVD, TV), as illustrated in
(246) In another embodiment, in response to executing a wallet application, as illustrated in
(247) In another embodiment, in response to executing weather application, as illustrated in
(248) In another embodiment, in response to executing health management application, as illustrated in
(249) Meanwhile, although embodiments are described above with reference to
(250) For example, in response to executing a voice recognition application, the controller 200 may control the curved display 100 to display voice-recognized information (e.g., voice-recognized text information) on the first sub region, and display information on available application (e.g., connectable functions/list of applications) on the second sub region.
(251) In another example, in response to executing a music application, the controller 200 may control the curved display 100 to display the title of the music on the first sub region, and display menus to control the music on the second sub region.
(252) In yet another example, in response to executing an electronic book (e-book) application, the controller 200 may control the curved display 100 to display title of a book on the first sub region, and display bookmark on the second sub region. Further, the controller 200 may control the curved display 100 to display index to previous page based on the current page on the first sub region, and display index to next page on the second sub region.
(253) In yet another example, in response to executing an auto vehicle-related application (e.g., navigation), the controller 200 may control the curved display 100 to display menus for a driver on the first sub region, and display menus for a passenger on the second sub region.
(254) In yet another example, in response to executing a navigation application, the controller 200 may control the curved display 100 to display estimated/target information (e.g., estimated arrival time, final destination, etc.) on the first sub region, and display current status information (e.g., road condition (congestion, etc.), current location, etc.) on the second sub region.
(255) In yet another example, in response to executing a convergence application, the controller 200 may control the curved display 100 to display superordinate concept information (e.g., list of external devices connected, list of detected beacons, etc.) on the first sub region, and display subordinate concept information (e.g., menus for selected device, messages for each beacon, etc.) on the second sub region. Further, the controller 200 may control the curved display 100 to display information about a subject doing an action (e.g., information about transmitting/receiving devices) on the first sub region, and display information about a content of the action (e.g., transmitted/received information) on the second sub region.
(256) In yet another example, in response to executing a telephone application, the controller 200 may control the curved display 100 to display information about person currently in conversation in the first sub region, and display information about a person waiting for conversation on the second sub region.
(257) In yet another example, in response to executing a message application, the controller 200 may control the curved display 100 to display a list of message groups for which message is received, on the first sub region, and display message for each of the message group on the second sub region.
(258) In yet another example, in response to executing a time application, the controller 200 may control the curved display 100 to display time information of a country where the user has residence, on the first sub region, and display time information about a country for roaming, on the second sub region.
(259) In yet another example, in response to executing an information search application, the controller 200 may control the curved display 100 to display total results of search (e.g., real-time hot search words, etc.) on the first sub region, and display partial result of search (e.g., location/age-based hot search words, etc.) on the second sub region.
(260) In yet another example, in response to executing a file download application, the controller 200 may control the curved display 100 to display information on status of transmission of the entire file on the first sub region, and display information on status of transmission of currently-transmitting file on the second sub region.
(261) As described above, the user is able to utilize applications with further increased convenience and ease, because, in response to executing a single application, the overall information is displayed on the first sub region and specific information is displayed on the second sub region, or a first type of information is displayed on the first sub region and a second type of information is displayed on the second sub region.
(262) Further, when a plurality of applications are executed, the controller 200 may control the curved display 100 to display a variety of UI elements on a main region and a plurality of sub regions, depending on types of applications being executed. Herein below, various embodiments will be explained with reference to
(263) In one embodiment, when a video application is executed, the controller 200 may control the curved display 100 to display video content on the main region 7000, display video control UI to control the video content on the first sub region 7010, and display user's frequently used shortcut icons on the second sub region 7020, as illustrated in
(264) In another embodiment, when the video application is executed, the controller 200 may control the curved display 100 to display video content on the main region 7000, display video control UI to control the video content on the first sub region 7010, and display user's frequently used shortcut icons on the second sub region 7020, as illustrated in
(265) In another embodiment, when the video application is executed, the controller 200 may control the curved display 100 to display the video content on the main region 7200, display video control UI to control the video content on the first sub region 7210, and display user's frequently used shortcut icons on the second sub region 7220, as illustrated in
(266) In another embodiment, when the video application is executed, the controller 200 may control the curved display 100 to display the video content on the main region 7300, display video control UI to control the video content on the first sub region 7310, and display user's frequently used shortcut icons on the second sub region 7320, as illustrated in
(267) In one embodiment, when the music application is executed, the controller 200 may control the curved display 100 to display information about currently-played music (e.g., album jacket image, lyrics, composer, lyricist, etc.) on the main region 7400, display music control UI to control the music content on the first sub region 7410, and display user's frequently used shortcut icons on the second sub region 7420, as illustrated in
(268) In one embodiment, when the music application is executed, the controller 200 may control the curved display 100 to display information about currently-played music on the main region 7500, display music control UI to control the music content on the first sub region 7510, and display user's frequently used shortcut icons on the second sub region 7520, as illustrated in
(269) In another embodiment, when the music application is executed, the controller 200 may control the curved display 100 to display information about currently-played music on the main region 7600, display music control UI to control the music content on the first sub region 7610, and display user's frequently used shortcut icons on the second sub region 7620, as illustrated in
(270) In another embodiment, when the music application is executed, the controller 200 may control the curved display 100 to display information about currently-played music on the main region 7700, display music control UI to control the music content on the first sub region 7710, and display user's frequently used shortcut icons on the second sub region 7720, as illustrated in
(271) In one embodiment, when the web application is executed, the controller 200 may control the curved display 100 to display a web screen on the main region 7800, display control UI (e.g., previous icon, next icon, home icon, address input window, search window, etc.) to control the web screen on the first sub region 7810, and display user's frequently used shortcut icons on the second sub region 7820, as illustrated in
(272) In another embodiment, when the web application is executed, the controller 200 may control the curved display 100 to display a web screen on the main region 7900, display control UI to control the web screen on the first sub region 7910, and display user's frequently used shortcut icons on the second sub region 7920, as illustrated in
(273) In another embodiment, when the web application is executed, the controller 200 may control the curved display 100 to display a web screen on the main region 8000, display control UI to control the web screen on the first sub region 8010, and display user's frequently used shortcut icons on the second sub region 8020, as illustrated in
(274) In another embodiment, when the web application is executed, the controller 200 may control the curved display 100 to display a web screen on the main region 8100, display control UI to control the web screen on the first sub region 8110, and display user's frequently used shortcut icons on the second sub region 8120, as illustrated in
(275) Meanwhile, the user terminal device 1000 may utilize a plurality of sub regions depending on functions, as listed in Table 1 below.
(276) TABLE-US-00001 TABLE 1 Example of utilizing a plurality of sub regions (first sub region + Function second sub region) Voice recognition Voice recognized content text + Function using recognized function text/application list Content providing Title + Control UI function Book title + Bookmark Index to previous page + Index to next page External device First external device (e.g., DVD) Control UI + Second external control function device (e.g., TV) Control UI First function of external device Control UI(e.g., Air conditioner Temp) + Second function of external device Control UI(e.g., Air conditioner capacity) Wallet function Barcode + Info (e.g., Balance, Deadline) Info for viewing by cashier (e.g., amount) + Info for viewing by myself (e.g., Authentication screen) (Barcode is displayed on sub region even when main screen is off) Health Language to translate + Translated language management Normal heart beat range + Measured heart beat data function Heart beat data for yesterday + Current heart beat data Translation Calories intake + Calories burnt function Actual activity + Target activity Auto vehicle- Final destination + Current location related function Recent destination history + Favorites Estimated time of arrival + Actual status info Control menu for driver + Control menu for passenger Gallery function Time information of when photography was taken + Location information of where photography was taken Thumbnail of previous photo + Thumbnail of next photo Emergency call List of friends who are playing back together + Friends available for function invitation Group playback function Group wireless Human face + Sound wave communication function Search function Search window + Search result (App. Icons & number of searched apps.) Handy connection Connected device (Incl. Disconnect icon) + Connectible device function (Incl. Connect icon) Content share Overall transmission status + Transmission of currently-downloaded function file Download function Weather info. Weather for yesterday + Weather for today Providing function Specific weather today + Summary weather for a week Social magazine Theme index + Comment info (Human face/ID, Display on main function region upon tapping) Search word Real-time hot search word + Location/age-based hot search word providing function Basic function Favorite contacts + Index Person waiting for call + Person currently in call Camera mode + Camera set value WWJF Time info. for my country + Time info. for country for roaming Gallery control function + Thumbnail info.
(277) Further, while the first function is being performed, in response to inputting a trigger signal to perform the second function, the user terminal device 1000 may control the main region and a plurality of sub regions according to types of the first and second functions. The functions herein may include functions utilizing images (e.g., web screen providing function, photographing function, etc.), functions utilizing images and audio (e.g., video providing function, video telephony function, etc.), functions utilizing audio (e.g., music providing function, audio telephony function, etc.), and other notification event providing functions (e.g., schedule notification, text message arrival notification, etc.)
(278) Embodiments of controlling main region and a plurality of sub regions will be explained according to types of the functions, with reference to Tables 2 to 5. Table 2 is provided to explain an embodiment in which the controller 200 controls the main region and a plurality of sub regions, in response to performing the image-utilizing function while another function is already being performed.
(279) TABLE-US-00002 TABLE 2 Existent function/new function Image-utilizing function (e.g., photographing function) Image-utilizing Image collision function (e.g., web Images provided by the existent function are removed from the screen providing main region. function) Images provided by the new function are provided on main region and a plurality of sub regions. Function utilizing Image collision images/audio (e.g., Audio provided by existent function is continuously outputted. video providing Images provided by new function are provided on main region function) and a plurality of sub regions. Audio-utilizing No collision function (e.g., music Audio provided by existent function is maintained, and images providing function) provided by existent function are provided on the first sub region. Images provided by new function are provided on main region and second sub region. Notification event No collision function (e.g., Images provided by existent function are provided on first sub schedule notification region. function) Images provided by new function are provided on main region and second sub region.
(280) Table 3 is provided to explain an embodiment in which the controller 200 controls the main region and a plurality of sub regions, in response to performing the function that utilizes images and audio while another function is already being performed.
(281) TABLE-US-00003 TABLE 3 Existent function/new function Function utilizing images/audio (e.g., video telephony function) Image-utilizing Image collision function (e.g., web Images provided by the existent function are removed. screen providing Images provided by the new function are provided on main function) region and a plurality of sub regions, and audio provided by new function is outputted. Function utilizing Image and audio collisions images/audio (e.g., Images and audio provided by existent function are removed. video providing Images provided by the new function are provided on main function) region and a plurality of sub regions, and audio provided by new function is outputted. Audio-utilizing Audio collision function (e.g., music Audio provided by existent function is removed, and images providing function) provided by existent function are provided on the first sub region. Audio provided by new function is outputted, and images provided by new function are provided on main region and second sub region. Notification event No collision function (e.g., Images provided by existent function schedule notification are provided on first subregion. function) Images provided by new function are provided on main region and second sub region, and audio provided by new function is outputted.
(282) Table 4 is provided to explain an embodiment in which the controller 200 controls the main region and a plurality of sub regions, in response to performing the audio-utilizing function while another function is already being performed.
(283) TABLE-US-00004 TABLE 4 Existent function/new function Audio-utilizing function (e.g., audio telephony function) Image-utilizing No collision function (e.g., web Images provided by the existent function are provided on main screen providing region and first sub region. function) Images provided by the new function are provided on second sub region, and audio provided by new function is outputted. Function utilizing Sound collision images/audio (e.g., Audio provided by existent function is removed, and images video providing provided by existent function are provided on first sub region. function) Audio provided by the new function is outputted, and images provided by new function are provided on second sub region. Main region outputs one of images provided by existent function/images provided by new function/other images Audio-utilizing Sound collision function (e.g., music Audio provided by existent function is removed, and images providing function) provided by existent function are provided on main region and first sub region. Images provided by new function are provided on second sub region and audio provided by new function is outputted. Notification event No collision function (e.g., Images provided by existent function are provided on first sub schedule notification region. function) Images provided by new function are provided on second sub region, and audio provided by new function is outputted. Main region outputs one of images provided by existent function/images provided by new function/other images
(284) Table 5 is provided to explain an embodiment in which the controller 200 controls the main region and a plurality of sub regions, in response to performing the notification function while another function is already being performed.
(285) TABLE-US-00005 Existent function/new function Notification event function (e.g., message notification function) Image-utilizing No collision function (e.g., web Images provided by the existent function are provided on main screen providing region and first sub region. function) Images provided by the new function are provided on second sub region Function utilizing No collision images/audio (e.g., Audio provided by existent function is continuously provided, video providing and images provided by existent function are provided on main function) region and first sub region. Images provided by the new function are provided on second sub region. Audio-utilizing No collision function (e.g., music Audio provided by existent function is maintained, and images providing function) provided by existent function are provided on first sub region. Images provided by new function are provided on second sub region. Main region outputs one of images provided by existent function/images provided by new function/other images Notification event No collision function (e.g., Images provided by existent function are provided on first sub schedule notification region. function) Images provided by new function are provided on second sub region. Main region outputs one of images provided by existent function/images provided by new function/other images
(286) Hereinafter, referring to
(287) The controller 200 may control the flexible display 100 to display a UI of an application on a sub area. Herein, the UI displayed on the sub area may be different from a UI of an application displayed on a main screen. To be specific, the UI displayed on the sub area may provide the number of UI elements less than the UI displayed on the main area. Also, the UI displayed on the sub area may provide a UI element which is smaller than a UI element provided from the UI displayed on the main area. Further, the UI displayed on the sub area may provide a UI element in a simpler shape than a UI element provided from the UI displayed on the main area. That is, the UI displayed on the sub area may provide a function which is more limited than the UI displayed on the main area.
(288) The controller 200 may provide a UI displayed on a sub area by detecting whether the user terminal device 1000 is gripped or not. To be specific, if it is detected that the user terminal device 1000 is not gripped while a specific application is executed or a specific event is generated, the controller 200 may control the flexible display 100 to display a UI of an application or a UI of an event on an entire screen of a plurality of sub areas. If it is detected that the user terminal device 1000 is gripped, the controller 200 may control the flexible display 100 to control and display at least one among a location, a shape and the number of UI elements included in a UI of an application or a UI of an event provided to an entire screen of a plurality of sub areas. To be specific, if it is detected that the user terminal device 1000 is gripped by a user's hand, the controller 200 may control the flexible display 100 to move a location of a UI element provided to an entire screen of a plurality of sub areas to an area which is not covered by a user's hand, and to display the UI element. If it is detected that the user terminal device 1000 is gripped by a user's hand, the controller 200 may control the flexible display 100 to remove at least one of a plurality of UI elements provided to an entire screen of a plurality of sub areas. Also, if it is detected that the user terminal device 1000 is gripped by a user's hand, the controller 200 may control the flexible display 100 to simplify and provide the shape of a plurality of UI elements provided to an entire screen of the plurality of sub areas. Meanwhile, an area which is not covered by a user's hand may be detected by a touch sensor, but this is one of examples, and it may be an area predetermined by a user (for example, an upper area).
(289) According to a detailed exemplary embodiment, if there is a request to receive telephone call from outside while a user does not grip the user terminal device 1000, the controller 200 may control the flexible display 100 to display a telephone number of a caller, and a volume adjustment icon on the first sub area 8310, and to display an accept icon and a reject icon on the second sub area 8320 as illustrated in
(290) According to another exemplary embodiment, if a message is received from outside while a user does not grip the user terminal device 1000, the controller 200 may control the flexible display 100 to display caller information and content of the message on the first sub area 8310, and display an icon to notify a receipt of a message, a replay icon, a next message icon, a delete icon on the second sub area 8320 as illustrated in
(291) According to another exemplary embodiment, if a web application is executed while the user terminal device 1000 is not gripped by a user, the controller 200 may control the flexible display 100 to display a bookmark icon, a setting icon, a print icon, a store icon on the first sub area 8410, and display a previous icon, a next icon, a home icon, a refresh icon on the second sub area 8420 as illustrated in
(292) As explained above, if a user grips the user terminal device 1000, a location, a shape, and the number of UI elements are changed, and thus, the user may remove an icon covered by a user's hand and control the device by a user's hand (especially, a thumb).
(293) However, the exemplary embodiments above are one of exemplary embodiments, and other applications may be applied to the technical spirit of the present invention. For example, if a camera application is executed while the user terminal device 1000 is gripped by a user's hand, the controller 200 may control the flexible display 100 to display a stop image shooting button and a video shooting button on an upper area which is not covered by a user's hand among the first sub area, and to display a gallery button on an upper area which is not covered by a user's hand among the second sub area. Also, if a music application is executed while the user terminal device 1000 is gripped by a user's hand, the controller 200 may control the flexible display 100 to display a volume adjustment icon on an upper area which is not covered by a user's hand among the first sub area, and to display a previous music icon, a next music icon and a pause icon on an upper area which is not covered by a user's hand among the second sub area.
(294) It is explained that a UI is displayed on all of a plurality of sub areas while a user grips the user terminal device 1000, but this is one of examples, and displaying a UI on only one sub area among a plurality of sub areas may be included in the technical spirit of the present invention.
(295) Meanwhile, the control method of a user terminal device 1000 according to various embodiments may be implemented as a program and provided on a display device or an input device. The program including a control method of a display device may particularly be stored and provided on a non-transitory computer readable medium.
(296) The non-transitory computer readable recording medium refers to a medium which store data semi-permanently and can be read by devices, rather than a medium that stores data temporarily, such as, register, cache, or memory. Specifically, the above various applications or programs may be stored and provided on a non-transitory computer readable recording medium such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, or ROM.
(297) Further, the foregoing exemplary embodiments and advantages are merely exemplary and are not to be construed as limiting the exemplary embodiments. The present teaching can be readily applied to other types of apparatuses. Also, the description of the exemplary embodiments of the present inventive concept is intended to be illustrative, and not to limit the scope of the claims.