Mobile terminal, display apparatus and control method thereof
10230921 ยท 2019-03-12
Assignee
Inventors
- Woo-Yong Chang (Yongin-si, KR)
- Seung-dong Yu (Osan-si, KR)
- Se-jun Park (Yongin-si, KR)
- Min-jeong Moon (Seongnam-si, KR)
Cpc classification
H04N7/147
ELECTRICITY
H04M1/724
ELECTRICITY
H04M2201/50
ELECTRICITY
H04N7/148
ELECTRICITY
H04M7/0027
ELECTRICITY
G06F3/1454
PHYSICS
International classification
G06F3/14
PHYSICS
G06F3/0488
PHYSICS
G06F3/041
PHYSICS
Abstract
Disclosed is a control method for a display apparatus and a mobile terminal which includes a camera for taking a photograph and generating an image; a voice input unit which is used to input a voice; a user input unit which receives a user's input; a display unit which displays the image thereon; a wireless communication unit which communicates with a counterpart mobile terminal through a wireless network; and a controller which performs a video call by transmitting to the counterpart mobile terminal video call data comprising a video generated by the camera and a voice input by the voice input unit according user input, displays on the display unit a shared image during the video call, and transmits to the counterpart mobile terminal the shared image added to the video call data.
Claims
1. A portable device for performing a video communication, the portable device comprising: a camera; a touch display; a first wireless communication interface; a second wireless communication interface; a memory storing instructions; and a processor configured to execute the stored instructions to: control to perform a video communication with another portable device through the first wireless communication interface by transmitting video data obtained through the camera to the other portable device through the first wireless communication interface and receiving video data from the other portable device through the first wireless communication interface, control to receive, from the other portable device through the first wireless communication interface through which the video communication is being performed, content during the video communication performed through the first wireless communication interface, control to provide video data in a first display area and the content in a second display area, video data and the content to be displayed together on the touch display of the portable device during the video communication performed through the first wireless communication interface, control to provide first handwritten information within the second display area based on receiving, from the other portable device through the first wireless communication interface through which the video communication is being performed, the first handwritten information for the content during the video communication performed through the first wireless communication interface, control to transmit, to the other portable device through the first wireless communication interface through which the video communication is being performed, second handwritten information inputted within the second display area of the touch display during the video communication performed through the first wireless communication interface, and control to transmit, to an external display device through the second wireless communication interface, a screen during the video communication through the first wireless communication interface, wherein the screen includes the content, the first handwritten information, and the second handwritten information.
2. The portable device according to claim 1, wherein at least one of the first and second handwritten information includes a handwritten drawing.
3. The portable device according to claim 1, wherein the content includes an image to be shared during the video communication.
4. The portable device according to claim 1, wherein the processor is configured to execute the stored instructions further to control to transmit, to the other portable device through the first wireless communication interface through which the video communication is being performed, a third handwritten information received from the external display device through the second wireless communication interface.
5. A control method of a portable device for performing a video communication, the control method comprising: performing a video communication with another portable device through a first wireless communication interface by transmitting video data obtained through a camera to the other portable device through the first wireless communication interface and receiving video data from the other portable device through the first wireless communication interface; receiving, from the other portable device through the first wireless communication interface through which the video communication is being performed, content during the video communication performed through the first wireless communication interface; displaying video data in a first display area and the content in a second display area, video data and the content to be displayed together on a touch display of the portable device during the video communication performed through the first wireless communication interface; displaying first handwritten information within the second display area based on receiving, from the other portable device through the first wireless communication interface through which the video communication is being performed, the first handwritten information for the content during the video communication performed through the first wireless communication interface; transmitting, to the other portable device through the first wireless communication interface through which the video communication is being performed, second handwritten information inputted within the second display area of the touch display during the video communication performed through the first wireless communication interface; and transmitting, to an external display device through a second wireless communication interface, a screen during the video communication through the first wireless communication interface, wherein the screen includes the content, the first handwritten information, and the second handwritten information.
6. The control method according to claim 5, wherein at least one of the first and second handwritten information includes a handwritten drawing.
7. The control method according to claim 5, wherein the content includes an image to be shared during the video communication.
8. The control method according to claim 5, further comprising: transmitting, to the other portable device through the first wireless communication interface through which the video communication is being performed, a third handwritten information received from the external display device through the second wireless communication interface.
9. A non-transitory computer readable recording medium storing instructions executable by a processor of a portable device for performing a video communication to cause the processor to: control to receive, from another portable device through a first wireless communication interface, content while performing a video communication through the first wireless communication interface by transmitting video data obtained through a camera to the other portable device through the first wireless communication interface and receiving video data from the other portable device through the first wireless communication interface; control to provide video data in a first display area and the content in a second display area, video data and the content to be displayed together on a touch display of the portable device during the video communication performed through the first wireless communication interface; control to provide first handwritten information within the second display area based on receiving, from the other portable device through the first wireless communication interface through which the video communication is being performed, the first handwritten information for the content during the video communication performed through the first wireless communication interface; control to transmit, to the other portable device through the first wireless communication interface through which the video communication is being performed, second handwritten information inputted within the second display area of the touch display during the video communication performed through the first wireless communication interface; and control to transmit, to an external display device through the second wireless communication interface, a screen during the video communication through the first wireless communication interface, wherein the screen includes the content, the first handwritten information, and the second handwritten information.
10. The non-transitory computer readable recording medium according to claim 9, wherein at least one of the first and second handwritten information comprises handwritten drawing.
11. The non-transitory computer readable recording medium according to claim 9, wherein the content includes an image to be shared during the video communication.
12. The non-transitory computer readable recording medium according to claim 9, wherein the instructions cause the processor further to control to transmit, to the other portable device through the first wireless communication interface through which the video communication is being performed, a third handwritten information received from the external display device through the second wireless communication interface.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The above and other aspects, features and advantages of certain embodiments of the present invention will become apparent and more readily understood from the following description, taken in conjunction with the accompanying drawings, in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
DETAILED DESCRIPTION OF THE EMBODIMENTS OF THE PRESENT INVENTION
(9) Hereinafter, various embodiments of the present invention will be described in detail with reference to accompanying drawings so as to be easily understood by a person having ordinary skill in the art. Various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. In addition, descriptions of well-known functions and parts are omitted for clarity, and like reference numerals refer to like elements throughout.
(10)
(11) Mobile terminals 1 and 2 also perform a calling function for a telephone call between a caller and a receiver. One of the mobile terminals is a caller terminal and the other one is a receiver terminal. A telephone call which is made by mobile terminals 1 and 2 includes a video call by which users transmit and receive video and voice during the telephone call. To perform a video call function according to the present embodiment, mobile terminals 1 and 2 may perform various communications such as Wideband Code Division Multiple Access (W-CDMA), Enhanced Data rates for GSM Evolution (EDGE), Long Term Evolution (LTE), and Worldwide Interoperability for Microwave Access (WiMAX).
(12) As shown in
(13) During a video call, mobile terminals 1 and 2 according to the embodiment of the present invention enable a caller and a receiver to share a predetermined image (hereinafter, shared image). During a video call, mobile terminals 1 and 2 also enable a caller or a receiver to edit the shared image and share the edited result (hereinafter, edited information). Hereinafter, mobile terminals 1 and 2, will be described according to the embodiment of the present invention, in more detail with reference to
(14)
(15) As shown therein, the caller mobile terminal 1 includes a camera 11, a voice input unit 12, a wireless communication unit 13, a display unit 14, a voice output unit 15, a user input unit 16 and a controller 18.
(16) Camera 11 captures image and generates photograph and video used for a video call. Camera 11 may include an optical unit (not shown) including at least one light-incident lens and an imaging sensor (not shown) converting incident light into electrical data to generate an image.
(17) Voice input unit 12 may include a voice sensor (not shown) such as a microphone, and receives a voice used for a voice call.
(18) Wireless communication unit 13 is connected to a wireless network and communicates with the counterpart mobile terminal 2 by a predetermined wireless communication method. During a video call, wireless communication unit 13 transmits to the counterpart mobile terminal 2 video call data including a video generated by camera 11 and a voice input by voice input unit 12 and receives video call data including a video and a voice from the counterpart mobile terminal 2 according to the control of controller 18.
(19) Display unit 14 displays thereon a video, and may include a display panel (not shown) such as a Liquid Crystal Display (LCD) panel. Display unit 14 according to the present embodiment displays thereon a video received from the counterpart mobile terminal 2 according to the control of controller 18 during a video call.
(20) Voice output unit 15 outputs a voice, and may include a voice output unit (not shown) such as an internal speaker. Voice output unit 15 may further include a connector (not shown) to be connected to an external voice output device (not shown) such as earphones, headsets and external speakers, and may output a voice to the connected external voice output device. Voice output unit 15 according to the present embodiment outputs a voice from the counterpart mobile terminal 2 according to the control of controller 18 during a voice call or a video call.
(21) User input unit 16 receives a user's input to manipulate mobile terminal 1. User input unit 16 may include a keypad (not shown) including a plurality of keys to input numbers, or characters. The keypad according to the present embodiment may include a touch pad. User input unit 13 according to the present embodiment may further include a sensor (not shown) to sense a user's motion or gesture as a user's input on display unit 14. The sensor of user input unit 13 may include a touch screen overlapping the display panel of display unit 14 such as an LCD panel.
(22) Controller 18 controls mobile terminal 1 as a whole. If a video call function is selected by user input through user input unit 16, controller 18 refers to an input telephone number and requests a call connection to the counterpart mobile terminal 2 through wireless communication unit 13. If the call connection to the counterpart mobile terminal 2 is made, controller 18 transmits video call data including a video generated by camera 11 and a voice input by voice input unit 12 to the counterpart mobile terminal 2 through wireless communication unit 13, and controls display unit 14 and voice output unit 15 to output the video and the voice included in the video call data received from the counterpart mobile terminal 2 through wireless communication unit 13, respectively.
(23) Returning to
(24) Wireless communication unit 23 of the receiver mobile terminal 2 communicates with the counterpart mobile terminal 1 as the caller mobile terminal 1 through the wireless network. Upon receiving a request for a call connection from the counterpart mobile terminal 1, controller 28 of the receiver mobile terminal 2 informs a user of the foregoing through voice output unit 25, and initiates a video call according to user input for confirming a call response through user input unit 26. At the time of a video call, controller 28 transmits to the counterpart mobile terminal 1 a video generated by camera 21 and a voice input by voice input unit 22 through wireless communication unit 23, and controls display unit 24 and voice output unit 25 to output a video and a voice received from the counterpart mobile terminal 1 through wireless communication unit 23, respectively.
(25) During a video call, mobile terminals 1 and 2 according to the present embodiment may display a shared image for both users to share such image. Further, mobile terminals 1 and 2 may edit the shared image, transmit the edited information to the counterpart mobile terminal and share the edited information of the shared image. Hereinafter, operations of mobile terminals 1 and 2 will be described in more detail with reference to
(26)
(27) Referring to
(28) At operation 302, sharing an image may be initiated by a user's input through user input unit 16. For example, controller 18 of mobile terminal 1 may display on display unit 14 a menu 142 to share the image according to user input, and initiate sharing the image 143 of
(29) Controller 18 of mobile terminal 1 displays on display unit 14 a predetermined shared image 143 as shown in
(30) Mobile terminal 1 according to the embodiment of the present invention may further include a storage unit 17, as shown in
(31) As shown in
(32) In step 302, controller 18 of mobile terminal 1 may edit the shared image 143 during a video call. The shared image 143 according to the present embodiment may be edited by a user's input through user input unit 16, and may be provided as various types relating to the shared image 143. For example, editing the shared image 143 includes adding an image indicating a user's gesture for the shared image 143 (hereinafter, gesture image 144) as shown in
(33) Returning to
(34) The method of transmitting to the counterpart mobile terminal the video call data added with the shared image 143 and the edited information 144 may vary. For example, controller 18 of mobile terminal 1 may combine the video 241 of the video call and the shared image 143 to generate combined images 241 and 143, and may transmit to the counterpart mobile terminal 2 the video 241 of the video call and the shared image 143 as the combined images 241 and 143. Further, controller 18 may reflect the edited information to the combined image.
(35) According to another embodiment, controller 18 of mobile terminal 1 may transmit to the counterpart mobile terminal 2 the shared image 143 and the edited information 144 individually. For example, controller 18 may divide blocks of single video call data or provide blocks of a plurality of video call data, and load data of the video 241 of the video call, the shared image 143 and the edited information to the provided block and transmit such data to the counterpart mobile terminal 2. Controller 18 may add identification information to the data of the video 241 of the video call, the shared image 143 and the edited information 144 and have the counterpart mobile terminal 2 identify and process the data. The identification information according to the present embodiment may include meta data, which may include information of a format or a source of the video 241.
(36) Referring to
(37) As shown in
(38) As above, the shared image 243 and the edited information 244 according to the present embodiment are displayed together with the video 241 of the video call. Accordingly, a user of mobile terminal 2 may immediately receive and view the edited result of the shared image from the counterpart during a video call to the counterpart, and may share more information efficiently.
(39) According to another embodiment, referring to step 404 in
(40) Editing the shared image 143 is not limited to the foregoing embodiment, and may vary. For example, enlarging, reducing or rotating the shared image 143 or changing color or adjusting at least a part of the shared image 143 may fall under editing. Text input by a user may also be added to the shared image 143.
(41) Hereinafter, another embodiment of the present invention will be described with reference to
(42) Signal receiver 31 receives an image signal. The image signal according to the present embodiment includes a broadcasting signal having a plurality of channels. The broadcasting signal may include a Digital TV (DTV) signal. Signal processor 32 processes an image signal received by signal receiver 31. Signal processor 32 may demultiplex, decode, enhance or scale the image signal. Display unit 33 displays an image thereon based on an image signal processed by signal processor 32. Display unit 33 may include a display device (not shown) such as an LCD, a Plasma Display Panel (PDP), or an Organic Light Emitting Diode (OLED).
(43) Wireless communication unit 34 communicates with mobile terminal 2. Communication between wireless communication unit 34 and mobile terminal 2 includes a home network communication such as Digital Living Network Alliance (DLNA). Wireless communication unit 23 of mobile terminal 2 further includes a communication function with respect to wireless communication unit 34 of display unit 33. User input unit 35 is provided as a remote controller or a manipulation panel, and receives user input. Controller 36 controls display apparatus 3 as a whole. Display apparatus 3 may further include a voice output unit (not shown) to output a voice such as a speaker and a power supply unit (not shown) to supply power.
(44)
(45) Referring to
(46) In step 803, controller 28 of mobile terminal 2 transmits to display apparatus 3 the received shared image 243 and the edited information 244 through wireless communication unit 23 during the video call. As shown in
(47) In step 901 of
(48) In step 903 of
(49) Referring to
(50) Hereinafter, mobile terminal 2 according to another embodiment of the present invention will be described. The configuration of mobile terminal 2 which is the same or similar to that of mobile terminal 2 according to the foregoing embodiment described with reference to
(51) During a video call to the counterpart mobile terminal 1, mobile terminal 2 selects at least one of a plurality of electronic devices, and transmits the shared image to the selected electronic device. The electronic device displays the shared image transmitted by mobile terminal 2. Mobile terminal 2 may transmit to the selected electronic device the edited information of the shared image and/or a video of the video call, together with the shared image, and the electronic device may display the transmitted edited information and/or the video of the video call. Mobile terminal 2 may transmit the shared image to at least one of a plurality of electronic devices that a user has selected.
(52) In selecting the electronic device among the plurality of electronic devices to transmit the shared image, etc., a characteristic of each electronic device may be considered. The characteristic of the electronic device according to the present embodiment includes a characteristic of the device itself, the surrounding environment, connectivity, and a supporting codec. Information of the characteristic of the plurality of electronic devices (hereinafter, device character information) may be transmitted to mobile terminal 2 from each electronic device or stored in advance in storage unit 27 of mobile terminal 2. Mobile terminal 2 refers to the device character information, and selects at least one of a plurality of electronic devices which is determined to be proper for transmitting the shared image.
(53) In selecting the electronic device to transmit the shared image, etc., a characteristic of the shared image may be considered. The characteristic of the shared image according to the present embodiment includes a resolution of an image, data volume, etc. Mobile terminal 2 may select at least one of a plurality of electronic devices that corresponds to the characteristic of the shared image to be transmitted. For example, if a resolution of the shared image is high, mobile terminal 2 may select an electronic device that has high display resolution among the plurality of electronic devices. As another example, if the data volume of the shared image is large, mobile terminal 2 may select an electronic device that has good data processing capability (or processing performance, processing speed) among the plurality of electronic devices.
(54) In selecting the electronic device to transmit the shared image, etc., a characteristic of a user of mobile terminal 2 may be considered. The characteristic of a user according to the present embodiment includes age, physical condition, preference and device usage pattern of a user. Information of a user's characteristic (hereinafter, user character information) may be stored in storage unit 27 of mobile terminal 2. The user character information may be set and/or changed by a user of mobile terminal 2. Mobile terminal 2 may refer to the user character information and select at least one of a plurality of electronic devices that corresponds to a user's characteristic. For example, if a user is presbyopic, an electronic device having a larger screen may be selected.
(55) Mobile terminal 2 may convert the shared image to be consistent with the electronic device which receives such shared image. Mobile terminal 2 may convert the shared image in consideration of the device character information of the electronic device. For example, mobile terminal 2 may change a resolution or format of the shared image to be consistent with the electronic device that receives such shared image.
(56) Although several embodiments have been shown and described, it will be appreciated by those skilled in the art that changes may be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.