Method and apparatus for generating or using interaction activity information
10353561 ยท 2019-07-16
Assignee
Inventors
- Seung dong YU (Gyeonggi-do, KR)
- Woo-yong Chang (Gyeonggi-do, KR)
- Se-jun Park (Gyeonggi-do, KR)
- Min-jeong Moon (Gyeonggi-do, KR)
Cpc classification
H04N21/41265
ELECTRICITY
G06K15/4045
PHYSICS
G06F3/1423
PHYSICS
H04L69/18
ELECTRICITY
H04N21/4222
ELECTRICITY
G06F3/04847
PHYSICS
H04L67/04
ELECTRICITY
H04L67/51
ELECTRICITY
G06F3/0484
PHYSICS
H04L12/2814
ELECTRICITY
G06F3/1232
PHYSICS
International classification
G06F3/00
PHYSICS
G06F3/0484
PHYSICS
H04L12/28
ELECTRICITY
G06F3/12
PHYSICS
G06K15/00
PHYSICS
G06F3/14
PHYSICS
Abstract
A method of generating interaction activity information, performed by a device, is provided. The method includes establishing communication with at least one external apparatus; receiving first information about a user selectable function of the external apparatus; and generating second information, based on the first information, about a user selectable function of the device, wherein the user selectable function of the device corresponds to the user selectable function of the external device and can be performed in collaboration with the external device.
Claims
1. A method of sending information, performed by a device, the method comprising: obtaining information about an external device, the information including an interaction activity list that is generated and displayed on the device based on functions that can be performed by both the device and the external device, wherein the displayed interaction activity list includes a list of functions, and wherein each function in the list of functions is performable by both the device and the external device; based on the obtained information, displaying a user interface item for controlling a function of the device corresponding to a function of the external device; based on an input received via the user interface item, generating control information about the function of the external device; and sending the control information to the external device over a connection established between the device and the external device, thereby causing the external device to perform the function of the external device.
2. The method of claim 1, wherein the information is obtained using a near field communication (NFC).
3. The method of claim 2, wherein the connection established between the device and the external device is based on the information obtained using the NFC.
4. A device for sending information, the device comprising: a communicator; a display; and a processor configured to: control the communicator to obtain information about an external device, the information including an interaction activity list that is generated and displayed on the device based on functions that can be performed by both the device and the external device, wherein the displayed interaction activity list includes a list of functions, and wherein each function in the list of functions is performable by both the device and the external device; based on the obtained information, control the display to display a user interface item for controlling a function of the device corresponding to a function of the external device; and based on an input received via the user interface item, generate control information about the function of the external device and send the control information, to the external device over a connection established between the device and the external device, thereby causing the external device to perform the function of the external device.
5. The device of claim 4, wherein the information is obtained using a near field communication (NFC).
6. The device of claim 5, wherein the connection established between the device and the external device is based on the information obtained using the NFC.
7. A device, for executing a function with an external device, the device comprising: a communicator; a display; and a processor configured to: control the communicator to transmit information including an interaction activity list that is generated and displayed on the device based on functions that can be performed by both the device and the external device about the device and receive control information, from the external device over a connection established between the device and the external device, thereby causing the external device to perform a function, wherein the displayed interaction activity list includes a list of functions, and wherein each function in the list of functions is performable by both the device and the external device; based on the information, control the display to display a user interface item for controlling a function of the device corresponding to a function of the external device; and based on the control information, execute the function of the device and controlling execution of the function of the device using the external device.
8. The device of claim 7, wherein the processor controls the communicator to receive media content related to the function from the external device and the display displays the media content on the device.
9. A non-transitory computer-readable recording medium having recorded thereon a computer program, which when executed performs a method for sending information, which can be performed by a device, the method comprising: obtaining information about an external device, the information including an interaction activity list that is generated and displayed on the device based on functions that can be performed by both the device and the external device, wherein the displayed interaction activity list includes a list of functions, and wherein each function in the list of functions is performable by both the device and the external device; based on the obtained information, displaying a user interface item for controlling a function of the device corresponding to a function of the external device; based on an input received via the user interface item, generating control information about the function of the external device; and sending the control information, to the external device over a connection established between the device and the external device, thereby causing the external device to perform the function of the external device.
10. The non-transitory computer-readable recording medium of claim 9, wherein the information is obtained using a near field communication (NFC).
11. The non-transitory computer-readable recording medium of claim 10, wherein the connection established between the device and the external device is based on the information obtained using the NFC.
12. The non-transitory computer-readable recording medium of claim 9, the method further comprising: displaying a list, based on the information, of the function of the external device.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The above and other features and advantages of the present invention will become more apparent by describing in detail embodiments thereof with reference to the attached drawings in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION
(16) The term interaction activity information as used herein refers to information about a function that may be used interactively between connected apparatuses. For example, according to such an interaction function, when a first apparatus and a second apparatus are connected to each other, a function of the first apparatus may be performed by the second apparatus, or a function of the second apparatus may be performed by the first apparatus. An interaction activity list is one embodiment of the interaction activity information. Hereinafter, information about the interaction function will be referred to as an interaction activity list.
(17)
(18) Referring to
(19) The interaction activity list generating apparatus 110 is connected to an external apparatus 120 via the interface unit 111. A connecting method between the interaction activity list generating apparatus 110 and the external apparatus 120 will be described in detail below. The interface unit 111 receives information about a function that is capable of being performed in the external apparatus 120 from the external apparatus 120. The information about a function that is capable of being performed in the external apparatus 120 includes metadata regarding functions, performances and limitations of the external apparatus 120. The metadata includes the functions, performances and limitations of the external apparatus 120, but is not limited thereto. The metadata may include any information as long as the information can be used to generate the interaction activity list. In addition, the information about a function that is capable of being performed in the external apparatus 120 may further include controlling signals regarding functions and performances of the external apparatus 120. If interaction activity list generating apparatus 110 receives the information about a function that is capable of being performed in the external apparatus 120 after requesting the external apparatus 120 for the information about a function that is capable of being performed in the external apparatus 120, the information about a function that is capable of being performed in the external apparatus 120 may further include authorization information with respect to the controlling signals of the external apparatus 120. The interface unit 111 transmits the metadata of the external apparatus 120 to the list generating unit 112.
(20) The list generating unit 112 generates the interaction activity list using the metadata of the external apparatus 120, which is received from the interface unit 111. In detail, the list generating unit 112 selects functions of apparatuses including the interaction activity list generating apparatus 110, which may be performed by the external apparatus 120, with reference to the functions, performances and limitations of the external apparatus 120, which are included in the metadata. Then, the list generating unit 112 generates the interaction activity list using the selected functions, and controlling signals corresponding to the selected functions from among the received controlling signals. The generated interaction activity list is stored in the storing unit 115.
(21) The controlling unit 114 selects one external apparatus 120, from among external apparatuses that are searched for via the interface unit 111, generates a connection request signal, and transmits the connection request signal to the interface unit 111. The interface unit 111 transmits the connection request signal to the external apparatus 120. Then, when the interface unit 111 receives connection authorization from the external apparatus 120, the interaction activity list generating apparatus 110 and the external apparatus 120 are connected. It is possible that the external apparatus 120 may not allow the interaction activity list generating apparatus 110 to be connected to the external apparatus 120. When the external apparatus 120 allows the interaction activity list generating apparatus 110 to be connected to the external apparatus 120, predetermined information about the interaction activity list generating apparatus 110 may be stored. The stored information may be used when the interaction activity list generating apparatus 110 is reconnected to the external apparatus 120.
(22) According to another embodiment of the present invention, when the external apparatus 120 access an interaction activity list generating apparatus 110 within a predetermined range, the interface unit 111 connects the external apparatus 120 to the interaction activity list generating apparatus 110. According to the present embodiment, only when the external apparatus 120 physically contacts the interaction activity list generating apparatus 110, the external apparatus 120 may be connected to the interaction activity list generating apparatus 110. In this case, the external apparatus 120 does not have to be searched for and selected.
(23) The displaying unit 113 displays the generated interaction activity list. In addition, when the connection between the external apparatus 120 and the interaction activity list generating apparatus 110 is released, and then the external apparatus 120 and the interaction activity list generating apparatus 110 are reconnected, the displaying unit 113 displays the interaction activity list related to the external apparatus 120 and the interaction activity list generating apparatus 110, which is stored in the storing unit 115. The displaying unit 113 may include a touch screen.
(24) When a user selects a predetermined list in the interaction activity list displayed by the displaying unit 113, the controlling unit 114 determines a signal regarding a function that is selected in the displayed interaction activity list. Then, the controlling unit 114 transmits an instruction that the external apparatus 120 performs the selected function to the external apparatus 120 via the interface unit 111.
(25) According to an embodiment of the present invention, after the interaction activity list generating apparatus 110 generates the interaction activity list, the interaction activity list generating apparatus 110 may transmit the metadata regarding the functions of apparatus including the interaction activity list generating apparatus 110, to the external apparatus 120. Here, the functions may be used in the external apparatus 120 interactively between the apparatuses including the interaction activity list generating apparatus 110 and the external apparatus 120. Alternatively, after the apparatuses are connected to each other, the apparatuses may exchange metadata regarding respective functions of the apparatuses and may generate respective interaction activity lists.
(26)
(27) Referring to
(28) In step 220, the connection requesting apparatus selects one external apparatus from among found external apparatuses. The connection requesting apparatus transmits a connection request signal to the selected external apparatus.
(29) In step 230, the connection requesting apparatus and the selected external apparatus are connected to each other. When the external apparatus receives the connection request signal, the external apparatus may transmit a signal for allowing connection with the connection requesting apparatus, in response to the connection request signal. It is possible that the external apparatus may not allow the connection with the connection requesting apparatus. When the external apparatus allows the connection with the connection requesting apparatus, predetermined information about the connection requesting apparatus may be stored. The stored information may be used when the connection requesting apparatus is reconnected to the external apparatus.
(30)
(31) In
(32) Referring to
(33) In
(34)
(35)
(36) Referring to
(37) In step 420, the connection allowance apparatus is connected to the recognized external apparatus.
(38)
(39) Referring to
(40) In
(41)
(42) Referring to
(43) In step 620, the second apparatus receives information about a function to be performed by the first apparatus, from the first apparatus. The information about the function to be performed by the first apparatus includes metadata regarding the function of the first apparatus. The metadata includes the functions, performances and limitations of an apparatus, but is not limited thereto. The metadata may include any information as long as the information can be used to generate the interaction activity list. In addition, first information further includes controlling signals regarding functions and performances of the first apparatus. If the second apparatus receives the first information after requesting the first apparatus for the first information, the first information may further include authorization information with respect to the controlling signals of the first apparatus.
(44) In step 630, the second apparatus generates the interaction activity list regarding functions that may be used interactively between the first apparatus and the second apparatus, based on the first information. In detail, the second apparatus selects functions of the second apparatus, which may be performed by the first apparatus, with reference to the functions, performances and limitations of the first apparatus. Then, the second apparatus generates the interaction activity list using the selected functions, and controlling signals corresponding to the selected functions from among the received controlling signals.
(45) In step 640, the second apparatus determines a selection signal in the interaction activity list, based on a user's selection signal, and transmits a controlling signal corresponding to the determined selection signal to the first apparatus.
(46) In the method of
(47)
(48) Referring to
(49)
(50) Referring to
(51) Referring to
(52)
(53) Referring to
(54) In step 920, an apparatus is selected from among the found external apparatuses. If the display 1011 of the mobile phone 1010 includes a touch screen, a user may select one external apparatus from among the found external apparatuses by touching an item corresponding to the external apparatus, or by using a button. When the user selects the item CONNECT NEW DEVICE 1013, the method of
(55) According to another embodiment of the present invention, when an external apparatus is powered-off, the external apparatus may be searched for. In this case, when the connection requesting apparatus selects the external apparatus that is powered-off, the connection requesting apparatus transmits a wake-up signal to the external apparatus that is powered-off. Then, when the external apparatus is powered-on, the external apparatus is connected to the connection requesting apparatus. In
(56) In step 930, the connection requesting apparatus is connected to the selected external apparatus. For example, in
(57) In step 940, after the connection requesting apparatus is connected to the external apparatus, an interaction activity list that is previously stored is displayed. When the connection requesting apparatus is reconnected to the external apparatus, an interaction activity list, which has been used when the connection requesting apparatus has been connected to the external apparatus before, is displayed without generating a new interaction activity list. If an interaction activity list is not stored, an interaction activity list may be generated by using the method of
(58)
(59)
(60) Referring to
(61) In step 1120, the connection allowance apparatus is connected to the recognized external apparatus.
(62) In step 1130, after the connection allowance apparatus is connected to the external apparatus, an interaction activity list that is previously stored is displayed. When the connection allowance apparatus is reconnected to the external apparatus, an interaction activity list, which has been used when the connection allowance apparatus has been connected to the external apparatus before, is displayed without generating a new interaction activity list.
(63)
(64)
(65) Referring to
(66) Referring to
(67) Referring to
(68) Referring to
(69) Referring to
(70) The present invention can also be embodied as computer readable codes on a computer readable recording medium. The computer readable recording medium is any data storage device that can store data which can be thereafter read by a computer system. Examples of the computer readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, etc. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. Also, functional programs, codes, and code segments for accomplishing the present invention can be easily construed by programmers skilled in the art to which the present invention pertains.
(71) While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention as defined by the following claims.