Electronic apparatus and control method thereof
11176937 · 2021-11-16
Assignee
Inventors
- Shina Kim (Suwon-si, KR)
- Jongjin Park (Suwon-si, KR)
- Wonjae Lee (Suwon-si, KR)
- Minsup Kim (Suwon-si, KR)
Cpc classification
H04N21/44231
ELECTRICITY
H04N21/42222
ELECTRICITY
G06F3/167
PHYSICS
H04N21/42204
ELECTRICITY
G08C2201/12
PHYSICS
H04N21/4436
ELECTRICITY
G10L15/22
PHYSICS
H04N21/44227
ELECTRICITY
International classification
H04N21/422
ELECTRICITY
G10L15/22
PHYSICS
Abstract
An electronic apparatus may include a microphone; a communication circuitry; a memory; and a processor configured to: identify whether information of an external apparatus that previously connected through the communication circuitry is stored in the memory based on a preset event of the electronic apparatus; based on identifying that the information of the external apparatus that previously connected through the communication circuitry is stored in the memory, perform connection with the external apparatus through the communication circuitry based on the information of the external apparatus; and based on identifying that the information of the external apparatus that previously connected through the communication circuitry is not stored in the memory, perform connection with the external apparatus by performing a search through the communication circuitry, based on a first voice command obtained through the microphone.
Claims
1. An electronic apparatus comprising: a microphone; a communication circuitry; a memory; and a processor configured to: identify whether information of an external apparatus that previously connected through the communication circuitry is stored in the memory based on a preset event of the electronic apparatus; based on identifying that the information of the external apparatus that previously connected through the communication circuitry is stored in the memory, perform connection with the external apparatus through the communication circuitry based on the information of the external apparatus; and based on identifying that the information of the external apparatus that previously connected through the communication circuitry is not stored in the memory, perform the connection with the external apparatus by performing a search through the communication circuitry, based on a first voice command obtained through the microphone, wherein the processor is further configured to: based on the external apparatus being not detected in the search, transmit a power-on signal to the external apparatus; and perform the connection with the external apparatus by performing a further search through the communication circuitry.
2. The electronic apparatus according to claim 1, wherein the processor is further configured to identify that the external apparatus is found, based on preset information being included in a response signal obtained from the external apparatus corresponding to the search.
3. The electronic apparatus according to claim 1, wherein the processor is further configured to transmit a connection request signal comprising preset information to the external apparatus, and obtain a connection acceptance signal corresponding to the connection request signal from the external apparatus.
4. The electronic apparatus according to claim 1, wherein the processor comprises: a first processor; and a second processor configured to consume less power than the first processor, wherein the first processor is configured to operate in a first power mode based on an occurrence of the preset event and switch to a second power mode based on absence of the information of the external apparatus, and wherein the second processor is further configured to control the first processor to switch to the first power mode based on identification of the first voice command obtained through the microphone in the second power mode.
5. The electronic apparatus according to claim 4, wherein the second processor is further configured to identify whether the first voice command is obtained through the microphone has a predetermined level or higher.
6. The electronic apparatus according to claim 4, wherein the second processor is configured to perform a first function of recognizing a second voice command and a second function of identifying whether the second voice command is noise, and is configured to not perform the first function in the first power mode.
7. The electronic apparatus according to claim 1, wherein the processor is further configured to identify whether the external apparatus is turned on based on a result of the search.
8. The electronic apparatus according to claim 1, wherein the processor is further configured to: obtain a second voice command through the microphone during the search, and transmit the second voice command to the external apparatus after the connection.
9. An electronic apparatus comprising: a microphone; a communication circuitry; a memory; and a processor configured to: identify whether information of an external apparatus that previously connected through the communication circuitry is stored in the memory based on a preset event of the electronic apparatus; based on identifying that the information of the external apparatus that previously connected through the communication circuitry is stored in the memory, perform connection with the external apparatus through the communication circuitry based on the information of the external apparatus; based on identifying that the information of the external apparatus that previously connected through the communication circuitry is not stored in the memory, perform the connection with the external apparatus by performing a search through the communication circuitry, based on a first voice command obtained through the microphone; store a second voice command, which is obtained through the microphone during the search, in the memory, and transmit the second voice command stored in the memory to the external apparatus after the connection.
10. A control method of an electronic apparatus, the control method comprising: identifying whether information of an external apparatus that previously connected to the electronic apparatus is stored in a memory of the electronic apparatus, based on a preset event of the electronic apparatus; based on identifying that the information of the external apparatus that previously connected is stored in the memory of the electronic apparatus, performing connection with the external apparatus based on the information of the external apparatus; based on identifying that the information of the external apparatus that previously connected is not stored in the memory of the electronic apparatus, performing the connection with the external apparatus by performing a search based on obtaining a first voice command; based on the external apparatus being not detected in the search, transmitting a power-on signal to the external apparatus; and performing the connection with the external apparatus by performing a further search.
11. The control method according to claim 10, wherein the performing the connection comprises identifying that the external apparatus is found, based on preset information being included in a response signal obtained from the external apparatus corresponding to the search.
12. The control method according to claim 10, wherein the performing the connection comprises transmitting a connection request signal comprising preset information to the external apparatus, and obtaining a connection acceptance signal corresponding to the connection request signal from the external apparatus.
13. The control method according to claim 10, wherein the performing the connection comprises: storing a second voice command which is obtained during the search; and transmitting the stored second voice command to the external apparatus after the connection.
14. The control method according to claim 10, wherein the performing the connection comprises: operating a first processor in a first power mode based on an occurrence of the preset event and switching to a second power mode based on absence of the information of the external apparatus; and making a second processor, which consumes lower power than the first processor, control the first processor to switch to the first power mode based on identification of the first voice command obtained in the second power mode.
15. The control method according to claim 14, wherein the switching to the first power mode comprises identifying whether the first voice command is obtained having a predetermined level or higher.
16. The control method according to claim 14, wherein the switching to the first power mode comprises not performing a first function of recognizing a second voice command in the first power mode, and performing a second function of identifying whether the second voice command is noise.
17. A non-transitory computer readable recording medium having stored thereon a computer program comprising a code for performing a control method of an electronic apparatus, the control method of the electronic apparatus comprising: identifying whether information of an external apparatus that previously connected to the electronic apparatus is stored in a memory of the electronic apparatus, based on a preset event of the electronic apparatus; based on identifying that the information of the external apparatus that previously connected is stored in the memory of the electronic apparatus, performing connection with the external apparatus based on the information of the external apparatus; and based on identifying that the information of the external apparatus that previously connected is not stored in the memory of the electronic apparatus, performing the connection with the external apparatus by performing a communication search based on obtaining a first voice command; based on the external apparatus being not detected in the communication search, transmitting a power-on signal to the external apparatus; and performing the connection with the external apparatus by performing a further communication search.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The above and other aspects, features, and advantages of certain embodiments of the present disclosure will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
DETAILED DESCRIPTION
(13) Below, embodiments will be described in detail with reference to accompanying drawings. In the description of the following embodiments, elements illustrated in the accompanying drawings will be referenced, and like numerals or symbols set forth in the drawings refer to like elements having substantially the same function. In the disclosure, at least one among a plurality of elements refers to not only all the plurality of elements but also both each one of the plurality of elements excluding the other elements and a combination thereof.
(14)
(15) The external apparatus 20 or the electronic apparatus 10 is not limited to the example shown in
(16) Below, for convenience of description, the description will be made on the assumption that the external apparatus 20 and the electronic apparatus 10 are respectively a TV and a remote controller dedicated to the TV, but embodiments are not limited thereto.
(17) The electronic apparatus 10 according to an embodiment may perform wireless connection with the external apparatus 20 based on a first voice command 31 of a user 30. For example, when a user issues the first voice command 31 by pronunciation of “connection”, the electronic apparatus 10 recognizes the first voice command 31 obtained through a microphone 11 and performs wireless connection with the external apparatus 20 through a communication circuitry 12 based on the recognized first voice command 31. However, there are no limits to the kind of first voice command 31, and the first voice command 31 may be speech of letters or words of various languages according to design methods besides “connection”.
(18) Thus, when connection between the electronic apparatus 10 and the external apparatus 20 is made based on the first voice command 31 of the user 30, the electronic apparatus 10 may be more simply designed because there a button for connection with the external apparatus 20 is not needed separately from a plurality of buttons 14 for controlling various functions of the external apparatus 20.
(19) Further, a user 30 does not have to find the electronic apparatus 10 having the connection button to be pressed or inconveniently press the button of the electronic apparatus 10, convenience of use for the wireless connection with the external apparatus 20 can be improved.
(20)
(21) The microphone 10 may receive a voice command spoken by the user 30. The kind or number of microphones is not limited as long as it can recognize a voice.
(22) The communication circuitry 12 may be a transceiver configured transmit and receive a signal for connection with the external apparatus 20, and perform communication based on a predetermined communication method as connected to the external apparatus 20. For example, the communication circuitry 12 may perform wireless communication based on a communication method such as Bluetooth, Bluetooth low energy (BLE), infrared data association (IrDA), Wi-Fi, ZigBee, Wi-Fi Direct (WFD), ultra-wideband (UWB), near field communication (NFC), etc. The communication circuitry 12 may be provided as one module corresponding to each of the communication methods or combination of modules corresponding to two or more communication methods.
(23) The storage 13 may be a memory configured to store an instruction, a program, an application, etc. to control the electronic apparatus 10. For example, the storage 13 may be configured to store information about an instruction or the like for connection with the external apparatus 20. The storage 13 may include a storage medium of at least one type among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g. a secure digital (SD) or extreme digital (XD) memory, etc.), a random access memory (RAM), and a read only memory (ROM).
(24) The button portion 14 may include a plurality of buttons. Through the button, a user's input may be obtained, and an instruction or information corresponding to the user's input may be output. When the button portion 14 is a touch screen, the button portion 14 may be displayed as a menu item showing a plurality of buttons and receive a user's touch input with regard to the menu item.
(25) The processor 15 may control general operation of the electronic apparatus 10. For example, the processor 15 may identify whether information about the previously connected external apparatus 20 is present in the storage 13 when power is supplied to the electronic apparatus 10. Further, when the information about the external apparatus 20 is not present, and the first voice command 31 of the user 30 is received for the purpose of connection with the external apparatus 20, the processor 15 may control the communication circuitry 12 so that the connection with the external apparatus 20 can be made based on the first voice command 31.
(26) The processor 15 may include a control program (or an instruction) for performing general control to elements, a nonvolatile memory in which the control program is installed, a volatile memory in which at least a part of the installed control program is loaded, and at least one sub-processor or central processing unit (CPU) for executing the loaded control program. Further, such a control program may be stored in another electronic apparatus other than the electronic apparatus 10.
(27) The control program may include a program(s) the form of at least one from among a basis input/output system (BIOS), a device driver, an operating system, a firmware, a platform, and an application. According to an embodiment, the application may be previously installed or stored when the electronic apparatus 10 is manufactured, or may be installed based on application data received from the outside when it is used in the future. The application data may for example be downloaded from an application market and the like server. Such a server is an example of a computer program product, but embodiments are not limited to this example.
(28) Further, the processor 15 may employ at least one of machine learning, a neural network or a deep-learning algorithm as a rule-based or artificial-intelligence algorithm to perform at least a part of data analysis, process, and result information generation for performing various functions such as communication connection with the external apparatus 20 based on the first voice command 31.
(29) However,
(30)
(31) Referring to
(32) The information of the previously connected external apparatus 20 refers to information about the external apparatus 20 having a history of being connected through the communication circuitry 12 of the electronic apparatus 10, and may include information received or generated while connecting with the corresponding external apparatus 20 and stored in the storage 13. For example, the information may be related to an apparatus name, an apparatus number, an apparatus address, etc. corresponding to the external apparatus 20.
(33) When the information of the external apparatus 20 is present, the processor 15 may perform connection with the external apparatus 20 through the communication circuitry 12 based on the information of the external apparatus 20 (S420). For example, when a name of a TV having a history of connection is stored in the storage 13, the processor 15 may automatically perform the connection with the TV based on the name of the TV.
(34) On the other hand, when the information of the external apparatus 20 is not present, the processor 15 may perform connection with the external apparatus 20 found by a search through the communication circuitry 12, based on obtainment of a user's preset voice command 31 (S430). For example, although there are no histories of connection with the TV, the processor 15 may search a TV when receiving the first voice command 31 of the user 30 who desires connection with the TV, and connect with the TV found by the search.
(35) Thus, the electronic apparatus 10 according to an embodiment automatically connects with the external apparatus based on presence of the information about the external apparatus 20, or connects with the external apparatus 20 based on the first voice command 31 of the user, thereby achieving more simplified design without a separate button for the connection with the external apparatus 20, and improving convenience of use without making the user 30 press the button.
(36)
(37) Referring to
(38) When the information of the external apparatus 20 is not present, the processor 15 receives a user's preset first voice command 31 through the microphone 11 (S513), and searches for the external apparatus 20 within a connectable range based on obtainment of the first voice command 31 (S514).
(39) The processor 15 receives a response corresponding to the search from the external apparatus 20 (S515), thereby founding the external apparatus 20 within the connectable range, and registering the external apparatus 20 based on information received from the external apparatus 20 (S516). For example, the response received from the external apparatus 20 may include the apparatus name, the apparatus number, the apparatus address, or the like information of the external apparatus 20, and the processor 15 may register the external apparatus 20 based on the apparatus name, the apparatus number, the apparatus address, or the like information of the external apparatus 20.
(40) The processor 15 may perform pairing with the registered external apparatus 20. To this end, the processor 15 makes a request for connection with the external apparatus 20 (S521), and receives connection acceptance corresponding to the connection request from the external apparatus 20 (S522). Further, the processor 15 receives a link key request from the external apparatus 20 (S531), generates and transmits a predetermined link key to the external apparatus 20 (S532). The generation of the link key is not described in detail because it is publicly known. For example, the link key may be generated with 128 bits based on the secure and fast encryption routine (SAFER)+ algorithm, and used in all security transaction.
(41) The processor 15 stores the link key transmitted to the external apparatus 20 (S533), and performs connection and communication with the external apparatus 20 based on a common link key shared between the electronic apparatus 10 and the external apparatus 20 (S534). However, the process in which the electronic apparatus 10 performs the connection with the external apparatus 20 is not limited to that shown in
(42) According to an embodiment, the connection between the electronic apparatus 10 and the external apparatus 20 is made based on a user's first voice command 31. Therefore, a connection button is not separately needed, and it is possible to mitigate inconvenience that a user 30 has to press the connection button, thereby simplifying design and improving convenience of use.
(43)
(44) Referring to
(45) In this case, the processor 15 may transmit a power-on signal to the external apparatus 20 (S612). For example, the processor 15 may use an infrared module to transmit the power-on signal while using a Bluetooth module of the communication circuitry 12 to perform the search.
(46) The processor 15 receives a response from the external apparatus 20 turned on based on the power-on signal (S613), and performs Bluetooth connection with the external apparatus 20 by pairing with the external apparatus 20 based on the operation S516 to S534 of
(47) Thus, the electronic apparatus 10 according to an embodiment the performs connection with the external apparatus 20 based on a user's first voice command 31 even though the external apparatus 20 is turned off, thereby providing more improved convenience of use as compared with the electronic apparatus 10 of
(48)
(49) Referring to
(50) Further, the processor 15 connects with the external apparatus 20 like the operation S516 to S534 of
(51) Thus, the electronic apparatus 10 according to an embodiment stores the second voice command received while performing the connection with the external apparatus 20, and provides the stored second voice command to the external apparatus 20 after the connection with the external apparatus 20, thereby solving a problem of losing the second voice command while performing the connection.
(52)
(53) First, referring to the block diagram of the electronic apparatus 10 shown in
(54) Referring to the table shown in
(55) When a present event occurs according to the operation S511 and S512 of
(56) Meanwhile, the second processor 17 may identify whether the preset first voice command 31 is received according to the operation S513 of
(57) The second processor 17 may identify whether the recognized first voice command 31 corresponds to a predetermined instruction stored in the storage 13. The instruction stored in the storage 13 may refer to a voice command corresponding to a predetermined sentence or word used for connection with the external apparatus 20, and may include a trigger syntax for starting a voice recognition operation through the external apparatus 20. For example, the first voice command 31 may include various commands such as “connection”, “connection to TV”, “Bixby”, “voice recognition start,” etc. according to design.
(58) When the recognized first voice command 31 corresponds to a predetermined command, the second processor 17 may make the first processor 16 operate in the first power mode. For example, when the first voice command 31 recognized by the second processor 17 is identified as corresponding to the voice command of “connection”, the second processor 17 transmits an interruption signal to the first processor 16 so that the first processor 16 can enter the first power mode.
(59) The first processor 16 switched over to the first power mode may perform connection with the external apparatus according to the operation S514 to S534 of
(60) The second processor 17 maintains a preprocessing function to only preprocess the second voice command received in the first power mode, and turns off a voice command identification function not to perform voice command identification for the second voice command. However, without limitations, it may be designed that both the preprocessing function and the voice command identification function may be turned off in the first power mode.
(61) Thus, when the second processor 17 is configured to identify the obtainment of the preset first voice command 31 in the second power mode according to whether the information of the previously connected external apparatus 20 is present, power is more efficiently used than the case where the first processor 16 identifies the obtainment of the preset first voice command 31.
(62) Meanwhile, the electronic apparatus 10 according to an embodiment makes the first processor 16 operate in a low power mode so that even the microphone 11 can receive a voice command equal to or higher than a predetermined level in the second power mode, thereby more efficiently reducing the power consumed in the second power mode.
(63)
(64) When it is identified that the information of the external apparatus 20 is present, the first processor 16 performs connection with the external apparatus 20 through the communication circuitry 12 based on the information of the external apparatus 20 (S920).
(65) On the other hand, when it is identified that the information of the external apparatus 20 is not present, the first processor 16 operates in the second power mode (S930), and the second processor 17 identifies whether a user's first voice command 31 is the preset voice command (S940).
(66) When the second processor 17 identifies that the first voice command 31 is the preset voice command, the first processor 16 operates in the first power mode (S950), and performs operation with the external apparatus 20 found by performing a search through the communication circuitry 12 (S960).
(67)
(68) The electronic apparatus 10 identifies whether a user's preset first command 31 is received during a disconnected state. When it is identified that the preset first voice command 31 is received, the electronic apparatus 10 performs reconnection with the external apparatus 20 found by performing a search through the communication circuitry 12 or employing the stored information of the external apparatus 20. For example, in a case where a user voluntarily stops the connection between the electronic apparatus 10 and the external apparatus 20, where disconnection is made by operation of an application running in the electronic apparatus 10, where the connection is temporarily interrupted to switch the connection with the external apparatus 20 of ‘A’ over to another external apparatus 20 of ‘B’, and the like case, it is possible to perform reconnection with the external apparatus 20 while maintaining the operation of the electronic apparatus 10.
(69) Thus, the electronic apparatus 10 according to an embodiment easily reconnects with the external apparatus 20 based on only a user's first voice command 31 in the state of being disconnected from the external apparatus 20 during operation, and is thus improved in convenience of use.
(70)
(71) In this case, the electronic apparatus 10 may perform connection with a predetermined external apparatus. For example, the electronic apparatus 10 may perform connection with the external apparatus having the strongest response signal among the plurality of external apparatuses. When a response signal received from a TV 21 is the strongest, the electronic apparatus 10 may connect with the TV 21 based on the first voice command 31. However, without limitations, a condition for the connection may be variously designed.
(72) When a user issues a different first voice command 31 for connection with another external apparatus in the state of connecting with the TV 21 based on the first voice command 31, the electronic apparatus 10 disconnects the previous connection and performs connection based on a newly received first voice command 31. For example, when a voice command of “connection to smartphone” is received while previously connecting and communicating with the TV 21, the electronic apparatus 10 disconnects the connection with the TV 21 and performs the connection with the smart phone 22. However, the voice command for the reconnection is not limited to this example, and the voice command for the reconnection may be variously designed.
(73) Thus, the electronic apparatus 10 according to an embodiment selectively connects with the plurality of external apparatuses based on a user's voice command, excludes a button for connection, and further improves convenience of use.
(74) According to the disclosure, there are provided an electronic apparatus and a control method thereof, in which connection with an external apparatus is performed based on a user's voice command, so that design can be more simplified without a button for the connection with the external apparatus, and convenience of use can be improved without making a user press the connection button.
(75) Further, according to the disclosure, there are provided an electronic apparatus and a control method thereof, in which low power is needed to perform operation of receiving and recognizing a user's voice command.
(76) Although the disclosure has been described with reference to the embodiments, various changes can be made in these embodiments without departing from the scope of the appended claims.