REMOTE CONTROL METHOD, APPARATUS, TERMINAL DEVICE, AND COMPUTER READABLE STORAGE MEDIUM
20190051147 ยท 2019-02-14
Assignee
Inventors
Cpc classification
H04M1/724
ELECTRICITY
G08C2201/93
PHYSICS
H04M1/2535
ELECTRICITY
International classification
Abstract
The present invention discloses a remote control method, apparatus, terminal device, and computer readable storage medium, wherein, the method comprises: receiving a screen image of a controlled terminal device from the controlled terminal device; generating an operation instruction according to the screen image; sending the operation instruction to the controlled terminal device to control the controlled terminal device. The present invention solves the problems such as complicated operation and poor real-time effect when a control terminal device remotely controls a controlled terminal device in prior art, and the present invention realizes real-time control over a controlled terminal device by a control terminal device.
Claims
1. A remote control method, applied to a control terminal device, comprising: receiving a screen image of a controlled terminal device from the controlled terminal device; generating an operation instruction according to the screen image; sending the operation instruction to the controlled terminal device to control the controlled terminal device.
2. The method of claim 1, wherein, the step of generating an operation instruction according to the screen image comprises: displaying the screen image, and performing a designated operation on the displayed screen image; recording coordinates information of the designated operation relative to a screen of the controlled terminal device; generating an operation instruction according to the designated operation and the coordinates information.
3. The method of claim 1, wherein, before receiving the screen image of the controlled terminal device from the controlled terminal device, the method comprises: establishing a VOLTE video call connection with the controlled terminal device.
4. A remote control method, applied to a controlled terminal device, comprising: sending a screen image of the controlled terminal device to a control terminal device; receiving an operation instruction from the control terminal device, wherein the operation instruction is generated by the control terminal device according to the screen image; executing a corresponding operation according to the operation instruction.
5. The method of claim 4, wherein, the step of executing a corresponding operation according to the operation instruction comprises: analyzing the operation instruction to obtain a designated operation performed on the screen image and coordinates information of the designated operation relative to a screen of the controlled terminal device; executing a corresponding operation according to the designated operation and the coordinates information.
6. The method of claim 4, wherein, before sending the screen image of the controlled terminal device to the control terminal device, the method comprises: establishing a VOLTE video call connection with the control terminal device.
7. A terminal device, comprising: at least one processor, and a memory communicably connected with the at least one processor; wherein, the memory stores instructions that are executable by the at least one processor, the instructions are executed by the at least one processor to cause the at least one processor to perform the remote control method comprising the steps receiving a screen image of a controlled terminal device from the controlled terminal device; generating an operation instruction according to the screen image; sending the operation instruction to the controlled terminal device to control the controlled terminal device.
8. The terminal device of claim 7, wherein, the step of generating an operation instruction according to the screen image comprises: displaying the screen image, and performing a designated operation on the displayed screen image; recording coordinates information of the designated operation relative to a screen of the controlled terminal device; generating an operation instruction according to the designated operation and the coordinates information.
9. The terminal device of claim 7, wherein, before receiving the screen image of the controlled terminal device from the controlled terminal device, the method further comprises establishing a VOLTE video call connection with the controlled terminal device.
10. A computer readable storage medium, with computer instructions stored thereon, wherein the instructions when executed by a processor cause the processor to perform the remote control method according to claim 1.
11. The computer readable storage medium of claim 10, wherein, the step of generating an operation instruction according to the screen image comprises: displaying the screen image, and performing a designated operation on the displayed screen image; recording coordinates information of the designated operation relative to a screen of the controlled terminal device; generating an operation instruction according to the designated operation and the coordinates information.
12. The computer readable storage medium of claim 10, wherein, before receiving the screen image of the controlled terminal device from the controlled terminal device, the method further comprises establishing a VOLTE video call connection with the controlled terminal device.
13. A terminal device, comprising: at least one processor, and a memory communicably connected with the at least one processor; wherein, the memory stores instructions that are executable by the at least one processor, the instructions are executed by the at least one processor to perform the steps of remote control method according to claim 4.
14. The terminal device of claim 13, wherein, the step of executing a corresponding operation according to the operation instruction comprises: analyzing the operation instruction to obtain a designated operation performed on the screen image and coordinates information of the designated operation relative to a screen of the controlled terminal device; executing a corresponding operation according to the designated operation and the coordinates information.
15. The terminal device of claim 13, wherein, before sending the screen image of the controlled terminal device to the control terminal device, the method comprises establishing a VOLTE video call connection with the control terminal device.
16. A computer readable storage medium, with computer instructions stored thereon, wherein the instructions when executed by a processor cause the processor to perform the remote control method according to claim 4.
17. The computer readable storage medium of claim 16, wherein, the step of executing a corresponding operation according to the operation instruction comprises: analyzing the operation instruction to obtain a designated operation performed on the screen image and coordinates information of the designated operation relative to a screen of the controlled terminal device; executing a corresponding operation according to the designated operation and the coordinates information.
18. The computer readable storage medium of claim 16, wherein, before sending the screen image of the controlled terminal device to the control terminal device, the method comprises establishing a VOLTE video call connection with the control terminal device.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0026] In order to more clearly describe the technical solutions in the embodiments of the present disclosure or in prior art, hereinafter, the accompanying drawings to be used for describing the specific embodiments or prior art will be briefly introduced. Apparently, the accompanying drawings described below are only directed to some embodiments of the present disclosure, and for a person skilled in the art, without expenditure of creative labor, other drawings can be derived on the basis of these accompanying drawings.
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
DETAILED DESCRIPTION
[0036] In order for the objectives, features and advantages of the present disclosure to be more clearly understood, hereinafter, a clear and complete description of the technical solution in embodiments of the present disclosure is provided in combination with the accompanying drawings of the embodiments of the present disclosure. Apparently, the embodiments described below are part of, but not all of, the embodiments of the present disclosure. All the other embodiments, obtained by a person skilled in the art on the basis of the embodiments described in the present disclosure without expenditure of creative labor, belong to the protection scope of the present disclosure.
[0037] As shown in
[0038] Optionally, the RF circuit 210 is used for receiving and sending signals in a process of information transmission or voice call. The memory 220 is used for storing software programs and modules, the processor 280 executes various application functions and data processing of the cellphone by running the software programs and modules stored in the memory 220. The input unit 230 may comprise a touch-control panel 231 or other input devices 232. Said other input devices 232 may include, but not limited to, one or more selected from a physical keyboard, a function button, a mouse, a joystick. The display unit 240 is used for displaying information inputted by a user, or information to be provided to a user, or various menus of the cellphone. The display unit 240 may comprise a display panel 241. The touch-control panel 231 may cover the display panel 241, and when the touch-control panel 231 detects a touch operation on it or in the proximity of it, the touch-control panel 231 transmits signal to the processor 280 so as to determine a type of the touch incident, and then the processor 280 provides a corresponding visual output on the display panel 241 according to the type of the touch incident.
[0039] The cellphone may also comprise at least one kind of sensor 250, such as an optical sensor, a motion sensor or other sensors. The optical sensor may comprise an environment light sensor and a proximity sensor, optionally the environment light sensor can adjust the luminance of the display panel 241 according to the brightness of environment light, and the proximity sensor can turn off the display panel 241 and/or the backlight when the cellphone is moved into proximity of the user's ear. The optical sensor in this embodiment may be provided on a casing at a front side or a back side of the cellphone, for detecting a shading area when the use holds the cellphone. Also, the cellphone may also comprise a pressure sensor provided on a casing at a front side or a back side of the cellphone, for determining the shading area when the use holds the cellphone, by detecting a pressure. In addition, the cellphone may also be equipped with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, an infrared ray sensor, which are not cumbersomely described herein.
[0040] The audio circuit 260, together with a speaker 261 and a sound receiver 262, can provide an audio interface between the user and the cellphone. The wireless module 270 may be a Wi-Fi module, which provides wireless interact access service to the user.
[0041] The processor 280 is a control center of the cellphone, which interconnects the respective components of the entire cellphone by using various interfaces and wires and executes various functions and data processing of the cellphone by running or executing the software programs and/or modules stored in the memory 220 as well as calling the data stored in the memory 220, so as to monitor the cellphone as a whole. Optionally, the processor 280 may comprise one or more processing units. Also, the cellphone comprises the power source 290 for supplying power to the respective components, and the power source 290 is logically connected to the processor 280 through a power management system, so as to realize functions such as charge and discharge management, energy consumption management, etc. by means of the power management system.
[0042] Although not shown, the cellphone may also comprise a camera, a Bluetooth module, etc., which are not cumbersomely described herein.
[0043] One embodiment provides a remote control method, applied to the above-mentioned control terminal device, such as a cellphone or a tablet computer.
[0044] Step S201: receiving a screen image of a controlled terminal device from the controlled terminal device. In particular, a VOLTE video call connection is established between the control terminal device and the controlled terminal device, and the control terminal device and the controlled terminal device use the transmission technology in the VOLTE video call to carry out data transmission. In an optional embodiment, the control terminal device receives, from the controlled terminal device, screen information recorded in real time by the controlled terminal device. In another optional embodiment, when the control terminal device and the controlled terminal device perform a VOLTE video call, the control terminal device receives in real time, from the controlled terminal device, screen images captured by the controlled terminal device. As a result, the control terminal device can acquire in real time the running status of the controlled terminal device.
[0045] Step S202: generating an operation instruction according to the screen image. In particular, the control terminal device displays the screen image received from the controlled terminal device, and by means of the displayed screen image, the control terminal device can perform operations such as clicking, sliding, long pressing on its screen, collect the coordinates information of the aforementioned various operations relative to the screen of the controlled terminal device, and generate the above-mentioned operation instruction.
[0046] Step S203: sending the operation instruction to the controlled terminal device to control the controlled terminal device. In particular, the controlled terminal device may analyze the above-mentioned operation instruction and convert the operation instruction into a screen interaction operation corresponding to itself, so as to realize real-time control of the controlled terminal device by the control terminal device.
[0047] One embodiment provides another remote control method, applied to the above-mentioned controlled terminal device, such as a cellphone or a tablet computer.
[0048] Step S301: sending a screen image of the controlled terminal device to a control terminal device. In particular, a VOLTE video call connection is established between the control terminal device and the controlled terminal device, and the control terminal device and the controlled terminal device use the transmission technology in the VOLTE video call to carry out data transmission. In an optional embodiment, the controlled terminal device records in real time its own screen, and continuously sends the recorded video information to the control terminal device. In another optional embodiment, when the control terminal device and the controlled terminal device perform a VOLTE video call, an image-capturing module of the controlled terminal device captures a screen image of its own and sends the captured screen image to the control terminal device for once every predetermined interval. As a result, the control terminal device can acquire in real time the running status of the controlled terminal device.
[0049] Step S302: receiving an operation instruction from the control terminal device, the operation instruction is generated by the control terminal device according to the screen image. In particular, the control terminal device displays the screen image received from the controlled terminal device, and by means of the displayed screen image, the control terminal device can perform operations such as clicking, sliding, long pressing on its screen, collect the coordinates information of the aforementioned various operations relative to the screen of the controlled terminal device, and generate the above-mentioned operation instruction.
[0050] Step S303: executing a corresponding operation according to the operation instruction. In particular, the controlled terminal device analyzes the above-mentioned operation instruction to obtain a designated operation performed on the screen image and coordinates information of the designated operation relative to the screen of the controlled terminal device, and converts these information into a screen interaction operation corresponding to itself, so as to realize real-time control of the controlled terminal device by the control terminal device.
[0051] Hereinafter, in combination with an information interaction process between the control terminal device and the controlled terminal device, examples for carrying out remote control of the controlled terminal device by the control terminal device are described.
[0052] As shown in
[0053] By means of the above-mentioned embodiment, in order for a control terminal device to truly realize real-time control over a controlled terminal device and for the control terminal device to be able to see in real-time the images of the controlled terminal device, the relatively stable communication technology of the existing VOLTE is utilized to transmit the screen information from the controlled terminal device to the control terminal device and transmit the operation information from the control terminal device back to the controlled terminal device, the controlled terminal device executes the received operation instruction, then the controlled terminal device again sends its screen information back to the control terminal device, so on and so forth executed in cycles, thereby completing real-time control of the controlled terminal device by the control terminal device. Because the transmission technology in the VOLTE video call is utilized, there is no need to provide an additional server to perform data relay, therefore low cost, safety and reliability are realized, and in the meantime the practicability of VOLTE video call is diversified, therefore the user experience is improved.
[0054] One embodiment provides a remote control apparatus, this apparatus is for carrying out the above-mentioned embodiments and their preferred implementing ways, and those already described will not be repeatedly described herein. As used below, the term module may be a combination of software and/or hardware for carrying out predetermined functions. Although the apparatus described in the embodiments below are preferably realized by software, implementation by hardware or by a combination of software and hardware can also be possibly conceived.
[0055]
[0056] Optionally, the generating module 62 comprises: a display unit, for displaying the screen image and performing a designated operation on the displayed screen image; a recording unit, for recording coordinates information of the designated operation relative to a screen of the controlled terminal device; a generating unit, for generating an operation instruction according to the designated operation and the coordinates information.
[0057] Optionally,the apparatus also comprises: a connection module, for establishing a VOLTE video call connection with the controlled terminal device before receiving the screen image of the controlled terminal device from the controlled terminal device.
[0058] The remote control apparatus in this embodiment is illustrated in a form of functional units, herein, the unit refers to an ASIC circuit, a processor and a memory for executing one or more software or fixed program, and/or other devices able to provide the above-mentioned functions.
[0059] Further functional description of the above-mentioned modules is the same as that of the corresponding embodiments above, which is not repeatedly described herein.
[0060] Another embodiment provides a remote control apparatus for carrying out the above-mentioned embodiments and their preferred implementing ways, and those already described will not be repeatedly described herein. As used below, the term module may be a combination of software and/or hardware for carrying out predetermined functions. Although the apparatus described in the embodiments below are preferably realized by software, implementation by hardware or by a combination of software and hardware can also be possibly conceived.
[0061]
[0062] Optionally, the execution module 73 comprises: an analyzing unit, for analyzing the operation instruction and obtain a designated operation performed on the screen image and coordinates information of the designated operation relative to a screen of the controlled terminal device; an execution unit, for executing a corresponding operation according to the designated operation and the coordinates information.
[0063] Optionally, the apparatus also comprises: a connection module, for establishing a VOLTE video call connection with the control terminal device before sending the screen image of the controlled terminal device to the control terminal device.
[0064] The remote control apparatus in this embodiment is illustrated in a form of functional units, herein, the unit refers to an ASIC circuit, a processor and a memory for executing one or more software or fixed program, and/or other devices able to provide the above-mentioned functions.
[0065] Further functional description of the above-mentioned modules is the same as that of the corresponding embodiments above, which is not repeatedly described herein.
[0066] Referring to
[0067] receiving a screen image of a controlled terminal device from the controlled terminal device;
[0068] generating an operation instruction according to the screen image;
[0069] sending the operation instruction to the controlled terminal device to control the controlled terminal device.
[0070] In the embodiments of the present disclosure, the processor 801 calls the program codes stored in the memory 804 to also perform the following steps:
[0071] displaying the screen image, and performing a designated operation on the displayed screen image;
[0072] recording coordinates information of the designated operation relative to a screen of the controlled terminal device;
[0073] generating an operation instruction according to the designated operation and the coordinates information.
[0074] In the embodiments of the present disclosure, the processor 801 calls the program codes stored in the memory 804 to also perform the following step:
[0075] establishing a VOLTE video call connection with the controlled terminal device.
[0076] Optionally, the communication bus 802 may be a Peripheral Component Interconnecting (PCI) bus or an Extended industry Standard Architecture bus. The communication bus 802 may be classified into an address bus, a data bus, a control bus, etc. For easy illustration, only one thick line is used in
[0077] Optionally, the memory 804 may comprise a volatile memory such as a Random Access Memory (RAM); the memory 804 may also comprise a non-volatile memory such as a flash memory, a hard disk drive (HDD) or a Solid State Drive (SSD); the memory 804 may also comprise a combination of the aforementioned types of memory devices.
[0078] Optionally, the processor 801 may be a Central Processing Unit (CPU), a Network Processor (NP), or a combination of CPU and NP.
[0079] Optionally, the processor 801 may further comprise a hardware chip. The aforementioned chip may be an Application Specific Integrated Circuit (ASIC), a Programmable Logic Device (PLD), or a combination thereof. The aforementioned PLD may be a Complex Programmable Logic Device (CPLD), a Field-Programmable Gate Array (FPGA), a Generic Array Logic (GAL), or a combination thereof.
[0080] Optionally, the memory 804 may store program instructions. The processor 801 may call the program instructions to carry out the remote control methods shown in the embodiments of
[0081] Referring to
[0082] sending a screen image of the controlled terminal device to a control terminal device;
[0083] receiving an operation instruction from the control terminal device, the operation instruction is generated by the control terminal device according to the screen image;
[0084] executing a corresponding operation according to the operation instruction.
[0085] In the embodiments of the present disclosure, the processor 901 calls the program codes stored in the memory 904 to also perform the following steps:
[0086] analyzing the operation instruction to obtain a designated operation performed on the screen image and coordinates information of the designated operation relative to a screen of the controlled terminal device;
[0087] executing a corresponding operation according to the designated operation and the coordinates information.
[0088] In the embodiments of the present disclosure, the processor 901 calls the program codes stored in the memory 904 to also perform the following steps:
[0089] establishing a VOLTE video call connection with the control terminal device.
[0090] Optionally, the communication bus 902 may be a Peripheral Component Interconnecting (PCI) bus or an Extended Industry Standard Architecture bus. The communication bus 802 may be classified into an address bus, a data bus, a control bus, etc. For easy illustration, only one thick line is used in
[0091] Optionally, the memory 904 may comprise a volatile memory such as a Random Access Memory (RAM); the memory 904 may also comprise a non-volatile memory such as a flash memory, a hard disk drive (HDD) or a Solid State Drive (SSD); the memory 904 may also comprise a combination of the aforementioned types of memory devices.
[0092] Optionally, the processor 901 may be a Central Processing Unit (CPU), a Network Processor (NP), or a combination of CPU and NP.
[0093] Optionally, the processor 901 may further comprise a hardware chip. The aforementioned chip may be an Application Specific Integrated Circuit (ASIC), a Programmable Logic Device (PLD), or a combination thereof. The aforementioned PLD may be a Complex Programmable Logic Device (CPLD), a Field-Programmable Gate Array (FPGA), a Generic Array Logic (GAL), or a combination thereof.
[0094] Optionally, the memory 904 may store program instructions. The processor 901 may call the program instructions to carry out the remote control methods shown in the embodiments of
[0095] The embodiments of the present disclosure also provide a non-transient computer storage medium, the computer readable storage medium stores computer executable instructions, the computer executable instructions can execute the remote control method in any of the above-mentioned method embodiments. Optionally, the storage medium may be a magnetic disk, an optical Disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Flash Memory, a Hard Disk Drive (HDD) or a Solid-State Drive (SSD); the storage medium may also comprise a combination of the aforementioned types of memory devices.
[0096] Although some embodiments of the present disclosure are described in combination with the accompanying drawings, a person skilled in the art can make various changes and modifications without departing from the essence and scope of the present disclosure, and these changes and modifications should all be embraced in the scope defined by the appended Claims.
[0097] It will be apparent to those skilled in the art that various modifications and variations can be made to the disclosed system and related methods. Other embodiments will be apparent to those skilled in the art from consideration of the specification and practice of the disclosed system and related methods.
[0098] It is intended that the specification and examples be considered as exemplary only, with a true scope being indicated by the following claims and their equivalents.