INFORMATION PROCESSING DEVICE AND INFORMATION PROCESSING METHOD
20170353761 · 2017-12-07
Inventors
Cpc classification
H04N21/41407
ELECTRICITY
G06F13/00
PHYSICS
H04N21/436
ELECTRICITY
H04N21/43637
ELECTRICITY
H04N21/4367
ELECTRICITY
International classification
H04N21/4363
ELECTRICITY
H04N21/4367
ELECTRICITY
Abstract
To appropriately perform connection between information processing devices. The information processing device is an information processing device including a communication unit and a control unit. The communication unit is configured to perform image transmission to a first information processing device by using wireless communication. The control unit is configured to temporarily suspend the first information processing device and perform an authentication process with a second information processing device having a different role from the first information processing device if the second information processing device is newly connected when transmitting the image to the first information processing device.
Claims
1. An information processing device, comprising: a communication unit configured to perform image transmission to a first information processing device by using wireless communication; and a control unit configured to temporarily suspend the first information processing device and perform an authentication process with a second information processing device having a different role from the first information processing device if the second information processing device is newly connected when the image transmission is performed.
2. The information processing device according to claim 1, wherein the communication unit performs real time image transmission to the first information processing device in accordance with a Wireless Fidelity (Wi-Fi) CERTIFIED Miracast specification, and after the first information processing device is temporarily suspended, the control unit performs an HDCP reauthentication process with each of the first information processing device and the second information processing device.
3. The information processing device according to claim 1, wherein if a role of the first information processing device is a transmitter, and a role of the information processing device is a receiver in a case where the image transmission is performed, when the role of the information processing device is changed to a relay device due to a connection of the second information processing device, the control unit performs the authentication process with the second information processing device after temporarily suspending the image transmission from the first information processing device, and resumes the image transmission from the first information processing device after the authentication process.
4. The information processing device according to claim 3, wherein the control unit performs a reauthentication process with the first information processing device after temporarily suspending the image transmission from the first information processing device, and performs the authentication process with the second information processing device after the reauthentication process succeeds.
5. The information processing device according to claim 1, wherein if a role of the first information processing device is a receiver, and a role of the information processing device is a transmitter in a case where the image transmission is performed, when the role of the information processing device is changed to a relay device due to a connection of the second information processing device, the control unit performs the authentication process with the second information processing device after temporarily suspending the image transmission to the first information processing device, and resumes the image transmission to the first information processing device after the authentication process.
6. The information processing device according to claim 5, wherein the control unit transmits Revocation information held when a wireless connection with the first information processing device starts to the second information processing device before performing the authentication process with the second information processing device.
7. The information processing device according to claim 1, wherein the information processing device is a dual role device satisfying a wireless Fidelity (Wi-Fi) CERTIFIED Miracast specification.
8. An information processing device, comprising: a communication unit configured to relay image transmission from a first information processing device to a second information processing device by using wireless communication; and a control unit configured to perform a reauthentication process with the first information processing device after temporarily suspending the first information processing device and resume the image transmission from the first information processing device after the reauthentication process when disconnecting a connection with the second information processing device.
9. The information processing device according to claim 8, wherein the control unit performs a disconnection process from the second information processing device after temporarily suspending the first information processing device.
10. An information processing device, comprising: a communication unit configured to relay image transmission from a first information processing device to a second information processing device by using wireless communication; and a control unit configured to cause notification information indicating that a connection with the first information processing device is to be disconnected to be output from at least one of the information processing device and the second information processing device when disconnecting the connection with the first information processing device.
11. The information processing device according to claim 10, wherein the control unit causes the output to be performed through a display of the notification information or an audio output of the notification information.
12. An information processing method, comprising: a process of determining whether or not a second information processing device to be newly connected has a role different from a first information processing device when performing image transmission to the first information processing device by using wireless communication; and a process of performing an authentication process with the second information processing device after temporarily suspending the first information processing device when the second information processing device has the role different from the first information processing device.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
[0039]
MODE(S) FOR CARRYING OUT THE INVENTION
[0040] Hereinafter, modes for carrying out the present technology (hereinafter referred to as “embodiments”) will be described. The description will proceed the following order.
1. Embodiments (example in which information processing device having a different role is newly connected and information processing device is disconnected)
2. Application examples
1. Embodiments
[Exemplary Configuration of Information Processing Device]
[0041]
[0042] The information processing device 100 includes a communication unit 110, a control unit 120, a storage unit 130, an operation receiving unit 140, and an information output unit 150.
[0043] The information processing device 100 is an information processing device or an electronic device having a wireless communication function. For example, the information processing device 100 is an information processing device having a wireless communication function (for example, a personal computer or a video watching device (for example, a television)) or a portable information processing device (for example, a smartphone or a tablet terminal).
[0044] The communication unit 110 is a module for transmitting and receiving radio waves via an antenna (not illustrated) (for example, a wireless local area network (LAN) modem). For example, the communication unit 110 can perform wireless communication in accordance with a communication scheme of the wireless LAN.
[0045] For example, the communication unit 110 may perform wireless communication in accordance with a communication scheme conforming to institute of electrical and electronics engineers (IEEE) 802.11, IEEE 802.15, IEEE 802.16, or a 3rd generation partnership project (3GPP) specification (for example, wideband code division multiple access (W-CDMA), global system for mobile communications (GSM (registered trademark)), worldwide interoperability for microwave access (WiMAX), WiMAX2, long term evolution (LTE), LTE-advanced (LTE-A)). The communication unit 110 can exchange various kinds of information using the wireless communication function. For example, it is possible to perform wireless communication using a wireless LAN between devices.
[0046] As the wireless LAN, for example, wireless Fidelity (Wi-Fi) direct, tunneled direct link setup (TDLS), an ad hoc network, or a mesh network can be used. Further, for example, Wi-Fi CERTIFIED Miracast (technical specification title: Wi-Fi Display) can be used as short-range wireless audio visual (AV) transmission communication used by the communication unit 110. Wi-Fi CERTIFIED Miracast is a mirroring technique in which audio or a display image to be reproduced by one terminal is transmitted to another terminal using a technique of Wi-Fi Direct or TDLS, and audio and image data are similarly output in another terminal.
[0047] Further, in Wi-Fi CERTIFIED Miracast, user input back channel (UIBC) over transmission control protocol/Internet protocol (TCP/IP) is implemented. UIBC is a technique of transmitting operation information of an input device such as a mouse or a keyboard from one terminal to another terminal. Instead of Wi-Fi CERTIFIED Miracast, other remote desktop software (for example, virtual network computing (VNC)) may be applied.
[0048] As described above, the communication unit 110 can perform real time image transmission with other information processing devices in accordance with the Wi-Fi CERTIFIED Miracast specification. Further, the communication unit 110 can relay image transmission from a first information processing device to a second information processing device in accordance with the Wi-Fi CERTIFIED Miracast specification.
[0049] The control unit 120 controls the respective units of the information processing device 100 on the basis of a control program stored in the storage unit 130. The control unit 120 is implemented by, for example, a central processing unit (CPU). Further, for example, the control unit 120 performs signal processing of transmitted or received information. Further, for example, the control unit 120 performs a connection process, an authentication process, and a disconnection process with other information processing devices.
[0050] The storage unit 130 is a memory that stores various kinds of information. For example, the storage unit 130 stores various kinds of information (for example, a control program) necessary for the information processing device 100 to perform a desired operation. Further, for example, the storage unit 130 includes a buffer used when the information processing device 100 transmits and receives data.
[0051] The operation receiving unit 140 is an operation receiving unit that receives an operation input performed by the user, and outputs operation information according to the received operation input to the control unit 120. For example, the operation receiving unit 140 receives an instruction operation for connection to the network and an instruction operation for disconnection from the network. The operation receiving unit 140 is implemented by, for example, a touch panel, a keyboard, a mouse, and a sensor (for example, a touch interface).
[0052] The information output unit 150 is an output unit that outputs various kinds of information on the basis of the control of the control unit 120. As the information output unit 150, for example, a display unit (for example, an organic electro luminescence (EL) panel or a liquid crystal display (LCD) panel) that outputs various kinds of information by displaying it may be used. Further, as the information output unit 150, for example, an audio output unit (for example, a microphone) that outputs various kinds of information as sound may be used. As the information output unit 150, for example, both the display unit and the audio output unit may be used. The operation receiving unit 140 and the information output unit 150 may be integrally configured using a touch panel that enables the user to perform an operation input by bringing a finger into contact with or close to a display surface.
[0053] As described above, the information processing device 100 can establish a Wi-Fi Direct connection with another information processing device. Further, the information processing device 100 can perform image communication with another information processing device in accordance with Wi-Fi CERTIFIED Miracast.
[0054] As described above, when the information processing device 100 is Wi-Fi Direct connected, the information processing device 100 can detect a new connection of another information processing device. Similarly, when the information processing device 100 is performing image communication in accordance with Wi-Fi CERTIFIED Miracast, the information processing device 100 can detect a new connection of another information processing device.
[0055] Further, when the information processing device 100 is Wi-Fi Direct connected, the information processing device 100 can detect disconnection of another information processing device. Similarly, when the information processing device 100 is performing image communication in accordance with Wi-Fi CERTIFIED Miracast, the information processing device 100 can detect disconnection of another information processing device.
[Exemplary Configuration of Communication Unit]
[0056]
[0057] In
[0058] In
[0059] Here, a dual role device is an information processing device that can function as both of a sink device and a source device of Wi-Fi CERTIFIED Miracast.
[0060] In
[Format Example of Revocation Information]
[0061]
[0062] The Revocation information is a list (Revocation List) which is managed by an upstream side device (a source device) and is used for monitoring whether or not an encryption key for encrypting a stream has leaked to a third party. Here, in the embodiment of the present technology, when communication of image data is performed, a reception side is indicated as “after” (or a downstream side), and a transmission side is indicated as “before” (or an upstream side).
[0063] The Revocation information is recorded, for example, in association with Number of Devices 191 and Device IDs 192.
[0064] The Number of Devices 191 is identification information identifying each device.
[0065] The Device IDs 192 are ID (identification) of each device.
[0066] Here, an HDCP digital rights management (DRM) technique will be described. In the HDCP DRM technique, devices are classified into three classes of a TX (Transmitter), a RX (Receiver), and a repeater, and a transmission path in which content is transmitted is protected.
[0067] Here, the TX is a device (transmitter) which transmits a digital stream without external digital input. Further, the RX is a device (receiver) that receives a digital stream without external digital output. Further, the repeater is a device (relay device) that has an external digital input and an external digital output and relays a stream digitally.
[0068] For example, the TX encrypts a stream to be transmitted to the RX. Further, the RX decrypts the stream (the stream encrypted by the TX) received from the TX. Further, after decrypting the stream (the stream encrypted by the TX) received from the TX, the Repeater encrypts the decrypted stream again and transmits the encrypted stream to the RX. In this case, the RX decrypts the stream (the stream encrypted by the repeater) received from the repeater.
[0069] As described above, the encrypted stream is exchanged between the TX and the RX. For this reason, authentication is performed between the TX and the RX, and an encryption key for encrypting the stream is exchanged. Further, the repeater performs authentication with each of the TX and the RX (that is, a total of two authentications), and exchanges the encryption key for encrypting the stream.
[0070] Further, in order to exclude an illegal device, the RX transmits the Revocation information to the TX.
[0071] Further, if there is a repeater between the RX and the TX, the repeater relays the Revocation information of the RX and transmits the Revocation information to the TX.
[0072] In Wi-Fi CERTIFIED Miracast, the transmission path is protected using HDCP. However, in Wi-Fi CERTIFIED Miracast, there are only two classes, that is, sink and source, and there is no class corresponding to the repeater. Further, each device can be a device (dual role device) that can function as the sink and the source. The sink device and the source device can be connected to the dual role device. Therefore, in Wi-Fi CERTIFIED Miracast, it is possible to connect the sink device with the source device via the dual role device.
[0073] Here, a case in which another device is added to the sink device and the source device that perform communication in accordance with Wi-Fi CERTIFIED Miracast is assumed. In this case, the role of the device on the side to which another device is added (the transmission side or the reception side) is also assumed to be changed. In this case, the role in HDCP is also changed. For example, in HDCP, the role is assumed to change from the TX to the repeater or from the RX to the repeater.
[0074] Further, any one of devices (the sink device and the source device) that perform communication in accordance with Wi-Fi CERTIFIED Miracast is assumed to be disconnected. In this case, the role of the device on the side from which the device is disconnected (the transmission side or the reception side) is changed. In this case, the role in HDCP is also changed. For example, in HDCP, the role is assumed to change from the TX to the repeater or from the RX to the repeater.
[0075] In HDCP, when the role of the device is changed as described above, re-authentication of HDCP is necessary. In the re-authentication of HDCP, it is necessary to disconnect the TCP connection of RTSP or the L2 connection of Wi-Fi Direct of the lower layer. Further, at the time of re-authentication of HDCP, a fuzzy image or a black image may occur. Further, from a point of view of the user, it may be difficult to view a display at the time of disconnection, or a black image may occur at the time of disconnection.
[Example in Which RX is Added After RX]
[0076] First, an example in which a role of the first RX is changed to the repeater when an RX is further added after the RX will be described.
[Exemplary Configuration of Communication System]
[0077]
[0078]
[0079] In
[0080] In
[0081] In
[0082] As illustrated in c of
[0083] For example, the information processing device 201 may be an imaging device (for example, a digital video camera), the information processing device 202 may be a tablet terminal, and the information processing device 203 may be a smartphone. For example, a case in which a captured image generated by the imaging device (information processing device 201) is first transmitted to the tablet terminal (the information processing device 202) and displayed is assumed. In this case, the smartphone (the information processing device 203) can be added and connected to the tablet terminal (the information processing device 202), and the display can be performed even on the smartphone (the information processing device 203). In this case, the captured image generated by the imaging device (the information processing device 201) can be displayed on both the tablet terminal (the information processing device 202) and the smartphone (the information processing device 203).
[0084] The communication examples will be described in detail with reference to
[Communication Examples]
[0085]
[0086]
[0087] As illustrated in
[0088] Here, M1 is a message (Query sink options) for inquiring about options of the sink device. Further, M2 is a message (Query source options) for inquiring about options of the source device.
[0089] M3 is a message (Query sink capabilities) for inquiring about capability information of the sink device. M4 is a message (Set sink parameters) for notifying the sink device of parameters to be set in the sink device.
[0090] M5 is a message indicating “Trigger WFD sink to issue {SETUP|PLAY|TEARDOWN|PAUSE} request.” Further, M6 is a message indicating “Send SETUP request to WFD source.” Further, M7 is a message indicating “Send PLAY request to WFD source. WFD source begins audio and/or video streaming.”
[0091] Here, the information processing device 203 is assumed to be further added after the information processing device 202. In this case, a disconnection process and a reconnection process are performed between the information processing device 201 and the information processing device 202 (308).
[0092] Further, the Wi-Fi Direct connection process is performed between the information processing device 202 and the information processing device 203 (315). Further, the exchange of the M1 to M7 messages (316 to 318, 320, and 321) and the HDCP reauthentication (319) are performed between the information processing device 202 and the information processing device 203.
[0093] Further, the information processing device 202 whose role is changed to the repeater performs the exchange of the M1 to M7 messages (309 to 311, 313, and 314) and the HDCP reauthentication (312) with the information processing device 201.
[0094] As described above, when the information processing device 203 is further added after the information processing device 202, it is necessary to perform the HDCP reauthentication. In this case, since it is necessary to disconnect the L2 connection of Wi-Fi Direct and TCP of RTSP, a fuzzy image or a black image may occur at the time of HDCP reauthentication. Further, at the time of HDCP reauthentication, there is a possibility of the authentication of the upstream side being performed again. In this regard,
[0095] Further, respective processes (331 to 337 and 315 to 321) illustrated in
[0096] The information processing device 202 issues PAUSE to the information processing device 201 before the HDCP reauthentication (342). Since it is possible to temporarily suspend the information processing device 201 by issuing PAUSE, it is possible to temporarily suspend an image. Accordingly, it is possible to prevent the occurrence of a fuzzy image or a black image at the time of HDCP reauthentication (344).
[0097] Then, the information processing device 202 issues HDCP Refresh to the information processing device 201 (343). Then, the information processing device 202 performs HDCP re-authentication (Up Stream) with the information processing device 201 (344). Further, the information processing device 202 performs HDCP re-authentication (Down Stream) with the information processing device 203 (346).
[0098] Then, the information processing device 202 issues PLAY to the information processing device 201 so that PLAY is set in the information processing device 201 (345).
[0099] Here, image data is continuously transmitted from the information processing device 201 after PAUSE is issued to the information processing device 201 (342). The image data transmitted as described above is held in the buffer of the information processing device 202. Therefore, the information processing device 202 can erase the image data by flushing the buffer at the timing of issuing PLAY to the information processing device 201 (349). In this case, the image data of the section is unable to be displayed, but since it is a relatively short period, influence on the user is small.
[0100] As described above, the information processing device 202 can delay a timing at which the authentication (346) on the downstream stream side, i.e., the repeater, is performed with the added information processing device 203 until the re-authentication (344) between the information processing device 201 and the information processing device 202 ends. Accordingly, it is possible to prevent the occurrence of a fuzzy image or a black image when the re-authentication (344) on the upstream (Up Stream) side fails. Further, it is possible to smoothly output images and sounds after the re-authentication without disconnecting the L2 connection of Wi-Fi Direct or the TCP connection of RTSP.
[0101] As described above, when the information processing device 203 having a different role from the information processing device 201 is newly connected, the control unit of the information processing device 202 (corresponding to the control unit 120 illustrated in
[Example in Which TX is Added Before TX]
[0102] Next, an example in which the role of the first TX is changed to the repeater when the TX is further added before the TX will be described.
[Exemplary Configuration of Communication System]
[0103]
[0104] In
[0105] In
[0106] In
[0107] As illustrated in c of
[0108] For example, the information processing device 211 may be a tablet terminal with a camera, the information processing device 212 may be a tablet terminal, and the information processing device 213 may be an imaging device (for example, a digital video camera). For example, a case in which a captured image generated by the tablet terminal with a camera (the information processing device 211) is first transmitted to the tablet terminal (the information processing device 212) and displayed is assumed. In this case, an imaging device (the information processing device 213) can be added and connected to the camera tablet terminal (the information processing device 211), and a detailed image by the imaging device (the information processing device 213) can be displayed on the tablet terminal (the information processing device 212). In this case, the captured images generated by both the tablet terminal with the camera (the information processing device 211) and the imaging device (the information processing device 213) can be simultaneously displayed on the tablet terminal (the information processing device 212).
[0109] The communication examples will be described in detail with reference to
[Communication Examples]
[0110]
[0111]
[0112] Further, respective processes (351 to 371) illustrated in
[0113] As described above, when the information processing device 213 is further added before the information processing device 211, it is necessary to perform the HDCP reauthentication. In this case, because it is necessary to disconnect the L2 connection of Wi-Fi Direct and TCP of RTSP, a fuzzy image or a black image may occur at the time of HDCP reauthentication. Further, at the time of HDCP reauthentication, there is a possibility of the authentication of the downstream side being performed again. In this regard,
[0114] Further, respective processes (381 to 387, and 391 to 397) illustrated in
[0115] After the HDCP authentication (385), the information processing device 211 records the Revocation information of the information processing device 212 in the storage unit (corresponding to the storage unit 130 in
[0116] As described above, when the information processing device 211 is first connected to the information processing device 212, the Revocation information of the information processing device 212 is recorded. Then, when the information processing device 213 is added, the Revocation information of the information processing device 212 is transmitted to the information processing device 213.
[0117] Accordingly, repeater authentication (HDCP reauthentication (Down Stream)) can be omitted after the information processing device 211 performs the repeater authentication (HDCP reauthentication (Up Stream)) with the information processing device 213 (395).
[0118] Further, the information processing device 211 transmits a PAUSE command to the information processing device 212 through Trigger METHOD before the HDCP reauthentication (389 and 390). Since it is possible to temporarily suspend the information processing device 212 by transmitting the PAUSE command, the image can be temporarily suspended. Therefore, it is possible to prevent the occurrence of a fuzzy image or a black image at the time of HDCP reauthentication (395).
[0119] Further, after the repeater authentication (HDCP reauthentication (Up Stream)) (395) is performed, the information processing device 211 issues PLAY to the information processing device 212 through Trigger METHOD (399 and 400). Accordingly, PLAY can be set in the information processing device 212 (399 and 400).
[0120] As described above, when the information processing device 213 having a different role from the information processing device 212 is newly connected, the control unit of the information processing device 211 (corresponding to the control unit 120 illustrated in
[Example in Which RX is Disconnected]
[0121] Next, an example in which the role of the repeater is changed to the RX when the RX is disconnected will be described.
[Exemplary Configuration of Communication System]
[0122]
[0123] In
[0124] In
[0125] In
[0126] The communication examples will be described in detail with reference to
[Communication Examples]
[0127]
[0128]
[0129] Further, respective processes (402 to 408) illustrated in
[0130] When the information processing device 223 is disconnected, the information processing device 222 transmits PAUSE to the information processing device 221 (401).
[0131] Further, the information processing device 222 performs the disconnection process of Wi-Fi Direct with the information processing device 223 (409).
[0132] As described above, when the information processing device 223 is disconnected, it is necessary to perform the HDCP reauthentication (406). In this case, because it is necessary to disconnect the L2 connection of Wi-Fi Direct and TCP of RTSP, a fuzzy image or a black image may occur at the time of HDCP reauthentication. In view of this,
[0133] Further, respective processes (412 and 414) illustrated in
[0134] Before the HDCP reauthentication (412), the information processing device 222 issues the PAUSE command to the information processing device 221 (411). The occurrence of a fuzzy image or a black image can be prevented by issuing this PAUSE command.
[0135] Then, the information processing device 222 performs the HDCP reauthentication with the information processing device 221 (412). Then, the information processing device 222 issues the PLAY command to the information processing device 221 (413) after the HDCP reauthentication (412).
[0136] Accordingly, it is possible to smoothly output images and sounds after the re-authentication without disconnecting the L2 connection of Wi-Fi Direct or the TCP connection of RT SP.
[0137] As described above, the control unit of the information processing device 222 (corresponding to the control unit 120 illustrated in
[Example in Which TX is Disconnected]
[0138] Next, an example in which the role of the repeater is changed to the TX when the TX is disconnected will be described.
[Exemplary Configuration of Communication System]
[0139]
[0140] In
[0141] In
[0142] In
[0143] The communication examples will be described in detail with reference to
[Communication Examples]
[0144]
[0145]
[0146] Further, respective processes (422 to 428) illustrated in
[0147] The information processing device 232 performs a disconnection process of Wi-Fi Direct with the information processing device 231 (421).
[0148] As described above, when the information processing device 231 is disconnected, it is necessary to perform the HDCP reauthentication (426). In this case, it is necessary to disconnect the L2 connection of Wi-Fi Direct and TCP of RTSP. Further, since the image transmission is terminated when the TX is disconnected, a black image may be displayed at the time of HDCP reauthentication.
[0149] Here, even when the device on the TX side (the device on the most upstream side) is changed (disconnected), a device next on the TX side (next to the upstream device) holds the Revocation information. For this reason, the HDCP reauthentication can be omitted. In this regard,
[0150] A process (431) illustrated in
[0151] After the disconnection process of Wi-Fi Direct with the information processing device 231 (431), the information processing device 232 outputs notification information for giving the user a notification indicating that the TX (the information processing device 231) has been disconnected (432). For example, the information processing device 232 causes the display unit to display a notification screen for giving the user a notification indicating that the TX (the information processing device 231) has been disconnected (for example, an input switching screen or a warning screen) (432). Further, for example, the information processing device 232 causes the audio output unit to output a message for giving the user a notification indicating that the TX (the information processing device 231) has been disconnected (432). The notification information may be automatically output when the information processing device 232 detects that the TX (the information processing device 231) is disconnected, and a black image is displayed on the display unit of the RX (the information processing device 233).
[0152] Further, after the disconnection process of Wi-Fi Direct with the information processing device 231 (431), the information processing device 233 omits the HDCP reauthentication and continues the streaming (433). In this case, the information processing device 232 can transmit the notification information for giving the user a notification indicating that the TX (the information processing device 231) has been disconnected to the information processing device 233 (433). For example, the information processing device 232 can transmit the notification information to the information processing device 233 using UIBC or the like (433).
[0153] Accordingly, it is possible to smoothly output images and sounds after the re-authentication without disconnecting the L2 connection of Wi-Fi Direct or the TCP connection of RTSP.
[0154] In this manner, when the connection with the information processing device 231 is disconnected, the control unit of the information processing device 232 (corresponding to the control unit 120 illustrated in
[Operation Examples of Information Processing Device]
[0155] Next, operation examples of the information processing device will be described.
[Operation Example When New Information Processing Device is Added]
[0156]
[0157] First, the control unit 120 of the information processing device 100 determines whether or not a newly connected information processing device (second device) has a different role (Wi-Fi CERTIFIED Miracast) from an already connected information processing device (first device) (step S801). Here, the role of Wi-Fi CERTIFIED Miracast is the source device or the sink device. Further, step S801 is an example of a process of determining in the claims set forth below.
[0158] When the new information processing device (second device) has the same role as the already connected information processing device (first device) (step S801), the control unit 120 is newly connected to the information processing device (second device) (step S802).
[0159] When the new information processing device (second device) has a different role from the already connected information processing device (first device) (step S801), the control unit 120 establishes a connection of Wi-Fi Direct with an information processing device (second device) (step S803).
[0160] Then, the control unit 120 PAUSEs the already connected information processing device (first device) (step S804). For example, when the already connected information processing device (first device) is the source device, the information processing device (first device) is PAUSEd by issuing PAUSE to the information processing device (first device). Further, for example, when the already connected information processing device (first device) is the sink device, the information processing device (first device) is PAUSEd by issuing the Trigger Method PAUSE to the information processing device (first device).
[0161] Then, the control unit 120 determines whether or not the new information processing device (second device) is the sink device (step S805). When the new information processing device (second device) is the sink device (step S805), the control unit 120 issues HDCP Refresh to the already connected information processing device (first device) (step S806).
[0162] Then, the control unit 120 performs the repeater authentication (HDCP reauthentication) with the new information processing device (second device), and performs an exchange until the M7 message of RTSP (step S807).
[0163] Further, when the new information processing device (second device) is the source device (step S805), the control unit 120 transmits the Revocation information of the already connected information processing device (first device) (step S808). In other words, when the HDCP authentication with the new information processing device (second device) is performed, the control unit 120 transmits the Revocation information of the already connected information processing device (first device) (step S808).
[0164] Then, the control unit 120 performs the repeater authentication (HDCP reauthentication) with the new information processing device (second device), and performs an exchange until the M7 message of RTSP (step S809).
[0165] Then, the control unit 120 sets PLAY in the already connected information processing device (first device) (step S810). For example, when the already connected information processing device (first device) is the source device, PLAY is set in the information processing device (first device) by issuing PLAY to the information processing device (first device). Further, for example, when the already connected information processing device (first device) is the sink device, PLAY is set in the information processing device (first device) by issuing the Trigger Method PLAY to the information processing device (first device). Steps S803 to S810 are an example of a process of performing an authentication process described in the claims set forth below.
[Operation Example When Information Processing Device is Disconnected]
[0166]
[0167] First, the control unit 120 of the information processing device 100 determines whether or not the information processing device to be disconnected is the sink device (step S821).
[0168] When the information processing device to be disconnected is the source device (step S821), the control unit 120 performs disconnection from the information processing device (the source device) (step S821). Then, the control unit 120 outputs the notification information for giving the user a notification indicating that the information processing device (the source device) has been disconnected from the information output unit 150 (step S823). For example, the control unit 120 causes the display unit to display the notification screen for giving the user a notification indicating that the information processing device (the source device) has been disconnected (step S823). Further, for example, the control unit 120 can give the user a notification by transmitting the notification information for giving the user a notification indicating that the information processing device (the source device) has been disconnected to another connected information processing device (the sink device). For example, the control unit 120 can transmit the notification information for giving the user a notification indicating that the information processing device (the source device) has been disconnected to another information processing device (the sink device) using streaming.
[0169] When the information processing device to be disconnected is the sink device (step S821), the control unit 120 PAUSEs the information processing device (the source device) that is not to be disconnected (step S824).
[0170] Then, the control unit 120 performs a disconnection from the information processing device (the sink device) to be disconnected (step S825). Then, the control unit 120 performs the HDCP reauthentication with the information processing device (the source device) not to be disconnected (step S826).
[0171] Then, the control unit 120 sets PLAY in the information processing device (the source device) that is not to be disconnected (step S827). In other words, the control unit 120 sets PLAY in the information processing device (the source device) by issuing PLAY to the information processing device (the source device) that is not to be disconnected.
[0172] Thus, in the embodiment of the present technology, it is possible to prevent the occurrence of a fuzzy image or a black image at the time of topology conversion in which the dual role device of Wi-Fi CERTIFIED Miracast changes it role from the TX to the repeater and increase the speed of the connection time. Similarly, it is possible to prevent the occurrence of a fuzzy image or a black image at the time of topology conversion in which the dual role device of Wi-Fi CERTIFIED Miracast changes its role from the RX to the repeater and increase the speed of the connection time.
[0173] Further, it is possible to prevent the occurrence of a fuzzy image or a black image at the time of topology conversion in which the dual role device of Wi-Fi CERTIFIED Miracast changes its role from the repeater to the TX and increase the speed of the connection time. Likewise, it is possible to prevent a fuzzy image at the time of topology conversion in which the dual role device of the Wi-Fi CERTIFIED Miracast changes its role from the repeater to the RX and increase the speed of the connection time.
[0174] As described above, according to the embodiments of the present technology, when the real time image transmission according to Wi-Fi CERTIFIED Miracast is performed, it is possible to appropriately perform a connection between information processing devices.
2. Application Examples
[0175] The technology according to the present disclosure can be applied to various products. For example, the information processing devices 100 may be realized as mobile terminals such as smartphones, tablet personal computers (PCs), notebook PCs, portable game terminals, or digital cameras, fixed-type terminals such as television receivers, printers, digital scanners, or network storages, or car-mounted terminals such as car navigation devices. Further, the information processing devices 100 may be realized as terminals (also referred to as machine type communication (MTC) terminals) which perform machine to machine (M2M) communication, such as smart meters, vending machine, remote monitoring devices and point of sale (POS) terminals. Furthermore, the information processing devices 100 may be wireless communication modules mounted in such terminals (for example, integrated circuit modules configured in one die).
2-1. First Application Example
[0176]
[0177] The processor 901 may be, for example, a central processing unit (CPU) or a system on chip (SoC), and controls functions of an application layer and other layers of the smartphone 900. The memory 902 includes a random access memory (RAM) and a read only memory (ROM), and stores programs executed by the processor 901 and data. The storage 903 can include a storage medium such as a semiconductor memory or a hard disk. The externally connected interface 904 is an interface for connecting an externally attached device such as a memory card or a universal serial bus (USB) device to the smartphone 900.
[0178] The camera 906 has an image sensor, for example, a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) to generate captured images. The sensor 907 can include a sensor group including, for example, a positioning sensor, a gyro sensor, a geomagnetic sensor, an acceleration sensor, and the like. The microphone 908 converts sounds input to the smartphone 900 into audio signals. The input device 909 includes, for example, a touch sensor that detects touches on a screen of the display device 910, a key pad, a keyboard, buttons, switches, and the like to receive manipulations or information inputs from a user. The display device 910 has a screen such as a liquid crystal display (LCD), or an organic light emitting diode (OLED) display to display output images of the smartphone 900. The speaker 911 converts audio signals output from the smartphone 900 into sounds.
[0179] The wireless communication interface 913 supports one or more wireless LAN standards of IEEE 802.11a, 11b, 11g, 11n, 11ac, and 11ad to execute the wireless LAN communication. The wireless communication interface 913 can communicate with another apparatus via a wireless LAN access point in an infrastructure mode. In addition, the wireless communication interface 913 can directly communicate with another apparatus in a direct communication mode such as an ad hoc mode, Wi-Fi Direct, or the like. Wi-Fi Direct is different from the ad hoc mode, and thus one of two terminals operates as an access point. However, communication is performed directly between the terminals. The wireless communication interface 913 can typically include a baseband processor, a radio frequency (RF) circuit, a power amplifier, and the like. The wireless communication interface 913 may be a single-chip module on which a memory that stores a communication control program, a processor that executes the program, and a relevant circuit are integrated. The wireless communication interface 913 may support another kind of wireless communication scheme such as a cellular communication scheme, a short-range wireless communication scheme, or a proximity wireless communication scheme in addition to the wireless LAN scheme. The antenna switch 914 switches a connection destination of the antenna 915 for a plurality of circuits (for example, circuits for different wireless communication schemes) included in the wireless communication interface 913. The antenna 915 has a single or a plurality of antenna elements (for example, a plurality of antenna elements constituting a MIMO antenna), and is used for transmission and reception of wireless signals from the wireless communication interface 913.
[0180] Note that the smartphone 900 may include a plurality of antennas (for example, antennas for a wireless LAN or antennas for a proximity wireless communication scheme, or the like), without being limited to the example of
[0181] The bus 917 connects the processor 901, the memory 902, the storage 903, the externally connected interface 904, the camera 906, the sensor 907, the microphone 908, the input device 909, the display device 910, the speaker 911, the wireless communication interface 913, and the auxiliary controller 919 to one another. The battery 918 supplies electric power to each of the blocks of the smartphone 900 shown in
[0182] In the smartphone 900 shown in
[0183] The smartphone 900 may operate as a wireless access point (software AP) when the processor 901 performs an access point function at an application level. The wireless communication interface 913 may have the wireless access point function.
2-2. Second Application Example
[0184]
[0185] The processor 921 may be, for example, a CPU or an SoC controlling a navigation function and other functions of the car navigation apparatus 920. The memory 922 includes a RAM and a ROM storing programs executed by the processor 921 and data.
[0186] The GPS module 924 measures a position of the car navigation apparatus 920 (for example, latitude, longitude, and altitude) using GPS signals received from a GPS satellite. The sensor 925 can include a sensor group including, for example, a gyro sensor, a geomagnetic sensor, a barometric sensor, and the like. The data interface 926 is connected to an in-vehicle network 941 via, for example, a terminal that is not illustrated to acquire data generated on the vehicle side such as car speed data.
[0187] The content player 927 reproduces content stored in a storage medium (for example, a CD or a DVD) inserted into the storage medium interface 928. The input device 929 includes, for example, a touch sensor that detects touches on a screen of the display device 930, buttons, switches, and the like to receive manipulations or information inputs from a user. The display device 930 has a screen such as an LCD or an OLED display to display images of the navigation function or reproduced content. The speaker 931 outputs sounds of the navigation function or reproduced content.
[0188] The wireless communication interface 933 supports one or more wireless LAN standards of IEEE 802.11a, 11b , 11g, 11n, 11ac, and 11ad to execute wireless LAN communication. The wireless communication interface 933 can communicate with another apparatus via a wireless LAN access point in the infrastructure mode. In addition, the wireless communication interface 933 can directly communicate with another apparatus in a direct communication mode, such as an ad hoc mode, Wi-Fi Direct, or the like. The wireless communication interface 933 can typically have a baseband processor, an RF circuit, a power amplifier, and the like. The wireless communication interface 933 may be a single-chip module on which a memory that stores a communication control program, a processor that executes the program, and a relevant circuit are integrated. The wireless communication interface 933 may support another kind of wireless communication scheme such as a short-range wireless communication scheme, a proximity wireless communication scheme, or the cellular communication scheme in addition to the wireless LAN scheme. The antenna switch 934 switches a connection destination of the antenna 935 for a plurality of circuits included in the wireless communication interface 933. The antenna 935 has a single or a plurality of antenna elements and is used for transmission and reception of wireless signals from the wireless communication interface 933.
[0189] Note that the car navigation apparatus 920 may include a plurality of antennas, without being limited to the example of
[0190] The battery 938 supplies electric power to each of the blocks of the car navigation apparatus 920 shown in
[0191] In the car navigation apparatus 920 illustrated in
[0192] The technology of the present disclosure may be realized as an in-vehicle system (or a vehicle) 940 including one or more blocks of the above-described car navigation apparatus 920, the in-vehicle network 941, and a vehicle-side module 942. The vehicle-side module 942 generates vehicle-side data such as a vehicle speed, the number of engine rotations, or failure information and outputs the generated data to the in-vehicle network 941.
[0193] The above-described embodiments are examples for embodying the present technology and have correspondence relations with factors in embodiments and specific inventive factors in the claims. Similarly, specific inventive factors in the claims and factors in embodiments of the present technology to which the same names as the specific inventive factors are given have correspondence relations. However, the present technology is not limited to the embodiments, but may be realized in various modification forms of the embodiments within the scope without departing from the gist of the present technology.
[0194] The processing orders described in the above-described embodiments may be ascertained as methods including the series of orders or may be ascertained as a program causing a computer to execute the series of orders or a recording medium storing the program. As the recording medium, for example, a compact disc (CD), a minidisc (MD), a digital versatile disc (DVD), a memory card, or a Blu-ray (registered trademark) disc can be used.
[0195] The advantageous effects described in the present specification are merely examples and are not limitative, and other advantageous effects may be achieved.
[0196] Additionally, the present technology may also be configured as below.
(1)
[0197] An information processing device, including:
[0198] a communication unit configured to perform image transmission to a first information processing device by using wireless communication; and
[0199] a control unit configured to temporarily suspend the first information processing device and perform an authentication process with a second information processing device having a different role from the first information processing device if the second information processing device is newly connected when the image transmission is performed.
(2)
[0200] The information processing device according to (1),
[0201] wherein the communication unit performs real time image transmission to the first information processing device in accordance with a Wireless Fidelity (Wi-Fi) CERTIFIED Miracast specification, and
[0202] after the first information processing device is temporarily suspended, the control unit performs an HDCP reauthentication process with each of the first information processing device and the second information processing device.
(3)
[0203] The information processing device according to (1),
[0204] wherein if a role of the first information processing device is a transmitter, and a role of the information processing device is a receiver in a case where the image transmission is performed, when the role of the information processing device is changed to a relay device due to a connection of the second information processing device, the control unit performs the authentication process with the second information processing device after temporarily suspending the image transmission from the first information processing device, and resumes the image transmission from the first information processing device after the authentication process.
(4)
[0205] The information processing device according to (3),
[0206] wherein the control unit performs a reauthentication process with the first information processing device after temporarily suspending the image transmission from the first information processing device, and performs the authentication process with the second information processing device after the reauthentication process succeeds.
(5)
[0207] The information processing device according to (1),
[0208] wherein if a role of the first information processing device is a receiver, and a role of the information processing device is a transmitter in a case where the image transmission is performed, when the role of the information processing device is changed to a relay device due to a connection of the second information processing device, the control unit performs the authentication process with the second information processing device after temporarily suspending the image transmission to the first information processing device, and resumes the image transmission to the first information processing device after the authentication process.
(6)
[0209] The information processing device according to (5),
[0210] wherein the control unit transmits Revocation information held when a wireless connection with the first information processing device starts to the second information processing device before performing the authentication process with the second information processing device.
(7)
[0211] The information processing device according to any of (1) to (6),
[0212] wherein the information processing device is a dual role device satisfying a wireless Fidelity (Wi-Fi) CERTIFIED Miracast specification.
(8)
[0213] An information processing device, including:
[0214] a communication unit configured to relay image transmission from a first information processing device to a second information processing device by using wireless communication; and
[0215] a control unit configured to perform a reauthentication process with the first information processing device after temporarily suspending the first information processing device and resume the image transmission from the first information processing device after the reauthentication process when disconnecting a connection with the second information processing device.
(9)
[0216] The information processing device according to (8),
[0217] wherein the control unit performs a disconnection process from the second information processing device after temporarily suspending the first information processing device.
(10)
[0218] An information processing device, including:
[0219] a communication unit configured to relay image transmission from a first information processing device to a second information processing device by using wireless communication; and
[0220] a control unit configured to cause notification information indicating that a connection with the first information processing device is to be disconnected to be output from at least one of the information processing device and the second information processing device when disconnecting the connection with the first information processing device.
(11)
[0221] The information processing device according to (10),
[0222] wherein the control unit causes the output to be performed through a display of the notification information or an audio output of the notification information.
(12)
[0223] An information processing method, including:
[0224] a process of determining whether or not a second information processing device to be newly connected has a role different from a first information processing device when performing image transmission to the first information processing device by using wireless communication; and
[0225] a process of performing an authentication process with the second information processing device after temporarily suspending the first information processing device when the second information processing device has the role different from the first information processing device.
REFERENCE SIGNS LIST
[0226] 100, 201 to 203, 211 to 213, 221 to 223, 231 to 233 information processing device
[0227] 110 communication unit
[0228] 120 control unit
[0229] 130 storage unit
[0230] 140 operation receiving unit
[0231] 150 information output unit
[0232] 160 communication unit
[0233] 161 RTSP server
[0234] 162 RTP server
[0235] 163 HDCP TX
[0236] 164 NIC
[0237] 170 communication unit
[0238] 171 RT SP server
[0239] 172 RTP server
[0240] 173 HDCP RX/TX repeater
[0241] 174 RTSP client
[0242] 175 RTP client
[0243] 176 NIC
[0244] 180 communication unit
[0245] 181 RTSP client
[0246] 182 RTP client
[0247] 183 HDCP RX
[0248] 184 NIC
[0249] 900 smartphone
[0250] 901 processor
[0251] 902 memory
[0252] 903 storage
[0253] 904 externally connected interface
[0254] 906 camera
[0255] 907 sensor
[0256] 908 microphone
[0257] 909 input device
[0258] 910 display device
[0259] 911 speaker
[0260] 913 wireless communication interface
[0261] 914 antenna switch
[0262] 915 antenna
[0263] 917 bus
[0264] 918 battery
[0265] 919 auxiliary controller
[0266] 920 car navigation apparatus
[0267] 921 processor
[0268] 922 memory
[0269] 924 GPS module
[0270] 925 sensor
[0271] 926 data interface
[0272] 927 content player
[0273] 928 storage medium interface
[0274] 929 input device
[0275] 930 display device
[0276] 931 speaker
[0277] 933 wireless communication interface
[0278] 934 antenna switch
[0279] 935 antenna
[0280] 938 battery
[0281] 941 in-vehicle network
[0282] 942 vehicle-side module