COMMUNICATION DEVICE CONTROL WITH EXTERNAL ACCESSORY
20170279950 · 2017-09-28
Inventors
Cpc classification
H04W4/80
ELECTRICITY
International classification
Abstract
Disclosed is a communication device (102) that can be hosting a communication application (112) and/or software, such as PTT/VoIP application, which is at least partially controlled and supplemented with payload data by at least one accessory to provide remote UI capabilities, to be used in a communications system as system element, with an UI feature and/or accessory device for communicating commands, signaling data and/or voice/audio data. Also disclosed is an accessory device as a system element of the communications system.
Claims
1-21. (canceled)
22. A communication device comprising a configuration for hosting a communication application and/or software, such as a PTT/VoIP application, for communication of audio data, such as voice data, with a wirelessly connected first accessory over a first wireless connection, such as Classic Bluetooth-compliant connection or Bluetooth Low Energy-compliant connection (BLE, Bluetooth LE or Bluetooth Smart), the communication device being further configured to be at least partially controlled and supplemented with payload data by at least one accessory to provide remote UI features and/or capabilities, the signaling being configured to occur via a second wireless connection, preferably Bluetooth Low Energy-compliant connection (BLE, Bluetooth LE or Bluetooth Smart).
23. The communication device of claim 22, wherein the communication device has been provided with an access to/from at least one, but optionally two or more accessory devices of which at least one is configured to control at least one of the communication device and a communication application of said communication device substantially simultaneously.
24. The communication device of claim 20, wherein it comprises such a configuration for the controlling of the communication, the configuration being adapted to at least to a same communications connection or session comprising at least one of said communication devices and at least one of said two or more accessory devices in the session or in the communications connection.
25. The communication device of claim 22, wherein it has a configuration for an accessory device for a user input command to the communication device and/or a configuration for an accessory device for audio and/or voice data transfer.
26. The communication device of claim 22, wherein the communication device comprises at least one of the following: a cellular phone, a so-called smartphone or a communications-enabled PDA, a tablet, a phablet, and a vehicle-installed communication equipment.
27. An accessory device for a wireless communications with a communications device of claim 22, the accessory device being configured with a first configuration to transmit to or generally communicate audio data, such as voice signals, with a communication device over a first wireless connection, which comprises using Classic Bluetooth-compliant connection and/or Bluetooth Low Energy connection (BLE).
28. The accessory device of claim 27, wherein the accessory device is further configured with a second configuration, to communicate therewith related signaling information, optionally including transmitting an indication of depressing or otherwise actuating a button, e.g. PTT, or other UI feature, over a second, different wireless connection, preferably compliant with Bluetooth Low Energy (BLE, Bluetooth LE or Bluetooth Smart).
29. The accessory device of claim 27, wherein the accessory device comprises a number of, or preferably a number of or a plurality of, user actuable such as manually actuable UI features such as a number of buttons, switches, keys, and/or a touch display/surface that are arranged to locally control feature(s) of the accessory device and/or be associated with predetermined control signal(s) transmitted wirelessly over a second connection to control the communication device via an application running thereon.
30. The accessory device of claim 27, wherein the accessory device has a configuration for setting the accessory device into a certain mode, which comprises at least one of a sleep mode, active mode, off-mode, stand-by mode or idle mode and a mode determined by another feature thereof such as a communications feature, which feature may be triggered on/off as responsive to a predetermined signal received over the second connection, preferably BLE, e.g. from the communication device.
31. The accessory device of claim 27, wherein said accessory device is configured for communication as a first accessory device to a master/communication device and/or other device, like said first accessory device, to, a second accessory device operating as a master device to the first accessory device.
32. The accessory device of claim 31, wherein said communication comprises a signal responsive to user action on the (integral) UI of the communication device itself and/or to a predefined event occurring at the communication device, such as launching of a communication application, establishing a connection or call therethrough.
33. The accessory device of claim 31, wherein it is configured to operate at least as one of a first accessory device and a second accessory device, to communicate with BLE connection or substantially a connection obeying a similar protocol, and wherein said accessory device is said first accessory device or said second accessory device.
34. The accessory device of claim 31, wherein said accessory device comprises an RSM device, vehicle-installed device, a headset, a speaker device, a control device, and/or a microphone device.
35. An interfacing logic module, wherein said interfacing logic module comprises a user interface access for a user to at least one of the following: to give commands, associate an accessory device for a UI feature, associate an accessory device's PTT button, touch screen or keypad of the communication device, mating a remote command with another remote command.
36. The user interface logic module of claim 35, wherein said module is configured to be locatable into a communication device, an accessory device, or in a diversified manner between said two.
37. A method of communicating in a session or a communication connection, by operating a communication system, which comprises at least one communication device, and in a number of or a plurality of accessory devices at least one accessory device, configured operable together via a user interfacing logic, the method, as executed in the communication device, comprising: providing wake-up and/or activation signal(s) to the accessory devices; receiving control command triggered by the user via the UI of the accessory; transferring audio and/or voice data between a communication device of the system and an accessory device by using at least one of the Bluetooth or BLE protocol, providing signaling data and/or command to the communication software, by using Bluetooth Low Energy (BLE, Bluetooth LE or Bluetooth Smart), in the command of the interfacing logic.
38. A method of communicating in a session or a communication connection, by operating a communication system, which comprises at least one communication device, and in a number of or a plurality of accessory devices at least one accessory device, configured operable together via a user interfacing logic, the method, as executed in the communication device and/or in an accessory device operable in communication with a communication device, comprising: receiving wake-up and/or activation signal(s) from a communication device; trigger response such as activation of communication link; obtaining control command via the UI and transmit a responsive signal; transferring audio and/or voice data between the communication device of the system and the accessory device by using at least one of the Bluetooth or BLE protocol, receiving data and/or command from the communication software, by using at least one of the Bluetooth or BLE protocol, in the command of the interfacing logic.
39. A communications system, comprising at least one communication device, and in a number of or a plurality of accessory devices at least one accessory device, configured operable together via an interfacing logic, according to a communication method as executed, in an accessory device operable in communication with a communication device.
40. The communications system of claim 39, wherein said number of or a plurality of accessory devices comprises at least one of the following: a PTT device, an RSM device, vehicle-installed device, a headset, a speaker device, a control device, and/or a microphone device.
41. The communication system of claim 39, wherein said communication device is at least one in a number of or a plurality of communications devices so comprising at least one of the following: a cellular phone, a so-called smartphone or a communications-enabled PDA, a tablet, a phablet, and a vehicle-installed communication equipment.
42. The communications system of claim 39, wherein said system comprises within at least in said communication device and/or said accessory device a user actuable such as manually actuable UI features such as a number of buttons, switches, keys, and/or a touch display/surface that are arranged to locally control feature(s) of the device and/or be associated with predetermined control signal(s) transmitted wirelessly over a second connection to control the communication device via application running thereon.
Description
BRIEF DESCRIPTION OF THE FIGURES
[0041] Various embodiments of the invention presented in the sense of examples and their potential advantages are explained in greater detail below with reference to the accompanying drawings, in which
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
[0049]
[0050]
[0051]
DETAILED DESCRIPTION
[0052]
[0053] An accessory or ‘remote UI’ device, such as an RSM 104a, 104b (headset, which may be a stand-alone headset potentially with own UI feature(s) such as a PTT control button, or a supplementary headset to be used in connection with other device(s) such as the RSM 104a), may be wirelessly providing data including e.g. user-initiated control commands (e.g. PTT, see UI feature 110) and voice (typically speech) data to the device 102 for use with the communication application 112 running thereon. The communication application 112 may be a PoC and/or VoIP application, for instance. Preferably, audio such as voice signals are wirelessly transferred between the accessory/accessories 104a, 104b and device 102 using a first wireless connection/technology and related signaling such as user-provided control commands are provided using a second wireless connection/technology. These may include Classic Bluetooth™ and Bluetooth Low Energy™, respectively. Classic BT supports different applicable audio transfer profiles whereas BLE enables provision of commands such as PTT commands to activate voice transmission with reduced delay.
[0054] The device 102 may optionally comprise interfacing logic 114, such as middleware, to preferably automatically convert the received, accessory-originated command into a proper local counterpart, when possible. The device 102 may contain a data repository such as a mapping table and/or a database (or “mapping rules” in general) for storing related mapping information enabling the generation of a proper local command based on the received remote one.
[0055] The mapping rules may be at least partially user-controllable, i.e. the user may affect the linkage between a received command and a local command providable via the built-in (local) UI 108 of the device 102.
[0056] The interfacing logic may thus conceptually match a button or other UI feature on the accessory 104a, 104b with a button or other UI feature on the device 102. This may be materialized such that as an activation of an RSM button or other UI feature causes a first, RSM-originated command, i.e. predetermined signal/data that can be interpret as a command, to be transmitted to the mobile device 102 and be thus detectable by the device 102, the received command (predetermined signal/data) may be mapped to an activation of an associated button or other local UI feature of the device 102 by causing the receipt of the first command to locally generate, in the device 102, a second command conventionally triggered by the direct local input via the UI.
[0057] The nature of the second command mimicking local UI input may differ between different embodiments of the present invention and even within a single embodiment. Namely, in some cases the second command may be related to a lower level command, e.g. for a lower level API, and in some other cases to a higher level command, e.g. for a higher level API. For example, the second command may just indicate an activation of a certain local UI feature, such as a certain button or key press, to the communication application, and/or it may directly indicate more cultivated, higher-level, information such as desired target function, e.g. a request for transmission permission (PTT), in which case the device 102 may, externally to the actual communication application, first convert the UI input-related lower level information (e.g. a button press) to a higher-level more conceptual information (e.g. request for transmission permission), and then provide the application with at least the higher-level information.
[0058] The same generally applies to the first, i.e. RSM-generated, command. It may indicate a lower level action such as a certain key press taken place in the RSM 104a, 104b, and/or a higher level action like a request for transmission permission. Further, the first and/or second command may effectively indicate also both, as depressing a predetermined PTT button, for example, usually simultaneously implies also a request for transmission permission.
[0059] In some embodiments, the user may determine, such as select from a predetermined list or type in, a wirelessly received (RSM) command and an associated local UI input-based command utilizing the UI 108 of the mobile device 102, such as keypad (button(s)) or a touch screen, and that way facilitate the pairing procedure between the received RSM command and local user input.
[0060] In some embodiments, the mobile device 102 may be configured to monitor both the data traffic, such as a command received from the RSM, and the local UI input for pairing purposes.
[0061] The device 102 may facilitate entering a pairing procedure. This may happen automatically upon receipt of an unrecognized command from the RSM and/or when requested by the user via the local UI 108. During pairing, the user may trigger sending an RSM-initiated command wirelessly to the mobile device 102 by operating associated UI feature of the RSM 104a, 104b. For example, an UI feature 110 such as a button like a PTT button of the RSM 104a, 104b may be activated, such as depressed and/or released, or voice input be given by the user to trigger the transmission, optionally in response to a corresponding request indicated by the device 102 to the user via a display and/or loudspeaker, for example.
[0062] The device 102 may acknowledge the receipt of an RSM command and optionally provide the user with an opportunity to check the received command e.g. via a display and further optionally to alter or change it, if needed.
[0063] Then the user may preferably apply the local UI 108 of the mobile device 102 to indicate the target command of the pairing action to the mobile device 102 optionally again in response to a corresponding request indicated by the mobile device 102 via a display and/or a loudspeaker, for example.
[0064] Advantageously the communication application 112 whereto the converted, now local-like input is provided may remain unaware of the actual origin (RSM) of the input. The interfacing logic 114 taking care of the conversion may preferably funnel the resulting RSM-tnggered commands to the application 112 via the same interface as being used with commands truly locally input via the UI 108.
[0065] The UI of the RSM 104a, 104b and/or the device 102 may support voice commands and include a speech recognition logic entity for the purpose.
[0066] Preferably, the communication device 102 may wirelessly wake up or activate accessory/accessories 104a, 104b, or at least different functions, features, or states thereof. A predetermined signal or signals may be utilized for the purpose. The activation may take place upon establishing a communication connection such as a call via the application 112, for example.
[0067]
[0068] Similarly, the memory entity 252 may be divided between one or more physical memory chips or other memory elements. As alluded above, the memory 252 may store program code and other data such as audio data, command mappings, etc. The memory 252 may further refer to and include other storage media such as a preferably detachable memory card, a floppy disc, a CD-ROM, or a fixed storage medium such as a hard drive. The memory 252 may be non-volatile, e.g. ROM (Read Only Memory), and/or volatile, e.g. RAM (Random Access Memory), by nature. Software (product), such as the middleware, applied for implementing an embodiment of the present invention may be provided on a carrier medium such as a memory card, a memory stick, an optical disc (e.g. CD-ROM or DVD), or some other memory carrier.
[0069] The UI (user interface) 254, 254b may comprise a display or a data projector 254, and a keyboard/keypad or other applicable user (control) input entity 254b such as a touch screen and/or voice control input (requires a microphone or corresponding transducer), or a number of separate keys, buttons, knobs, switches, a touchpad, a joystick, and/or a mouse, configured to provide the user with practicable data visualization and device/application control features, respectively. The UI 254, 254b may include one or more loudspeakers and/or beepers (buzzers), and associated circuitry such as D/A (digital-to-analogue) converter(s) for sound output and/or a microphone with A/D converter for sound, e.g. speech, input. Further, an accelerometer may be used for providing user input. A tactile output device such as a vibration element may be applied for providing tactile output.
[0070] The device 102 further comprises a data interface 156 such as a number of wireless and optionally wired transmitters, receivers, and/or transceivers for communication with other devices such as accessories, terminals or network infrastructure(s). For example, an integrated or a removable network adapter may be provided. Non-limiting examples of the generally applicable technologies include WLAN/Wi-Fi (Wireless LAN, wireless local area network), LAN, Ethernet, USB (Universal Serial Bus), GSM (Global System for Mobile Communications), GPRS (General Packet Radio Service), EDGE (Enhanced Data rates for Global Evolution), UMTS (Universal Mobile Telecommunications System), WCDMA (wideband code division multiple access), CDMA2000, PDC (Personal Digital Cellular), PHS (Personal Handy-phone System), and different Bluetooth technologies.
[0071] For the information transfer between the communication device and accessory/accessories, preferably at least two transfer technologies are supported in the concerned devices, optionally Classic Bluetooth (voice) and Bluetooth Low Energy (control commands). Either Bluetooth variant may be implemented using a dedicated chip, for instance. Accessory for providing only control commands (actuated via button presses, for example) may contain Bluetooth Low Energy chip only whereas other accessory used for audio transfer may implement (solely) Classic Bluetooth for such purpose. Alternatively, both transceivers may be included in the same accessory/remote UI device or element. In some embodiments, multi-mode transceivers (chips) could be utilized particularly if they are found truly supporting simultaneous usage of both BT modes.
[0072] It is clear to a skilled person that the device 102 may comprise numerous additional functional and/or structural elements for providing advantageous communication, processing or other features, whereupon this disclosure is not to be construed as limiting the presence of the additional elements in any manner. Entity 258 refers to such additional element(s) potentially found useful depending on the embodiment.
[0073]
[0074] Item 304 refers to sending a wake-up signal (optional) or potential other activation or configuration message to accessory/accessories. BLE is preferably applied for the purpose due to its low latency.
[0075] Item 306 refers to receiving a control command from an accessory. It may be provided to the communication application 310 as is or as converted/mapped by interfacing logic as discussed hereinbefore. The communication application may act accordingly. The command such as a PTT command may instruct establishing or terminating voice transmission (link), for instance.
[0076] Item 308 refers to receiving audio data from an accessory (same or different accessory than the command-providing one) and/or transmitting audio data (from the communication application) thereto. Received data may be provided to the communication application 310 for possible forwarding towards remote recipient(s) such as remote parties of a call.
[0077] Correspondingly, item 314 refers to receiving a wake up signal at the accessory/remote UI device and acting accordingly (ramping up a voice/data link, for example).
[0078] Item 316 refers to obtaining control command via the UI of the accessory from the user. The command may be provided by pressing a button of the UI, such as PTT button, for instance, or actuating other feature of the UI. In case the command is not for local adjustments only (e.g. for the volume adjustment of the loudspeaker of the accessory), an associated control signal may be transmitted to the communication device to establish or activate an audio link, for example.
[0079] Item 318 refers to sending audio data to and/or receiving audio data from the communication device. The audio data may include call-related voice data, for example.
[0080] A skilled person will realize that e.g. the mutual order of many method items may vary or be reversed depending on the circumstances. Dotted loop-back arrows indicate the likely repetitive nature of the execution of the shown method items.
[0081] A computer program, comprising a code means adapted, when run on a computer, to execute an embodiment of the desired method items in accordance with the present invention, may be provided. A non-transitory carrier medium such as an optical disc, floppy disc, or a memory card, comprising the computer program may further be provided. The program may be delivered over a communication network.
[0082] In
[0083] According to an embodiment of the invention,
[0084] In the scenario of
[0085] The branching arrow between the communication device (left) and the accessory device (right), at the accessory side pointing the two buttons is indicative of an illustrated situation in which the view on the screen of the communications device (left) and/or a related function of it is achieved by having both PTT buttons pressed simultaneously, so facilitating talking to a channel or to a contact or reach operator. These examples explained in
[0086]
[0087] For example emergency functionality button at the upper left corner of the accessory device (the device at the right hand side of the sheet) can be configured to send location, or call an alert according to the configuration made. In this example the button can be also operated optionally to toggle status between certain modes, in the example as illustrated for example available and busy.
[0088] The broken conical array from the communication device's (at left on the sheet) right side to the lower ensemble of buttons, the button at upper right of the accessory device (at left on the sheet) is configured to operate as a replay button, a secondary PTT or to send call alert, for example. At the left end of the array line, the feature is indicated on the communications display.
[0089] The straight line from the communication device's (at left on the sheet) left side to the lower ensemble of buttons, the button at upper left of the accessory device (at left on the sheet) is configured to operate also as a replay button, but as a primary PTT or as a replay button for last message, for example. At the left end of the array line, the feature is indicated on the communications display.
[0090]
[0091] According to an example in the illustration in
[0092] The communication device at the middle illustrate a view on the display of the device when the button of the accessory device's at its lower ensemble, the upper right corner is used to activate replay as a secondary PTT or to send call alert. The association of the button and the functionality according to the configuration is indicated by the line connecting the feature at the communication device's screen and the button just indicated.
[0093] The communication device at the left illustrate a view on the display of the device when the button of the accessory device's at its lower ensemble, the upper left corner is used to activate also a replay but as a primary PTT or to replay a last message. The association of the button and the functionality according to the configuration is indicated by the lowest line connecting the feature at the communication device's screen and the button just indicated.
[0094] According to an embodiment of the invention views exemplified in figures for a communication device's display and the shown associated functionalities are those of the same communications device. According to an embodiment, then the views represent examples on different configurations of the buttons of the accessory device. According to an embodiment of the invention said different configurations are made to one but a different communication device, so indicating the configuration versatility. According to an embodiment all three communications devices are separate, to be operated with the same accessory device, whose buttons are dedicated to the communications devices respectively according to the examples as explained, but operable to point even simultaneously or essentially simultaneously to the dedicated communication device according to the configuration of the PTT button in question and the functionality of the particular communication device in question.
[0095]
[0096] According to an example illustrated in
[0097] At the lower left side the accessory device has a secondary PTT button (PTTS, P/R) and at the upper left side a PTT (P/R) button.
[0098]
[0099] According to this embodiment, the Decoded audio bit stream, DAB, is further internally communicated in the smart phone to a communication application 904. The application 904 can also have a proprietary audio codec (P.25/Speex/etc), or it 904 can have an access to an audio codec in the smart phone's resources, to be used for the purposes of further communications of audio signals from the smart phone, via a communications link illustrated by the 3G/4/Wifi associated arrow. The arrow is indicative of communication example via a communications network (IP).
[0100] The above mentioned delay is thus demonstrated being caused by a double use of audio codecs, thus causing a further delay to the signal processing in the smart phone and thus to the signal being used in the communications via the network.
[0101] But it is not only the delay, that is experienced as problematic in the use of two codings with a number of lossy different codecs in the audio coding. Such can namely cause also significant audio quality degradation and loses the intelligibility. Such an extra delay by a second coding can be excess of 50 ms, typically 100 ms. A Non Real Time (NRT) communications is a result of this scenario, which thus often cannot meet the 3GPP RT standard of 300 ms delay from a microphone 902 to network (IP).
[0102] Link opening time can be 400 ms to 2000 ms, which is too long lag for professional PTT use, and cannot shut down link when not used, which thus leads to high power consumption.
[0103] BTC audio communication also needs the use of inconvenient pairing procedure. Also user errors as well as variation between phone brands and models cause negative effects that would need to be avoided.
[0104] In
[0105]
[0106] This way, as illustrated in the embodiment of
[0107] The embodiments in
[0108] Additionally, no pairing procedure of BTC is needed with the BLE-connection. Thus the setup of the connection between the smart phone and RSM device is easier than in
[0109] Consequently, a skilled person may on the basis of this disclosure and general knowledge apply the provided teachings in order to implement the scope of the present invention as defined by the appended claims in each particular use case with necessary modifications, deletions, and additions.
[0110] Yet, instead of the pronouncedly set forth RSM, the applied accessory could practically be any other suitable device or an aggregate entity of a plurality of at least functionally connected elements external to the arrangement and feasible for controlling the arrangement-run target application. For example, different headsets or in-car, or generally in-vehicle, electronics device(s) or entitie(s), which may include command input and potentially also sound such as speech input element(s), may be mobilized for the purpose.
[0111] In some embodiments, an in-vehicle entity, which may refer to a multimedia control system or other substantially integrated user interface, for instance, can receive user input an indication of which is then relayed preferably wirelessly to the mobile arrangement for optional adaptation and delivery to the communication application. In a general sense, even the vehicle itself can be considered as the accessory from the standpoint of the mobile arrangement and the present invention.
[0112] Ultimately, instead of wireless communication, even wired transmission could be applied between the accessories and the arrangement.