SELECTING A MORE SUITABLE INPUT MODALITY IN RELATION TO A USER COMMAND FOR LIGHT CONTROL
20240306280 ยท 2024-09-12
Inventors
Cpc classification
International classification
Abstract
A system (1) for determining a suitability of an input modality (36) for providing a user command for controlling at least one lighting device (31) is configured to receive a signal indicative of the user command for controlling the at least one lighting device. The user command is provided by a user (69) using the input modality. The system is further configured to determine a suitability rating for the used input modality in relation to the user command, determine one or more further suitability ratings for one or more further input modalities (19, 37, 38) in relation to the user command, compare the suitability rating with the one or more further suitability ratings, and output information specifying an input modality recommended in relation to the user command. The recommended input modality is selected from the one or more further input modalities and has a further suitability rating which is higher than the suitability rating.
Claims
1. A system for determining a suitability of an input modality of a first input type for providing a user command for controlling at least one lighting device, said system comprising: at least one receiver; at least one output interface; and at least one processor configured to: receive, via said at least one receiver, a signal indicative of said user command for controlling said at least one lighting device, said user command being provided by a user using said input modality of said first input type, determine a suitability rating for said used input modality in relation to said user command, determine one or more further suitability ratings for one or more further input modalities in relation to said user command, compare said suitability rating with said one or more further suitability ratings, and output, via said at least one output interface, information specifying an input modality of a second input type recommended in relation to said user command, said recommended input modality of said second input type being selected from said one or more further input modalities, said further suitability rating of said recommended input modality being higher than said suitability rating.
2. A system as claimed in claim 1, wherein said at least one processor is configured to determine said suitability rating for said used input modality of said first input type in relation to said user command independent of a specific action specified in said user command.
3. A system as claimed in claim 1, wherein said at least one processor is configured to determine said suitability rating for said used input modality of said first input type in relation to said user command in dependence on a specific action specified in said user command.
4. A system as claimed in claim 2, wherein said specific action comprises selecting any light scene, selecting a specific light scene, switching off all lighting devices, or switching on all lighting devices.
5. A system as claimed in claim 1, wherein said at least one processor is configured to determine said suitability rating and said one or more further suitability ratings based on a size of a space in which said user command is provided, a function of said space, and/or a complexity of user interaction associated with providing said user command using said input modality of said first input type.
6. A system as claimed in claim 1, wherein said at least one processor is configured to determine said suitability rating and said one or more further suitability ratings by obtaining said suitability rating and said one or more further suitability ratings from a further system.
7. A system as claimed in claim 1, wherein said suitability rating and said one or more further suitability ratings are calculated based on input modalities used by other users in relation to said user command.
8. A system as claimed in claim 7, wherein said other users have a lighting system which has a similarity to a lighting system of said user which exceeds a first threshold and/or have spaces which have a similarity to spaces of said user which exceeds a second threshold.
9. A system as claimed in claim 1, wherein said at least one processor is configured to determine settings for a lighting control device based on said user command, said lighting control device being associated with said recommended input modality of said second input type, and transmit, via said at least one output interface, said settings to said lighting control device.
10. A system as claimed in claim 1, wherein said information also specifies a further recommended input modality in relation to said user command, said further recommended input modality being selected from said one or more further input modalities, said further suitability rating of said combination of said recommended input modality and said further recommended input modality being higher than said suitability rating.
11. A system as claimed in claim 1, wherein said used input modality of said first input type and said one or more further input modalities include one or more of voice input, light switch input, and sensor input.
12. A system as claimed in claim 1, wherein said at least one processor is configured to determine said suitability rating for said used input modality of said first input type in relation to said user command by determining a user-independent suitability rating which is common to all users of said system and applying a user-dependent weight to said user-independent suitability rating.
13. A system as claimed in claim 12, wherein said at least one processor is configured to determine said user-dependent weight based on user-specified preferences and/or previous user commands provided by said user.
14. A method of determining a suitability of an input modality of a first input type for providing a user command for controlling at least one lighting device, said method comprising: receiving a signal indicative of said user command for controlling said at least one lighting device, said user command being provided by a user using said input modality of said first input type; determining a suitability rating for said used input modality in relation to said user command; determining one or more further suitability ratings for one or more further input modalities in relation to said user command; comparing said suitability rating with said one or more further suitability ratings; and outputting information specifying an input modality of a second input type recommended in relation to said user command, said recommended input modality of said second type being selected from said one or more further input modalities, said further suitability rating of said recommended input modality being higher than said suitability rating.
15. A computer program product for a computing device, the computer program product comprising computer program code to perform the method of claim 14 when the computer program product is run on a processing unit of the computing device.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0037] These and other aspects of the invention are apparent from and will be further elucidated, by way of example, with reference to the drawings, in which:
[0038]
[0039]
[0040]
[0041]
[0042]
[0043]
[0044]
[0045]
[0046]
[0047] Corresponding elements in the drawings are denoted by the same reference numeral.
DETAILED DESCRIPTION OF THE EMBODIMENTS
[0048]
[0049] Lighting devices 31-34 may be Philips Hue lamps, for example. The bridge 16 may be a Philips Hue bridge, for example. In the example of
[0050] Mobile device 1 and Internet server 13 are able to control lighting devices 31-34 via the wireless LAN access point 17 and the bridge 16. The Internet server 13 is also connected to the Internet 11. Instead of a single Internet server, a cluster of Internet server may be used. This cluster may be part of one or more clouds.
[0051] The mobile device 1 comprises a transceiver 3, a transmitter 4, a processor 5, memory 7, and a touchscreen display 9. The processor 5 is configured to receive, via the receiver 3, a signal indicative of the user command for controlling lighting device 31 and/or 32. In the embodiment of
[0052] The processor 5 is further configured to determine a suitability rating for the used input modality in relation to the user command, determine one or more further suitability ratings for one or more further input modalities in relation to the user command, and compare the suitability rating with the one or more further suitability ratings.
[0053] The processor 5 is also configured to output, via the touchscreen display 9, information specifying an input modality recommended in relation to the user command. The recommended input modality is selected from the one or more further input modalities. The further suitability rating of the recommended input modality is higher than the suitability rating.
[0054] In a first implementation, (the processor 5 of) the mobile device 1 calculates the suitability rating and the one or more further suitability ratings itself. In a second implementation, the processor 5 is configured to determine the suitability rating and the one or more further suitability ratings by obtaining the suitability rating and the one or more further suitability ratings from the Internet server 13.
[0055]
[0056] The light control device 36 is a light switch with multiple buttons. Each button can be associated with a light scene and each light scene can be associated with one or more lighting devices. In the example of
[0057] In the example of
[0058] Shortly thereafter, or at another suitable time, the mobile device 1 provides a recommendation to the user 69 to use a smart speaker system to control the lighting device 31. The mobile device may recommend this further input modality because the button to change the scene was pressed in a living room and/or in a large room, for example.
[0059] After the user 69 has installed a new smart speaker system 19, and a wireless connection between the smart speaker system 19 and the wireless LAN access point 17 has been setup (see
[0060] Instead of a smart speaker system, the mobile device 1 might recommend the use of an additional light switch in the living room, e.g. a tap switch or a smart button, which could be placed closer to the lighting device 31 than light control device 36. For example, if the user has programmed the lighting device 34 to turn on and off automatically based on a schedule and does not really use the light control device 38, which is a smart button, the user could move the light control device 38 to the rear side of the living room 65. The advantage of voice control is that it is beneficial in larger spaces. However, selecting a light scene is easier with a tap switch or smart button than by using voice control.
[0061] The mobile device 1 may use a baseline scoring method that defines the optimal input modality or set of input modalities that would maximize the value of a user interaction with the lighting system. Such a method may determine the value that each (reasonable) device or combination of devices would generate for a given interaction. Furthermore, user defined weights may be used for baseline values that are based and dependent on user preferences, usage over time, the time of the day, or a combination of these. A recommendation for an optimal set of interaction devices may then be generated based on baseline scores and user defined weights. Weights representing whether input modalities are already present in the lighting system may also be applied.
[0062] If the mobile device 1 recommends repurposing an existing device, it may also recommend another input modality to replace the input modality being repurposed. For example, the mobile device 1 may propose a dimmer switch and at the same time propose a better solution for the part of the lighting system that is currently controlled by the dimmer switch, such that the user could reconfigure the dimmer switch he has and use a different input modality for the space that was previously controlled by the dimmer switch.
[0063] In the embodiment of the mobile device 1 shown in
[0064] The receiver 3 and the transmitter 4 may use one or more wireless communication technologies, e.g. Wi-Fi (IEEE 802.11) for communicating with the wireless LAN access point 17, for example. In an alternative embodiment, multiple receivers and/or multiple transmitters are used instead of a single receiver and a single transmitter. In the embodiment shown in
[0065] In the embodiment of
[0066]
[0067] The computer 21 comprises a receiver 23, a transmitter 24, a processor 25, and storage means 27. The processor 25 is configured to receive, via the receiver 23, a signal indicative of the user command for controlling lighting device 31 and/or 32. In the embodiment of
[0068] The processor 25 is further configured to determine a suitability rating for the used input modality in relation to the user command, determine one or more further suitability ratings for one or more further input modalities in relation to the user command, and compare the suitability rating with the one or more further suitability ratings.
[0069] The processor 25 is also configured to output, via transmitter 24, information specifying an input modality recommended in relation to the user command. The recommended input modality is selected from the one or more further input modalities. The further suitability rating of the recommended input modality is higher than the suitability rating. The information may be transmitted to the mobile device 41, which then displays it on its display. Alternatively, the information may be transmitted in a different way, e.g. by e-mail, and output on a device other than a mobile device. In that case, a mobile device would not be involved.
[0070] In the embodiment of the computer 21 shown in
[0071] The receiver 23 and the transmitter 24 may use one or more wired and/or wireless communication technologies such as Ethernet and/or Wi-Fi (IEEE 802.11) to communicate with the wireless LAN access point 17, for example. In an alternative embodiment, multiple receivers and/or multiple transmitters are used instead of a single receiver and a single transmitter. In the embodiment shown in
[0072] In the embodiment of
[0073] A first embodiment of the method of determining a suitability of an input modality for providing a user command for controlling at least one lighting device is shown in
[0074] A step 103 comprises determining a suitability rating for the used input modality in relation to the user command. A step 105 comprises determining one or more further suitability ratings for one or more further input modalities in relation to the user command. The used input modality and the one or more further input modalities may include one or more of voice input, light switch input, and sensor input, for example.
[0075] In the embodiment of
[0076] Furthermore, in the embodiment of
[0077] The suitability of an input modality may be defined, for example, as a combination of ease of use (how easy is it to access a specific function), accessibility to different system features (what features could be controlled), and relevance and appropriateness to a context (does the specific interaction mean fits the context where interaction occurs).
[0078] A scoring system may be used to determine suitability ratings. This scoring system may, for example, determine the value that a device or a combination of devices generate if used for a given command. A device may be a mobile device running the Hue app or a Tap switch, for example. An example of a command is scrolling through pre-defined scenes in a room.
[0079] A step 107 comprises comparing the suitability rating determined in step 103 with the one or more further suitability ratings determined in step 123. A step 108 comprises selecting a single recommended input modality from the one or more further input modalities. The further suitability rating of the recommended input modality is higher than the suitability rating. A step 109 comprises outputting information specifying the recommended input modality which was selected in step 108. Steps 108 and 109 are not performed if the suitability rating determined in step 103 is higher than all further suitability ratings determined in step 105.
[0080] A second embodiment of the method of determining a suitability of an input modality for providing a user command for controlling at least one lighting device is shown in
[0081] In steps 141 and 143, like in steps 121 and 123 of
[0082] Unlike in steps 121 and 123 of
[0083] A third embodiment of the method of determining a suitability of an input modality for providing a user command for controlling at least one lighting device is shown in
[0084] Steps 161 and 163 comprises obtaining the obtaining the suitability rating and the one or more further suitability ratings from a further system. The further system may calculate the suitability rating and the one or more further suitability ratings based on input modalities used by other users in relation to the user command. The other users may have a lighting system which has a similarity to a lighting system of the user which exceeds a first threshold and/or may have spaces which have a similarity to spaces of the user which exceeds a second threshold, for example. Alternatively, suitability ratings may have been associated with input modalities and user command-related parameter values (e.g. select light scene or living room) by an administrator of the further system.
[0085] Step 161 may comprise transmitting information describing the used input modality and information describing the user command and/or context relating to the user command to the further system. Steps 161 and 163 may be combined into a single step in which the suitability rating and the one or more further suitability ratings are received at the same time.
[0086] A fourth embodiment of the method of determining a suitability of an input modality for providing a user command for controlling at least one lighting device is shown in
[0087] Step 103 comprises determining a suitability rating for the used input modality in relation to the user command. Step 105 comprises determining one or more further suitability ratings for one or more further input modalities in relation to the user command.
[0088] In the embodiment of
[0089] Step 107 comprises comparing the suitability rating determined in step 103 with the one or more further suitability ratings determined in step 181. A step 183 comprises selecting a recommended input modality or two recommended input modalities from the one or more further input modalities. The further suitability rating of the recommended input modality or the two recommended input modalities is higher than the suitability rating.
[0090] Next, a step 185 comprises determining settings for one or more lighting control devices based on the user command. The one or more lighting control devices are associated with the recommended input modality or at least one of the two recommended input modalities selected in step 183.
[0091] In the embodiment of
[0092] Step 189 comprises detecting whether the one or more lighting control devices for which settings were determined in step 185 have been installed. If not, step 189 is repeated at a later time. A step 191 is performed when the one or more lighting control devices are detected. Step 191 comprises transmitting the settings determined in step 185 to the one or more lighting control devices for which the settings were determined.
[0093] A fifth embodiment of the method of determining a suitability of an input modality for providing a user command for controlling at least one lighting device is shown in
[0094] Next, step 103 comprises determining a suitability rating for the used input modality in relation to the user command and step 105 comprises determining one or more further suitability ratings for one or more further input modalities in relation to the user command. In the embodiment of
[0095] Step 203 comprises determining a user-independent suitability rating which is common to all users of the system and applying the user-dependent weight determined in step 201 to this user-independent suitability rating. Step 205 comprises determining one or more user-independent further suitability ratings which are common to all users of the system and applying the user-dependent weight determined in step 201 to these one or more user-independent further suitability ratings.
[0096] Weights may be defined as a function W(user, time) that evolves over time differently for each user, starting from a default definition common to all users. Examples of customization could be that, for a given user, voice control is not acceptable independently from how great it could be for certain interactions/commands. In a different example, the system can learn that a certain user could benefit from having a different ordering of the scenes in its dimmer switch based of the time of the day.
[0097] The evolution of the value over time enables continuous optimizations specific to each user. This can be used to provide tailored suggestions on how to configure the system, and to suggest new input modalities and how they could enable interesting interactions.
[0098] Step 107 comprises comparing the suitability rating determined in step 203 with the one or more further suitability ratings determined in step 205. Step 108 comprises selecting a recommended input modality from the one or more further input modalities when the further suitability rating of the recommended input modality is higher than the suitability rating. Step 109 comprises outputting information specifying the recommended input modality which was selected in step 108.
[0099] The embodiments of
[0100]
[0101] As shown in
[0102] The memory elements 304 may include one or more physical memory devices such as, for example, local memory 308 and one or more bulk storage devices 310. The local memory may refer to random access memory or other non-persistent memory device(s) generally used during actual execution of the program code. A bulk storage device may be implemented as a hard drive or other persistent data storage device. The processing system 300 may also include one or more cache memories (not shown) that provide temporary storage of at least some program code in order to reduce the quantity of times program code must be retrieved from the bulk storage device 310 during execution. The processing system 300 may also be able to use memory elements of another processing system, e.g. if the processing system 300 is part of a cloud-computing platform.
[0103] Input/output (I/O) devices depicted as an input device 312 and an output device 314 optionally can be coupled to the data processing system. Examples of input devices may include, but are not limited to, a keyboard, a pointing device such as a mouse, a microphone (e.g. for voice and/or speech recognition), or the like. Examples of output devices may include, but are not limited to, a monitor or a display, speakers, or the like. Input and/or output devices may be coupled to the data processing system either directly or through intervening I/O controllers.
[0104] In an embodiment, the input and the output devices may be implemented as a combined input/output device (illustrated in
[0105] A network adapter 316 may also be coupled to the data processing system to enable it to become coupled to other systems, computer systems, remote network devices, and/or remote storage devices through intervening private or public networks. The network adapter may comprise a data receiver for receiving data that is transmitted by said systems, devices and/or networks to the data processing system 300, and a data transmitter for transmitting data from the data processing system 300 to said systems, devices and/or networks. Modems, cable modems, and Ethernet cards are examples of different types of network adapter that may be used with the data processing system 300.
[0106] As pictured in
[0107] Various embodiments of the invention may be implemented as a program product for use with a computer system, where the program(s) of the program product define functions of the embodiments (including the methods described herein). In one embodiment, the program(s) can be contained on a variety of non-transitory computer-readable storage media, where, as used herein, the expression non-transitory computer readable storage media comprises all computer-readable media, with the sole exception being a transitory, propagating signal. In another embodiment, the program(s) can be contained on a variety of transitory computer-readable storage media. Illustrative computer-readable storage media include, but are not limited to: (i) non-writable storage media (e.g., read-only memory devices within a computer such as CD-ROM disks readable by a CD-ROM drive, ROM chips or any type of solid-state non-volatile semiconductor memory) on which information is permanently stored; and (ii) writable storage media (e.g., flash memory, floppy disks within a diskette drive or hard-disk drive or any type of solid-state random-access semiconductor memory) on which alterable information is stored. The computer program may be run on the processor 302 described herein.
[0108] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms a, an, and the are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms comprises and/or comprising. when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
[0109] The corresponding structures, materials, acts, and equivalents of all means or step plus function elements in the claims below are intended to include any structure, material, or act for performing the function in combination with other claimed elements as specifically claimed. The description of embodiments of the present invention has been presented for purposes of illustration, but is not intended to be exhaustive or limited to the implementations in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the present invention. The embodiments were chosen and described in order to best explain the principles and some practical applications of the present invention, and to enable others of ordinary skill in the art to understand the present invention for various embodiments with various modifications as are suited to the particular use contemplated.