System for the spatially limited activation of a control unit

Abstract

A system for the spatially limited activation of a control unit, comprising an activation unit and a user unit operable to transmit the control signal directly or indirectly to the activation unit, the system further including a relay unit operable to communicate with the user unit and with the activation unit, and the relay unit and/or the user unit are operable to determine, from a signal of the activation unit received from the relay unit, as to whether the relay unit and the activation unit are located within a predetermined spatial area relative to one another, the user unit being operable to transmit the control signal to activate the control unit to the activation unit only if the relay unit and the activation unit are located within the predetermined spatial area relative to one another.

Claims

1.-15. (canceled)

16. A system for the spatially limited activation of a control unit, comprising an activation unit which is operable to activate the control unit after receiving a control signal, and a user unit operable to transmit the control signal directly or indirectly to the activation unit, wherein the system further comprises a relay unit operable to communicate with the user unit and with the activation unit, wherein the relay unit and/or the user unit are operable to determine, from a signal of the activation unit received from the relay unit and/or from an image recorded by the relay unit, as to whether the relay unit and the activation unit are located within a predetermined spatial area relative to one another, the user unit being operable to transmit the control signal to activate the control unit to the activation unit only if the relay unit and the activation unit are located within said predetermined spatial area relative to one another.

17. A system according to claim 16, wherein the relay unit comprises a portable unit, and the portable unit comprises one of: a smartphone; tablet; laptop computer; or bodycam.

18. A system according to claim 17, further comprising a telepresence robot, on which the relay unit is carried along.

19. A system according to claim 18, wherein the user unit is operable to control both the activation unit and the vehicle, via a common user interface of the user unit.

20. A system according to claim 16, wherein the control unit and the activation unit comprise respective stationary units, and the activation unit is arranged spatially separate from the control unit and is operable to activate the control unit mechanically.

21. A system according to claim 16, wherein the relay unit and the activation unit each have a short-range transceiver, wherein the relay unit and/or the user unit operable to infer, from a successful communication setup between the short-range transceivers, that the relay unit and the activation unit are located within the predetermined spatial area relative to one another.

22. A system according to claim 16, wherein the relay unit and the activation unit each have a short-range transceiver and the relay unit is operable to receive the control signal from the user unit, transmitting the control signal to the activation unit via the short-range transceiver.

23. A system according to claim 16, wherein the relay unit comprises a camera and is operable to transmit images recorded by the camera to the user unit by way of a live stream.

24. A system according to claim 16, wherein the relay unit or the user unit is operable to identify the activation unit in the image recorded by the relay unit, in the live stream, and to conclude that the relay unit and the activation unit are located in said predetermined spatial area relative to one another if the activation unit is visible in the image or, if applicable, in the live stream.

25. A system according to claim 16, wherein the activation unit comprises a machine-readable optical marker.

26. A system according to claim 23, wherein the optical marker or a communication between the short-range transceivers includes a name, a unique identification and/or information about the position or function of the control unit and/or a unique identification, a state of charge, a network address and/or possible switching states of the activation unit and/or a unique identification of the optical marker.

27. A system according to claim 16, wherein the user unit is operable to output a depiction of the environment of the relay unit, the depiction comprising images recorded by the relay unit, and the user unit is further operable to highlight the control unit in the depiction if said unit can be activated via the user unit.

28. A system according to claim 16, wherein the activation unit, the relay unit and/or the user unit are operable to activate the control unit only if the relay unit located in the predetermined spatial area relative to the control unit has an appropriate user authorization.

29. A system according to claim 16, wherein the system further comprises the control unit which is top open or lock a door, call a lift or switch on a light source, wherein the control unit is operable both via the activation unit and manually.

30. A system according to claim 16, wherein the activation unit is controllable only via a short-range communication link and, when appropriate, manually.

Description

[0026] Advantageous and non-limiting embodiments of the invention are explained in further detail below with reference to the drawings.

[0027] FIG. 1 shows a system for the spatially limited activation of a control unit in a first embodiment with a telepresence robot.

[0028] FIG. 2 shows a system for the spatially limited activation of a control unit in a second embodiment with a remote-controlled vehicle.

[0029] FIG. 3 shows a system for the spatially limited activation of a control unit in a third embodiment with a bodycam.

[0030] FIG. 4 shows a system for the spatially limited activation of several control units with a static relay unit.

[0031] FIG. 1 shows a system 1 for the spatially limited activation of a control unit 2, in this case a lift. In the illustrated example, the control unit 2 has two buttons 3, 4, which each are to be operated by remote control. However, the invention is not limited to this control unit 2, but other control units such as a button for opening, unlocking, closing or locking a door, a light switch or the like could also be used. The system 1 is usually employed in a building in which at least two control units 2 (e.g., two doors or light switches) are provided which can be activated as described below, but the invention is not limited to such intended uses.

[0032] In one embodiment, it is the objective of the system 1 that a user can operate the control unit 2 at a remote location, but only if a relay unit 5 is located close to the control unit 2. In a concrete example, the user is a business partner visiting a building by means of a telepresence robot 6 on which the relay unit 5 is mounted. The business partner should always be able to only operate those control units 2 that are located close to the telepresence robot 6. It is thereby achieved that the business partner does not gain access to all control units 2 in the building at the same time, but only to those in the vicinity of the telepresence robot 6, which, on the one hand, gives the user a clearer overview and, on the other hand, increases security.

[0033] In order to implement this, the system 1 comprises an activation unit 7 at or near the control unit 2 and a user unit 8 in the vicinity of the user. The user unit 8 can be, for example, a computer with a monitor, such as a smartphone or a laptop. As a rule, two different functions are implemented on the user unit 8, namely firstly the control of the telepresence robot 6 and secondly the activation of the control unit 2. Both functions are preferably implemented in a single application.

[0034] The activation unit 7 is located, for example, next to the control unit 2 or can also be designed with this as a single component. The activation unit 7 is usually located at a maximum distance of 3 m, 2 m, 1 m or 0.5 m from the control unit 2. In the example of FIG. 1, the activation unit 7 and the control unit 2 are designed as separate components and are connected electrically, for example, via a connecting cable or else a wireless interface. In the embodiment of FIG. 2, the activation unit 7 and the control unit 2 are designed as a single component and are electrically interconnected. In the embodiment of FIG. 3, the activation unit 7 and the control unit 2 are designed as separate components, wherein the activation unit 7 actuates the control unit 2 mechanically, in this case via a pivotable finger 17, in order to press a switch of the control unit 2. In the illustrated example, the pivotable finger 17 can actuate both buttons selectively, for which it might also be envisaged that the activation unit 7 has one finger 17 each for one of the two buttons, or a separate activation unit 7 with a separate finger 17 for each of the buttons might even be provided.

[0035] In general, the activation unit 7 can comprise a mechanical actuator which is designed, for example, for pressing a button of the control unit 2, moving a slider of the control unit 2 and/or turning a rotary knob of the control unit 2. However, it goes without saying that the mechanical actuator is not limited to these embodiments.

[0036] Various methods can be applied to determine whether the relay unit 5 and the activation unit 7 are located within a predetermined spatial area relative to one another. In a first example, the relay unit 5 comprises a camera 9 with an image area B. It is to be understood that the telepresence robot 6 and the relay unit 5 can share a single camera 9, in particular if the relay unit 5 is integrated into the telepresence robot 6. As a rule, the images recorded by the camera 9 are sent to the user unit 8 as a live stream so that the user can control the telepresence robot 6 or generally the vehicle on which the relay unit 5 is located. Subsequently, the live stream can be evaluated—usually in the relay unit 5 or in the user unit 8—as to whether the activation unit 7 or the control unit 2 can be identified in the live stream. If this is the case, the relay unit 5 and the activation unit 7 are located in a predetermined spatial area relative to one another. For example, if the relay unit 5 communicates with the activation unit 7 directly via an optical communication link such as an infrared link, the predetermined spatial area does not have to be restricted any further. However, if the relay unit 5 communicates with the activation unit 7, for example, via a radio connection, the predetermined spatial area could be restricted to a specific communication range between these units. Thus, it could also be envisaged that the relay unit 5 and the activation unit 7 are located in the predetermined spatial area relative to one another, if, on the one hand, they are able to establish a communication link and, on the other hand, the activation unit 7 is located in the image area of the relay unit 5.

[0037] In order to simplify the determination as to whether the activation unit 7 is in the live stream, the activation unit 7 can, for example, comprise a machine-readable optical marker such as a QR code, which is easily discernible in the live stream. The optical marker can be printed on a plaque or a sticker, for example, and can be provided next to or on the control unit 2. Alternatively or additionally, the activation unit may comprise a display such as an e-paper display on which the optical marker is indicated.

[0038] Alternatively or additionally, the relay unit 5 is able to determine by means of a short-range transceiver 10 as to whether the relay unit 5 and the activation unit 7 are located within a predetermined spatial area relative to one another. In this case, the activation unit 7 also includes a corresponding short-range transceiver 11. The two short-range transceivers 10, 11 can communicate with one another, for example, via WLAN, Bluetooth, RFID or another short-range communication standard, possibly also infrared or ultrasound. In this case, the short-range transceiver 10 and/or 11 can permanently check as to whether a communication link can be established with the other respective short-range transceiver 10, 11. If this is the case, the conclusion may be drawn that the relay unit 5 and the activation unit 7 are located within a predetermined spatial area relative to one another. Alternatively, it is possible to draw the conclusion that the relay unit 5 and the activation unit 7 are located within a predetermined spatial area relative to one another only if the strength of the communication link exceeds a predetermined threshold value, which can be determined, for example, via the Received Signal Strength Indicator, RSSI.

[0039] The actual determination as to whether the relay unit 5 and the activation unit 7 are located within a predetermined spatial area relative to one another can be made either by the relay unit 5 itself or by the user unit 8. If the determination is made in the relay unit 5, by evaluating either the live stream or the communication link, the relay unit 5 sends a corresponding message to the user unit 8. Alternatively, the relay unit 5 sends the live stream or, respectively, the content of the communication with the short-range transceiver 11 of the activation unit 7, for example, without prior evaluation to the user unit 8, which carries out said determination as to whether the relay unit 5 and the activation unit 7 are located within a predetermined spatial area relative to one another.

[0040] The communication between the relay unit 5 and the user unit 8 can take place via said short-range transceiver 10 of the relay unit 5, optionally via the Internet by means of a gateway, which can be located in particular in a WLAN network in which the short-range transceiver 10 communicates. The user unit 8 can comprise its own transceiver 12 for this purpose. However, the relay unit 5 can also comprise a further transceiver 13 which communicates with the transceiver 12 of the user unit 8 directly via a mobile radio network, for example.

[0041] As soon as the user unit 8 knows that the relay unit 5 and the activation unit 7 are located within the predetermined spatial area relative to one another, the user unit 8 can give the user the option of activating the control unit 2 by means of the activation unit 7. In one variant, the user unit 8 can show the live stream on an output device such as a monitor, provided that such a device is available, and the control unit 2 can be displayed in the live stream, e.g., as an interactive button 14, preferably at the point where the control unit 2 is located in the live stream. If no live stream is sent from the relay unit 5 or, respectively, the telepresence robot 6 to the user unit 8, a meta view of the building, which was previously stored in the user unit 8, could also be displayed on the output device, for example, and the control unit 2 can be shown in this view as an interactive button 14. In yet other embodiments, a switch area could also simply be displayed on the output device of the user unit 8, and the user is given the opportunity to press the switch area in order to activate the control unit 2. In this context, it should also be mentioned that a switch area 15 for controlling the telepresence robot 6 (or the vehicle in general) can furthermore be output on the output device so that the telepresence robot 6 and the control unit 2 can be controlled via the same user interface or application, respectively.

[0042] In the above-mentioned variant, the interactive button 14 is thus displayed on the user unit 8 as soon as the relay unit 5 is located close to the activation unit 7. Alternatively, however, it might also be envisaged that the interactive button 14 is displayed permanently, but actually sends a control signal to the activation unit 7 only when the relay unit 5 and the activation unit 7 are located within said predetermined spatial area relative to one another. In general, it is said that the user unit 8 is designed for sending the control signal to the activation unit 7 for activating the control unit 2 only when the relay unit 5 and the activation unit 7 are located within said predetermined spatial area relative to one another.

[0043] In order for the user to receive more information about the control unit 2, the activation unit 7 can send additional information to the relay unit 5 or the user unit 8, respectively. This can be done either via the communication link between the transceivers 10, 11 or via the optical marker such as a QR code, if the latter reproduces the information. The information that can be made available to the user unit 8 is, for example, a name, a unique identification and/or information about the position or function of the control unit 2 and/or a state of charge, a network address and/or possible switching states of the activation unit 7.

[0044] If the user unit 8 gives the user the opportunity to activate the control unit 2, i.e., after it has been established that the relay unit 5 and the activation unit 7 are located within a predetermined spatial area relative to one another, and the user takes this opportunity, the user unit 8 sends a corresponding control signal to the activation unit 7.

[0045] The control signal can be transmitted to the activation unit 7 via the relay unit 5, i.e., via the transceiver 12 of the user unit 8 to the transceiver 12 of the relay unit 5 (or to the transceiver 10 of the relay unit 5) and subsequently from the transceiver 10 of the relay unit 5 to the transceiver 11 of the activation unit 7. Alternatively or additionally, it may be envisaged that the user unit 8 communicates directly with the activation unit 7, via a mobile radio network, for example. The activation unit 7 can optionally have its own transceiver (not shown) for this purpose.

[0046] Referring to FIG. 2, it is evident that the invention is implementable also without a telepresence robot 6. In the illustrated example, the relay unit 5 is provided on a generic vehicle 16 such as, e.g., a cleaning robot. As explained in connection with the embodiment of FIG. 1, a camera 9 can also in this case be provided, which sends a live stream to the user unit 8 in order to control the vehicle 16. All the alternatives and variants explained for the embodiment of FIG. 1 can also be implemented for the embodiment of FIG. 2.

[0047] FIG. 3 shows an embodiment in which the relay unit 5 is not arranged on a vehicle but can be carried directly by a person. In one embodiment, the relay unit 5 can, in this case, again comprise a camera 9 and can thus be designed as a bodycam. In a practical implementation, the bodycam can be worn, for example, by security personnel, and the user, e.g., a building manager, at the user unit 8 can specify when which control unit 2 can be opened in the vicinity of the security personnel. The camera 9 can again be used for determining the specified spatial area and/or for transmitting a live stream to the user unit 8, or it can record a video purely for backup purposes and store it in a memory.

[0048] In yet another embodiment, the relay unit 5 can also not have a camera 9. This can be used, for example, in connection with a particularly reliable remote diagnosis. For example, only an authorized specialist should have the authorization to activate the control unit 2. If the specialist cannot personally activate the control unit, but is at a remote location, an assistant can bring the relay unit 5 close to the activation unit 7, after which the specialist can activate the control unit 2, for example, in order to record measured values by means of the control unit 2.

[0049] In the embodiments of FIGS. 1 to 3, the relay unit 5 is, in each case, designed as a movable unit, and the control units 2 and the associated activation units 7 have a static design. In general, the control units 2 and the associated activation units 7 could also be designed so as to be movable. For example, a monitor could be designed so as to be movable, and the control unit 2 is the monitor's on/off switch. The activation unit 7 could be provided as part of the control unit 2, as described above, or could be mounted beside it. Once the movable monitor is brought close to the relay unit 5 (which could, for example, again be provided on a telepresence robot 6), the user can actuate the control unit 2 on the user unit 8 by the above-described method.

[0050] In this context, the relay unit 2 could also have a static design, as illustrated in FIG. 4. One or several control units 2 with activation units 7 can be designed so as to be movable, and it is again possible to detect whether and which control unit 2 is located with its associated activation unit 7 in a predetermined spatial area relative to the relay unit 5. In the illustrated example, the relay unit 5 is, for example, provided statically, e.g., on a passage area, an control units 2 passing through can be activated by remote control via the user unit 8. For example, the control units 2 could be provided on products, and a quality tester at the user unit 8 could use the control units 2 to display a green light when they pass a visual quality check. It is furthermore illustrated that the relay unit 5 can have only one communication device which can communicate both with the user unit 8 and with the activation unit 7, either via the same or via a different communication standard. This can be provided in all embodiments.

[0051] Since safety concerns play a major role in all of the aforementioned embodiments, it may furthermore be envisaged that user authorizations are provided for actuating respective control units 2 using the activation units 7. For this purpose, it may be envisaged that the activation unit 7, the relay unit 5 and/or the user unit 8 activate the control unit 2 only if the relay unit 5 located in a predetermined spatial area relative to the control unit 2 has a corresponding user authorization. The reason for this is that, for example, not every business partner should gain access to every control unit 2 in the building. The user authorization can be checked in different ways. For example, appropriate tables and/or keys are stored in the activation unit 7, in the relay unit 5 and/or in the user unit 8. In this case, “user authorization for the relay unit 5” is understood to mean synonymously a user authorization for the user unit 8 and for the user, respectively.

[0052] As already explained in detail, the control unit 2 can be activated by the activation unit 7 only if the relay unit 5 and the activation unit 7 are located within a predetermined spatial area relative to one another. As an example of the predetermined spatial area, it has already been stated that, in this area, the activation unit 7 is in the field of view B of the camera 9 of the relay unit 5 and/or that, in this area, a communication link is feasible between the transceivers 10, 11 of the relay unit 5 and the activation unit 7, possibly with a minimum strength of the communication link. It is evident from the above-mentioned examples that the predetermined spatial area is not necessarily defined by a minimum distance, in particular if the activation unit 7 is supposed to be in the field of view B of the camera 9 of the relay unit 5. However, alternatively or in particular additionally, it may be envisaged that the relay unit 5 and the activation unit 7 are to be located at a predetermined minimum distance from each other so that they are located within the predetermined spatial area relative to one another. The minimum distance can be determined, for example, using optical measuring methods, radio waves or GPS data. Particularly preferably, the minimum distance can be determined by a so-called “time-of-flight” method.

[0053] As already mentioned, the system 1 can also comprise at least two control units 2, each comprising an activation unit 7. Depending on the arrangement of the control units 2 or, respectively, the activation units 7, it may happen that a relay unit 5 is located within the predetermined spatial area of both control units 2 or, respectively, activation units 7, and the user at the user unit 8 could thereby activate both control units 2. Several relay units 5 may also be present in the system 1, for example, if several telepresence robots 6 are provided, each comprising a relay unit 5. In this case, a separate user unit 8 is usually provided for each relay unit 5.

[0054] Another possible application for the present system 1 is the use for persons with physical restrictions. In this case, the relay unit 5 is installed, for example, on a wheelchair constituting the vehicle. The user unit 8 is also provided on this wheelchair so that the person in the wheelchair can operate a control unit 2 as soon as he or she is close to the control unit. This has the advantage of providing a clearer overview, since only those control devices 2 that are in the user's vicinity are displayed to him or her or can be activated by him or her. In addition, the increased safety factor of the system 1 continues to exist, since the activation units 7 cannot be controlled from outside of the building.