PROVIDING MOUNTING INFORMATION
20170132840 ยท 2017-05-11
Inventors
Cpc classification
Y02P90/02
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
G05B19/41885
PHYSICS
G06F3/011
PHYSICS
G05B2219/31027
PHYSICS
International classification
G06T19/00
PHYSICS
H04N7/18
ELECTRICITY
Abstract
Embodiments of the present invention provide an information system for providing mounting information for a number of connectable devices and electrical devices to a user, comprising a camera configured to record a scene, a display, and a processing device coupled to the camera and the display and configured to display the scene in the display, and to identify in the scene a number of at least one of connectable devices or receptacles, and to overlay the scene in the display with mounting information for the identified connectable devices or the identified receptacles.
Claims
1. An information system for providing mounting information for a number of connectable devices and electrical devices to a user, comprising: a camera configured to record a scene, a display, and a processing device coupled to the camera and the display and configured to display the scene in the display, and to identify in the scene a number of at least one of connectable devices or receptacles, and to overlay the scene in the display with mounting information for the identified connectable devices and receptacles.
2. The information system according to claim 1, wherein the processing device is configured to identify at least one of electrical devices or the connectable devices or the receptacles by identifying an optical code on the connectable devices or receptacles, wherein the information system comprises a database configured to store for every optical code the mounting information of the respective connectable device or receptacle.
3. The information system according to claim 1, comprising a position sensor configured to identify at least one of the position or orientation of the camera in three dimensional space, wherein the processing device is configured to determine the position of the electrical devices or the identified connectable devices or the identified receptacles, and wherein the processing device is configured to display the mounting information at the position of the respective identified connectable devices or receptacles on the display.
4. The information system according claim 3, wherein the processing device is configured to indicate with the mounting information of a connectable device the direction in which the respective receptacle is located if the respective receptacle for the connectable device was already identified.
5. The information system according claim 3, wherein the processing device is configured to indicate with the mounting information of a receptacle the direction in which the respective connectable device is located if the respective connectable device for the receptacle was already identified.
6. The information system according to claim 3, wherein the processing device is configured to calculate for all identified electrical devices and the identified connectable devices and the identified receptacles the distance between the respective receptacles which have to be connected by a connectable device and verify if the connectable device which is provided to connect the respective receptacles is at least as long as the calculated distance.
7. The information system according to claim 1, wherein the processing device is configured to mark a connectable device or a receptacle which is positioned by the user in the middle of the camera view or scene as active connectable device or receptacle, respectively, and wherein the processing device is configured to display mounting information only for the active connectable device or receptacle.
8. The information system according to claim 1, wherein the processing device is configured to subsequently store information about all connected connectable devices and receptacles which have been mounted using the information system, and wherein the processing device is configured to display in the display a list of connectable devices which are not yet connected.
9. The information system according to claim 1, comprising a communication interface which is coupled to the processing device, wherein the processing device is configured to transmit via the communication interface information about the connectable devices connected to one of the electrical devices to said electrical device.
10. The information system according to claim 1, comprising a diagnosis unit configured to inspect if all connectable devices have been connected to the correct receptacles, wherein the processing device is configured to indicate in the display movement directions in which the camera has to be moved by the user in order for the processing device to generate a list with all electrical devices and connectable devices and receptacles into which connectable devices have been mounted after they have been mounted, wherein the diagnosis unit configured to inspect if all connectable devices have been connected to the correct receptacles based on said list.
11. A method for providing mounting information for a number of connectable devices and electrical devices to a user, comprising: recording a scene with a camera, identifying in the scene a number of at least on of connectable devices or receptacles, overlaying the scene with mounting information for the identified connectable devices and the identified receptacles, and displaying the scene with the overlay information in a display.
12. The method according to claim 11, wherein identifying comprises identifying the electrical devices or connectable devices or receptacles by identifying an optical code on the connectable devices or receptacles, the method further comprising storing for every optical code the mounting information of the respective connectable device or receptacle.
13. The method according to claim 11, comprising identifying at least one of the position or orientation of the camera in three dimensional space, and determining the position of the electrical devices or the identified connectable devices or the identified receptacles, and wherein the mounting information is displayed at the position of the respective identified connectable devices or the respective identified receptacles on the display, and especially wherein with the mounting information of a connectable device the direction in which the respective receptacle is located is indicated if the respective receptacle for the connectable device was already identified.
14. The method according to claim 11, wherein with the mounting information of a receptacle the direction in which the respective connectable device is located is displayed if the respective connectable device for the receptacle was already identified.
15. The method according to claim 13 or 14, wherein for all identified electrical devices or identified connectable devices or identified receptacles the distance between the respective receptacles which have to be connected by a connectable device is calculated and it is verified if the connectable device which is provided to connect the respective receptacles is at least as long as the calculated distance.
16. The method according to claim 11, wherein a connectable device or a receptacle which is positioned by the user in the middle of the camera view or scene is marked as active connectable device or receptacle, and wherein mounting information is displayed only for the active connectable device or receptacle.
17. The method according to claim 11, wherein information about all connected connectable devices or receptacles which have been mounted is subsequently stored, and wherein in the display a list of connectable devices which are not yet connected is displayed.
18. The method according to claim 11, wherein information about the connectable devices connected to one of the electrical devices is transmitted to the respective electrical device.
19. The method according to claim 11, comprising inspecting if all connectable devices have been connected to the correct receptacles, wherein in the display movement directions are indicated in which the camera has to be moved by the user in order to generate a list with all electrical devices or connectable devices or receptacles into which connectable devices have already been mounted, wherein it is inspected if all connectable devices have been connected to the correct receptacles based on said list.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0023] For a more complete understanding of the present invention and advantages thereof, reference is now made to the following description taken in conjunction with the accompanying drawings. The invention is explained in more detail below using exemplary embodiments which are specified in the schematic figures of the drawings, in which:
[0024]
[0025]
[0026]
[0027]
[0028] The enclosed drawings are intended to provide further understanding of the embodiments of the invention. They illustrate embodiments and, in conjunction with the description, serve to explain principles and concepts of the invention. Other embodiments and many of the stated advantages can be found from the drawings. The elements of the drawings are not necessarily shown in scale with one another.
[0029] In the figures of the drawing, any elements and components that are identical, have the same function and work in the same way, are each given the same reference signs, unless stated otherwise.
DETAILED DESCRIPTION OF THE DRAWINGS
[0030]
[0031] The camera 7 is configured to record a scene 8 and transmit the data regarding the recorded scene 8 to the processing device 10. The processing device 10 in turn is configured to enhance the recorded scene 8 with additional mounting information 2-1-2-n and display the enhanced scene 8 in the display 9.
[0032] In front of the camera 7 there are shown two connectable devices embodied as cable connectors 3-1 and 3-n.
[0033] Furthermore, together with the cable connectors 3-1 and 3-n respective receptacles 5-1 and 5-n are shown. Possible further connectable devices and receptacles are hinted at by three dots. The connectors 3-1 and 3-n and the receptacles 5-1 and 5-n represent a stylised version of a real scene which could be recorded by the camera 7 in a real application situation.
[0034] In order to enhance the scene 8 for displaying to a user, the processing device 10 identifies in the scene 8 the connectors 3-1 and 3-n and the corresponding receptacles 5-1 and 5-n. The identification can be based on optical pattern or image recognition techniques, RFID, or the like. After identifying the single connectors 3-1 and 3-n and receptacles 5-1 and 5-n the processing device 10 includes the respective mounting information 2-1 and 2-n as overlay in the scene 8 and displays in the display 9 the scene 8 together with the mounting information 2-1 and 2-n.
[0035] The processing device 10, the camera 7 and the display 9, as well as further elements shown in combination with other embodiments of the information system 1-1, can be included in a single device, like a smartphone, a PDA, a tablet PC or the like. In another embodiment the elements of the information system 1-1 can be distributed over a variety of devices. For example the camera 7 and the display 9 could be included in a head mounted system and the processing device 10 could be provided in a computer connected to the head mounted system.
[0036] Every other partitioning of the elements of the information system 1-1 is also covered by this patent application.
[0037] Providing mounting information 2-1-2-n for all presently visible connectable devices 3-1-3-n and/or receptacles 5-1-5-n can clutter the display 9 with too much information to be comfortably used by the user for mounting the connectable devices 3-1-3-n and/or receptacles 5-1-5-n. In order to simplify the mounting of the connectable devices 3-1-3-n for the user, the processing device 10 can mark as active a connectable device 3-1-3-n and/or a receptacle 5-1-5-n which is positioned by the user in the middle of the camera view or the scene 8.
[0038] Until the active connectable device 3-1-3-n and/or receptacle 5-1-5-n is finally mounted by the user the processing device 10 displays mounting information 2-1-2-n only for the active connectable device 3-1-3-n and/or receptacle 5-1-5-n.
[0039] Furthermore, to supervise the overall progress of the mounting process the processing device 10 can subsequently store information about all connected connectable devices 3-1-3-n and/or receptacles 5-1-5-n which have been mounted using the information system 1-1. It is then possible to display, e.g. in the display 9 or the display of a related computer, a list of connectable devices 3-1-3-n which are not yet connected. It is also possible to audibly or visually indicate to a user that all connectable devices 3-1-3-n have been mounted.
[0040]
[0041] The method starts with recording S1 a scene 8 with the camera 7. In a second step a number of connectable devices 3-1-3-n and/or receptacles 5-1-5-n in the scene 8 are identified S2. Following the identification of connectable devices 3-1-3-n and/or receptacles 5-1-5-n the scene 8 is overlaid S3 with mounting information 2-1-2-n for the respective connectable devices 3-1-3-n and/or receptacles 5-1-5-n. Finally, the scene 8 is displayed S4 with the overlay information 2-1-2-n in a display 9 for a user to use the overlay information 2-1-2-n to mount the connectable devices 3-1-3-n in the correct receptacles 5-1-5-n.
[0042] Tracking the mounting process can be supported by storing information about all connected connectable devices 3-1-3-n and/or receptacles 5-1-5-n which have been mounted. This allows displaying a list of connectable devices 3-1-3-n which are not yet connected, and to notify a user when all connectable devices 3-1-3-n have been mounted.
[0043]
[0044] The processing device 10 of the information system 1-2 is configured to identify the electrical devices 4-1-4-n, connectable devices 3-1-3-n and/or receptacles 5-1-5-n by identifying an optical code 11-1-11-n on the connectable devices 3-1-3-n and/or receptacles 5-1-5-n. In
[0045] Furthermore, the information system 1-2 comprises in addition to the camera 7, the processing device 10 and the display 9 a database 12, a position sensor 13, a communication interface 17 and a diagnosis unit 18 which are all coupled to the processing device 10.
[0046] The database 12 is used to store for every optical code 11-1-11-n the mounting information 2-1-2-n of the respective connectable device 3-1-3-n and/or receptacle 5-1-5-n. The mounting information 2-1-2-2 can be pre-stored in the database 12 or can be dynamically loaded by the processing device 10 e.g. from a central database (not shown). Such a central database can e.g. be hosted on a server which is accessible over the internet.
[0047] After identifying the single connectable device 3-1-3-n and/or receptacle 5-1-5-n the processing device 10 can then display the mounting information 2-1-2-n at the position of the respective identified connectable devices 3-1-3-n and/or the respective identified receptacles 5-1-5-n on the display 9.
[0048] Furthermore, in the database 12 the processing device 10 can store the information about all connected connectable devices 3-1-3-n and/or receptacles 5-1-5-n which have been mounted using the information system 1-1 to track the mounting progress as already explained above.
[0049] The position sensor 13 can be used by the processing device to identify the position and/or orientation 14 of the camera 7 in three dimensional space. This information can be used by the processing device 10 to determine the position of the electrical devices 4-1-4-n, the identified connectable devices 3-1-3-n and/or the identified receptacles 5-1-5-n. The processing device 10 can e.g. use a method like dead reckoning to calculate and follow the position of the camera 7. Based on a known camera position the processing device can then also calculate the positions of the electrical devices 4-1-4-n, the identified connectable devices 3-1-3-n and/or the identified receptacles 5-1-5-n.
[0050] Knowing the exact location of connectable devices 3-1-3-n and of the respective receptacle 5-1-5-n the processing device 10 can indicate with the mounting information 2-1-2-n of a connectable device 3-1-3-n the direction 15 in which the respective receptacle 5-1-5-n is located or vice versa. This is especially useful if either the receptacle 5-1-5-n for a visible connectable device 3-1-3-n or the connectable device 3-1-3-n for a visible receptacle 5-1-5-n is not visible in the scene 8.
[0051] Furthermore, knowing the location of connectable devices 3-1-3-n and the receptacles 5-1-5-n the processing device 10 calculates for all identified electrical devices 4-1-4-n, connectable devices 3-1-3-n and/or receptacles 5-1-5-n the distance between the respective receptacles 5-1-5-n which have to be connected by a connectable device 3-1-3-n, like a cable, and verify if the cable 3-1-3-n which is provided to connect the respective receptacles 5-1-5-n is at least as long as the calculated distance.
[0052] In
[0053] Finally the information system 1-2 comprises a diagnosis unit 18 which inspects if all connectable devices 3-1-3-n have been connected to the correct receptacles 5-1-5-n.
[0054]
[0055] In order to simplify the identification step S2, the step of identifying S2 comprises identifying the electrical devices 4-1-4-n, connectable devices 3-1-3-n and/or receptacles 5-1-5-n by identifying an optical code 11-1-11-n on the connectable devices 3-1-3-n and/or receptacles 5-1-5-n. After the identification step S2 the method further comprises storing S5 for every optical code 11-1-11-n the mounting information 2-1-2-n of the respective connectable device 3-1-3-n and/or receptacle 5-1-5-n for further use.
[0056] To improve the mounting information 2-1-2-n with extra directional indications in step S6 the position and/or orientation 14 of the camera 7 in three dimensional space is determined. Furthermore, the position of the electrical devices 4-1-4-n, the identified connectable devices 3-1-3-n and/or the identified receptacles 5-1-5-n is extracted from the images recorded by the camera 7 together with the known camera position. If the positions of electrical devices 4-1-4-n, the identified connectable devices 3-1-3-n and/or the identified receptacles 5-1-5-n are known, with the mounting information 2-1-2-n of a connectable device 3-1-3-n the direction 15 in which the respective receptacle 5-1-5-n or connectable device 3-1-3-n is located can be displayed to help the user find the respective receptacle 5-1-5-n or connectable device 3-1-3-n.
[0057] In step S7 for all identified electrical devices 4-1-4-n, identified connectable devices 3-1-3-n and/or identified receptacles 5-1-5-n the distance between the respective receptacles 5-1-5-n which have to be connected by a connectable device 3-1-3-n, i.e. a cable, is calculated. The information about the single connectable devices 3-1-3-n deduced from the optical code 11-1-11-n can e.g. comprise the length of the respective cable. Based on the calculated distance and the known length it is verified in step S8 if the cable 3-1-3-n which is provided to connect the respective receptacles 5-1-5-n is at least as long as the calculated distance. If not, this fact can be displayed to the user, who can then select another cable.
[0058] To facilitate handling of the connectable devices 3-1-3-n a connectable device 3-1-3-n or a receptacle 5-1-5-n which is positioned by the user in the middle of the camera view and/or scene 8 is marked in step S9 as active connectable device 3-1-3-n or receptacle 5-1-5-n. From this moment on mounting information 2-1-2-n is displayed only for the active connectable device 3-1-3-n or receptacle 5-1-5-n until it is connected or another connectable device 3-1-3-n or another receptacle 5-1-5-n is selected as active.
[0059] Finally in step S11 it is inspected if all connectable devices 3-1-3-n have been connected to the correct receptacles 5-1-5-n. To facilitate this step in the display movement directions can be indicated in which the camera 7 has to be moved by the user in order to generate a list with all electrical devices 4-1-4-n, connectable devices 3-1-3-n and/or receptacles 5-1-5-n into which connectable devices 3-1-3-n have already been mounted. Based on the acquired information it is then inspected if all connectable devices 3-1-3-n have been connected to the correct receptacles 5-1-5-n.
[0060] Although specific embodiments have been illustrated and described herein, it will be appreciated by those of ordinary skill in the art that a variety of alternate and/or equivalent implementations exist. It should be appreciated that the exemplary embodiment or exemplary embodiments are only examples, and are not intended to limit the scope, applicability, or configuration in any way. Rather, the foregoing summary and detailed description will provide those skilled in the art with a convenient road map for implementing at least one exemplary embodiment, it being understood that various changes may be made in the function and arrangement of elements described in an exemplary embodiment without departing from the scope as set forth in the appended claims and their legal equivalents. Generally, this application is intended to cover any adaptations or variations of the specific embodiments discussed herein.
[0061] Specific nomenclature used in the foregoing specification is used to provide a thorough understanding of the invention. However, it will be apparent to one skilled in the art in light of the specification provided herein that the specific details are not required in order to practice the invention. Thus, the foregoing descriptions of specific embodiments of the present invention are presented for purposes of illustration and description. They are not intended to be exhaustive or to limit the invention to the precise forms disclosed; obviously many modifications and variations are possible in view of the above teachings. The embodiments were chosen and described in order to best explain the principles of the invention and its practical applications, to thereby enable others skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated. Throughout the specification, the terms including and in which are used as the plain-English equivalents of the respective terms comprising and wherein, respectively. Moreover, the terms first, second, and third, etc., are used merely as labels, and are not intended to impose numerical requirements on or to establish a certain ranking of importance of their objects.