System and method for remotely monitoring the operating life of electronic displays

Abstract

A system for remotely monitoring and controlling one or more electronic displays containing several hardware components. The components may electronically communicate with a network connection which can be used to establish communication with a local area network and/or the internet. A personal computing device can be used to run a user interface which allows the user to access a wealth of information from the electronic display as well as change controlling software, operating parameters, and check for downtime incidents or failures. Various sensors and measurement devices can be installed within the display to provide the information which may be stored locally or stored remotely for real-time access or on-demand access.

Claims

1. A system for remotely monitoring and controlling an electronic display comprising: a first electronic display having a backplane in electrical connection therewith; a color light sensor placed in front of the first electronic display and electrically connected with the backplane; a network connection with the backplane; and a computing device residing at a location remote to and not visible from the first electronic display, the computing device having a second display, change controlling software, and an electronic storage medium populated with operating parameters, the computing device in electronic communication with the network connection and adapted to display a user interface on the second display, the user interface configured to present the current brightness level of the first electronic display and to accept as an input a new brightness level to be provided via the change controlling software to the first electronic display if the current brightness level of the first electronic display is determined to fall outside of corresponding acceptable operating parameters saved on the electronic storage medium.

2. The system of claim 1 further comprising: a power module electrically connected with the backplane.

3. The system of claim 2 wherein: the user interface is adapted to display the current draw of the power module.

4. The system of claim 2 wherein: the user interface is further adapted to display the temperature of the power module.

5. The system of claim 1 further comprising: a fan placed electrically connected with the backplane.

6. The system of claim 5 wherein: the user interface is adapted to display the speed of the fan.

7. The system of claim 1 further comprising: an AC current monitoring device electrically connected with the backplane.

8. The system of claim 7 wherein: the user interface is adapted to display the data from the AC current monitoring device.

9. The system of claim 1 wherein: the first electronic display is a liquid crystal display.

10. The system of claim 1 wherein: the first electronic display is an OLED display.

11. The system of claim 1 wherein: there are a plurality of first electronic displays, each first electronic display having: a display assembly, a backplane in electrical connection therewith, a color light sensor placed in front of each first electronic display and electrically connected with the backplane thereof, and a network connection with the backplane; and wherein the computing device is adapted to communicate with each first electronic display device, and the user interface is adapted to present sensor data from each first electronic display device and to allow new input values to be provided thereto.

12. A system for remotely monitoring and controlling a liquid crystal display (LCD), the system comprising: an LCD having a backlight; a backplane electrically connected with the LCD and backlight; a light sensing device placed to measure the light emitted from the backlight and electrically connected with the backplane; at least one temperature sensing device electrically connected with the backplane and placed to measure at least one temperature of the LCD and; a fan placed to draw cooling air over the backlight and electrically connected with the backplane; a network connection with the backplane; and a computing device residing at a location remote to and not visible from the LCD, the computing device having a second display, change controlling software, and an electronic storage medium populated with operating parameters, the computing device in electronic communication with the network connection and adapted to display a user interface on the second display, the user interface configured to present data from the light sensing device, the fan and the at least one temperature sensing device, and to accept as an input new backlight emission levels and new fan speeds to be provided via the change controlling software to the LCD if the light from the backlight as measured by the light sensing device or a temperature of the LCD as measured by the at least one temperature sensing device is determined to fall outside of corresponding acceptable operating parameters saved on the electronic storage medium.

13. The system of claim 12 wherein: the network connection is a wireless network.

14. The system of claim 12 further comprising: a power module electrically connected with the backplane.

15. The system of claim 14 wherein: the user interface is adapted to display the current draw of the power module.

16. The system of claim 12 wherein: an ambient light sensor is also electrically connected with the backplane; and the user interface is adapted to display data from the ambient light sensor and to accept as an input new backlight emission levels to be provided via the change controlling software to the LCD if the ambient light level as measured by the ambient light sensor is determined to fall outside of corresponding acceptable operating parameters saved on the electronic storage medium.

17. A computing device for remotely monitoring and controlling an electronic display having a display assembly, a backplane electrically connected with the display assembly, an ambient light sensor electrically connected with the backplane, a power module electrically connected with the backplane, and a fan electrically connected with the backplane, the device comprising: an electronic storage medium at a location remote to the electronic display and electrically connected with a processor, a second display, and a network communication port; wherein the electronic storage medium contains operating instructions to accept and display the speed of the fan, the current draw and temperature of the power module, and the data from the ambient light sensor; and wherein the electronic storage medium further contains operating instructions which provide an acceptable range for the current draw and temperature of the power module and analyze the incoming current draw and temperature data to determine if it has fallen outside the acceptable range.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) A better understanding of an exemplary embodiment will be obtained from a reading of the following detailed description and the accompanying drawings wherein identical reference characters refer to identical parts and in which:

(2) FIG. 1 is shows an electrical block diagram for an exemplary display which contains an embodiment of the display performance monitoring system;

(3) FIGS. 2-12 show a series of screenshots for an exemplary user interface for accessing status information about the display;

(4) FIG. 13 is an embodiment of the display performance monitoring system when using a wireless transmitter and several displays; and

(5) FIGS. 14-18 show a series of screenshots for an exemplary user interface for accessing status information about both the transmitters and the displays.

DETAILED DESCRIPTION

(6) FIG. 1 shows an electrical block diagram for an exemplary display 100 which contains an embodiment of the display performance monitoring system. A color light sensor 15 may be placed in front of the display assembly 10. In this embodiment, the color light sensor 15 is placed between the display assembly 10 and the front display plate 12 which may protect the display from damage or provide additional optical properties (anti-reflection, polarizing, optical matching, light absorption, etc.). The specific embodiment shown here could be used with an LCD display, where the display assembly 10 may be an LCD stack with an associated backlight assembly 13 placed behind the LCD stack. Obviously, with other embodiments using other types of display assemblies, a backlight assembly 13 may not be necessary. For example, an organic light-emitting diode (OLED), light emitting polymer (LEP), or electroluminescent display may be used as the display assembly 10 where a backlight would not be required.

(7) The display assembly 10 may be in electrical communication with a timing and control assembly (TCON) 30. The color light sensor 15 and TCON 30 may be in electrical communication with a signal backplane 31. If a backlight assembly 13 is used, it may be connected to a power backplane 20 which may also be connected to one or more power module assemblies 22. A temperature sensing device may be placed on or near each power module assembly 22 in order to measure the temperature of the power module assembly 22. A display controller assembly 24 may also be in electrical communication with the signal backplane 31. The power backplane 20 may be in electrical communication with the signal backplane 31. The display controller assembly 24 may include several different components including, but not limited to a video receiving unit, decompressor, and display interface board (DIB). In some embodiments, the TCON 30 may be incorporated into the display controller assembly 24.

(8) Other elements may also be in electrical communication with the signal backplane 31, including but not limited to an ambient light sensor 35 and a backlight sensor 36. An ambient light sensor 35 may be used to detect the amount of ambient light which is present. A backlight sensor 36 may be used to detect the level of luminance that is being produced by the backlight assembly 13 (if used). Exemplary embodiments may also utilize a plurality of temperature sensing devices, placed in electrical communication with a backplane and placed to sense the temperature of the backlight 13, display assembly 10, power module assemblies 22, inlet/exit air temperatures, and the exterior environment temperatures.

(9) The display may contain several input/output interfaces. A video input 25 accepts the video data from a video source and may connect to the signal backplane 31 or may connect directly to the display controller assembly 24. An RS232 interface 26 as well as an Ethernet/network interface 27 may be used to provide communication between the various display components and the user. The RS232 interface 26 may use standard levels and signals to allow connection to a personal computer. The Ethernet/network interface 27 may provide automatic sensing to allow connection directly to a PC or network hub. Through one or both of these interfaces 26 and 27, the user can communicate with the display to accomplish a variety of different objectives. It should be noted that this is only one embodiment for the input/output interfaces for a display. Other embodiments may not use the RS232 interface 26 and instead would only use the Ethernet/network interface 27. In wireless applications, a wireless network card (or other type of wireless transmitting/receiving device) may be used to both receive the video data and communicate with the user over a network connection. In these embodiments, the wireless network card may replace the RS232 interface 26, Ethernet/network interface 27, and the video input 25. The wireless application will be discussed further below.

(10) A power input 28 may be connected to the power backplane 20. A current monitoring device 39 may be placed between the power input 28 and the power backplane 20 in order to measure the power consumption of the display. One or more fans 40 may be used to cool the display and may be electrically connected to the power backplane 20.

(11) Although shown in the figure with a signal backplane 31 and a power backplane 20 as separate elements, this may not be used in all embodiments. In some embodiments, the power and signal backplanes may be incorporated into a single backplane.

(12) A color light sensor 15 may be placed in front of the display assembly 10 so that it may detect various properties of the display assembly 10. In some embodiments, a pre-determined watermark may be displayed on the display assembly 10 and measured/analyzed by the color light sensor 15. The watermark may be generated by one or more components of the display controller assembly 24, TCON 30, or any other local storage/control assembly. The watermark may be automatically created by the display or may be shown when directed by the user. The watermark may be a grouping of image elements (ex. pixels) on the display which are selected to display a specific color or set pattern of colors for measurement by the color light sensor. The watermark can be placed anywhere on the display, but since the color light sensor should preferably be placed in front of the display, the watermark should preferably be placed in a corner or near the edge of the display so that the image is only disrupted a minimal amount. In some embodiments, the watermark may simply be a small shape showing a solid color (ex. Red (R), Green (G), Blue (B), or White (W)). The watermark may show each color for a predetermined amount of time while its properties are measured by the color light sensor 15. For example, the watermark may cycle through squares/rectangles of the following colors in the following times: T1=R, T2=G, T3=B, T4=W, T5=R, etc.

(13) In one embodiment, when the display is initially installed it may be inspected to determine that it is operating properly. Then, once the watermark begins to be displayed, the measurements of the color light sensor may be stored as the reference points for comparison throughout the life of the display. Once the color light sensor determines that the measurements have fallen outside of an acceptable range, this may be indicated to the user (either automatically or when the user requests the data) and the display may need certain parameters reset or may possibly need serviced and/or replaced. In other embodiments, the required measurement values from the color light sensor may be pre-determined and stored within the display controller assembly 24. Then during the life of the display, the measurements from the color light sensor 15 are compared with these pre-determined values and when they fall outside the acceptable range, an error may be reported to the user.

(14) Some embodiments may not report errors out to the user immediately, but instead may simply store the data internally for later retrieval by the user. Once the data is retrieved and analyzed it can be determined that the display has malfunctioned and may continue to malfunction.

(15) Exemplary embodiments may provide constant feedback on the performance of the display 100 and can quickly notify the user that the display 100 is not functioning properly. Notifications may be sent to the user's PC through the RS232 interface 26 or to any remote location using the Ethernet/network interface 27. A variety of internet notifications could be sent to the user through the Ethernet/network interface 27. Notifications could include email, instant messaging, text messaging, or a web page which can be accessed by the user and may contain the data for a number of different displays (discussed further below). Prior to the exemplary embodiments herein, a user would have no notice of a malfunctioning display unless actually observed by the user. As discussed above, a user may have many displays in operation and it may be difficult or impossible to closely monitor them. The display may have been malfunctioning for some time before the user actually notices the failure. In some situations, even actual observation may be difficult since some display parameters are sometimes difficult or impossible to notice by simply looking at the display with the naked eye.

(16) The display may generate and display the same watermark regardless of the video which is being displayed. Alternatively, each video stream may include its own specific watermark. This method would be advantageous as it would permit a measurement of the precise amount of time that each video is being displayed. This would allow an advertising firm to determine exactly how long each client's advertisements were shown on which specific displays. This can be advantageous when many different displays are being used to advertise for many different clients. This would also permit very precise and accurate billing to the clients of the advertising firm.

(17) The embodiments herein allow for a near instantaneous detection of failures in communication between display components, including but not limited to the TCON, DIB, display assembly, and all of the cabling/connections in between. In addition to the monitoring of the display components for proper operation, a number of different display parameters can be monitored by the embodiments described herein, including but not limited to: gamma saturation, contrast, luminance, and color saturation.

(18) As an advanced embodiment of the setup described herein, each bit level for each color may be measured to determine if it is working properly. For example, with a typical LCD display, the luminance level for each subpixel (red, green, and blue) may be defined by 8 bits. Thus, each subpixel can vary from Gamma 0 (black) to Gamma 255 (full on). To test the red subpixels for this example, the bits can vary from: 00000000 (black), 00000001, 00000010, 00000100, 00001000, 00010000, 00100000, 01000000, 10000000, 11111111 (full on). By driving the red subpixels at each bit variation and measuring the output by the sensor, it can be determined if each bit level is functioning properly. Obviously, this can be repeated for the green and blue subpixels.

(19) Many types of color light sensors would work with the embodiments described herein. An exemplary color light sensor is the TCS3404CS or TCS3414CS which are commercially available from Texas Advanced Optoelectronic Solutions® (TAOS) of Plano, Tex. www.taosinc.com. The TAOS specification document TAOS068 entitled ‘TCS3404CS, TCS3414CS Digital Color Light Sensors’ is herein incorporated by reference in its entirety.

(20) Various display types can be used with the embodiments described herein, including but not limited to LCD, plasma, LED, organic LED, light-emitting polymer, field emission display, and organic electro luminescence. As discussed above, some of these displays may not require a backlight assembly. Embodiments may be used with displays of other types including those not yet discovered.

(21) FIG. 2 provides a screenshot of a user interface for monitoring the performance of a display. This screen shot shows the ‘Home’ tab which provides the name of the display and the specific product. FIG. 3 provides a screen shot of an exemplary Network Settings tab. With this menu, the user can view and/or modify the Host Name, DHCP State, IP Address, Gateway, and Net Mask settings. The Host Name can simply allow the user to utilize a meaningful name for the display, or perhaps indicate its location. The DHCP State may be ‘disabled’ when the IP address is to be a fixed address. The DHCP State may be ‘enabled’ when it is desirable to assign the IP address automatically by the network router. The IP Address may be used for the purposes of remote status and monitoring and should preferably be a known IP address on the company intranet. The Gateway is the IP address of the upstream connection that the system may use for all outgoing network communications. The Gateway value should preferably be assigned during installation. The Net Mask setting is the network mask value for the upstream connection that the system may use for all outgoing network communications. After the user enters any Network Settings, pressing the ‘Submit’ button will allow the system to accept the values. The display may reboot.

(22) FIG. 4 provides a screenshot for the Set Time section of the System Settings tab. Under this section, the time/date settings for the display may be controlled. For security reasons, FIG. 5 provides the Set Password section of the System Settings tab where a password can be used to control access to the display. FIG. 6 indicates the Save Configuration section where the displays configuration may save all system parameters to a configuration file. The Shell Command section may be setup for maintenance purposes. FIG. 7 shows the Standby Mode section where the user can enable or disable the ability to operate the display for a period of time with the backlight off.

(23) FIG. 8 provides the various parameters of the Brightness Control section of the System Settings tab where the user may set the brightness of the display to by dynamically controlled based on ambient light conditions or set to a fixed value. Enabling the Dynamic Brightness Control allows the brightness to be automatically adjusted based on ambient light conditions. Disabling the Dynamic Brightness Control allows the user to set and maintain the brightness level at a constant value (as supplied by the Fixed Brightness Value). The Ambient Sensor Location allows the user to select the location of the ambient light sensor. The High Ambient Reading allows the user to select a value for the ambient light sensor where once this value is read by the ambient light sensor, the backlight is driven at the Desired High Nits Value. The Fixed Brightness Value is the chosen constant brightness value when the Dynamic Brightness Control is Disabled. The Desired High Nits is the desired brightness level in nits during high ambient light conditions. This value may only affect the brightness level when the Dynamic Brightness Control is set to Enabled. Desired Low Nits is the desired brightness level in nits during low ambient light conditions which is also takes effect only when the Dynamic Brightness Control is set to Enabled.

(24) FIG. 9 provides the SNMP Settings section where a user may utilize an SNMP Manager if the SNMP Community String is configured. FIG. 10 provides the Reboot Display section of the System Settings tab where the user can reboot the display.

(25) FIG. 11 shows an embodiment for a display page where the Display Status tab has been selected along with the Basic Status section. As shown in this figure, a large amount of information can be shown to the user on this page. This data could be recorded, sorted, and/or plotted in any way that is convenient to the user. Any type of ‘data dump’ into a familiar format (ex. Excel or Numbers) for the user could also be accomplished. Specifically, the data for the power supply(s) (power module assemblies) can be viewed, including the status, current draw, and temperature. Further, additional temperature sensing devices can be placed throughout the display to provide temperature data, as shown in FIG. 11. Each temperature sensing device is preferably placed in electrical communication with a backplane.

(26) As shown in the Figure, the temperature, current draw, and status of each power module (power supply) can be accepted and displayed. Operating parameters can be pre-chosen for the power modules so that if the temperature or current strays outside of an acceptable range, then the Status indication changes from OK to BAD.

(27) FIG. 12 shows an embodiment for a display page where the Display Status tab has been selected along with the Downtime Incidents section. For each downtime incident, the date, cause, and duration of the incident may be recorded and displayed to the user. The downtime incidents may be reset at any time.

(28) FIG. 13 shows an embodiment of the display performance monitoring system when using a wireless connection with several displays. In this embodiment, a video player 200 provides the video (and optional audio) data to the transmitter 210. The transmitter 210 may be in two-way wireless communication with several displays 250, 251, and 252. The transmitter 210 may also be in communication with an internet connection and/or network hub 220 so that a user may access information from the displays/transmitter from any internet and/or network connection.

(29) With embodiments such as the one shown in FIG. 13, separate user interfaces (sometimes web pages) may be created for the transmitter as well as each display (i.e. receiver). FIG. 14 provides a screenshot for a display page. Now that a wireless setup is being used, various data regarding the wireless system can be observed as it relates to the display. As shown in the figure, SSID, WPA2 Pass Phrase, Wireless Channel, Wireless Transmit Rate, Acceptable Frame Rate, and Signal Quality can all be viewed from the Network Settings tab of the display page. A link may be provided to return to the transmitter pages. In an exemplary embodiment, to communicate with the display, a user should preferably establish a physical connection with the Ethernet/network port of the display, either directly or through a crossover cable or via a network switch.

(30) FIG. 15 shows an embodiment for a transmitter page where the Receiver List tab has been selected. This tab may provide the data for each receiver 350 that is connected to the transmitter, in a row format. This can provide a quick view for the user to determine the status of the entire site/location. The rows may be colored coded so that a user can quickly determine if a display/receiver is not performing well. The DHCP Status 300 and WPA2 Status 310 are both shown. During installation, it may be preferable to enable DHCP and disable WPA2. When the displays and transmitters are initially powered up, the displays may use DHCP to connect to a valid transmitter and may begin displaying any transmitted video data. Once this has been done, the transmitter should be connected via a switch on the same network or a crossover connection. The transmitter may be given a default IP address and by connecting a computer which is on the same subnet but with a different IP address the computer may begin communications with the transmitter. It may then be preferable to Bind 360 some or all of the displays in communication with the transmitter (the binding process is discussed further below). It may then be preferable to Disable DHCP 330 and Reboot 340 the system. At this point it may be preferable to enable WPA2 security, which can be accomplished by entering a Pass Phrase under the Network Settings tab (discussed further below). Each row showing the connected receivers may contain a hyperlink 370 which will connect to the page for the particular receiver.

(31) In various embodiments, the transmitters and receivers may be designed to work together by default, without binding. However, in an exemplary embodiment the transmitters and receivers would utilize binding for optimal system performance. In some cases, such as multiple transmitter installations, binding may be required. The principle behind binding is to tell a transmitter that a given set of receivers should always be communicating and receiving video and sometimes audio. If one of the receivers stops responding, the transmitter may flag this receiver and report this to a user using a remote monitoring system or web-based user interface. If there is no binding, the transmitter does not expect the receiver to be there and may not recognize that a receiver has a failure. When all receivers are bound to a transmitter, a preferred embodiment may disable DHCP.

(32) When multiple (N) transmitters are used in the same location, it may be preferred to change the wireless SSID and the wireless channel for at least N−1 of the transmitters. The basic setup as discussed above may be followed for each transmitter. Then, a user may access the Network Settings tab (shown below) for each transmitter in order to change the wireless SSID and wireless channel.

(33) FIG. 16 shows an embodiment for a transmitter page where the Network Settings tab has been selected. Here, the Host Name 400 can be changed. The IP Address 410 may be entered to allow remote status and monitoring. It is preferable that the IP Address 410 is a statically allocated IP address on the company intranet. The Gateway IP address 420 may be entered, which may be the address of the upstream connection that the system will use for outgoing network communications. As discussed above regarding ‘binding’, and especially when using a multiple transmitter system, the SSID 430 may be changed. If using a single transmitter system, the SSID 430 may not require any action by the user. The WPA2 Passphrase 440 may be entered to allow WPA2 security to be enabled. When using multiple transmitter systems, the Transmission Channel 450 may be altered so that a different wireless channel could be used for each transmitter. This may reduce the interference between wireless systems. Even in some single transmitter setups, it may still be advantageous to experiment with different wireless transmission channels to find one that works the best for the particular setup and location.

(34) In some applications, it may be desirable to alter the Wireless Transmission Rate 460. Sometimes, it may improve the video/audio throughput if the Wireless Transmission Rate 460 is lowered. As a general rule, it may be preferable to always keep the Wireless Transmission Rate 460 set at least 2 Mbps greater than the Video Data Rate 480. A Minimum Acceptable Frame Rate 470 may be selected where if the frame rate of the video stream drops below this value, a default image or logo may be displayed instead. The Video Data Rate 480 can also be adjusted which essentially controls the level of compression for the transmitted video source. As noted above, it may be preferable to keep this value less than the Wireless Transmission Rate 460 discussed above.

(35) FIG. 17 shows an embodiment for a transmitter page where the Display Status tab has been selected along with the Downtime Incidents section. Similar to this tab and section for a display, similar data can be shown for the transmitter as well. Thus, for each downtime incident, the date, cause, and duration of the incident may be displayed. Also, the downtime incidents may be reset.

(36) FIG. 18 shows an embodiment for a transmitter page where the DTU Upgrades tab has been selected. On this page, a user can update various types of software for the transmitter and displays. Because each type of software may require a different installation process, different sections may be created for each type of software to be updated. In this embodiment, four sections under the DTU Upgrades tab are shown: Runtime Partition Update, Kernel Update, Boot Update, and Root Filesystem Update. A user can simply select the type of software update, click ‘Browse’ to find the appropriate update, and ‘Submit’.

(37) The various embodiments for the user interface shown in the figures above can be run on any type of computing device. As is known in the art, any computing device with a processor can operate software to accomplish the tasks of the user interface shown and described above. Typical devices contain an electronic storage medium in electrical communication with a processor, a display, and a network communication port. Thus, the user interface shown and described herein can be operated on any computing device including but not limited to: personal computers, tablet computers, smart phones, and any other device with a processor for running software. The user interface may be web-based for running on any personal computing device with an internet connection or may be designed for local use (LAN).

(38) It should be noted that the times/dates for the information shown on the various user interfaces was arbitrary and simply selected to show the various embodiments of the system. The times/dates which are shown in no way indicate that activity regarding the various embodiments actually occurred on those dates.

(39) Having shown and described preferred embodiments, those skilled in the art will realize that many variations and modifications may be made to affect the described embodiments and still be within the scope of the claimed invention. Additionally, many of the elements indicated above may be altered or replaced by different elements which will provide the same result and fall within the spirit of the claimed invention. It is the intention, therefore, to limit the invention only as indicated by the scope of the claims.