Abstract
A system for synchronizing lighting effect patterns of interactive lighting effect devices at a remote location with respect to those at local location is disclosed herein. Synchronized lighting effects produced at the remote location while watching a lighting effect show using other interactive lighting effect devices illuminated according to a script at event venue, can be achieved. Such synchronized lighting effects obtained at remote location generate a corresponding virtual simulated perception of attending same concert venue live when watching a live streaming video thereof. Low latency between lighting effect changes are produced at remote location with respect to those observed in concert venue live streaming video due to method of color control signal generation along with usage of color control pattern blending module that creates a blended video frame comprising of a color control pattern, which allows for efficient lighting effect pattern generation at remote location.
Claims
1. A method for synchronizing a lighting effect pattern and a lighting effect control signal, comprising of steps of: step S1: generating a color control signal by a lighting controller at a live event venue located at a first location, wherein the color control signal is obtained from a lighting pattern change script of the live event venue in a sequential manner; step S2: capturing a current video frame at a live event venue located at the first location, wherein the current video frame containing an image of the live event venue comprising of a plurality of illuminated interactive lighting effect devices; step S3: broadcasting wirelessly the color control signal via a wireless transmitter as a plurality of repeating RF data bursts, and receiving the color control signal by a color control pattern blending module located at the first location, and creating a blended video frame comprising of a color control pattern blended with the current video frame of the live event venue using the color control pattern blending module; step S4: transmitting the blended video frame to a video streaming server via internet; step S5: downloading, decompressing and playing the blended video frame using a video player and determining a location of the color control pattern within the blended video frame; step S6: extracting a color value from the color control pattern in the blended video frame and transmitting the color value to a wireless control module located at a second location; step S7: copying the color value to a data structure to form a color control signal vector and sending the color control signal vector to the wireless control module located at the second location; step S8: broadcasting the color control signal vector via a wireless transmitter as a plurality of repeating RF data bursts from the wireless control module located at the second location; and step S9: receiving the color control signal vector by an interactive light effect device located at the second location, and initiating a lighting change according to the color control signal vector to form a lighting effect pattern.
2. The method of claim 1, wherein the step s3 is replace by sending the color control signal directly in a direct wire connection to a color control pattern blending module located at the first location, and creating a blended video frame comprising of a color control pattern blended with the current video frame of the live event venue using the color control pattern blending module.
3. The method of claim 1, wherein the color control pattern includes at least one zone inside the image of the live event venue.
4. The method of claim 3, wherein the color control pattern includes color data comprising of R, G, B color values, of which a color value of each color zone of the color control pattern range from 0 to 255, respectively.
5. A system for synchronizing lighting effect patterns and lighting effect control signals of a plurality of interactive lighting effect devices which are located at a second location with respect to the interactive lighting effect devices located at a first location, respectively, comprising: a video recorder, comprising a camera; a lighting controller; a wireless transmitter and a color control pattern blending module; a color control pattern extracting module; a wireless control module; and each of the interactive lighting effect devices comprising a memory having stored therein a zone region indexed by a zone code, a wireless receiver configured to capture the RF data burst from the wireless transmitter, a controller responsive to the RF data burst, and is coupled to the memory, and at least one light source disposed therein being operationally responsive to the controller to change an illuminating state therein, wherein the at least one light source comprising a plurality of light emitting diodes (LED) having at least colors of red, green and blue, and illuminating intensity of the red, green and blue LEDS are configured in accordance with red, green and blue color codes (R, G, B) ranging from 0 to 255, respectively; wherein a color control signal is generated and a current video frame is captured at the first location, the first location is a live event venue, the color control signal is obtained from a lighting change script of the live event venue and the current video frame containing an image comprising of a plurality of illuminated interactive lighting effect devices located at the first location, the color control signal is sent to the color control pattern blending module located at the first location by direct wire connection or by wireless transmission via RF data burst broadcasts, and a blended video frame comprising of a color control pattern blended with the current video frame of the live event venue using the color control pattern blending module is produced and transmitted to a video streaming server via internet, which in turn then transmits the blended video frame to the color control extracting module disposed at the second location, which in turn extracts the color control pattern and the color control signal from the blended video frame to control the illuminating state of the interactive lighting effect devices at the remote location to form a lighting effect pattern.
6. The system of claim 5, wherein the color control signal comprising the R, G, B color codes and the zone code.
7. The system of claim 5, wherein the second location is a remote location that is broadcasting the blended video frame, and the color control extracting module is coupled to the wireless control module at the second location for wireless transmitting the color control signal to the interactive lighting effect devices at the remote location.
8. The system of claim 5, wherein the illuminating state of the light source comprising on, off, or flashing.
9. The system of claim 5, wherein the RF data burst is replaced by wireless data bursts under Wi-Fi, Bluetooth or ZigBee.
10. The system of claim 5, wherein two or more interactive lighting effect devices that are preconfigured with the zone code stored in the memory thereof to be the same are capable of receiving the same set of pattern-related data for lighting effect to cause the light sources selectively to be illuminating in accordance with a same illuminating color data.
11. The system of claim 5, wherein the interactive lighting effect device is an illuminating LED wristband, an illuminating LED necklace, an LED bangle, a LED bracelet, a glowing head band, a glowing eyewear, a set of LED gloves, or a handheld LED glow stick.
12. A method for forming a color control pattern and extracting a color control signal for controlling illuminating state of an interactive lighting effect device so as to produce a lighting effect pattern, comprising of steps of: (s11) determining and configuring a geometric structure for an outline of the color control pattern; (s12) determining and configuring a number of illuminating panels for the color control pattern; (s13) allocating a portion of a blended video frame as being a scanning region in a display screen; and (s14) detecting the color control pattern from the blended video frame within the scanning region, and extracting the color control signal from the color control pattern using an algorithm; wherein the number of illuminating panels is at least two panels, the scanning region is allocated by directing touching the display screen at a particular location which resides the color control pattern; step (s14) is continuously repeated to obtain more than one color control signals to thereby continuously changing illuminating states of the interactive lighting effect device until end of a lighting show.
13. The method of claim 12, wherein the algorithm for extracting of the color control signal in step (s14) comprising of a plurality of sub-steps: (sub-s1) determining a center point of the color control pattern having (x, y) coordinates within the span region by scanning of the geometric structure of the outline of the color control pattern, and determining a joining location of at least two segments of the illuminating panels; (sub-s2) configuring the joining location determined in sub-step (sub-s1) as being the center point; (sub-s3) scanning continuously and repeatedly for obtaining a data value for each of the illuminating panels for the color control pattern, wherein the data value is a color value, a zone code value, or an additional data value; and (sub-s4) converting all of the collected data values in (sub-s3), including the color value and the zone code value, to form a set of color control signal vector.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The present invention will become more readily apparent to those ordinarily skilled in the art after reviewing the following detailed description and accompanying drawings, in which:
(2) FIG. 1 shows a block diagram of a conventional system for synchronizing lighting effect patterns and lighting effect control signals of a plurality of interactive lighting effect devices using color control signal RF data bursts.
(3) FIG. 2 shows an illustrative example of a layout diagram of zone code allocation arrangement for seating zones in a venue event according to a conventional method.
(4) FIG. 3 shows an illustrative example of zones codes listed with respect to specific seating zone regions as found in prior art.
(5) FIG. 4 shows a block diagram of a system for synchronizing lighting effect patterns and lighting effect control signals of a plurality of interactive lighting effect devices which are located at a second location with respect to the interactive lighting effect devices located at a first location, respectively, according to an embodiment of present invention.
(6) FIG. 5 shows an illustrated flow-chart diagram of a method for generating a color control pattern and a blended video frame from a color control signal from a light controller for controlling illuminating state of an interactive lighting effect device according to an embodiment of the present invention.
(7) FIG. 6 shows a detailed flow-chart diagram of a method for synchronizing lighting effect patterns and lighting effect control signals of a plurality of interactive lighting effect devices located at a second location with respect to those located at a first location in accordance to an embodiment of present invention in accordance with different time points.
(8) FIG. 7 shows a flow chart diagram of a method for producing lighting effect pattern changes and lighting effect patterns according to a color control signal vector for interactive lighting effect devices at a remote location.
(9) FIGS. 8A?8B show a plurality of illustrative examples of the color control pattern in accordance with the embodiment of present invention.
(10) FIG. 9 shows a flow-chart diagram of a method for extracting a color control signal comprising of color values of color zones from the color control pattern using an algorithm according to an embodiment of present invention.
(11) FIGS. 10A?10B show diagrams illustrating a process timing scheme including a latency (time lag) for the method for synchronizing lighting effect patterns and lighting effect control signals according to the embodiment of the present invention.
(12) FIG. 11 shows a process flow diagram describing the utilization of a color control pattern extracting module for extracting the color control signal from the color control pattern in a blended video frame to control illuminating state of the interactive lighting effect devices at the remote location.
(13) FIG. 12 shows an illustrative block diagram of the system for synchronizing lighting effect patterns and lighting effect control signals of the interactive lighting effect devices which are located at the remote location with respect to the interactive lighting effect devices located at a live event venue location.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
(14) The present invention will now be described more specifically with reference to the following embodiments. It is to be noted that the following descriptions of the embodiments of this invention are presented herein for purpose of illustration and description only. It is not intended to be exhaustive or to be limited to the precise form disclosed.
(15) Several terms or phrases are used throughout the present disclosure with the following definitions, such as, the following:
(16) A synchronized lighting effect control signal has the following defined meanings: when a series of lighting effect control signals are generated in sequence according to a concert's script to wirelessly control interactive lighting effect devices held by audience members at a local location of a live concert A, the audience members who located at a remote location and are also holding interactive lighting effect devices, through viewing of the streaming video of the live concert A, will experience substantially the same timing of lighting effect control changes on their interactive lighting effect devices as those as seen in the streaming video on the interactive lighting effect devices experienced by the audience member at the local location of the live concert A.
(17) A color control pattern is defined as follow: is an image-based pattern generated by a color control pattern generated unit. The color control pattern is used to achieve synchronized lighting effect control signal to control the interactive lighting effect devices at the remote location. The color control signal data is mapped onto the color control pattern as R, G, B color value. Then the color control pattern blends with raw video images to be shown on a video frame of live streaming video.
(18) Referring to the disclosure in US Patent Publication Number 20170048951 with publication date of Feb. 16, 2017 (herein referred also as US-Pub 20170048951), an interactive lighting effect portable light illuminating device (herein referred to also as, an interactive lighting effect device, for short), an interactive lighting effect control system, a plurality of LED light sources operationally responsive to change an illuminating state thereof, wireless data transmission in the form of RF data bursts from the interactive lighting effect control system comprising illuminating color and zone assignment data, illuminating color and zone assignment sequence data file comprising a plurality of prearranged illuminating intensities of red, green and blue light emitting diodes (LEDS) and the nested hierarchical zone codes of the zone regions in sequential data burst timing, a plurality of light emitting diodes (LEDs) having at least colors of red, green and blue for the light sources, along with various other teachings and techniques can all be incorporated along the embodiment of present invention, as to be effectively adapted for usage in embodiments of present invention.
(19) The present invention provides illuminating states of the light source comprising on, off, or flashing for the interactive lighting effect portable light illuminating device.
(20) The present invention provides interactive lighting effect portable light illuminating device in various structures and configurations, such as, for example, an illuminating LED wristband, an illuminating LED necklace, or a handheld LED glow stick.
(21) Based upon disclosure of US Patent Publication Number 20170048951, the present invention also provides an interactive lighting effect control system configured and adapted for use together with the interactive lighting effect portable light illuminating devices, in which the interactive lighting effect control system comprising a wireless transmitter comprising a memory and at least one lighting controller, the at least one lighting controller generating a color control signal, the color control signal comprising an illuminating color and zone assignment data, the lighting controller is coupled to the memory of the wireless transmitter, the color control signal is transmitted to the wireless transmitter, the wireless transmitter is an RF transmitter configured to broadcast the color control signal in a plurality of RF data bursts in sequential order, and at least one wireless receiver, the at least one wireless receiver is configured to intercept and respond to the RF data bursts broadcasted from the wireless transmitter upon verifying the authenticity thereof. Each of the RF data burst comprising the illuminating color and zone assignment data for the at least one wireless receiver having a memory therein storing at least one zone region indexed by one or more nested hierarchical zone codes, the wireless transmitter to be initiating sequential broadcasting at a time t.sub.n of one color control signal in one RF data burst to the interactive lighting effect portable light illuminating device, and initiating sequential broadcasting at a time t.sub.n+1 of another color control signal in another RF data burst to the interactive lighting effect portable light illuminating device, upon receiving of the RF data burst for the color control signal by the interactive lighting effect portable light illuminating device, a controller therein performing authentication verification of an identification code from the illuminating color and zone assignment data of the received RF data burst of the color control signal and inspecting whether the identification code of the color control signal after calculation is correct or not, and initiating change of illuminating color of a plurality of LEDs in the interactive lighting effect portable light illuminating device in accordance with the color control signal comprising a plurality of illuminating colors for a plurality of light sources of the interactive lighting effect portable light illuminating devices defined by a set of red, green, and blue (R, G, B) color codes.
(22) The present invention provides the wireless receiver to be configured and disposed in the interactive lighting effect portable light illuminating device.
(23) The present invention provides redundant RF data bursts to be sequentially broadcasted at the time t.sub.n and at the time t.sub.n+1 comprising of the same redundant color control signal in consecutive RF data bursts to the interactive lighting effect portable light illuminating device.
(24) In the embodiments of present invention, the following features or resources are provided: the illuminating states of the light source include on, off, or flashing. In other words, any number of red, green and blue light emitting diodes (LED1, LED2, LED3) can be turned on or powered on, turned off or powered off, or flashing on and off in repeating pattern with a specified frequency (i.e. 2 times per second). Turning on means or entails that at least one of the R, G, B color codes is not zero. Turning off means that all of the R, G, B color codes are set to be zero, or that the dimmer color code is set to zero. The color for the flashing on/off can be set by the corresponding R, G, B color code data. Meanwhile, the flashing frequency can be configured or set by the controller of the interactive lighting effect portable light illuminating device to be given a preset flashing frequency value, i.e. 2 flashings/second, or through generating a random number by the controller. The wireless data transmissions from the wireless transmitter to the wireless receiver can be performed by RF data bursts or alternatively, Wi-Fi, Bluetooth or ZigBee transmissions, to name a few. The interactive lighting effect device can be an illuminating LED wristband, an illuminating LED necklace, or a handheld LED glow stick, but is not limited to these options, and can be adapted to other types of illuminating devices with wireless communication capability.
(25) As shown in FIG. 4, a system 100 for synchronizing lighting effect patterns and lighting effect control signals of a plurality of interactive lighting effect devices 10 which are located at a second location 40 with respect to the interactive lighting effect devices 10 located at a first location 20, respectively, includes the following: a video recorder 50, which comprising a camera; a lighting controller 18; a wireless transmitter 15 and a color control pattern blending module 25; a color control pattern extracting module 35; and a wireless control module 45. In the above-mentioned system 100, as also shown in FIG. 1 (and explained in greater details in US-Pub 20170048951) each of the interactive lighting effect devices 10 comprising a memory having stored therein a zone region indexed by a zone code within the color control signal RF data bursts data, a wireless receiver configured to capture the RF data burst from the wireless transmitter, a controller responsive to the RF data burst, and is coupled to the memory, and at least one light source (LED1, LED2, LED3) disposed therein being operationally responsive to the controller to change an illuminating state therein, wherein the at least one light source comprising a plurality of light emitting diodes (LED1, LED2, LED3) having at least colors of red, green and blue, and illuminating intensity of the red, green and blue LEDS are configured in accordance with red, green and blue color codes (R, G, B) ranging from 0 to 255, respectively. In the illustrated embodiment, a color control signal is generated and a current video frame is captured at the first location 20, the first location 20 can be a live event venue, the color control signal is obtained from a lighting change script of the live event venue and the current video frame containing an image comprising of a plurality of illuminated interactive lighting effect devices 10 located at the first location 20, the color control signal is sent to the color control pattern blending module 25 located at the first location 20 through direct wiring connection or by wireless transmission via RF data burst broadcasts, and a blended video frame comprising of a color control pattern blended with the current video frame of the live event venue using the color control pattern blending module 25 is produced and transmitted to a live streaming server via internet, which in turn, then transmits the blended video frame to a color control pattern extracting module 35 disposed at the second location 40, which in turn extracts the color control pattern and the color control signal from the blended video frame to control the illuminating state of the interactive lighting effect devices 10 at the remote location 40 to form a lighting effect pattern. As shown in FIG. 1, the color control signal includes data for the R, G, B color codes and the zone code. As shown in illustrated example of FIGS. 2 and 3, the zone codes to be stored in the interactive lighting effect devices are matched to each of the zone partitions (or seating location regions) in a venue event. In the illustrated embodiment of FIG. 4, the second location 40 can be one or more of remote location 40 that is broadcasting the blended video frame, and the color control pattern extracting module 35 can be coupled to the wireless control module 45 at the second location 40 for wireless transmitting the color control signal to the interactive lighting effect devices 10 at the remote location 40. The illuminating state of the light source comprising on, off, or flashing in the interactive lighting effect devices 10, respectively, so as to produce lighting effects changes when illuminated together. In other embodiments (not shown), the RF data burst can be replaced by wireless data bursts under Wi-Fi, Bluetooth or ZigBee. In the illustrated embodiment of FIGS. 1 and 4, two or more interactive lighting effect devices 10 that are preconfigured with the zone code stored in the memory thereof to be the same are capable of receiving the same set of pattern-related data for lighting effect to cause the light sources selectively to be illuminating in accordance with a same illuminating color data. The interactive lighting effect device 10 can be an illuminating LED wristband, an illuminating LED necklace, an LED bangle, a LED bracelet, a glowing head band, a glowing eyewear, a set of LED gloves, or a handheld LED glow stick. Furthermore, the interactive lighting effect device 10 can also include a drone configured with LED lighting. In addition, the interactive lighting effect device 10 can be different types of devices combined together, i.e. a group of LED light sticks and a group of drones with LED can be disposed inside the first location 20, and/or the second location 40, respectively.
(26) As shown in FIG. 4, the video recorder 50 can be a conventional digital camera, such as Sony? HDR-series digital camera, or a mobile device with a camera module. The color control pattern blending module 25 includes the following components: (1) a color control pattern generating unit, which can be a PC, laptop or mobile device running a pattern generating program therein; (2) a video image blending unit, such as Sony? MCX-500 vision mixer, or a PC, laptop or mobile device that is running image blending program therein; (3) a memory (not shown); and (4) an uploading unit, which can be used to compress and upload video to Internet, and can be implemented by, for example, a PC, laptop or mobile electronic device. In other words, the color control pattern blending module 25 is a device or module used to generate the color control pattern according to the color control signal, blend the color control pattern with the video frame, and to upload the video frames to internet after the video blending is finished. The color control pattern blending module 25 including of the color control pattern generating unit, the video image blending unit, and the uploading unit, can be implemented and realized by means of configuring a set of computer program residing on a PC, a smartphone, and/or by adding configuration algorithms in driver source file for an embedded system, and/or by adding compiled coding/program to microprocessor . . . etc.
(27) As further shown in FIG. 4, the wireless transmitter 15 can be the same wireless transmitter as disclosed in US-Pub 20170048951. The color control pattern extracting module 35 includes the following components: (1) a downloading unit (not shown), which can be a PC, laptop or mobile electronic device that is configured to be capable of downloading video from internet; (2) a video image extracting unit (not shown), which can be a PC, laptop or a mobile electronic device that run a program capable of decompressing the video, and also run a program to extract a color value of a color control pattern. In other words, the color control pattern extracting module 35 is an electronic module or device configured and adapted to be used to download video image frames from internet, and to extract the color control pattern and the color control signal to control the illuminating state of the interactive lighting effect devices 10 at the remote location 40. The color control pattern extracting module 35 including of the downloading unit and the video image extracting unit, can be implemented by means of configuring a set of computer program residing on a PC, a smartphone, and/or by adding configuration algorithms in driver source file for an embedded system, and/or adding compiled coding/program to microprocessor . . . etc. In the illustrated embodiment, the wireless control module 45 includes the following components: (1) a lighting controller (not shown), which can be a PC, laptop or mobile that is configured to receive the extracted color value of color control pattern and copy it to a data structure as the color control signal vector at the remote location used to control interactive lighting effect devices; and (2) a wireless transmitter (not shown, but is the same wireless transmitter as found in US-Pub US 20170048951). The uploading unit (not shown) belonging to the color control pattern blending module 25 is configured and adapted to be used to upload the blended video frames to online video streaming platform such as YouTube (www.youtube.com), Twitch (https://www.twitch.tv/) . . . etc. for users to live the live concert at the remote location. For bandwidth saving purpose, these video frames will be usually compressed before uploading to online video streaming platform.
(28) As shown in FIG. 9, a flow chart for a method for extracting color values directly from color control pattern in a current video frame (to find the color value of each zone by comparing the color value difference of a whole scanned image to find the color value of a center point of each color zone, in which the color control pattern has uniform regular shape/structure such as the four-zone square shown in the illustrated embodiment of FIGS. 8A-8B) includes the following steps: In step S200, a full screen (P?Q pixels) image of a current video frame is captured by a video recorder 50 and then stored into the memory therein using a software program. In step S205, image pixels from (0,0) to (xn,yn) are scanned to inspect the color value. For instance, yn is configured to be zero (0), and xn is configured or set from 0 to P to perform scanning. Then yn is set to be 1, and xn is configured from 0 to P to perform scanning. The same procedure is then repeated many times while yn is incremented each time by one (1) during each scanning. Later upon yn reaching Q, xn is then set or incremented from 0 to P to do scanning. In step S210, upon finding M/2 numbers of pixel color to be substantially the same color (i.e. substantially the same color can be defined by color difference of these M/2 numbers of pixel color to be less than a threshold d) during scanning process, the last image location of (xn, yn) can then be found and recorded, so that (M/2, 0), (M/2, 1) . . . (M/2,N), (M,0), . . . (M,N) points are respectively recorded. In step S215, a center point of the color control pattern, which is (M/2, N/2) is located, since because upper left point of color control pattern is (0,0). In step S220, the color values of the color zones are extracted respectively by picking up the image location data located at the center point of each color zone obtained, in which the center point image location for the color zones, are for example, (M/4, N/4), (3M/4, N/4), (M/4, 3N/4) and (3M/4, 3N/4), respectively, in the illustrated embodiment of FIGS. 5 and 8A.
(29) In the illustrated embodiment, the color value extraction of each color zone by finding their center points is just an example for the sake of calculation convenience, nevertheless conventional techniques adopting pattern recognition algorithm are also available for dealing with color control patterns having irregular or non-uniform shapes, such as for example: a pattern recognition algorithm can be utilized to find a center point of a color control pattern on the scanned video image first. Then because the color control pattern is predesigned ahead of time, then according to the known size/dimensions of the color control pattern, the center point of the color control pattern and the known relative position of each color zone of the color control pattern are calculated or determined based on simple geometric relationship calculations. Later, color data for each color zone of the color control pattern is then extracted. For the aforementioned pattern recognition algorithm, a conventional open source algorithm described in Feature Detection and Description section of OpenCV (http://docs.opencv.org/3.0-beta/doc/py_tutorials/py_feature2d/py_table_of_contents_feature2d/py_table_of_contents_feature2d.html) can be consulted to find the feature of the object of an image and then find its corresponding center point. These algorithm include SIFT, SURF and BRIEF . . . etc.
(30) Referring to FIG. 6, a flow-chart diagram of a method for synchronizing a lighting effect pattern and a lighting effect control signal includes the following steps: In step S100, a color control signal is generated by a lighting controller at a live event venue located at a first location, in which the color control signal is obtained from a lighting pattern change script of the live event venue in a sequential manner. In step S105, a current video frame is captured at a live event venue located at the first location, in which the current video frame containing an image of the live event venue comprising of a plurality of illuminated interactive lighting effect devices. In step S110, the color control signal is broadcasted wirelessly via a wireless transmitter as a plurality of repeating RF data bursts, and the color control signal is received by a color control pattern blending module located at the first location, and a blended video frame comprising of a color control pattern blended with the current video frame of the live event venue using the color control pattern blending module is created. In step S115, the blended video frame is transmitted to a live streaming server via internet. In step S120, the blended video frame is downloaded, decompressed, and played using a video player and a location of the color control pattern within the blended video frame is determined. In step S125, a color value is extracted from the color control pattern in the blended video frame and the color value is transmitted to a wireless control module located at a second location. In step S130, the color value is copied to a data structure to form a color control signal vector and the color control signal vector is sent to the wireless control module located at the second location. In step S135, the color control signal vector is broadcasted via a wireless transmitter as a plurality of repeating RF data bursts from the wireless control module located at the second location. In step S140, the color control signal vector is received by an interactive light effect device located at the second location, and a lighting change is initiated according to the color control signal vector to form a lighting effect pattern. In an alternative embodiment, the step S110 can be replaced by the following step: the color control signal is sent directly to a color control pattern blending module located at the first location by a direct wiring connection, and a blended video frame is created comprising of a color control pattern blended with the current video frame of the live event venue using the color control pattern blending module. In the embodiments of present application, the color control pattern includes at least one zone inside the image of the live event venue, and the color control pattern includes color data comprising of R, G, B color values, of which a color value of each color zone of the color control pattern range from 0 to 255, respectively.
(31) Referring to FIGS. 10A-10B, a color control signal is generated, and a current video frame is captured at a live event venue located at a first location 20 at a time point t1, in which the color control signal is obtained from a lighting pattern change script of the live event venue in a sequential manner and the current video frame containing an image of the live event venue comprising of a plurality of illuminated interactive lighting effect devices 10. In the illustrated embodiment, the color control signal is broadcasted via a wireless transmitter 15 as a plurality of repeating RF data bursts to a color control pattern blending module 25 located at the first location 20, and creating a blended video frame comprising of a color control pattern blended with a blank image together with the current video frame of the live event venue using the color control pattern blending module 25 at a time point t2 (refer also to FIG. 5 for more details regarding the creation of the blended video frame and the color control pattern). Later, the blended video frame is transmitted to a live streaming server via internet at a time point t3; the blended video frame is then downloaded, decompressed, and played using a video player, and a location of the color control pattern within the blended video frame is determined at a time point t4; a color value from the color control pattern in the blended video frame is extracted, and the color value is transmitted to a wireless control module 45 located at a second location 40 at a time point t5; the color value is then copied to a data structure to form a color control signal vector, and the color control signal vector is sent to the wireless control module 45 located at the second location 40 at a time point t6; the color control signal vector is broadcasted via a wireless transmitter as a plurality of repeating RF data bursts from the wireless control module 45 located at the second location 40 at a time point t7; and the color control signal vector is then received by an interactive light effect device 10 located at the second location 40, and a lighting change is initiated according to the color control signal vector to form a lighting effect pattern at a time point t8; according to experimentation results, a latency (time lag) defined as being a time difference total calculated from a time point t4 to a time point t5 (?t3), a time point t5 to a time point t6 (?t4), a time point t6 to a time point t7 (?t5), and a time point t7 to a time point t8 (?t6), in the method for synchronizing a lighting effect pattern and a lighting effect control signal is determined or evaluated, which includes the following: the latency from the time point t4 to the time point t5 is less than 3 seconds for only a first lighting change of the color control signal vector, but is less than 1 millisecond for subsequent lighting changes of the color control signal vector; the latency from the time point t5 to the time point t6 is less than 1 millisecond, and from the time point t6 to the time point t7 is less than 1 millisecond for all lighting changes of the color control signal vector, respectively; the latency from the time point t7 to the time point t8 is less than 5 milliseconds for all lighting changes of the color control signal vector, respectively. In addition, the latency (time lag) calculated from the time point t4 to the time point t5, the time point t5 to the time point t6, the time point t6 to the time point t7, and the time point t7 to the time point t8 is under 8 milliseconds. However, because the above example is only just one embodiment, therefore, other examples with improved results for latency are also possible and included. Meanwhile, due to the fact that the time point t4 can be flexibly chosen in accordance with user preference with respect to the time point t3, therefore, latency is not defined or limited by the timing of time points t1, t2, and/or t3, respectively. In other words, user has the freedom to decide when to watch the video at the remote location, because it does not have to be in sequential order with respect to timing sequence shown by FIG. 10A.
(32) FIG. 5 shows an illustrated flow-chart diagram of a method for generating the color control pattern and the blended video frame from a color control signal from a light controller for controlling illuminating state of an interactive lighting effect device according to an embodiment of the present invention, which includes the following steps: In step S1, a color control signal is obtained from a lighting controller. In step S2, a color control pattern is created (i.e. R=0, G=0, B=0). In step S3, each color zone is filled in with individual color values (i.e. R, G, B) in accordance to data from color control signal (refer to FIG. 5 in step S3 for greater details). In step S4, the color control pattern is blended with a blank image whose background is removed and the blended video frame is outputted to a video image blending unit (refer to FIG. 5 in step S4 for greater details).
(33) Referring to FIG. 7, which shows steps for producing lighting effect patterns and lighting effect control signals at the remote location, including steps S160?S180, namely the following: in step S160, a lighting controller receives color values (ft G, B values) of each color zone from the color control pattern extracting module (matching to step S125 of FIG. 6). In step S165, data (i.e. R, G, B and zone code) is copied to a data structure as a color control signal vector at a remote location for controlling a plurality of interactive lighting effect devices (matching to step S130 of FIG. 6). In step S170, the color control signal vector is transmitted to a wireless transmitter of a wireless control module at the remote location (matching to step S130 of FIG. 6). In step S175, the color control signal vector is broadcasted via RF data bursts in sequential order from the wireless transmitter of the wireless control module located at the remote location (matching to step S135 of FIG. 6). In step S180, the color control signal vector is received by the interactive lighting effect device located at the remote location, and a lighting change is initiated according to color control signal vector to form a lighting effect pattern (matching to step S140 of FIG. 6).
(34) Referring to FIG. 8B (example 3), which shows an illustrative example of a method for obtaining the color control pattern in accordance with the embodiment of present invention, in which four color zones having square shapes, includes color values of the following respectively:
(35) (first color zone) R=255, G=255, B=255;
(36) (second color zone) R=0, G=0, B=0;
(37) (third color zone) R=128, G=128, B=128;
(38) (fourth color zone) R=30, G=30, B=30.
(39) The first square color zone sets R of the color control signal to be set to 255, while the second square color zone sets the G of the color control signal to be zero (0), the third square color zone sets the B of the color control signal to be 128, and the fourth square color zone sets the zone code (ZC) of the color control signal to be 30. Furthermore, FIG. 8A contains example 1 and example 2, which shows additional examples for obtaining the color control pattern.
(40) While the invention has been described in terms of what is presently considered to be the most practical and preferred embodiments, it is to be understood that the invention needs not be limited to the disclosed embodiment. On the contrary, it is intended to cover various modifications and similar arrangements included within the spirit and scope of the appended claims which are to be accorded with the broadest interpretation so as to encompass all such modifications and similar structures.
