Presentation capture with automatically configurable output
09659504 · 2017-05-23
Assignee
Inventors
Cpc classification
G09B5/06
PHYSICS
H04N7/181
ELECTRICITY
H04N21/458
ELECTRICITY
G09B5/10
PHYSICS
H04N21/238
ELECTRICITY
G09B5/065
PHYSICS
H04N21/437
ELECTRICITY
H04N21/44016
ELECTRICITY
International classification
G09B5/06
PHYSICS
H04N21/433
ELECTRICITY
G09B5/10
PHYSICS
H04N5/272
ELECTRICITY
H04N7/18
ELECTRICITY
H04N21/422
ELECTRICITY
H04N21/4363
ELECTRICITY
H04N21/44
ELECTRICITY
H04N21/437
ELECTRICITY
Abstract
A device and method for simultaneously capturing a combination of content video, content audio, presenter video and presenter audio, as well as distributing a combination of content video, content audio, presenter video and presenter audio to a digital sink via a high-definition multimedia interface (HDMI) connection. Video sources are automatically routed to the digital sink depending on the source configuration.
Claims
1. A presentation capture device for capturing a content audio stream, a content video stream, and a presenter audio stream of a presentation comprising: an analog video input channel configured for receiving an analog video signal comprising the content video stream; a digital content input channel configured for receiving one of a digital video data stream comprising the content video stream and a digital data stream comprising the content video stream and the content audio stream; an analog audio input channel configured for receiving an analog audio signal comprising the content audio stream; a microphone input channel configured for receiving an analog audio signal comprising the presenter audio stream; a digital output channel configured for transmitting a combined audiovisual (AV) digital data stream comprising a combination of the content video stream, the content audio stream, and the presenter audio stream; wherein the presentation capture device is configured for: detecting which input channel is receiving the content audio stream and the content video stream and automatically routing a detected combination of input channels to the digital output channel, automatically routing the analog video input channel and the analog audio input channel to the digital output channel when the presentation capture device detects that the digital content input channel is inactive, automatically routing the digital content input channel and the analog audio input channel to the digital output channel when the presentation capture device detects that the digital content input channel is receiving a digital video data stream comprising the content video stream, automatically routing the digital content input channel to the digital output channel when the presentation capture device detects that the digital content input channel is receiving a digital data stream comprising the content video stream and the content audio stream, simultaneously recording the content video stream, the content audio stream, and the presenter audio stream, and combining the content video stream, the content audio stream, and the presenter audio stream as the combined AV digital data stream.
2. A presentation capture device for capturing a content video stream and a presenter audio stream of a presentation comprising: a first video input channel configured for receiving the content video stream; a second video input channel configured for receiving the content video stream; a third video input channel configured for receiving a presenter video stream; an audio input channel configured for receiving the presenter audio stream; a digital output channel configured for transmitting a combined audiovisual (AV) digital data stream comprising a combination of the content video stream and the presenter audio stream; a video switch connected to the first video input channel and the second video input channel and configured for: detecting which input channel is receiving the content video stream and automatically routing a detected video input channel to the digital output channel, automatically routing the first video input channel to the digital output channel when the video switch detects that the second video input channel is inactive, and automatically routing the second video input channel to the digital output channel when the video switch detects that the second video input channel is receiving a data stream comprising the content video stream; and wherein the presentation capture device is configured for: simultaneously recording the content video stream and the presenter audio stream, and combining the content video stream and the presenter audio stream as the combined AV digital data stream.
3. The presentation capture device of claim 2, wherein the digital output channel outputs the combined AV digital data stream to at least one of a local data sink, a confidence monitor, a universal serial bus (USB) memory stick, a network, a monitor and speakers, a television with embedded speakers, and any combination thereof.
4. The presentation capture device of claim 2, wherein the first video input channel comprises an analog video input channel.
5. The presentation capture device of claim 4, wherein the video switch is further configured for converting the content video stream received from the first video input channel from analog to digital.
6. The presentation capture device of claim 4, wherein the analog video input channel comprises a red-green-blue-horizontal sync-vertical sync (RGBHV) channel.
7. The presentation capture device of claim 2, wherein the second video input channel comprises a digital video input channel.
8. The presentation capture device of claim 7, wherein one of the digital video input channel and the digital output channel comprises one of an HDMI channel, DisplayPort channel, DVI channel, and any combination thereof.
9. The presentation capture device of claim 2, wherein the audio input channel receives the presenter audio stream from a microphone.
10. The presentation capture device of claim 2, wherein the audio input channel comprises an analog audio input channel.
11. The presentation capture device of claim 10, wherein the analog audio input channel comprises a transceiver configured to receive a digital audio signal and output a corresponding analog audio signal.
12. The presentation capture device of claim 2 further comprising an analog video output channel configured for transmitting the content video stream and an analog audio output channel configured for transmitting a content audio stream.
13. The presentation capture device of claim 2, wherein the third video input channel receives the presenter video stream from a video camera.
14. The presentation capture device of claim 2 further comprising a video processor configured for combining the presenter video stream with the content video stream in a single video stream.
15. The presentation capture device of claim 14, wherein the video processor combines the presenter video stream with the content video stream in one of a picture-by-picture (PBP) window and a picture in picture (PIP) window.
16. The presentation capture device of claim 2 further capturing a content audio stream, wherein the presentation capture device further comprises a second audio input channel configured for receiving the content audio stream, and wherein the second video input channel is configured for receiving a data stream comprising the content video stream and the content audio stream.
17. The presentation capture device of claim 16, wherein the video switch is further configured for extracting the content audio stream from the data stream comprising the content video stream and the content audio stream.
18. The presentation capture device of claim 17, wherein the presentation capture device further comprises an audio switch connected to the video switch and the second audio input channel and configured for: detecting the source of the content audio stream and automatically routing a detected audio input channel to the digital output channel, automatically routing the second audio input channel to the digital output channel when the audio switch detects lack of audio packets from the video switch, and automatically routing the second video input channel to the digital output channel when the audio switch detects that the video switch is receiving a data stream comprising the content audio stream.
19. The presentation capture device of claim 16 further comprising an audio mixer configured for combining the presenter audio stream and the content audio stream into a single audio stream.
20. A presentation capture device for capturing a content video stream, a content audio stream, and a presenter audio stream of a presentation comprising: a first video input channel configured for receiving the content video stream; a second video input channel configured for receiving one of (i) the content video stream and (ii) a data stream comprising the content video stream and the content audio stream; a first audio input channel configured for receiving the presenter audio stream; a second audio input channel configured for receiving the content audio stream; a digital output channel configured for transmitting a combined audiovisual (AV) digital data stream comprising a combination of the content video stream and the presenter audio stream; a video switch connected to the first video input channel and the second video input channel and configured for: detecting which input channel is receiving the content video stream and automatically routing a detected video input channel to the digital output channel, automatically routing the first video input channel to the digital output channel when the video switch detects that the second video input channel is inactive, and automatically routing the second video input channel to the digital output channel when the video switch detects that the second video input channel is receiving the content video stream; and wherein the presentation capture device is configured for: simultaneously recording the content video stream and the presenter audio stream, and combining the content video stream and the presenter audio stream as the combined AV digital data stream.
21. The presentation capture device of claim 20, wherein the video switch is further configured for extracting the content audio stream from the data stream comprising the content video stream and the content audio stream.
22. The presentation capture device of claim 20, wherein the presentation capture device further comprises an audio switch connected to the video switch and the second audio input channel and configured for: detecting the source of the content audio stream and automatically routing a detected audio input channel to the digital output channel, automatically routing the second audio input channel to the digital output channel when the audio switch detects lack of audio packets from the video switch, and automatically routing the second video input channel to the digital output channel when the audio switch detects that the video switch is receiving the data stream comprising the content audio stream.
23. The presentation capture device of claim 20 further comprising an audio mixer configured for combining the presenter audio stream and the content audio stream into a single audio stream.
Description
BRIEF DESCRIPTION OF DRAWINGS
(1) The accompanying figures further illustrate the present invention.
(2) The components in the drawings are not necessarily drawn to scale, emphasis instead being placed upon clearly illustrating the principles of the present invention. In the drawings, like reference numerals designate corresponding parts throughout the several views.
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
LIST OF REFERENCE NUMBERS FOR THE MAJOR ELEMENTS IN THE DRAWING
(14) The following is a list of the major elements in the drawings in numerical order. 10 presentation capture device 20 front panel (p/o presentation capture device 20) 30 back panel (p/o presentation capture device 30) 50 first configuration 60 second configuration 70 third configuration 101 lecturer 102 computer 103 High Definition Multimedia Interface (HDMI) connection 104 wireless microphone 105 video camera 106 digital sink 107 Universal Serial Bus (USB) memory stick 108 Ethernet connection 201a record button 201b pause button 201c stop button 201d navigational button 202 display 203 recording indicator LED 204 audio level indicator 205 USB output 301 remote control interface 302 network interface 303 digital content input 304 analog video input 305 audio input 306 camera input 307 digital content output 308 analog video output 309 audio output 310 microphone input 401 digital content input channel 402 analog video input channel 403 analog audio input channel 404 camera input channel 405 microphone input channel 406 analog video output channel 407 digital content output channel 408 capture output channel 409 analog audio output channel 410 first video switch 411 video processor 412 codec 413 digital signal processor 414 audio mixer 415 audio switch 416 second video switch 417 digital content transmitter 801 (step of) receiving the content video stream 802 (step of) determining source 803 (step of) automatically routing analog video input channel 804 (step of) automatically routing digital content input channel 805 (step of) capturing codec output 806 (step of) displaying codec output or second video switch output 901 (step of) receiving the content audio stream and the content video stream 902 (step of) determining source of the content audio stream 903 (step of) determining source of the content audio stream 904 (step of) automatically routing analog audio input channel 905 (step of) automatically routing analog audio input channel 906 (step of) automatically routing digital content input channel 1001 (step of) receiving the content video stream from analog video source 1002 (step of) determining video not from digital content input channel 1003 (step of) automatically routing analog video input channel 1004 (step of) capturing and transmitting combination including the content video stream 1005 (step of) switching to receiving the content video stream from digital video source 1006 (step of) determining video from digital content input channel 1007 (step of) automatically routing digital content input channel 1008 (step of) capturing and transmitting combination including the content video stream 1101 (step of) receiving the content video stream and the content audio stream from analog sources 1102 (step of) determining video not from digital content input channel 1103 (step of) automatically routing analog video input channel 1104 (step of) determining audio not from digital content input channel 1105 (step of) automatically routing analog audio input channel 1106 (step of) capturing and transmitting combination including the content video stream and the content audio stream 1107 (step of) switching to receiving the content video stream and the content audio stream from digital content source 1108 (step of) determining video from digital content input channel 1109 (step of) automatically routing digital content input channel 1110 (step of) determining audio from digital content input channel 1111 (step of) automatically routing digital content input channel 1112 (step of) capturing and transmitting combination including the content video stream and the content audio stream
DETAILED DESCRIPTION OF THE INVENTION
(15) The present invention relates to presentation capture device for recording and distributing audio and video from one or more content sources and audio and video of a presenter. More particularly, the invention relates to a presentation capture device for capturing audio and video from content sources and a presenter as well as automatically detecting input source and distributing the content audio stream and video to a digital sink, accordingly.
(16)
(17) The content video stream and the content audio stream refer to audio visual (AV) media used by the presenter during the presentation and may be received as a digital signal or an analog signal. For example, the content video stream may be a power point slideshow received from a computer. The content audio stream may be audio accompanying the PowerPoint slideshow.
(18) The presenter video stream and the presenter audio stream refer to AV media of the presenter or audience during the presentation. For example, the presenter audio stream may be the audio of a professor's lecture received from the presentation capture device from a wireless microphone. The presenter video stream may be video of the presenter recorded during the lecture. In another example, the presenter audio stream may also include questions asked by students in the audience of the lecture and the presenter video stream may include a video of the student asking the question.
(19) The inventive presentation capture device 10 as shown in
(20) The presentation capture device 10 is configured to simultaneously record the content video stream, the content audio stream, the presenter audio stream and the presenter video stream to a compressed audio-visual format. The presentation capture device 10 mixes the content audio stream and the presenter audio stream and combines the presenter video stream and the content video stream, such as by positioning the presenter video stream as a picture-by-picture (PBP) window or a picture-in-picture (PIP) window.
(21) The presentation capture device 10 combines the audio and video as a compressed AV stream and outputs the compressed AV stream for capture (stored locally and uploaded to a server for archiving and on demand playback) or live streaming (transmitted as an AV stream over Ethernet 108). For example, the presentation capture device 10 may output the compressed AV stream for storage on a USB memory stick 107 which the lecturer may take with him. Alternatively, the presentation capture device 10 may transmit the compressed AV stream on a network for remote storage. Additionally, the presentation capture device 10 may output the compressed AV stream to a media server for live streaming over a network.
(22) Additionally, the presentation capture device 10 processes and distributes a combination of the content audio stream, the content video stream, the presenter audio stream, and the presenter video stream to a digital sink 106 for display during the lecture. For example, the presentation capture device 10 may transmit the content audio stream and the content video stream to a television with embedded speakers. The presentation capture device 10 may also transmit combined video of the content video stream and the presenter video stream as well as combined audio of the content audio stream and the presenter audio stream to a digital sink 106. Advantageously, the presentation capture device 10 is configured to detect the source type of the incoming content audio stream and content video stream and automatically distribute the appropriate sources to a digital sink without requiring user interaction with the device, such as selecting a source.
(23)
(24) A USB output 205 is disposed on the front panel 20 of the inventive presentation capture device for receiving a USB memory stick. The presentation capture device outputs the combination of the content audio stream, the content video stream, the presenter audio stream and the presenter video stream to the USB memory stick via USB output. Advantageously, the lecturer is provided with a recording of the captured lecture on the USB memory stick when the lecture has ended.
(25)
(26) The back panel 30 also comprises a network interface 302 for communicating on a network. The presentation capture device 10 is configured to transmit and receive information from a network, such as a local area network (LAN) or the world wide web, via network interface 302. Advantageously, the presentation capture device 10 may be remotely controlled from a computer on the network executing a software program as either a locally stored program or in an internet browser. The software may be Roomview software that is available from Crestron Electronics, Inc. of Rockleigh N.J. Additionally, the presentation capture device 10 may send information to the network. For example, the presentation capture device 10 may transmit the compressed AV stream of the captured lecture for storage or streaming on the network and may also transmit status information to the network.
(27) The back panel 30 further comprises multiple inputs for receiving video and audio. A digital content input 303 is configured for receiving a cable from a digital content source transmitting digital content video stream and digital content audio stream as a digital data stream. For example, the digital content input may an HDMI input, a DisplayPort input, or a DVI input.
(28) An analog video input 304 is configured for receiving a cable from an analog video source transmitting analog content video stream. For example, the analog video input 304 may be a red-green-blue-horizontal sync-vertical sync (RGBHV) input port configured for receiving an analog component video signal comprising video in RGBHV, RGBs, RGsB, or YUV format.
(29) An audio input 305 is configured to receive a cable from an analog audio source transmitting analog content audio stream. For example, the audio input 305 may be an audio jack configured to receive two channels of analog audio.
(30) A camera input 306 is configured to receive a cable from a camera source, such as a video camera, transmitting the presenter video stream. For example, the camera input may be an RCA jack configured for receiving composite video from a video camera.
(31) A microphone input 310 is configured to receive an input connector from a microphone transmitting the presenter audio stream. For example, the microphone input 310 may be a TRS connector port configured to receive a TRS connector jack from a microphone. In another embodiment the TRS connector jack may receive audio from a wireless microphone receiver. The wireless microphone receiver may comprise an RF transceiver for receiving a digital RF signal from a wireless microphone 104 comprising the content audio stream and transmitting a corresponding analog audio signal received via TRS connector jack.
(32) The back panel 30 further comprises multiple outputs for transmitting video and audio. A digital content output 307 is configured for receiving a cable for transmitting the content video stream and the content audio stream as a digital data stream to a digital content sink, such as over an HDMI connection, DVI connection, or DisplayPort connection. For example, the digital content output 307 may be transmitting digital video and digital audio to a television with embedded speakers. Further, the presentation capture device 10 may transmit a combination of digital content video stream, digital presenter video stream, digital content audio stream, and digital presenter audio stream to a digital data sink via a digital content output, such as an HDMI connection.
(33) An analog video output 308 is configured for receiving a cable for transmitting analog content video stream to an analog video sink. For example, the analog video output 308 may be a red-green-blue-horizontal sync-vertical sync (RGBHV) output port configured for transmitting an analog component video signal comprising the content video stream in RGBHV, RGBs, RGsB, or YUV format.
(34) An analog audio output 309 is configured to receive a cable for transmitting both presenter and content analog audio to an analog audio sink. For example, the audio output 309 may be an audio jack configured to transmit the presenter audio stream to a speaker via a speaker cable.
(35)
(36) The presentation capture device 10 is configured to capture a presentation by simultaneously recording a combination of the content video stream, the content audio stream, and the presenter audio stream. The presentation capture device 10 receives the content video stream through the digital content input channel 401 or the analog video input channel 402. Both the digital content input channel 401 and the analog video input channel 402 transmit the content video stream to a first video switch 410. The first video switch 410 is configured to convert analog video to digital video if received from the analog video input channel and transmit the content video stream from either input channel to a video processor 411. The video processor 411 is configured to scale the content video stream according to requirements of the compressed AV format that will be recorded or streamed. The video processor 411 is configured to transmit the content video stream to a codec 412 for further processing.
(37) The presentation capture device 10 receives the presenter audio stream at the microphone input channel 405. The presenter audio stream is processed at a digital signal processor 413 which is configured to process the audio and equalize the level. The presenter audio stream is transmitted to an audio mixer 414 which is configured to route audio to the codec 412 for further processing.
(38) The presentation capture device 10 may also receive the content audio stream from the digital content input channel 401 or the analog audio input channel 403. The first video switch 410 is further configured for extracting the content audio stream from the content video stream received at the digital content input channel 401. An audio switch 415 is configured for receiving the content audio stream from the digital content input channel 401 and the analog audio input channel 403. The audio switch 415 routes the received content audio stream to the audio mixer 414. The audio mixer 414 is further configured to mix the content audio stream with the presenter audio stream and transmit the combined presenter and the content audio stream to the codec 412.
(39) In a further embodiment, the presentation capture device 10 is configured to capture the presenter video stream and incorporate it as part of the captured lecture. A camera input channel 404 receives the presenter video stream from a camera source such as a video camera. The video processor 411 is further configured to receive the presenter video stream from the camera input channel 404 and convert it from analog to digital. The video processor 411 then combines the presenter video stream with the content video stream by either inserting it as a PIP window or as a PBP window. The combined video stream is transmitted to the codec 412.
(40) The codec 412 is configured to receive a combination of the content video stream, the content audio stream, the presenter video stream and the presenter audio stream from the video processor and from the audio mixer. The codec 412 is configured to encode the combination of the content video stream, the content audio stream, the presenter video stream and the presenter audio stream in a compressed AV format as a digital data stream. The digital data stream from the codec 412 may be output to a capture output channel 408 such as a USB output 205 or a network interface 302.
(41) The presentation capture device 10 is further configured to distribute a combination of the content video stream, the presenter video stream, the content audio stream, and the presenter audio stream to one or more local sinks via output channels. Specifically, the presentation capture device 10 further comprises a digital content output channel 407, digital content transmitter 417 and a second video switch 416. The second video switch 416 is configured for receiving an output from the first video switch 410 and an output from the codec 412. According to user preference, the second video switch 416 routes either of these outputs to the digital content transmitter 417. The digital content transmitter 417 is configured to receive video from the second video switch 416 and transmit said video to a digital sink via digital content output channel 407. Additionally, if the video received from the first video switch 410 is output from the first video switch 410 and not the codec 412, the digital content transmitter 417 may combine the audio from the audio mixer 414 to the digital data stream, according to user preference. Finally, the presentation capture device 10 may transmit the output of the codec 412 via digital content output channel 407. For example, the output of the codec 412 may be transmitted to a confidence monitor providing the lecturer with visual feedback of the combined video stream such as by allowing him to view whether he is in the field of view of the video camera or if a PIP window is blocking important underlying content.
(42) Advantageously, the presentation capture device 10 is configured to automatically detect an input configuration of content sources and distribute an appropriate combination of the content video stream and the content audio stream to a digital content output channel 407 without user interaction. Specifically, the first video switch 410 is configured to automatically detect the input configuration by detecting a source type of the content video stream and route the corresponding input channel accordingly. Similarly the audio switch 415 is configured to detect whether it is receiving the content audio stream from the first video switch 410 and route the appropriate input channel.
(43) The first video switch 410 may receive content in one of three configurations. Depending on the configuration, the first video switch 410 and audio switch 415 automatically route an optimal combination of input channels to the codec 412 (via video processor 411) and the digital content output channel 407 (via second video switch 416 and the digital content transmitter 417) without the user having to select the source.
(44)
(45)
(46)
(47)
(48)
(49) If the first video switch 410 determines in step 802 that the content video stream is received from the digital content input channel 401, the method proceeds to step 903, wherein the audio switch 415 determines whether the content audio stream has been extracted by the first video switch 410 from a digital data stream and transmitted to the audio switch by the video switch. If the audio switch 415 determines that the content audio stream is not received from the first video switch 410, in step 905, the audio switch 415 automatically routes the analog audio input channel 403 to the codec 412 and the digital content output channel 407 via audio mixer 414 and digital content transmitter 417. If the audio switch 415 determines that the content audio stream is received from the first video switch 410, in step 906, the audio switch 415 automatically routes the digital content input channel 401 to the codec 412 and the digital content output channel 407 via audio mixer 414 and digital content transmitter 417.
(50)
(51) In step 1005, the presentation capture device 10 begins receiving the content video stream from a digital video source 401 instead. In step 1006, the first video switch 410 determines that the content video stream is being received from the digital content input channel 401. In step 1007, the digital content input channel 401 is automatically routed to the codec 412 and the digital content output channel 407 via video processor 411 and the second switch 416 and digital content transmitter 417, respectively. In step 1008, a combination of the content video stream, the content audio stream, the presenter video stream and the presenter audio stream is captured as an output of the codec 412 and transmitted via digital content output channel 407 as either an output of the codec 412 or an output of the second switch 416.
(52)
(53) In step 1107, the presentation capture device 10 begins receiving the content video stream and the content audio stream from a digital content source 401 instead. In step 1108, the first video switch 410 determines that the content video stream is being received from the digital content input channel 401. In step 1109, the digital content input channel 401 is automatically routed to the codec 412 and the digital content output channel 407 via video processor 411 and the second switch 416 and digital content transmitter 417, respectively. In step 1110, the audio switch 415 determines that the audio is being received from the first video switch 410. In step 1111, the digital content input channel 401 is automatically routed to the codec 412 and the digital content transmitter 417 via audio mixer 414. In step 1112, a combination of the content video stream, the content audio stream, the presenter video stream and the presenter audio stream is captured as an output of the codec 412 and transmitted via digital content output channel 407 as either an output of the codec 412 or an output of the second switch 416 and the audio mixer 414.
INDUSTRIAL APPLICABILITY
(54) To solve the aforementioned problems, the present invention is a unique device configured for simultaneously capturing a combination of the content video stream, the content audio stream, the presenter video stream and the presenter audio stream is for storage or streaming as well as for distributing to a digital sink.
LIST OF ACRONYMS USED IN THE DETAILED DESCRIPTION OF THE INVENTION
(55) The following is a list of the acronyms used in the specification in alphabetical order. AV audio-visual HDMI high-definition multimedia interface LAN local area network PBP picture-by-picture PIP picture-in-picture RF radio frequency RGB red green blue RGBHV red green blue horizontal sync vertical sync USB universal serial bus
Alternate Embodiments
(56) Alternate embodiments may be devised without departing from the spirit or the scope of the invention. For example, the presentation capture device 10 could be equipped with an RF transceiver for communicating wirelessly with a network.