VIDEO SIGNAL GENERATING APPARATUS, VIDEO SIGNAL RECEIVING APPARATUS, AND VIDEO SIGNAL GENERATING AND RECEIVING SYSTEM
20210313044 · 2021-10-07
Assignee
Inventors
Cpc classification
H04N23/555
ELECTRICITY
G16H50/20
PHYSICS
G06F13/385
PHYSICS
A61B1/00059
HUMAN NECESSITIES
A61B1/05
HUMAN NECESSITIES
International classification
G11B27/10
PHYSICS
Abstract
A video signal generating apparatus is disclosed which includes: a camera configured to generate a video signal; an operating device configured to operate at least either the camera or an apparatus configured to receive the video signal; a text data generating device configured to generate text data including a meaningful term in response to the operation performed on the operating device; and a text data inserting device configured to insert the text data generated by the text data generating device into the video signal in a corresponding manner.
Claims
1. A video signal generating apparatus comprising: a camera configured to generate a video signal; an operating device configured to operate at least either said camera or an apparatus configured to receive said video signal; a text data generating device configured to generate text data including a meaningful term in response to the operation performed on said operating device; and a text data inserting device configured to insert said text data generated by said text data generating device into said video signal in a corresponding manner.
2. The video signal generating apparatus according to claim 1, wherein said camera generates a serial digital video signal in HD-SDI format stipulated by SMPTE, said text data generating device generates as said text data a term value which is a type of metadata stipulated by SMPTE, and said text data inserting device inserts said term value as ancillary data into a vertical blanking interval of said serial digital video signal in said HD-SDI format.
3. The video signal generating apparatus according to claim 1, wherein said operating device includes a recording start executor and a recording end executor configured to start and end video recording respectively on said apparatus configured to receive said video signal, and said text data generating device generates text data designating a video recording start point and a video recording end point in response to the execution of said recording start executor and said recording end executor respectively.
4. The video signal generating apparatus according to claim 1, wherein said operating device includes an operator configured to be operated regarding a video frame of interest so that the frame will be communicated as a point of interest to said apparatus configured to receive said video signal, and said text data generating device generates text data designating said point of interest in response to the operation performed on said operator.
5. The video signal generating apparatus according to claim 1, further comprising: a microphone; and a voice recognizing device configured to recognize a voice input to said microphone; wherein said text data generating device generates said text data also in response to a result of the recognition by said voice recognizing device.
6. A video signal receiving apparatus comprising: a receiving device configured to receive a video signal into which is inserted text data including a meaningful term; a text data extracting device configured to extract said text data from said video signal received by said receiving device; and an interpreting device configured to interpret as an operation instruction said text data extracted by said text data extracting device; wherein said video signal receiving apparatus performs the operation corresponding to said text data.
7. The video signal receiving apparatus according to claim 6, wherein said receiving device receives a serial digital video signal in HD-SDI format stipulated by SMPTE, and said text data extracting device extracts a term value which is a type of metadata stipulated by SMPTE, as said text data from an ancillary data area in a vertical blanking interval of said serial digital video signal in said HD-SDI format.
8. The video signal receiving apparatus according to claim 6, further comprising a recording device configured to record said video signal received by said receiving device; wherein said interpreting device interprets text data designating a video recording start point and a video recording end point as a video signal recording start instruction and a video signal recording end instruction respectively, and said recording device starts and ends recording of said video signal in response to said text data designating said video recording start point and said video recording end point respectively.
9. The video signal receiving apparatus according to claim 8, further comprising: an onscreen data generating device configured to generate onscreen data; and a superimposing device configured to superimpose said onscreen data generated by said onscreen data generating device onto said video signal received by said receiving device; wherein the video signal having passed said superimposing device is output for monitor display purposes, and from the time said recording device starts recording said video signal until said recording device ends the recording, said onscreen data generating device keeps generating onscreen data indicating that the recording is underway.
10. The video signal receiving apparatus according to claim 6, further comprising a still image capturing device configured to capture as a still image said video signal received by said receiving device; wherein said interpreting device interprets text data designating a point of interest as an instruction to capture said video signal as said still image, and said still image capturing device captures said still image in response to said text data designating said point of interest.
11. The video signal receiving apparatus according to claim 10, further comprising a multi-screen processing device configured to generate a multi-screen video signal causing said video signal received by said receiving device and said still image captured by said still image capturing device to be displayed on a single screen; wherein the video signal having passed said multi-screen processing circuit is output for monitor display purposes.
12. The video signal receiving apparatus according to claim 6, further comprising: an onscreen data generating device configured to generate onscreen data; and a superimposing device configured to superimpose said onscreen data generated by said onscreen data generating device onto said video signal received by said receiving device; wherein said interpreting device interprets the text data extracted by said text data extracting device as an instruction to superimpose said text data onto an image, and said onscreen data generating device generates as said onscreen data the text data extracted by said text data extracting device.
13. A video signal generating and receiving system comprising: a video signal generating apparatus; and a video signal receiving apparatus; wherein said video signal generating apparatus includes a camera configured to generate a video signal, an operating device configured to operate at least either said camera or said video signal receiving apparatus configured to receive said video signal, a text data generating device configured to generate text data including a meaningful term in response to the operation performed on said operating device, and a text data inserting device configured to insert said text data generated by said text data generating device into said video signal in a corresponding manner, said video signal receiving apparatus includes a receiving device configured to receive said video signal into which said text data was inserted by said video signal generating device, a text data extracting device configured to extract said text data from said video signal received by said receiving device, and an interpreting device configured to interpret as an operation instruction said text data extracted by said text data extracting device, and said video signal receiving apparatus performs the operation corresponding to said text data.
14. The video signal generating and receiving system according to claim 13, wherein said camera of said video signal generating apparatus generates a serial digital video signal in HD-SDI format stipulated by SMPTE, said text data generating device of said video signal generating apparatus generates as said text data a term value which is a type of metadata stipulated by SMPTE, said text data inserting device of said video signal generating apparatus inserts said term value as ancillary data into a vertical blanking interval of said serial digital video signal in said HD-SDI format, said receiving device of said video signal receiving apparatus receives said serial digital video signal in said HD-SDI format, and said text data extracting device of said video signal receiving apparatus extracts said term value as said text data from an ancillary data area in said vertical blanking interval of said serial digital video signal in said HD-SDI format.
15. A method for inserting text data into a video signal in a manner triggering an operation, said method comprising the steps of: causing a camera to generate a video signal; causing at least either said camera or an apparatus for receiving said video signal to generate text data including a meaningful term; and inserting the generated text data into a corresponding frame of said video signal.
16. A method for causing a video signal receiving apparatus to operate in a manner corresponding to text data, said method comprising the steps of: receiving a video signal into which is inserted text data including a meaningful term; extracting said text data from the received video signal; interpreting the extracted text data as an operation instruction; and causing said video signal receiving apparatus to operate in a manner corresponding to said text data.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
[0039]
[0040]
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0041] Preferred embodiments of the present invention will now be described in reference to the accompanying drawings. The ensuing description will focus primarily on how the invention is embodied illustratively in the form of an electronic endoscope for medical purposes and an optical disk recorder for recording images picked up by the electronic endoscope.
[0042]
[0043] The electronic endoscope 1 and optical disk recorder 2 are connected by a coaxial cable 3 that transmits a serial digital video signal in HD-SDI format according to the SMPTE 292M standard (the signal will be referred to as the HD-SDI signal hereunder). A video display monitor 4 is connected to the optical disk recorder 2.
[0044] The optical disk recorder 2 is also connected to a diagnostic PC (personal computer carrying diagnostic software) 6, an archive system (PACS: picture archiving and communication system for storage and distribution of clinical images) 7, and an electronic clinical chart system 8 by way of a LAN (local area network) 5 inside the medical facilities.
[0045]
[0046] An image pickup signal generated photoelectrically by the CCD camera 16 is forwarded to a video signal processing circuit 17 inside the scope unit 11. The video signal processing circuit 17 subjects the image pickup signal to digital conversion and various other signal processes (luminance signal process, color signal process, gamma correction, conversion to Y/Cb/Cr, etc.) thereby generating a digital HDTV signal. The digital HDTV signal thus generated is sent to an SDI encoder 19 in the processor unit 12 through a parallel cable 18 inside the tube 13.
[0047] The SDI encoder 19 is a circuit that effects multiplexing, scrambling and other processes on the digital HDTV signal in accordance with the SMPTE 292M standard (HD-SDI). Under control of a CPU 20 supervising the entire processor unit 12, the SDI encoder 19 superimposes EssenceMark™ as ancillary data onto a VBI (vertical blanking interval) area of the digital HDTV signal according to the SMPTE 292M standard.
[0048] As one feature of the present invention, a control panel 21 on the housing surface of the processor unit 12 includes a “REC” button 22, a “STOP” button 23, and a “MARK” button 24 used to operate the optical disk recorder 2 (
[0049] The “REC” button 22 is a button which, when operated, causes the optical disk recorder 2 to start video recording. The “STOP” button 23, when operated, causes the optical disk recorder 2 to stop the ongoing video recording.
[0050] The “MARK” button 24 is operated to mark a video frame of interest (e.g., a frame showing the affected region of a patient). The button operation causes the optical disk recorder 2 to capture the frame in question as a still image.
[0051] The microphone 25 allows the operator pronouncing illustratively the word “rec,” “stop,” or “mark” to replace the physical operation of the “REC” button 22, “STOP” button 23, or “MARK” button 24, respectively. A voice signal input to the microphone 25 is converted to an electrical signal that is sent to a voice recognition circuit 26. The voice recognition circuit 26 recognizes the pronounced word “rec,” “stop,” or “mark” and informs the CPU 20 of the result of the recognition.
[0052]
[0053] When this procedure is started, checks are repeated in three steps until any one of them results in the affirmative. More specifically, a check is first made in step S1 to determine if the “REC” button 22 is operated or if the pronounced word “rec” is recognized by the voice recognition circuit 26. If the result of the check in step S1 is negative, then step S2 is reached. In step S2, a check is made to see if the “STOP” button 23 is operated or if the pronounced word “stop” is recognized by the voice recognition circuit 26. If the result of the check in step S2 is also negative, then step S3 is reached and a check is made to see if the “MARK” button 24 is operated or if the pronounced word “mark” is recognized by the voice recognition circuit 26. If the result of the check in step S3 is negative, then step S1 is reached again and the process is repeated.
[0054] If the result of the check in step S1 is affirmative, then step S4 is reached. In step S4, the CPU 20 generates EssenceMark™ having the value (i.e., “Value” field of the KLV metadata in
[0055] If the result of the check in step S2 is affirmative, then step S5 is reached. In step S5, the CPU 20 generates EssenceMark™ having the value representative of “_RecEnd” (i.e., a reserved word indicating the recording end point of the AV material as shown in
[0056] If the result of the check in step S3 is affirmative, then step S6 is reached. In step S6, the CPU 20 generates EssenceMark™ having the value representative of “_ShotMark1” (i.e., a reserved word indicating a scene as a point of interest in the AV material as shown in FIG.
[0057] 2). The CPU 20 then controls the SDI encoder 19 to superimpose the generated EssenceMark™ as ancillary data onto the VBI area of the frame in effect at this timing. From step S6, control is returned to step S1. According to the procedure of
[0058] As shown in
[0059]
[0060] The SDI decoder 33 is a circuit that submits the converted parallel HD-SDI signal to such processes as descrambling and demultiplexing in order to restore the original digital HDTV signal. Furthermore, the SDI decoder 33 detects timing reference signals (EAV and SAV) and ancillary data from the VBI area of the digital HDTV signal.
[0061] The digital HDTV signal restored by the SDI decoder 33 is forwarded through a superimposing circuit 34 (for superimposing characters) to three circuits: a video signal processing circuit 35 for recording purposes, a still image capturing circuit 36, and a multi-screen processing circuit 37.
[0062] The video signal processing circuit 35 subjects the digital HDTV signals to such processes as addition of error-correcting code, conversion to a signal format suitable for recording onto optical disks, and data compression. The signal processed by the video signal processing circuit 35 is sent to an optical pickup 38.
[0063] The still image capturing circuit 36 captures still images from the digital HDTV signal. The data of each still picture thus captured is stored into an image memory 39 as an image file in DICOM (Digital Imaging and Communication in Medicine) format, which is a format for clinical image data.
[0064] The multi-screen processing circuit 37 generates a multi-screen video signal that arrays, on a single screen in reduced form, the digital HDTV signal from the superimposing circuit 34 and the still image data of image files (e.g., a predetermined number of the most recently created files) retrieved from the image memory 39. If no image file is found in the image memory 39, the multi-screen processing circuit 37 outputs in unmodified form the digital HDTV signal from the superimposing circuit 34 (alternatively, it is possible to generate a multi-screen video signal with its still image data portion left blank). The video signal generated by the multi-screen processing circuit 37 is output from a monitor display video output terminal 40 and sent to the monitor 4 in the configuration of
[0065] The timing reference signals and ancillary data detected by the SDI decoder 33 are forwarded to a CPU 41 that controls the optical disk recorder 2 as a whole. Based on a time code in the ancillary data, the CPU 41 controls an onscreen data generation circuit 42 to generate onscreen data (characters) indicating the current time code. The characters generated by the onscreen data generation circuit 42 are sent to the superimposing circuit 34 whereby the characters are superimposed onto the digital HDTV signal.
[0066] The CPU 41 checks for the presence and type of EssenceMark™ in each frame of the ancillary data coming from the SDI decoder 33. The CPU 41 carries out the checks using the procedure shown in
[0067] When this procedure is started, the checks are repeated in three steps until any one of them results in the affirmative. More specifically, a check is first made in step S11 to determine if the ancillary data of a given frame contains EssenceMark™ having the value (i.e., “Value” field of the KLV metadata in
[0068] If the result of the check in step S11 is affirmative, then step S14 is reached. In step S14, the CPU 41 controls the onscreen data generation circuit 42 (
[0069] If the result of the check in step S12 is affirmative, then step S16 is reached. In step S16, the CPU 41 controls the onscreen data generation circuit 42 to stop generating the characters indicating that video recording is underway (i.e., characters generated in step S14 for the preceding frames). In step S17, the CPU 41 controls the actuator and the drive circuit to stop the ongoing video recording onto the optical disk. This completes the processing on the current frame.
[0070] If the result of the check in step S13 is affirmative, then step S18 is reached. In step S18, the CPU 41 stores the EssenceMark™ value “_ShotMark1” into an internal memory of the CPU 41 as a document file such as an XML document shown in
[0071] What follows is a description of how images are recorded to the optical disk recorder 2 or are displayed on the monitor 4 in response to the operations performed on the electronic endoscope 1 in
[0072] When the operator starts picking up images by operating the electronic endoscope 1, an HD-SDI signal is sent from the endoscope 1 to the optical disk recorder 2 through the coaxial cable 3. From the optical disk recorder 2, the HD-SDI signal is forwarded to the monitor 4. The images being picked up are displayed on the monitor 4 in this manner.
[0073] To get the optical disk recorder 2 to start recording images, the operator may either push the “REC” button 22 (
[0074] The optical disk recorder 2 separates this EssenceMark™ from the signal, interprets its value as an operation instruction, and starts recording images accordingly (in step S15 of
[0075] With the video recording thus started, the operator may either operate the “MARK” button 24 on the control panel 21 (
[0076] The optical disk recorder 2 separates this EssenceMark™ from the signal, interprets its value as an operation instruction, and stores “_ShotMark1” as a document file together with the frame number (in step S18 of
[0077]
[0078] Thereafter, the operator may either push the “STOP” button 23 on the control panel 21 (
[0079] The optical disk recorder 2 separates this EssenceMark™ from the signal, interprets its value as an operation instruction, and stops the ongoing video recording accordingly (in step S17 of
[0080] As described, operations are carried out (physically or phonetically) on the control panel 21 of the electronic endoscope 1 to have the optical disk recorder 2 start video recording, capture still images, and stop the recording. In turn, the HD-SDI signal having EssenceMark™ as text data containing the corresponding meaningful terms is sent to and received by the optical disk recorder 2. Using the EssenceMark™ text data, the optical disk recorder 2 starts video recording, captures still images, and stops the recording reflecting the operations performed on the electronic endoscope 1.
[0081] Simply connecting the electronic endoscope 1 with the optical disk recorder 2 by a single coaxial cable 3 for HD-SDI signal transmission makes it possible for the endoscope to control the recorder in recording and still image capturing.
[0082] The electronic endoscope 1 controls the optical disk recorder 2 in video recording operation but does not control reproduction of recorded images. The reproduction of recorded images is controlled illustratively by the diagnostic PC 6 (
[0083] Since EssenceMark™ is human-readable text data as a variation of the standardized KLV metadata, an apparatus not embodying the present invention such as the optical disk recorder 2 receiving the HD-SDI signal from the electronic endoscope 1 can correctly determine how the metadata in question is to be utilized and what the text data signifies. This guarantees interoperability between the connected apparatuses (for example, upon reproduction following the recording of images, it is possible to display a list of thumbnail images each having the EssenceMark™ value of “_ShotMark1” superimposed thereon).
[0084] The foregoing examples have shown that the EssenceMark™ values of the reserved words listed in
[0085] As another alternative, the control panel 21 may be furnished with additional buttons for setting the time period in which to display the superimposed name in characters, the locations at which to display the name, and the font color in which to display these characters.
[0086] A command indicating these settings may be added to the EssenceMark™ value in a manner distinct from the superimposed name. Given the command, the optical disk recorder 2 may establish accordingly the time period in which to display the superimposed characters, the locations at which to display the characters, and the font color in which to display the characters.
[0087] In the foregoing examples, the EssenceMark™ values were shown to be generated and superimposed by physically operated buttons or by phonetically input words. Alternatively, an EssenceMark™ value may be generated and superimposed using one of the following three events as a trigger:
[0088] (1) a predetermined result is obtained through image processing (e.g., the patient's affected region is detected by application of pattern recognition techniques);
[0089] (2) a predetermined result is obtained through voice processing whereby both image and voice are recorded (e.g., voice of a predetermined level is detected); or
[0090] (3) a preset time is reached.
[0091] In the foregoing examples, the present invention was shown to be applied to the electronic endoscope for medical purposes and to the optical disk recorder for recording images picked up by the electronic endoscope. Alternatively, the present invention may be applied to varieties of applications covering security (crime and disaster prevention), academic pursuits (excavation of ancient ruins), and any other field where images generated by a camera are recorded by another apparatus. Furthermore, where images picked up by a camera-equipped apparatus are received by another apparatus having no capability of video recording, this invention may be utilized to control the latter apparatus in its operation.
[0092] In the foregoing examples, the EssenceMark™ values were shown to be generated and superimposed in response to the operations carried out on the electronic endoscope 1 with regard to the optical disk recorder 2. Alternatively, where the invention is applied to an apparatus having a control unit that operates a camera, EssenceMark™ values may be generated and superimposed in response to the operations performed on the camera. For example, when the camera is operated to change its filter setting, shutter speed or gain setting, the reserved word “_FilterChange,” “_ShutterSpeedChange” or “_GainChange” as part of those shown in
[0093] In the foregoing examples, EssenceMark™ text data was shown generated and superimposed onto the VBI area of the HD-SDI signal. Alternatively, it is possible to generate text data with meaningful words other than those of EssenceMark™, and to superimpose such text data onto video signals in a format other than that of the HD-SDI signal.
[0094] It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factor in so far as they are within the scope of the appended claims or the equivalents thereof.