SYSTEM AND METHOD FOR USING DIGITAL TECHNOLOGY TO PERFORM STEREO AERIAL PHOTO INTERPRETATION

Abstract

A system for performing stereoscopic views of digital photographs using a high resolution, retina display monitor, one or more lens stereoscopes positioned over a plurality of computer loaded images that has been pre-positioned and properly zoomed in for comparative purposes. A method for using the aforementioned system to perform 3D aerial photograph interpretations on digital only, rather than analog, images sent to the system and properly aligned/positioned on a high-resolution monitor using one or more positioned lens stereoscopes.

Claims

1. A system for performing 3D aerial photograph interpretations on digitally supplied images, said system comprising: (i) a display monitor having a resolution and pixel density of 300 or more pixels per inch, said display monitor configured to stand flat on a raised platform with all power and computer connections readily fitting under said raised platform; (ii) means for delivering to the display monitor photographs of a target area in a scan resolution of at least about 7 microns; (iii) means for zooming in on said photographs and rotating said photographs to provide a split screen image of the target area on the display monitor; and (iv) at least two lens stereoscopes, each lens stereoscope on its own stand made from a plurality of leg supports, said at least two lens stereoscopes being spaced apart from each other and resting directly on the display monitor to observe and perform 3D interpretations of the target area.

2. The system of claim 1, which delivers photographs to the display monitor in a scan resolution of at least about 12 microns.

3. The system of claim 1 wherein the display monitor has a plurality of leg supports at least temporarily attached to its rear surface.

4. The system of claim 4 wherein each of the plurality of leg supports is separately height adjustable.

5. The system of claim 1 wherein a bottom to each of the plurality of leg supports of the at least two lens stereoscopes is covered with tape or felt to prevent the leg bottoms from scratching the display monitor while using the at least two lens stereoscopes to perform 3D interpretations of the target area.

6. The system of claim 1 wherein the photographs supplied to the display monitor are from original negatives.

7. The system of claim 1 wherein the photographs supplied to the display monitor are in at least stereo-pairs of the target area.

8. The system of claim 7 wherein the photographs supplied to the display monitor are in stereo triplets of the target area.

9. The system of claim 1 wherein the photographs supplied to the display monitor are arranged vertically side-by-side.

10. The system of claim 1 wherein the photographs supplied to the display monitor are taken aerially over the target area in an overlapping sequence.

11. The system of claim 1 wherein the zooming and rotating means includes using a graphics editing software.

12. A method for performing 3D aerial interpretations of digital-only supplied aerial photographs of a target area at two or more different points in time for conducting a comparative analysis of differences in the target area over the two or more different points in time, said method comprising: (a) providing a system consisting of: (i) a display monitor having a resolution and pixel density of 300 or more pixels per inch, said display monitor configured to stand flat on a raised platform with all power and computer connections fitting under said platform; (ii) means for delivering to the display monitor a plurality of digital photographs of the target area in a scan resolution of at least about 7 microns; (iii) means for zooming in on a common area in plurality of digital photographs of the target area and rotating said digital photographs to provide vertically viewable, split screen images of the common area on the display monitor; and (iv) one or more lens stereoscopes for resting directly on the display monitor without scratching or otherwise damaging the display monitor; (b) delivering to the display monitor the plurality of digital photographs of the common area at two or more different points in time; (c) zooming and rotating the plurality of digital photographs for examining side-by-side the common area on the display monitor at two or more different points in time; (d) providing one or more lens stereoscopes, each stereoscope resting on its own stand comprised of a plurality of leg supports, said one or more lens stereoscopes adapted for being manually spaced apart and positioned directly on the display monitor; and (e) performing at least one stereoscopic aerial interpretation looking through said at least two lens stereoscopes resting on the display monitor for noteworthy visual differences in the common area at two or more different points in time.

13. The method of claim 12, which delivers photographs in a scan resolution of at least about 12 microns.

14. The method of claim 12 wherein the display monitor has a plurality of leg supports at least temporarily attached to its rear surface.

15. The method of claim 14 wherein each of the leg supports is separately height adjustable.

16. The system of claim 14 wherein a bottom to each of the plurality of leg supports of the at least two lens stereoscopes is covered with tape or felt to prevent the leg bottoms from scratching the display monitor while using the at least two lens stereoscopes to perform 3D interpretations of the target area.

17. The method of claim 12 wherein the zooming and rotating means includes a graphics editing software.

Description

BRIEF DESCRIPTION OF THE DRAWING(S)

[0021] Further features, objectives and advantages of this invention will be made clearer with the following Detailed Description made with reference to the accompanying drawings in which:

[0022] FIG. 1 is a side-by-side, split perspective view showing a PRIOR ART system that includes using on the left side, a close up of a typical Bausch & Lomb Zoom Stereoscope ZS over a photograph P, the right side of this perspective view adding a laptop L (Note that this known, PRIOR ART system was only used for making monoscopic comparisons and producing report illustrations);

[0023] FIG. 2 is a diagram showing some terminology and relative geometric relationships for a stereoscopic model viewing an overlap O between two photographs 1 and 2, taken in the same aerial direction (arrow A) said view being what an observer creates mentally;

[0024] FIG. 3A is a diagram showing an eye base, or interpullary distance IPD between the separation S of photographs P1, P2 when stereoscopic viewing using a lens stereoscope LS;

[0025] FIG. 3B is a diagram showing an interpullary distance IPD for an effective eye base EEB using a mirror stereoscope MS (that has an adjustable viewing width) to view a pair of photographs P1, P2 that are distinctly kept apart by a known separation S;

[0026] FIG. 4 is a diagram showing an idealized flight plan (mapping) with numerous vertical photographs (numbered 1 through 11) taken with 60% overlap along flight path lines and a 25-30% sidelap between adjacent flight lines (such overlaps providing the opportunity for several different, high quality stereo views);

[0027] FIG. 5 is a top perspective view showing one embodiment of the system of this invention used for stereoscopically viewing on a retina screen display RSD with separate, spaced apart lens stereoscopes LS1 and LS2 to inspect and analyze for comparison purposes of aerial photographs Y1L, Y1R (for year 1971) and Y2L, Y2R (for 1977) of the same industrial site IS;

[0028] FIG. 6 is a top plan view of the system from FIG. 5 showing the layout of the same four photographs Y1L, Y1R, Y2L and Y2R on the retina screen display RSD with the two separate lens stereoscopes LS1 and LS2 positioned thereon for making comparisons per this invention;

[0029] FIG. 7 is a bottom perspective view showing one means for supporting the external flat RSD monitor using corner legs CL1, CL2, CL3 and CL4 for comfortable viewing on a work table (not shown), perhaps over many hours (Note: because cables (also not shown) connect to the back of monitor RSD, through cable connect portals CCP1, CCP2 and power outlet PO, the monitor cannot simply be laid flat on a viewing/work table). Also note that the bottoms to these corner legs are preferably covered with tape or felt in order to prevent the legs from scratching the display monitor while using the two lens stereoscope to perfrom 3D interpretations of a target area;

[0030] FIG. 8 is a perspective view showing a desktop arrangement per one system of this invention (left side), comprising a pair of spaced lens stereoscopes LS1 and LS2 atop a photograph P1 displayed on a monitor RSD, the whole of that system sitting adjacent a prior art-analog viewing system with its own Zoom Stereoscope ZS for viewing a diapositive film stereogram P2, said desktop further including a report-writing laptop L to the far right (Such a side-by-side, dual setup is needed because only a few years of aerial photography for a given site will be available as film reproductions, while the remainder (i.e., majority) will be available as digital scans); and

[0031] FIG. 9 is a top plan view showing a monitor RSD set for displaying and then stereoscopically examining, through two separate lens stereoscopes LS1, LS2 four different year pairs (left and right) Y1, Y2, Y3 and Y4 of aerial photographs for the same site per the present invention.

DETAILED DESCRIPTION OF THE INVENTION

[0032] Until the present invention, it has not been possible to easily observe, in stereo, from scanned historical aerial photographs digitally displayed on a computer screen without quite expensive hardware and software systems. Even if this capability was on hand, a GIS (Geographical Information System) setup effort greatly increases the cost of such an endeavor. As such, it has not been possible for environmental investigators to quickly, yet easily observe stereo aerial photographs that are only available in digital form.

[0033] Admittedly, the computer and digital entertainment industries have been moving forward at a rapid pace. For example, the computer gaming arena has constantly sought more realistic and detailed presentation of the virtual battlefield. Similarly, large-screen television sets and computer monitors have required more and more pixels to present an attractive, sharp picture. New computer displays have appeared under various names such as Retina Display, ultra-high definition TV, 4K monitor, 5K monitor, etc.

[0034] The application of this technology to historical API began with experiments using inexpensive, smartphone stereoscopes such as the Speck stereoscope and the Google Cardboard. The input digital files and native resolution of a phone does not permit a satisfying viewing experience, however.

[0035] The appearance of Retina Display Monitors for laptop computers changed all of this! Although first perceived as an advertising and marketing ploy, it has had a very real impact on visual display interpreting. The average laptop computer has a screen with perhaps 1200 to 1800 pixels across its screen from left to right. The new Retina Display screens boasts 2850 pixels across its screen. Early experiments on a laptop screen showed that scanned aerial photos could be very adequately viewed, in stereo, on such equipment. However, it was awkward and uncomfortable because of the ergonomics of trying to position a stereoscope over one's laptop screen. In addition, a laptop computer might not allow itself to be laid completely flat on the viewing area/table.

[0036] Per the present invention, using an external monitor hooked up to the laptop solves the foregoing problems. Thus, the image processing software and report writing software would operate on the laptop monitor, while the display of the one or more stereo aerial photos would occur exclusively on a 21-inch Retina Display 4K Monitor sitting flat on the desk with a lens stereoscope sitting directly thereover. FIG. 6 shows this configuration in use for comparing two different years of aerial coverage for a given site.

[0037] The mechanics of making all that come together comfortably, took some experimentation. However, it did succeed. Several, months-long environmental investigations have been completed, almost exclusively, based on these techniques. And an operating procedure has now been defined.

Operating Procedure

[0038] 1. Obtain the highest quality, highest resolution scan images of the aerial photographs for the time periods needed. [0039] Scan resolution should be at least 12 microns, but much better: 7 microns. [0040] Scans should be done from the original negatives, where possible. [0041] Stereo pairs (or triplets) should be ordered; also redundant coverage from adjoining flight lines can prove quite beneficial.

[0042] 2. Pre-process the individual frames of photography. [0043] Clip out the target area from each of the exposures carefully labeling each. [0044] Use DIP techniques to enhance and match the target clips. [0045] If they are from the same flight line, rotate each image 90 degrees and save this version of the photo. (Note: Shadows pointing down screen are best, when possible.)

[0046] 3. Using ADOBE PHOTOSHOP (i.e., a software program developed by ADOBE to allow its users to edit graphics), pull up two of the corresponding stereo images on the external monitor. [0047] Use the following menu procedure to position the photos correctly for stereo viewing: [0048] WINDOW/ARRANGE/TILE ALL VIEWS VERTICALLY [0049] Zoom and reposition the images until you see the left and right photos side-by-side. [0050] Position the two photos so that corresponding images are about 55 mm apart.

[0051] 4. Place a lens stereoscope over the monitor and adjust until stereo viewing is comfortable. [0052] If a reverse stereo is encountered, drag the photo on the left to the right side. [0053] If little to no stereo is observed, change the rotation of the images by 90. [0054] Zoom and reposition the two photos, individually, as appropriate.

[0055] 5. Begin interpreting the stereo-pair and writing the report on the laptop screen.

Some Working Guidelines

[0056] The success of any stereo photograph interpretation depends on having good quality images to begin with. The importance of scan resolution was stressed above, if small details are necessary to the investigation. If photos from adjoining flight lines are used (per FIG. 4), rotation of the images will not be necessary.

[0057] In general, a good operating procedure for photographic comparisons starts by cutting out the target area from a stereo-pair. Save those files with an X attached to the end of the filename. Then rotate each of the two images 90 degrees, and resave the files, with a Y attached to the filename. In this way, the Y-files can be used for standard observation along one flight line, and the X-files for observation across two flight lines. This is mentioned, because for a variety of stereo views, it is often very helpful to identify and then interpret small details, or very subtle features, like ground stains from pollutants.

[0058] Such methodology also permits very easy comparisons of different years of target coverage. The procedure would be to get the first year of coverage displayed as described above, then open two photos in the same way for another flight year. After doing this, use the procedure to WINDOW/ARRANGE/TILE ALL VIEWS VERTICALLY once more, then zoom and move about the two images until your two stereo-pairs are displayed side by side. Such comparisons are most easily made by positioning two separate stereoscopes over the same visual display monitor, before shifting between the two scopes, back and forth, from one to the other. In this same fashion, further comparison stereo-pairs can be opened at the same time, and very easily viewed.

[0059] It is easily possible to compare stereo-pairs from four different photo flights (i.e., eight photographs) on the same screen. FIG. 9 illustrates this setup. This is an enormous advantage over traditional film viewing techniques, when trying to create a history for a polluted, industrial site, or any other features being studied through time.

[0060] In conclusion, this procedure allows the detailed interpretation of industrial scenes in good stereo from digital input materials. Although the level of zooming, and quality of stereo imagine may not be as good as film diapositives made from the original negatives, such diapositives are being less and less available for use in these types of side-by-side comparisons. Of course, some actual film reproductions are still available on a very limited basis. Hence, a well-equipped photo interpreter must be able to use either method, and compare images side-by-side, from different media types.

[0061] Having described the presently preferred embodiments, it is to be understood that this invention may also be embodied in the scope of the appended claims.

SEQUENCE LISTING

[0062] Not applicable.