SPECTACLE LENS SHAPE MEASUREMENT METHOD

20220397389 ยท 2022-12-15

Assignee

Inventors

Cpc classification

International classification

Abstract

A method of measuring lens shape of a spectacle lens, the method comprising: a) providing a spectacle lens on a surface; b) providing an image recording apparatus comprising a camera and a display; c) positioning the image recording apparatus so that the camera is largely parallel to the surface; d) capturing an image of the spectacle lens, the captured image comprising a total surface area of a camera-facing side of the spectacle lens; e) indicating positions of features of the spectacle lens in the captured image; and f) measuring a shape of the spectacle lens and determining image coordinates of the spectacle lens features.

Claims

1. A method of measuring lens shape of a spectacle lens, the method comprising: a) providing a spectacle lens on a surface; b) providing an image recording apparatus comprising a camera and a display; c) positioning the image recording apparatus so that the camera is largely parallel to the surface; d) capturing an image of the spectacle lens, the captured image comprising a total surface area of a camera-facing side of the spectacle lens; e) indicating positions of features of the spectacle lens in the captured image; and f) measuring a shape of the spectacle lens and determining image coordinates of the spectacle lens features.

2. The method of claim 1, wherein the spectacle lens is marked with an axis line and a centering point prior to being placed on the surface in step a).

3. The method of claim 1, wherein in step b) an image background is first provided on the surface, which is flat, before the spectacle lens is placed thereon.

4. The method of claim 3, wherein the image background comprises a plurality of computer readable markers in a predefined area and intersecting horizontal and vertical lines.

5. The method of claim 4, further comprising aligning the spectacle lens with the intersecting horizontal and vertical lines of the image background.

6. The method of claim 5, wherein [in step d),] the image recording apparatus is positioned for image capture, in relation to the intersection of the horizontal and vertical lines, directly above the intersection, above the intersection along the vertical line, below the intersection along the vertical line, left of the intersection along the horizontal line, or right of the intersection along the horizontal line.

7. The method of claim 1, wherein the image recording apparatus comprises at least one spatial orientation and/or spatial scanning sensor.

8. The method of claim 6, wherein the image in step d) is captured automatically when an output of the at least one spatial orientation sensor indicates that the image recording apparatus is in a largely horizontal position with the camera pointed at the surface and/or the image background is present in a video feed of the image recording apparatus.

9. The method of claim 8, wherein the image is automatically captured when the image background fills the display of the image recording device and a preset number of computer readable markers are visible in the image.

10. The method of claim 1, wherein in step d), the image recording apparatus is placed at a distance of 10 to 20 cm from the spectacle lens.

11. The method of claim 3, wherein capturing the image of the spectacle lens in step d) comprises capturing the image background, on which the spectacle lens is placed, in its entirety.

12. The method of claim 11, further comprising of recording spatial orientation sensor data in step d).

13. The method of claim 1, wherein the image of the spectacle lens is captured by drawing an outline of a perimeter of the lens directly on the image background or by tracing an outline of an inner rim perimeter of a spectacle frame adapted to fittingly hold the spectacle lens therein directly on the image background, and subsequently capturing an image of the outline of the perimeter of the lens or the outline of the inner rim perimeter with the image recording apparatus.

14. The method of claim 1, wherein the captured image is verified prior to step f) by comparing the image of the spectacle lens with an overlay displayed on the image recording apparatus.

15. The method of claim 1, wherein the features of the spectacle lens comprise an axis line, or the axis line and one or both of a centering point and at least two drill holes.

16. The method of claim 1, wherein the measuring of step f) comprises measuring one or more of a perimeter length, geometric shape, lens height, lens width, lens thickness, and diameter of the spectacle lens.

17. The method of claim 16, further comprising indicating and determining coordinates for one or more of: an axis line, a centering point and at least two drill holes in relation to the measured lens perimeter.

18. The method of claim 16, further comprising step g) deriving a corrective power of the lens from the measured lens thickness.

19. The method of claim 1, wherein the image recording apparatus transmits the captured image of step d) to a second electronic device, either directly or through an external server, and indicating step e) and measuring step f) are then performed on the second electronic device.

20. The method of claim 1, wherein method steps c) and d) are repeated to provide a plurality of captured images of the spectacle lens, whereby a three-dimensional representation of the spectacle lens is generated from/based on the plurality of captured images.

21. A system comprising: an image recording apparatus comprising a display and at least one spatial orientation sensor, the image recording apparatus configured to capture and display an image; a computer comprising a graphical user interface; and a non-transitory computer readable program for causing the computer to perform the following steps when executed: instructing a user to capture an image of the spectacle lens; instructing the user to verify the captured image; instructing the user to indicate features of the spectacle lens in the captured image; measuring a shape of the spectacle lens; and transmitting data of the captured image to a secondary device.

22. The system of claim 21, wherein the image recording apparatus further comprises at least one spatial scanning sensor.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The present disclosure will be discussed in more detail below, with reference to the attached drawings, in which:

[0026] FIG. 1 shows an image recording apparatus in image capture position of a lens placed on an image background.

[0027] FIG. 2 shows a close-up view of the lens with an axis line and lens marking points.

[0028] FIG. 3 shows the frontal side of the image recording apparatus.

[0029] FIG. 4 shows image recording apparatus in image capture position of a lens without image background.

[0030] FIG. 5 shows the back side of the image recording apparatus.

[0031] FIG. 6 shows a flow chart depicting a process of measuring lens shape.

DETAILED DESCRIPTION

[0032] FIGS. 1 and 4 show positioning the image recording apparatus 20 in relation to the lens 10 which is being measured. Image recording apparatus 20 is largely parallel to a surface on which the lens 10 is placed. Surface on which the image background and/or lens is placed is for example a table, a workbench, a shelf or conveyor belt, which is substantially parallel to the horizontal plane perpendicular to the gravity vector.

[0033] Image recording apparatus 20 camera 26 is aimed towards the central portion on the lens 10 using the real-time video feed shown on the image recording apparatus 20 display screen 22.

[0034] Image recording apparatus 20 is a handheld electronic device, for example, a smartphone, a tablet computer or other handheld device which is capable of capturing an image, has an interactive display screen, computational hardware, and typically has spatial orientation sensors such as gyroscopes and accelerometers as well as a microphone and a sound speaker. The image recording apparatus 20 can include a computer system, software, an application and/or other configuration to perform at least one or more steps of method 100 shown in FIG. 6.

[0035] FIG. 1 also shows an image background 40, which is placed on the surface prior to placing the lens 10 on the image background 40 before capturing an image with the image recording apparatus 20. Image background 40 is made of printed medium made from paper, cardboard, plastic or other printable material, and is printed with a predetermined pattern of computer readable markers 41, within an area 48, horizontal line 44 and vertical line 46. All the above-mentioned elements of the predetermined printed pattern of the image background 48 can be represented in various colors for aiding the measurement process and/or aesthetic reasons. The purpose of the image background 40 is to provide data needed by computer vision routines to measure a lens, such as scale of the image, position of the image capture apparatus 20 in relation to the image background 40, orientation and positioning of the lens 10 and providing image contrast. In particular, predetermined placement of computer readable markers 41 enable computer vision routines to perform above mentioned measurements.

[0036] In FIG. 2 the lens 10 is shown in detail, and represents either left- or right-hand side lens of an associated spectacle frame. The lens 10 shows an axis line 12, which is drawn by the user and is a line parallel to the line that bisects both spectacle lenses height-wise. The purpose of the axis line 12 is to determine appropriate orientation of the measured shape of the lens 10. Optionally, axis line 12 is omitted and lens orientation is determined by other methods, such as analyzing lens shape image with lens shape with a known orientation for example as specified in technical drawings of the associated spectacle frame. Additionally, FIG. 2 shows lens marking points: centering point 14 and drill holes 16. Centering point 14 indicates the center of the pupil of the wearer while wearing spectacles and is used in lens and/or spectacle manufacture. It is a user-made mark on the lens, placed there with a writing instrument such as a permanent marker, or a virtual point defined by coordinates relative to the spectacle frame entered by the user in the appropriate part of the user interface of the image recording apparatus 20. Drill holes 16 are only present when the lens 10 is associated with rimless spectacles, and are used to assemble the said rimless spectacles by fastening the lenses with the spectacle bridge and temples.

[0037] FIGS. 3 and 5 show details of the image recording apparatus 20. In FIG. 3 front side of the image recording apparatus 20 is shown, depicting the display screen 22 and an image capture icon 24. Back side of the said image capture apparatus 20 is shown in FIG. 5. Including the camera 26, spatial scanning sensor 28 and illumination component 29. Spatial scanning sensor 28 may employ electromagnetic and/or sound waves to accurately determine the position of the lens 10 in relation to the image recording apparatus 20, as well as scan surface of the lens 10. Illumination component 29 may be a LED light which is used to enhance light conditions during image capture process described in step 106 of process 100 depicted in FIG. 6.

[0038] Optionally, the camera 26 and the spatial scanning sensor 28 are part of an attachment fitted to the image recording apparatus 20. Data connection between such an attachment is established by a physical data connection or via wireless data communication.

[0039] A preferred embodiment of the present disclosure is shown in FIG. 1. The lens 10 is placed on the image background 40 above which the image recording apparatus 20 is positioned at a typical distance of about 10 to 20 cm from and largely parallel to the image background 40 with the camera 26 facing downwards. The image background is preferably placed on the surface. The lens 10 is placed on the image background 40 so that the axis line 12 aligns with and overlaps the horizontal line 44, while the vertical line 46 approximately bisects the lens 10 width-wise.

[0040] In a preferred embodiment, image recording apparatus 20 camera 26 is aimed at the lens 10 resting on the image background 40 so that the entire surface of area 48 of the image background is shown on the display screen 22 via real-time video feed from camera 26. It is desirable for the image background area 48 to fill the whole display screen 22 symmetrically, and in particular with respect to the width of display screen 22. Optionally, the image apparatus 20 contains data output from one or more spatial orientation sensors (not shown), which aid the user in correct aiming of the camera 26. In this regard, the data output from the one or more spatial orientation sensors can be used to provide visual and/or audio guidance instructions to the user.

[0041] Once the image recording apparatus 20 is positioned correctly the user captures the image by tapping the image capture icon 24 on the display screen 22. Alternatively, image capture is performed by the user giving a voice command recorded by the image recording apparatus microphone (not shown) instead of tapping the image capture icon 24. Optionally, the user indicates the positions of one or more lens features: the axis line 12, the centering point 14 and drill holes 16 in the captured image displayed on the interactive display screen 22 thus indicating their coordinates in the captured image.

[0042] Next, the captured image is analyzed employing computer vision routines by the computational hardware of the image recording apparatus 20 measuring the shape of the lens 10. One or more measurements are made at the conclusion of the aforementioned analysis, such as geometrical shape of the lens 10, length of its perimeter, its height and width, and coordinates of the lens marking points.

[0043] In an embodiment, image capture is performed automatically by the image recording apparatus 20 without user input by computational analysis of the real-time video feed recorded by the camera 26, triggering image capture once image background 40 fills the screen width-wise and all computer readable markers 41 are visible. Optionally, data from spatial orientation sensors of the image recording apparatus 20 are included in the criteria used to trigger image capture in order to increase accuracy of the captured image and lens shape measurement.

[0044] In an embodiment, a number of images of the lens 10 placed on the image background 40 are taken with the purpose of computing a 3-dimensional representation of the lens 10. The number of images taken may be any positive integer, including but not limited to, 1, 2, 3, 4, 5, 10 or more images. The 3-dimensional representation may enable or facilitate more accurate measurement(s) of the lens 10. In addition to the default position of the image recording apparatus 20 being placed largely parallel to the surface of the image background 40, the image recording apparatus may be placed in at least one additional position in relation to the intersection of horizontal line 44 and vertical line 46. These additional positions can include positioning: above the intersection along the vertical line 46, below the intersection along the vertical line 46, left of the intersection along the horizontal line 44, and right of the intersection along the horizontal line 44. For all of the above-mentioned additional positions, the aiming point of the camera 26 is the intersection of horizontal line 44 and vertical line 46. In this regard, the image recording apparatus 20 is not positioned largely parallel to the image background.

[0045] FIG. 3 shows verification of the lens shape measurement. Here, the user is presented with the captured image with an overlay 25 of the lens shape perimeter drawn on the display screen 22 from the output generated by computer vision routines analyzing the lens 10. Next, the user compares overlay 25 of the lens shape with the image of the lens 10. If they align, the user completes the measurement process by tapping the image capture icon 24 and/or giving a voice command recorded by the image recording device microphone. Otherwise, the process of image capture, lens shape measurement and analysis is repeated.

[0046] In an embodiment, comparison of the lens shape overlay 25 with the image of the lens 10 can be done computationally on the image recording apparatus 20 or on another device by analyzing the gap in the captured image between the overlay 25 and the image of the lens 10. Optionally, other methods of image analysis, such as statistical analysis of multiple captured images' lens perimeters and associated overlays, may be used to compare the shape and dimensions of the overlay 25 and the lens image 10 to verify the output generated by computer vision routines. Optionally, image capture icon 24 enables transfer of the captured image, spatial orientation sensors' data, and/or lens shape measurements to a computer system selected by the user in a format selected by the user in the user interface, such as data file formats used by various lens ordering and/or production systems. This data is transmitted by means of an email or other type of electronic message sent to an email address or other type of electronic inbox and/or computer system. The communication and data transfer between image recording apparatus 20 and other computer devices and/or systems can be through a network data connection, or through a wireless data connection.

[0047] As shown in FIG. 4, the lens 10 is placed on the surface without the image background 40. Data provided by the image background 40, and in particular the position of the lens 10 relative to the image recording apparatus 20, is instead determined computationally from data provided by the spatial scanning sensor 28 of the image recording apparatus 20. In this case, the time electromagnetic and/or sound wave traveling from and reflected back to the spatial scanning sensor 28 is measured, and this measurement is then used to calculate the distance.

[0048] Optionally, the data collected by the spatial scanning sensor 28 upon a full scan the surface of the lens 10 is used to construct 3-dimensional digital model of the lens 10 used for more precise measurement of the lens shape, thickness and calculation of the corrective power of the lens 10. For measurement of the corrective power of the lens 10, at least one image of the lens 10 with the concave side facing the camera 26 and at least one image of the convex side facing the camera are taken. Corrective power is calculated by comparing the 3-dimensional shapes of the convex side with the concave side, thereby determining precise lens thickness over its entire surface. Several images of the lens 10 may be captured along with corresponding spatial scanning data in order to increase measurement precision.

[0049] The orientation of the lens 10 may be established by user input indicating the position of the axis line 12 in the captured image. Alternatively, the position of the axis line 12 can be determined computationally using computer vision routines on the captured image without the need for user input by analyzing the image of the lens surface for a line drawing.

[0050] FIG. 6 shows a method 100 of steps, which are discussed in relation to FIGS. 1-5:

[0051] Step 102: Placement of the spectacle lens on the image background.

[0052] The lens is placed in the middle of the image background 40. In other embodiments, the lens may be placed on the surface without the image background as shown in FIG. 4. Preferably, the lens is provided with an axis line prior to positioning on the image background, though it is foreseeable that the axis line could be provided on the lens after it is positioned on the image background.

[0053] Step 104: Alignment of the spectacle lens with horizontal and vertical lines.

[0054] The lens 10 is aligned with the image background 40 so that axis line 12 overlaps with the horizontal line 44 while the vertical line 46 approximately bisects the lens width-wise as shown in FIG. 1. For an embodiment such as one shown in FIG. 4, this step may be skipped.

[0055] Step 106: Positioning of the image recording apparatus and image capture.

[0056] In this step, the user positions the image recording apparatus 20 so that the image background 40 fills the screen, as shown in FIG. 1, and taps the image capture icon 24 or gives a verbal command to capture the image. Optionally, this process can be aided by data from spatial orientation sensors. In an embodiment, image capture may be performed automatically without user input, triggered by video feed and/or sensor data analysis.

[0057] Step 108: Image verification.

[0058] In this step the user performs a visual inspection of the captured image as shown in FIG. 3. Optionally, this step can be performed automatically by analyzing the image using computer vision routines without user input. If the image satisfies predetermined criteria as described herein, such as when the image background fills the screen width-wise and all of the computer readable markers are visible in the image, the process proceeds to step 110; or when the predetermined criteria are not satisfied, the process instead proceeds to step 109.

[0059] Step 109: Repositioning of the image recording apparatus.

[0060] The user repositions the image recording apparatus so that lens is aligned with background image and/or background image fills the entire screen on the image recording apparatus.

[0061] Step 110: Indication of lens marking points on the lens.

[0062] The user indicates the lens marking points on the captured image shown on FIG. 3. At least one lens marking point is indicated, but any number of marking points can be indicated. If no lens marking points are present this step may be skipped.

[0063] In an embodiment, the centering point 14 is indicated by user entry of image and/or frame coordinates on the image recording apparatus. In an embodiment, the user indicates the position of the axis line 12 in the captured image.

[0064] Alternatively, step 110 may be performed automatically without user input by computer vision routines analyzing the captured image.

[0065] Step 112: Measurement of lens shape and dimensions.

[0066] This step is performed computationally by computer vision routines, the output of which may include a geometrical shape of the lens, a lens perimeter length, a lens height, a lens width, and/or a lens diameter. Optionally, coordinates of the lens marking points and/or axis line in the captured image are measured. In an embodiment, step 112 is performed by a computational device, separate from the image recording apparatus 20, based on recorded data electronically sent from the image recording apparatus to the computational device.

[0067] Step 114: Data transmission.

[0068] All or part of the data relating to the measurements and/or the measurements themselves may be transmitted by the user from the image recording apparatus to a separate computer system or other electronic device such that lens and/or spectacle manufacture may proceed; in the alternative the data may be automatically transmitted between the electronic devices.

[0069] While the present disclosure has been described with reference to exemplary embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the present disclosure. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the present disclosure without departing from the essential scope thereof. Therefore, it is intended that the present disclosure not be limited to the particular or preferred embodiments disclosed, but that the present disclosure will include all embodiments falling within the scope of the appended claims.