Display system and method

10765314 ยท 2020-09-08

Assignee

Inventors

Cpc classification

International classification

Abstract

A system for improving a patient's vision, comprising means for diagnosing and monitoring a deterioration in macular vision or macular vision loss in the patient's eye, and means for augmenting the use of a preferred retinal location (PRL) and eccentric fixation in case the deterioration in macular vision or macular vision loss was detected. A method for improving a patient's vision, comprising: diagnosing and monitoring a deterioration in macular vision or macular vision loss in the patient's eye; and augmenting the use of a preferred retinal location (PRL) and eccentric fixation in case the deterioration in macular vision or macular vision loss was detected.

Claims

1. A system for improving a patient's vision, comprising: a. means for diagnosing and monitoring a deterioration in macular vision or macular vision loss in a patient's eye, comprising means for testing and mapping a retina by scanning the retina, and b. means for augmenting the use of a preferred retinal location (PRL) and eccentric fixation in case the deterioration in macular vision or macular vision loss was detected; wherein the diagnosing and monitoring means, and the augmenting means, further including means for applying a focalized stimulus to one location on the retina at a time; and wherein the applying means further including eye tracker means for measuring a gazing direction of the patient's eye and means for changing the location of the focalized stimulus accordingly, so as to keep the stimulus on the same location on the retina.

2. The system for improving a patient's vision according to claim 1, wherein the system has several modes of operation including Mapping, Training, and Supervisor/Monitor, and further including means for selecting one of the modes of operation for use as desired.

3. The system for improving a patient's vision according to claim 2, further including means for defining and registering a most suitable retinal locations for PRL, based on the results of the diagnosing and monitoring a deterioration in macular vision or macular vision loss, and wherein the most suitable retinal locations for PRL is defined as the location in the peripheral retina having the least deterioration.

4. The system for improving a patient's vision according to claim 1, further including means for evaluating and registering performance results for each retinal location.

5. The system for improving a patient's vision according to claim 4, wherein the performance results for each retinal location include one or more of the following spatial and temporal parameters: visual acuity, reading acuity, reading speed, contrast sensitivity, crowding, reaction time, saccades, fixation stability, size of healthy area, color test, orientation discrimination and/or optical distortions.

6. The system for improving a patient's vision according to claim 1, wherein the means for augmenting the use of a PRL comprise means for training the patient to constantly focus the visual stimuli with the PRL and to develop a pseudo-fovea.

7. The system for improving a patient's vision according to claim 6, wherein the means for training the patient further include eye tracker means for measuring an eye gazing direction, and means for stabilizing an image on the retina based on results of the gazing direction measurements.

8. The system for improving a patient's vision according to claim 1, wherein the system is implemented as a stationary or portable system, comprising a display or displays, eye tracker means, processor means and control inputs.

9. The system for improving a patient's vision according to claim 8, further including a tri-dimensional (3D) system comprising 3D glasses and a 3D screen, to separate the PRL stimulus to each of the two eyes.

10. The system for improving a patient's vision according to claim 1, wherein the display is part of a personal computer (PC).

11. The system for improving a patient's vision according to claim 1, wherein the system is implemented as a portable system integrated in wearable goggles, and wherein the display or two displays comprise a micro-displays so devised as to present an image on the retina when the micro-display is located close to the eye, and further including a camera or two cameras attached to the goggles.

12. A device for treating patients with a retinal disease, comprising means for mapping multiple parameters of visual performance onto various locations on the retina areas, means for stabilizing an image displayed on each location using eye tracker means, and means for training the patient to constantly focus the visual stimuli with a most suitable retinal location (PRL) and to develop a pseudo-fovea.

13. The device for treating patients with a retinal disease according to claim 12, further including means for reducing visual crowding and visual noise from the visual stimuli, means for monitoring changes of the retinal performance, and means for achieving a rehabilitation function.

14. The device for treating patients with a retinal disease according to claim 12, further including means for moving the image displayed according to the PRL location.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) Embodiments of the invention are disclosed hereinafter with reference to the drawings, in which:

(2) FIG. 1 illustrates a normal eye field of view.

(3) FIG. 2 illustrates a normal eye, straight-on gaze.

(4) FIG. 3 illustrates a normal eye, right side gaze.

(5) FIG. 4 illustrates a macular scotoma, straight-on gaze.

(6) FIG. 5 illustrates a macular scotoma with deteriorated peripheral vision, straight-on gaze.

(7) FIG. 6 illustrates a mapping phase, with target at centerno image perceived.

(8) FIG. 7 illustrates a mapping phase, with target at left-up sideno image perceived.

(9) FIG. 8 illustrates a mapping phase, with target at left down side.

(10) FIG. 9 illustrates a mapping phase, with target at right down side.

(11) FIG. 10 illustrates a mapping phasevisual acuity evaluation various targets.

(12) FIG. 11 illustrates a mapping phaseevaluating visual acuity.

(13) FIG. 12 illustrates a mapping phaseconstant retinal location on display using eye trackers.

(14) FIG. 13 illustrates a mapping phasePRL determination.

(15) FIG. 14 illustrates a training phaseeliminating crowding on display.

(16) FIG. 15 illustrates a fixed color mask, gradient color changing mask.

(17) FIG. 16 illustrates a training phaseconstant PRL location on display using eye trackers.

(18) FIG. 17 illustrates a stationary (desktop) system basic setup.

(19) FIG. 18 illustrates a stationary (desktop) system block diagram.

(20) FIG. 19 illustrates a goggles system general view.

(21) FIG. 20 illustrates a goggles system near view.

(22) FIG. 21 illustrates a goggles system cutaway views.

(23) FIG. 22 illustrates a training method using a movable obscuring mask.

(24) FIG. 23 illustrates a method for activating modes of operation in the display system.

(25) FIG. 24 illustrates a human-machine interface for setting the system's mode of operation.

(26) FIG. 25 illustrates another method for activating modes of operation in the display system.

(27) FIG. 27 illustrates gazing direction stabilization using an eye tracker in a servo loop.

(28) FIG. 28 illustrates the operation of the servo loop in the Mapping and Training modes.

(29) FIG. 29 illustrates the operation of the servo loop in the Daily use mode.

DETAILED DESCRIPTION OF THE INVENTION

(30) The current invention will now be described by way of example and with reference to the accompanying drawings.

(31) Remark: In all pictures the symbol denotes the gazing direction 12 on the display is indicated with the symbol illustrated in FIG. 2C.

(32) Mapping and Monitoring of the Retinal Performance

(33) The retina will be tested and mapped. According to our novel method, all the area of the retina will be scanned by a focalized stimulus while preventing the rest of the retinal locations from receiving any visual stimuli. Thus, the patient visual attention will be concentrated on the stimulus only. The performance of each retinal location will be evaluated and registered. The size, shape and number of the distinct areas can be determined for each subject according to the retinal condition.

(34) Each retinal location will be tested for one or more of the following spatial and temporal parameters: visual acuity, reading acuity, reading speed, contrast sensitivity, crowding, reaction time, saccades, fixation stability, size of healthy area, color test, temporal JND (just-noticeable difference), orientation discrimination and/or optical distortions. The information, including test results with the time and date, will be recorded.

(35) After attaining retinal mapping, the most suitable retinal locations for PRL (one or more) can be defined and registered. The mapping procedure can be repeated periodically in order to monitor the retinal conditionthe location, the size and characteristics of this area can be modified according to the individual progress of the disease and the training paradigm.

(36) The Basic Test Process

(37) Let us assume that the patient has both a macular scotoma 32 and a peripheral scotoma 33, see FIG. 6B. Furthermore, let us assume that the patient has a PRL 34 at the location as shown. This PRL 34 is not known yet to the specialist performing the mapping test. The stimulus (e.g. as used on tumbling E charts) will be displayed on various locations on the display. The patient will be asked to identify the target orientation.

(38) The patient will indicate when he sees a target and can fixate on the target either by using an input device such as a computer mouse button or by vocal feedback. This step can be done also without patient participation by analyzing the eye tracker data for fixation.

(39) In FIG. 6A, the target 41 is located in the center of the display. The patient is gazing at the center of the display and, because of his macular scotoma 32, he sees nothing as shown in part B of this figure.

(40) In FIG. 7A, the target 41 is moved to the left-upper side of the display. The patient is gazing at the center of the display but because of his peripheral scotoma 33, he sees nothing as shown in FIG. 7B.

(41) In FIG. 8A, the target 41 is moved to the left-lower side of the display. The patient is gazing at the center of the display but, because of his general peripheral retina location which has a poor visionhe sees for example, a low resolution and contrast image 35 as shown in FIG. 8B.

(42) In FIG. 9A, the target 41 is located at the right-lower side of the display. The patient is gazing at the center of the display but, because of his PRL 34 located there, he has a better vision than in the previous step (of FIGS. 8A, 8B) thus seeing a better image as shown in FIG. 9B.

(43) Subsequently, the system moves the target 41B responsive to movements of the gazing direction 12, so as to keep the target 41B on the PRL 34, despite eye movements. See FIGS. 12A, 12B and 12C.

(44) Additional Features of the Test

(45) The mapping method can consist of different criteria, the decision on the best location for PRL could result from any of the criteria or a combination of a few of them.

(46) Such criteria could be found by using tests like: Visual acuity, contrast sensitivity, reading speed, fixation stability, crowding, reaction time, saccades, size of healthy area, color test, temporal JND (just-noticeable difference), orientation discrimination and/or optical distortions.

(47) Examples of some methods for performing some of these tests are listed below: The targets can be rotated in order to measure the visual acuity in multiple directions or orientations, as shown in FIGS. 10A and 11.

(48) The targets can be displayed in different sizes in order to measure the best visual acuity in every part of the retina, as shown in FIG. 10B.

(49) The targets can be displayed in different values of contrast and intensity in order to check the best sensitivity in every part of the retina as shown in part FIG. 10C.

(50) The targets can be constructed in any shape, color etc. They can be animated for better acquisition by the patient.

(51) In order to get reliable mapping results, it is critical that the location of the test targets will be at a fixed location in relation to the patient's gaze. This is usually done in current tests 10 by asking the patient to fixate on a fixation point while measuring his peripheral vision.

(52) However, the patient, especially at the early stages of the disease, has a tendency to move his (damaged) straightforward gazing direction on to the target, rather than using the (better vision) PRL.

(53) Thus, the peripheral vision through the PRL may be destroyed, without achieving any vision improvement, because of the macular scotoma 32.

(54) By using the eye tracker, the location of each target 41B on the display will be fixed in relation to the gazing direction 12, i.e., when the patient changes his gazing direction 12 during the test, the target 41B will move accordingly, thus ensuring that the stimulus, for each test, will be on a stationary location on the retina. See FIGS. 12A, 12B and 12C.

(55) A stationary stimulus will significantly improve vision (otherwise the image may be blurred); improved vision using our new system and method may result in further vision improvement by the patient in response, as patient's body collates together sensor cells and neurons for the PRL 34 at that location. Thus, a therapeutic effect may be achieved, wherein the body heals itself, aided and stimulated by our system and method.

(56) Using the eye tracker, the BCEA ellipse will be evaluated and scored. Each location will be assessed, quantified and scored to determine the best PRLssee FIG. 13.

(57) Training Method

(58) One of the main objectives of the present invention is to train the patient in using a PRL, or to help the patient to develop a PRL in a predefined, constant and limited area of the retina which is the patient's retinal location with the highest potential to become a pseudo-fovea.

(59) Instead of using a target image that has a visual information covering the whole area of the display (see FIG. 14A), the new system presents only limited information corresponding to the PRL (see FIGS. 14B and 14C), while preventing exposure of visual information from the rest of the retina.

(60) This non-crowded stimulation system and method will shorten the patient's learning curve, by eliminating competing areas of the retina which may otherwise intervene in the process of the PRL training. This system and method will also improve patient's vision fixation stability, and in general will ease up the process.

(61) The masking of the unnecessary information could be done in different ways such as a fixed color mask, gradient color changing mask, blurred image, etc. See FIG. 15.

(62) The location of the focalized stimulus is stabilized on the retina with the aid of eye trackersthat is, if the gazing direction changes, the focalized stimulus will move correspondingly, so as to keep the stimulus on the same location on the retina. Otherwise, the stimulus may appear as an indistinct blur and mapping may be hindered or may be impossible to perform.

(63) The trained parts of the retina, comprising either a single PRL or multiple PRLs, will be based on the mapping system explained above or supplied by any other measurement techniques. This will provide the patient a steadier fixation point. This technique will prevent the need of constant searching for the best location for a fixation point.

(64) In order to ensure the image information on a constant retinal location, the displayed image on the monitor corresponding to the PRL follows the eye gaze in real timesee FIGS. 16A, 16B and 16C. The information regarding the eye gaze (the gazing direction 12 for each eye) is received from an eye tracking device composed of a video camera and appropriate software or any other commercial eye tracking device.

(65) Alternative Training Method

(66) Following is a description of another embodiment of the training method, see FIG. 22.

(67) Unlike the abovedetailed training method, the target will not move with the change in the gazing direction, rather only the mask will move according to the gazing direction. The system will mask/deteriorate the entire image except the location of the desired good PRL. If the patient is gazing straight ahead, then only the lower/right part of the image will be displayed on the PRL area while the rest of the image will be deteriorated or completely masked away. See FIGS. 22A and 22B.

(68) If the patient is gazing up and left, only the middle part of the image will be displayed on the PRL area (which is now in the center of the displayed image) while the rest of the image will be deteriorated or completely masked away. See FIGS. 22C and 22D.

(69) Stimulating a retina constant location with the visual information will force this location to serve as the fixation point, since once eye gaze is changed, the eye tracking function will move the exposed area on the screen accordingly, thus preserving (exposing the image onto) a fixed area on the retina. Using the same location to fixate can serve as a training procedure, leading to an improvement in performance and subsequently enabling for this location to serve as pseudo-fovea.

(70) The patient will gain better fixation stability, visual acuity and contrast sensitivity performance. The area of the PRL can be determined by the size of the exposed visual information area, this area can be modified along the training, starting from a large area and narrow it, or the oppositeuse a small area at the beginning and then stretch it.

(71) In case where more than one PRL exists, this training method will force the patient to abandon his secondary locations and train the brain to develop only one primary PRL This will prevent confusion and the need to search for the best location.

(72) Basic Training Process

(73) PRL is defined through the mapping progress as described above, or by any other method. 1. Different masking methods (different colors, gradient, blurring, etc.) may be displayed to the patient to find his preferred method. 2. Different sizes and shapes of unmasked retinal areas may be displayed to the patient around his PRL to find his preferred shape, taking also in account the best size and shape for PRL training. 3. The mask will follow the eye tracking data as to preserve a fixed location of the exposed data on the PRL area. The patient will be asked to perform visual tasks, such as reading, smooth pursuit of a moving target, saccades from point to point, etc., while using his PRL for a predetermined time. This process will be repeated according the training program. 4. The system will record eye tracker data such as gaze direction, speed, pupil size, saccades, micro-saccades, tremor, etc.

(74) The system will analyze the progress by calculating and analyzing gaze change speeds, BCEA etc., will score the results and provide feedback to the patient/specialist. Based on the patient progress, the system will automatically decide when to change the various task parameters and enhance the training or terminate it.

(75) Some of the central retinal diseases are progressive. As a result, the PRL may change its position due to a progress of the disease. Since our method enables constant monitoring of the retinal performance, a reduction in the current PRL performance might lead to a new training for the next most suitable location for the next PRL.

(76) Forcing the patient to use a single, constant location for viewing may be used in standalone training.

(77) Other, prior art trainings techniques, can also be used in combination with the proposed method to enhance the development of the pseudo-fovea.

(78) Reducing visual crowding and visual noise from the visual stimuli by masking the area around the pseudo-fovea (either on the screen or the goggles) might be used not only in the training sessions described in this document, but rather in other normal activities performed by the patient such as reading, internet browsing, watching TV, handcrafting, writing, playing, etc. This way, the PRL development will be further enhanced.

(79) Apparatus

(80) Our novel method of training on a constant retinal location and limiting the visual information from the rest of the retina can be implemented in either one of two configurations, or in a combination of the two: a stationary (desktop) system, and a portable system with a wearable device such as goggles. 1. A stationary (desktop) system, in front of a computer display, where the entire image on the display 51 is masked around the target 41B corresponding to the PRL area.

(81) In FIG. 17, the patient 30 sits in front of a display 51.

(82) The system comprises a display 51, one (remote) or two (near the eye) eye trackers 52 (for each eye separately). The display 51 includes a link 53 to a computer such as a personal computer (PC).

(83) FIG. 18 shows a block diagram of the stationary (desktop) system, which includes a display 51, connected to a processor 55. Also shown is the link 511 conveying display signals from the processor 55 to the display 51.

(84) The display 51 can be a part of a PC, laptop computer, tablet, smart phone, television (TV) or the like. The software is programmed in the processing unit memory.

(85) The system further includes remote eye tracker means 52 for measuring the gazing direction of each eye. Signals 521 conveying in real time the gazing direction of each eye in two dimensions (azimuth and elevation) are transferred to the processor 55.

(86) If the patient is using glasses for optical correction for viewing the computer screen, he should use them during the training as well.

(87) If the retinal damage of the two eyes is significantly not symmetrical, a different PRL location will be tailored to each eye.

(88) In this case, a prism might be added to at least one side of the patient glasses, and the patient will use the prismatic spectacles also during the training. Alternatively, the patient might refrain from using the prismatic glasses and in this case a 3D system will be used (3D glasses and 3D screen) to separate the PRL stimulus to each of the two eyes. 2. A portable system with a wearable device such as goggles 6, see FIG. 19.

(89) In one preferred embodiment, a portable system comprises goggles 6 and a processing unit 61. The processing unit 61 can be reduced in size and thus embedded in the goggles 6. In the configuration as shown, the processing unit 61 is in a separate unit which is attached to the patient's belt, to reduce the weight of the goggles 6.

(90) In the embodiment illustrated in FIGS. 20 and 21, the system comprises one or two micro displays 62 (one for each eye separately), one or two eye trackers 63 (for each eye separately), corrective optics 65 if necessary, and a processing unit (not shown). Furthermore, the system includes a camera 64, or two cameras 64, one for each eye. The video of these scene cameras will go through all the processing explained in the present disclosure.

(91) The various components of the system are attached to the goggles 6 frame as shown. The software may be stored in the processing unit's memory.

(92) If the two eyes are significantly not symmetrical in terms of the retinal damage, optional advantageous would be to develop a different PRL position in each eye.

(93) In this case, a prism (not shown) might be added to at least one side of the patient glasses, and the patient will use the prismatic correction optics also during the training.

(94) Alternatively, the patient might refrain from using the prismatic glasses and the PRL stimulus will be presented at different locations for the two eyes separately on the two displays accordingly.

(95) The above description refers to a method wherein correction and/or treatment is applied concurrently to each of the patient's eyes.

(96) In another embodiment, only one eye will receive treatment and/or correction, whilst the other eye will look without any such improvements. Preferably, the eye with the better vision will receive correction and/or treatment.

(97) Eye trackers are well known devices, which are used for various applications in a variety of fields. They measure the gazing direction, gazing speeds, pupils size and more. They can provide this data for one eye or for each of the two eyes.

(98) Main Objects of the Present Invention

(99) 1. To map the best location for the patient's PRL by using eye-tracking and various criteria or a combination of a few criteria. 2. To ensure the patient's PRL is located at the optimal location. 3. To enhance the development of a pseudo-fovea at the most suitable PRL location. 4. To improve visual performance such as fixation, stability, saccadic movements, contrast sensitivity, visual acuity, reading speed and others. 5. To avoid patient's constant search for the right fixation point. 6. To reduce crowding by eliminating information from being presented on locations other than the PRL. 7. (Optional) To reduce visual noise by eliminating non relevant information from being presented on other retinal locations than the PRL. 8. To improve fixation stability and reduce the BCEA size. 9. To monitor the performance of the PRL to provide feedback for PRL training. 10. To monitor the performance of the PRL to decide if a new PRL should be found and trained. 11. To identify the best location for developing new PRL in case of degraded retinal performance and/or provide suggested foveal location with the best VA. 12. In case of performance reduction of the existing PRL, to train the patient in using the next most suitable one more effectively before the existing PRL is totally damaged.
Main Benefits of the Invention Over Existing Instruments and Methods 1. The new method offers a reliable accessible retinal mapping, monitoring and training for low vision patients with pathologies that affect the central retina. The retinal mapping, monitoring and training can be performed either at the patient location e.g. at home, at the clinic, or by using the goggles system, the training can be performed anywhere. 2. Ease of use: The operation of mapping, monitoring and training are very easy to use since all tasks are done with a constant PRL location as ascertained by eye tracking, in such a manner that prevents confusion with information from other retinal locations. 3. Reduce confusing visual clutter: Prior art methods for PRL training present a complete image to the patient, and use visual awareness, biofeedback using an eye tracker or practice in magnified text reading. This may confuse a patient, especially one with deteriorated vision.

(100) The new method, however, limits the visual information projected on the retina to only a predefined location (PRL). Eye tracking information is used to move the displayed image for the PRL (or image masking outside the desired PRL) on the monitor to follow the patient gaze, thus preventing the visual information from other areas outside the PRL. 4. Optionally, any prior art trainings PRL method may be used in combination with the new method of eliminating the information from the rest of the retina. 5. Prior art methods for locating the most suitable PRL use dedicated equipment which is available only at the specialist clinic, such as visual field tests or scanning laser ophthalmoscope. The new method can be performed at the patient's home using inexpensive equipment including personal computer, eye-tracker (video camera) and software.
Vision Improvement Method

(101) In one embodiment, the new method comprises the steps of: 1. Mapping the retina performance; 2. Identifying the most suitable location on the retina for developing a pseudo-fovea; 3. Training the most suitable location on the retina, to develop a pseudo-fovea; and 4. Monitoring the retinal performance, giving warning regarding changes in performance that might indicate a deterioration in the retina health.

(102) Additional details, as well as other embodiments of the present invention are detailed below.

(103) Modes of Operation of the Display System

(104) Referring to FIG. 23, the user can activate any of the modes of operation in the system. The modes of operation include Mapping, Training, Daily use and Supervisor/Monitor. a. Mapping 71the retina of each eye is tested and mapped, to find the most suitable retinal location for PRL. This location is then defined and registered, for subsequent use as well as use in the other modes of operation of the system.

(105) The PRL may be used to replace the damaged macula for use in reading and everyday life. FIGS. 1 to 13 and the related text detail operation of the system in the Mapping mode.

(106) Mapping may be performed using the system and method disclosed in the present invention, or using prior art methods.

(107) In either case, the location of the PRL 34 is stored in the system and is available in all the modes of operation therein.

(108) The result of mapping: two angular coordinates (azimuth and elevation) in a polar coordinate system, indicative of the location of the PRL 34 on the retina, with respect to the gazing direction 12 (for example see FIGS. 6 to 9, and 11 to 13).

(109) A stationary system usable for Mapping is illustrated in FIGS. 17 and 18 and the related text.

(110) Alternatively, a portable, wearable embodiment of the display system may be used in the Mapping mode. See for example the embodiment illustrated in FIGS. 19 to 21 and the related text. b. Training 72in this mode, the PRL found in the Mapping mode is stimulated so as to strengthen it, to further improve the patient's vision.

(111) Training methods are detailed with reference to FIGS. 14 to 16 and the related text.

(112) In Training mode, new vision-related connections are formed, thereby improving the patient's vision using the PRL.

(113) The stationary system illustrated in FIGS. 17 and 18 and the related text may also be used in Training.

(114) The portable, wearable embodiment of the display system may also be used in the Training mode. See for example the embodiment illustrated in FIGS. 19 to 21 and the related text. c. Daily use 73the patient may enjoy improved vision using the PRL found in the Mapping mode and enhanced in the Training mode.

(115) The new, portable, wearable embodiment of the display system may be used to further improve the patient's vision during daily use. See for example the embodiment illustrated in FIGS. 19 to 21 and the related text.

(116) Even without the display system, the patient may enjoy improved vision as a result of activities of the display system in the Mapping and Training modes. d. Supervisor/Monitor 74in this mode, past activities and patient's performance log may be reviewed and evaluated, and system's parameters may be adjusted responsive thereto, to adapt the system to the patient's characteristics, so as to achieve better results.

(117) Referring to FIG. 23, the user can activate any of the modes of operation in the system: Mapping 71, Training 72, Daily use 73, and Supervisor/Monitor 74.

(118) In the embodiment of the invention as shown, it is possible to switch from any mode of operation, to any other of the four modes.

(119) FIG. 24 illustrates a human-machine interface for setting the system's mode of operation. The computer display 75 which implements the interface may be presented to the user (i.e. a patient or a therapist), in any of the modes of operation shown in FIG. 23.

(120) Icons 751, 752, 753 and 754 presented on the display 75 may be used to activate any of the modes of operation: Mapping 71, Training 72, Daily use 73, and Supervisor/Monitor 74, respectively.

(121) With the passage of time, as the patient's vision further deteriorates, the area of the retina used for PRL itself may become damaged; the Mapping mode 71 may be re-activated, to find a new PRL.

(122) The mapping procedure can be repeated periodically in order to monitor the retinal conditionthe location, the size and characteristics of this area can be modified according to the individual progress of the disease and the training paradigm. Multiple PRLs can be mapped and used.

(123) FIG. 25 illustrates another embodiment of a method for activating modes of operation in the display system. In this embodiment, the Supervisor/Monitor mode 74 is protected so as to prevent or minimize the possibility of misuse of the system by unauthorized persons.

(124) The rationale for this method is that the display system collects and stores private, confidential information about a patient; this information should be protected. Furthermore, setting the parameters of operation of the display system may require knowledge and experience, which a therapist possesses, and the patientnot.

(125) Thus, three modes of operation may be freely activated: Mapping 71, Training 72, and Daily use 73. The Supervisor/Monitor mode 74, however, requires a password for its activation; only if the user gives the correct password in the Guardian module 756, the Supervisor/Monitor mode 74 is activated.

(126) Another improvement in the method illustrated in FIG. 25 is a Select module 755. When a user desires to change the mode of operation, a menu for supporting the user in this task is presented. The menu may include icons for activating the various modes in the system, may recommend preferred actions and/or may display Help messages.

(127) According to user's choice, any of the abovedetailed modes of operation may be activated.

(128) Another improvement in the method illustrated in FIG. 25 is an Activity Log module 757. This module operates concurrently with any mode of operation of the system, to measure any activity performed by the display system and store it for subsequent use.

(129) Using hardware embodiments with the 4 modes of operation

(130) The stationary embodiment disclosed with the FIGS. 17 and 18 and related description may be used with the following modes of operation: Mapping 71, Training 72, and Supervisor/Monitor 74.

(131) An obvious limitation of the stationary system is that the user cannot take it with him/her, therefore use in the Daily use mode 73 may be severely limited or impossible.

(132) The portable/wearable embodiment disclosed with the FIGS. 19 to 21 and related description may be used with all the modes of operation: Mapping 71, Training 72, Daily use 73, and Supervisor/Monitor 74.

(133) In Supervisor/Monitor 74 mode, input means such as a keyboard, keypad, pointing device, etc., are necessary; such means may be connected to the display system using a connector such as micro-USB, or via a wireless link such as Wi-Fi or Bluetooth.

(134) In another application, a therapist may use a stationary system, and the patienta portable system, wherein the two systems can connect to each other.

(135) Method of Operation:

(136) a. Connecting the stationary and the portable systems. b. The portable, personal system transmits present settings, and a log of patient's activities. c. The therapist reviews the information on his stationary system and plans future therapeutic sessions. d. The parameters of the portable system are adjusted if necessary. e. The stationary and the portable systems are disconnected from each other.
Another Method for Detecting the PRL in the Mapping Mode

(137) This method is another embodiment of the Mapping mode methods described with reference to FIGS. 6 to 13. The method comprises: a. Presenting a display 75 on the whole, or a large part of, the area of the retina; the display includes a plurality of unique characters (each character appears only once on the display). The characters may comprise alphanumerics and/or other symbols, as illustrated in the example in FIG. 26. b. The display of Step (a) is presented to only one eye at a time. c. The display of Step (a) is stabilized on the retina using a closed loop servo system with an eye tracker device for measuring eye movements, see FIG. 27. Actually, there are two independent loops being closed, one for azimuth, the other for elevation. d. The therapists asks the patient What do you see?. e. The patient's answer, i.e. I see the number 7 indicates unambiguously the location of the PRLthe area on the retina offering a relatively better vision.
Rationale and Technical Details a. For patients whose macular area is damaged, as illustrated for example in FIGS. 4B, 5B, 6B, etc., they look at the display of FIG. 26 with their peripheral vision, see FIG. 1. b. The PRL on the retina serves as a bi-dimensional band-pass filter in this application, as illustrated with reference to FIGS. 8 and 9. The patient will not see the characters presented on damaged areas of the retina, such as in FIG. 8. The patient will see the character presented on the PRL area of the retina, such as in FIG. 9. c. The eye tracker measures the direction of the gazing direction 12, as shown in FIGS. 1 to 9, 17, 18 and 21. Thus, the display system can correlate the characters presented on display 75 with the patient's answer and the measured gazing direction 12, to find the angle of the PRL in two angular dimensions, relative to the gazing direction.

(138) For example, a PRL measurement may give the following result: For Left eye, PRL=+21.5 degrees el, 11 degrees az For Right eye, PRL=+13 degrees el, 15 degrees az d. People having vision deficiency such as a macular scotoma 32 (see FIG. 6B) may have difficulty stabilizing their gazing direction 12; that is, the gazing direction will change involuntarily and uncontrollably, despite patient's best efforts to look in only one direction.

(139) These changes may cause the display to appear fuzzy to the patientrather than one character being presented on each location, each character will be projected onto various locations on the retina, so the character presented on each location will change. This may hinder the PRL detection, or may render the whole Mapping process useless.

(140) To address this problem, the display projected on the retina is stabilized in two angular dimensions, using the system of FIG. 27. This system allow for each character to be continuously presented on a fixed, specific location on the retina, despite eye 3 movements. The eye tracker 52 measures the gazing direction of the eye 3 and outputs two signals indicative of the direction angle in azimuth and elevation. The controller 79 moves the displayed text and/or images on the display 75 in such a way, that the images are projected on the same locations on the retina, despite eye movements.

(141) In other words: as the gazing direction changes, the characters on the display 75 are moved accordingly, so the same characters will be displayed on the same locations on the retina. See also examples in FIGS. 16A, 16B and 16C. e. The closed loop servo system may be designed using methods and technologies known in the art, but taking into account the unique properties of the human eye.

(142) For example, either analog or digital loops may be used. The control loop may be of the first order, second order or a higher order. Either a linear or a nonlinear system may be implemented.

(143) Adaptive or optimal control technologies may be used. f. If there are more than one PRL locations, the patient may report that he sees two or more characters; further measurements may be then performed, to find the best location for the PRL.
Display Stabilization in the Various Modes of Operation

(144) The servo loop illustrated in FIG. 27 should operate differently in the various modes of operation of the display system, as detailed below. a. In the Mapping mode 71 and Training mode 72, the control loop is so closed as to suppress or minimize any changes in the location of the characters displayed on the retina, despite eye movements.

(145) Basically, in this mode all eye movements are considered an interference, to be supressed. FIG. 28 illustrates the operation of the servo loop in this mode.

(146) In both FIGS. 28 and 29, the IN graph indicates angular eye movements in one dimension; the OUT graph indicates the movement of the image on the retina, corresponding to the angular eye movements. b. In the Daily use mode 73, the loop is closed so as to distinguish between random variations in the gazing directions and voluntary eye movements, when the patient desires to look in another direction.

(147) The loop so acts as to supress random/undesired variations in the gazing directions, whereas not affecting voluntary/desired eye movements.

(148) Basically this mode is akin a bidimensional Low Pass Filter LPF.

(149) FIG. 29 illustrates the operation of the servo loop in the Tracking/LPF mode.

(150) Benefits:

(151) a. In the Mapping mode 71 and Training mode 72, an augmented image is presented to the patient, wherein characters or figures have each a fixed location on the retina; thus, the image is clearer and less fuzzy. b. In the Daily use mode 73, the image on the retina will change when the patient so desiresthat is, when the patients wishes to look in another direction.

(152) Still, a better image is presented to the patient, because random, noise undesired eye movements are filtered outwhen looking in any direction, the patient will be presented with a clearer, less fuzzy image.

(153) Using a 3D System Technology

(154) In the present invention, components of a 3D system (3D glasses and 3D screen) are used in an unconventional way: not to present a 3D image to the user, rather to separate the PRL stimulus to each of the two eyes.

(155) In the Mapping mode 71 and Training mode 72, the image displayed onscreen is intended for only one eye at a time; 3D glasses, acting as an optical ON/OFF switch for each eye, allow to present the image to only one eye at a time, as desired.

(156) Examples of images usable in the Mapping mode 71 and Training mode 72 are shown in FIGS. 6A, 7A, 8A, 9A, 10, 14 to 16, and 26.

(157) Moving the Image on the Screen According to the PRL Location

(158) An essential aspect of the present invention relates to moving the image on the screen (display) according to the PRL location.

(159) Benefit: Ease of use, so that the patient will not have to adopt awkward eye/head positions.

(160) In Mapping mode, the PRL may be detected using the method as detailed for example with FIGS. 9 and 11the target 41 is shown on the screen so it will be projected onto the PRL region 34, wherein the gazing direction 12 points conveniently at the center of the display.

(161) FIGS. 12A, 12B and 12C illustrate how the target 41B is moved across the display so as to follow the gazing direction 12. Thus, despite changes in the gazing direction 12, the target 41B is always projected onto the PRL region 34.

(162) In Training mode, a desired target 46 is always projected onto the PRL area of the retina despite changes in the gazing direction 12, see for example FIGS. 16A, 16B and 16C.

(163) In Daily Use mode, a somewhat different method of operation is required, as detailed with reference to FIGS. 27, 28 and 29.

(164) It will be recognized that the foregoing is but one example of an apparatus and method within the scope of the present invention and that various modifications will occur to those skilled in the art upon reading the disclosure set forth hereinbefore, together with the corresponding drawings.