Interest-attention feedback method for separating cognitive awareness into different left and right sensor displays

Abstract

A method for using an interest-attention feedback loop involving the determination of the interest of a person in a left sensor stimulation stream and a right sensor stimulation stream, and the adjustment of attention factors to balance that interest, with the intent to facilitate, or train, a person to intentionally suppress binocular fusion and operate within the dual experience, where the person is able to simultaneously render separate left and right mental displays. The dual experience allows the person new mental processing capabilities that can produce novel information synthesis, double the information input in man machine interfaces, and allow reaction to the cognitive awareness of two simultaneous world views. This includes facilitating awareness and interactions with two different computer screen interfaces simultaneously, reducing fatigue associated with optical screen switching, and encouraging the fusion of two different simultaneous experiences into an abstract information synthesis.

Claims

1. A method for facilitating a dual experience in a person, comprising: (a) presenting, by a controller, a left optic stimulation pattern with a left transmitter to encompass a field of view of a left eye of the person, and presenting, by the controller, a right optic stimulation pattern with a right transmitter to encompass a field of view of a right eye of the person, wherein the right optic stimulation pattern is different from the left optic stimulation pattern, (b) determining, by the controller based on receiving sensor data from one or more sensors, one or more measurements of a first level of interest of the person in the left optic stimulation pattern and a second level of interest of the person in the right optic stimulation pattern, (c) determining, by the controller, one or more adjustments to one or more attention factors of at least one of the left optic stimulation pattern and the right optic stimulation pattern, wherein the controller determines the one or more adjustments based upon the one or more measurements and causing a balancing of the first level of interest and the second level of interest of the person, (d) applying, by the controller, the one or more adjustments to suppress binocular fusion and binocular rivalry in the person in order to maintain the dual experience in the person, where the person simultaneously renders and has awareness of a left mental display derived from a left optic stimulation pattern and a separate right mental display derived from a right optic stimulation pattern, and (e) repeating, by the controller, steps (a)-(e) in real-time.

2. The method of claim 1, wherein the one or more attention factors of at least one of the left optic stimulation pattern and the right optic stimulation pattern comprise at least one of: color, illumination, or image movement.

3. The method of claim 1, wherein determining the first level of interest and the second level of interest includes measuring, with the one or more sensors, at least one movement of the person.

4. The method of claim 1, wherein the one or more sensors and the controller are included in a single lever mechanism.

5. The method of claim 1, wherein determining and applying the one or more adjustments to the one or more attention factors of the left optic stimulation pattern further comprises outputting, by the controller via a left audio generator proximate to the left ear of the person, a left auditory stimulations pattern, and wherein determining and applying the one or more adjustments to the one or more attention factors of the right optic stimulation pattern further comprises outputting, by the controller via a right audio generator proximate to the right ear of the person, a right auditory stimulation pattern.

6. The method of claim 1, wherein determining, by the controller, the one or more adjustments further comprises determining, by the controller, one or more adjustments to counteract one or more intrinsic alterations of at least one of the left optic stimulation pattern and the right optic stimulation pattern, wherein the one or more intrinsic alterations would otherwise influence the person to not balance the first level of interest and the second level of interest.

7. The method of claim 1, where determining the first level of interest and the second level of interest includes measuring involuntary changes in the person with the one or more sensors.

8. The method of claim 1, wherein the left transmitter further comprises a left mirror positioned at an angle to the left eye of the person that reflects the left optic stimulation pattern presented by the left transmitter to the left eye of the person, and wherein the right transmitter further comprises a right mirror positioned at an angle to the right eye of the person that reflects the right optic stimulation pattern presented by the right transmitter to the right eye of the person.

9. The method of claim 8, wherein: the left mirror is positioned proximate to the face of the person to reflect the left optic stimulation pattern to the field of view of the left eye of the person, and the right mirror is positioned proximate to the face of the person to reflect the right optic stimulation pattern to the field of view of the right eye of the person.

10. The method of claim 9, wherein: the left mirror is coupled with one or more left opaque surfaces that prevent optical signals from an environment proximate to the person from entering the left eye; and the right mirror is coupled with one or more right opaque surfaces that prevent optical signals from the environment proximate to the person from entering the right eye.

11. A device to facilitate a dual experience in a person, comprising: a left screen positioned proximate to a left eye of a person, so as to encompass a field of view of the left eye of the person, a right screen positioned proximate to a right eye of the person, so as to encompass a field of view of the right eye of the person, one or more sensors, and a computer coupled to the left screen, the right screen, and the one or more sensors, which includes a non-transitory computer readable medium and a microprocessor configured to execute instructions for presenting a left optic stimulation pattern and a right optic stimulation pattern, wherein the executed instructions cause the computer to perform operations comprising: (a) displaying, by the computer, the left optic stimulation pattern on the left screen and displaying, by the computer, a right optic stimulation pattern on the right screen, wherein the left optic stimulation pattern is different from the right optic stimulation pattern, (b) determining, by the computer based on receiving sensor data from the one or more sensors, one or more measurements of a first level of interest of the person in the left optic stimulation pattern and a second level of interest of the person in the right optic stimulation pattern, (c) determining, by the computer, one or more adjustments to one or more attention factors of at least one of the left optic stimulation pattern and the right optic stimulation pattern, wherein the computer determines the one or more adjustments based upon the one or more measurements and causing a balancing of the first level of interest and the second level of interest, (d) applying, by the computer, the one or more adjustments to suppress binocular fusion and binocular rivalry in the person in order to maintain the dual experience in the person, where the person simultaneously renders and has awareness of a left mental display derived from a left optic stimulation pattern and a separate right mental display derived from a right optic stimulation pattern, and (e) repeating, by the computer, steps (a)-(e) in real-time.

12. The device of claim 11, wherein: the left screen is positioned at an angle to the left eye of the person to display the left optic stimulation pattern to the majority of the field of view of the left eye, and the right screen is positioned at an angle to the right eye of the person to display the right optic stimulation pattern to the majority of the field of view of the right eye.

13. The device of claim 12, wherein: the left screen is coupled with one or more left opaque surfaces that prevents optical signals from an environment in-front the person from entering the left eye, and the right screen is coupled with one or more right opaque surfaces that prevents optical signals from the environment in-front of the person from entering the right eye.

14. The device of claim 13, wherein: the one or more left opaque surfaces are composed of a blackened featureless material to prevent the person from directing attention away from the left screen, and the one or more right opaque surfaces are composed of a blackened featureless material to prevent the person from directing attention away from the right screen.

Description

SUMMARY OF DRAWINGS

(1) For a more complete understanding of our invention, reference is now made to the following description of selected embodiments of the Attention Feedback Method in conjunction with the accompanying drawings.

(2) FIG. 1 (Prior Art) illustrates the prior art understanding of binary fusion in the brain of a person.

(3) FIG. 2 illustrates the dual experience with a left image as the left sensor stimulation stream and a right image as the right sensor stimulation stream.

(4) FIG. 3 illustrates a method for the interest-attention feedback loop.

(5) FIG. 4 shows one embodiment of a system to illuminate the left image and the right image with the intensity of two light bulbs controlled by an Illumination intensity controller and two mirrors for reflecting the left image into the left eye of a person and the right image into the right eye of a person.

(6) FIG. 5 shows one embodiment of a system using a computer to generate the left image and the right image that are presented on screens mounted in front of the left and right eye of a person.

(7) FIG. 6 shows one embodiment of a system that includes electro-encephalogram (“EEG”) scalp mounted electrodes to measure the interest of a person in the left sensor stimulation stream 215 and right sensor stimulation stream 225.

(8) FIG. 7 shows one embodiment of a system with separate left and right audio generators to be placed over the left and right ear and tactile patches to be placed on the left and right body to present additional inputs to the left sensor stimulation stream and right sensor stimulation stream.

DETAILED DESCRIPTION OF DRAWINGS

(9) FIG. 2 illustrates the dual experience 200 with a left image as the left sensor stimulation stream and a right image as the right sensor stimulation stream. A left image 210 is presented to a person as the left sensor stimulation stream 215 while a right image 220 is also presented to the person as the right sensor stimulation stream 225. The brain 250 of the person then renders a separate left mental display 230 and right mental display 240. In the dual experience 200, the person renders and can interact with the left mental display 230 and the right mental display 240 separately and simultaneously. This is wholly different to the person rendering, or being trained to render, one coherent three-dimensional display 130 as in the prior art understanding of binocular fusion 100.

(10) To suppress binocular fusion 100 and maintain the rendering of separate left mental display 230 and right mental display 240 the attention factors that make the left image 210 or the right image 220 more interesting must be balanced. Balancing the attention factors, represses the brains tendency to select the left image 210 or the right image 220 for rendering one coherent three-dimensional display 130.

(11) In various embodiments, the attention factors include but are not limited to: 1) image, audio, or tactile changes in illumination, volume, or pressure respectively 2) image, audio, or tactile changes in content such as color, texture, or rhythm 3) image, audio, or tactile changes in content motion, image size, or angular aspect. 4) Any surprises or unanticipated changes of the above listed attention factors.

(12) The identification of attention factors and ability to control such attention factors in both the left and right input sensor sets, the senses on the left side or right side of the body, is not enough to assure dual experience 200 for a person. To achieve dual experience 200, it is necessary to determine the interest of the person in the left sensor stimulation stream 215 and the right sensor stimulation stream 225 and adjust the application of attention factors to balance this interest. Hence, an interest-attention feedback loop must be established to continually balance this interest by adjusting the attention factors based on the interest of the person in the left sensor stimulation 215 and the right sensor stimulation stream 225. For example, if the person becomes more interested in the left sensor stimulation stream 215 than the right sensor stimulation stream 225, then the right image 220 could be more strongly illuminated to balance the interest of the person in both the left sensor stimulation stream 215 and the right sensor stimulation stream 225 and maintain the dual experience 200 for the person.

(13) It was also found that balancing the attention factors further involves controlling attention factors in the environment surrounding the person. If the person becomes distracted by attention factors in the environment surrounding the person, then the dual experience 200 may not be achieved. As such, the left image 210 and the right image 220 should be presented in such a way as to block or mitigate attention factors in the environment surrounding the person.

(14) FIG. 3 illustrates the interest-attention feedback loop 300, according to one embodiment. The steps of the interest-attention feedback loop 300 are described as being performed by a system, such as the systems described below in FIG. 4, FIG. 5, FIG. 6, and FIG. 7, but a person skilled in the art would understand that these are example embodiments and any system to perform the steps of the interest-attention feedback loop 300 is included in the scope of this patent. The interest-attention feedback loop 300 includes the real-time execution of the following steps. The interest-attention feedback loop 300 begins at step 305, where a system presents the left sensor stimulation stream 215 and the right sensor stimulation stream 225 to a person. The left sensor stimulation stream 215 may be, for example, the left image 210 presented to the left eye and the right sensor stimulation stream 225 may be, for example, the right image 220 presented to the right eye.

(15) In other embodiments, presenting the left sensor stimulation stream 215 and the right sensor stimulation stream 225 to a person may include generating images, sounds, or tactile sensations, which are presented to the person.

(16) At step 310, the system determines the interest of the person in the left sensor stimulation stream 215 and the right sensor stimulation stream 225. As shown below in conjunction with various embodiments of the system. The embodiments generally fall into two categories, those in which the person voluntarily participates in the determination of step 310 and those were a computer performs step 310 by measuring the state of the person. The person may monitor his or her own interest in the left sensor stimulation stream 215 and the right sensor stimulation stream 225 and voluntarily perform some action, such as moving a lever, joystick, dial, mouse, pressure sensor, potentiometer, or body part, from which the system determines that interest. In the above examples, the person could perform the movements with a hand, foot, head, arm, or other suitable body part. The advantages to systems that include voluntary determination of interest are lower cost and ease of use. Such implementations are appropriate for low cost introductory kits that make a person familiar with the notion of the dual experience 200.

(17) In other embodiments, the system may determine a quantifiable measurement of this interest by measuring involuntary changes in the state of the person, such as involuntary eye movements or brain activity measured by an electro-encephalogram. The advantages of systems that include measurements of involuntary changes in the state of the person may be well suited for allowing the person to manually operate machinery such as an unmanned aerial vehicle.

(18) At step 315, the system determines adjustments to the attention factors to balance the interest of the person in the left sensor stimulation stream 215 and the right sensor stimulation stream 225, thus facilitating the dual experience 200. In some embodiments, the system may determine a mechanical adjustment of a light source to change the brightness of the left image 210 or right image 220. In other embodiments, the system may determine the adjustment by selecting a modification of other characteristic of the left image 210 or right image 220, such as contrast, or movement within or of the image. In still other embodiments, the system may determine adjustments to audio signals transmitted to the ears of the person, such as volume or content of the audio signals or adjustments to the tactile sensations transmitted to the skin of the person, such as intensity of vibration or temperature.

(19) At step 320, the system applies the adjustments to the attention factors determined in step 315 to the left sensor stimulation stream 215 and the right sensor stimulation stream 225. The system may apply the adjustments by, for example, modifying the content or brightness of the left image 210 or right image 215.

(20) In some embodiments, the step 315 and step 320 may be combined. For example, the system may simply move a light source to the left or right to change the brightness of the left image 210 or right image 215, in response to the person voluntarily moving a lever.

(21) The interest-attention feedback loop 300 then returns to step 315, where the left sensor stimulation stream 215 and the right sensor stimulation stream 225, with modifications from step 320, are again presented to the left eye and right eye of the person.

(22) Through the determination of interest at step 310, determination of adjustments at step 315, and application of adjustments at step 320, the interest-attention feedback loop 300 continually updates and presents the left sensor stimulation stream 215 and a right sensor stimulation stream 225 that balance the interest of the person in the left sensor stimulation stream 215 and right sensor stimulation stream 225 and thereby facilitates the dual experience 200. Various embodiments are not limited to these exact steps in this exact order. Various embodiments may augment the steps of the interest-attention feedback loop 300 in order to suppress binocular fusion.

(23) Initially the interest of the person may shift rapidly between the left sensor stimulation stream 215 and a right sensor stimulation stream 225, causing binocular rivalry. To prevent binocular rivalry, the interest-attention feedback loop 300 executes in real-time (or near real-time, i.e. less than the typical human response time of 100 milliseconds).

(24) The person may feel strained, tired, nauseas, or develop a headache, when initially participating in the interest-attention feedback loop 300 and experiencing the dual experience 200. Therefore, in one embodiment, a training protocol includes a series of training sessions for the person. Each training session includes the continued execution of the interest-attention feedback loop 300 for gradually extending periods of time. As the person progresses through the training protocol, the person requires a shorter amount of time to suppress binocular fusion, including binocular rivalry, and achieve the dual experience 200 of simultaneously rendering separate left and right mental displays. Further progress through the training protocol may allow the person to enter the dual experience 200 at will.

(25) In summary, embodiments of the interest-attention feedback loop 300 provide the person with a tool to facilitate the simultaneous rendering of separate left mental display 230 and right mental display 240 through the dual experience 200 rather than render one coherent three-dimensional image 130 through binocular fusion 100. Embodiments of the interest-attention feedback loop 300 may also provide more advanced capabilities, such as allowing the person to synthesize novel merging of information presented in two separate images without the fatigue encountered in rapidly switching between sequential images, or to train an operator to process attention and warning signals at the human reflex level and then automatically switching back to binocular fusion 100 and rendering one coherent three-dimensional display 130 when interest in specific signals that surpass an attention threshold are present.

(26) FIG. 4 shows one embodiment of a system to illuminate the left image 210 and the right image 220 with the intensity of two light bulbs controlled by an Illumination intensity controller and two mirrors for reflecting the left image 210 into the left eye of a person and the right image 220 into the right eye of a person. As shown, the system 400 includes:

(27) Left picture 410.

(28) Right picture 420.

(29) Left light 430 set to shine light at the left picture 410 so as to project the left image 210 from the left picture 410.

(30) Right light 440 set to shine light at the right picture 420 so as to project a right image 220 from the right picture 420.

(31) Illumination intensity controller 470 that is coupled to the left light 430 by interface 472 and coupled to the right light 440 by interface 474. The illumination intensity controller may include a potentiometer that controls the light intensity emitted by the left light 430 and right light 440. In one embodiment, the illumination intensity controller 470 can increase the light intensity emitted by the left light 430 while decreasing the light intensity emitted by the right light 440 and vis-versa.

(32) Left mirror 450 adjusted to reflect the left image 210 from the left picture 410 into the left eye of the person. The left mirror 450 should be shaped in an oval and sized according to the eye socket of the person, so that the left mirror 450 can fit against the nose of the person and encompass, or nearly encompass, the field of view of the person. That is block, as much as possible, the left eye of the person from being able to see anything beyond the left mirror 450.

(33) Right mirror 455 adjusted to reflect the right image 220 from the right picture 420 into the left eye of the person. The right mirror 455 should be shaped in an oval and sized according to the eye socket of the person, so that the right mirror 455 can fit against the nose of the person and encompass, or nearly encompass, the field of view of the person. That is block, as much as possible, the right eye of the person from being able to see anything beyond the right mirror 455.

(34) The left mirror 450 and right mirror 455 should be offset from each other at an angle, e.g. 90 degrees, so as to properly reflect the left image 210 from the left picture 410 into the left eye of the person and the right image 220 from the right picture 420 into the right eye of the person.

(35) Frame 460 holds the left mirror 450 and right mirror 455 and can either be attached to a table mounted stand that the person holds his or her head against or alternatively incorporated into a headband or helmet that is worn on the head of the person. The frame 460, left mirror 450, and right mirror 455 are configured to mitigate or block attention factors in the environment surrounding the person, including attention factors from the frame 460 itself.

(36) Left shade 480 attached to the frame 460 and proximate to the left mirror 450. Left shade 480 blocks the left eye of the person from being able to see anything beyond the left shade 480, including light or objects from the surrounding environment, but not the left mirror 450 or left image 210.

(37) Right shade 485 attached to the frame 460 and proximate to the right mirror 455. Right shade 485 blocks the right eye of the person from being able to see anything beyond the right shade 485, including light or objects from the surrounding environment, but not the right mirror 455 or right image 220.

(38) The system 400 thus executes the interest-attention feedback loop 300 by adjusting the attention factor of image brightness in the left sensor stimulation stream 215 and the attention factor of image brightness in the right sensor stimulation stream 225.

(39) As described, the system 400 presents the left image 210 to the left eye and right image 220 to the right eye at various intensities. The left light 430 shines light at the left picture 410 to project the left image 210 to the left mirror 450, where the left image 210 is then reflected into the left eye of the person as the left sensor stimulation stream 215. Simultaneously, the right light 440 shines light at the right picture 420 to project the right image 220 to the right mirror 455, where the right image 220 is then reflected into the right eye of the person as the right sensor stimulation stream 225.

(40) System 400 implements a voluntary measurement of interest, where the person is required to determine his or her interest in the resulting left sensor stimulation stream 215 and right sensor stimulation stream 225, and then determine adjustments to the attention factors, and adjust the attention factors through some external voluntary muscle action that manipulate the illumination intensity controller 470.

(41) In one embodiment, the hand of the person is used to manipulate the illumination intensity controller 470. The person uses the illumination intensity controller 470 to adjust the brightness of the left image 210 by controlling the light intensity emitted by the left light 430 while also adjusting the brightness of the right image 220 by controlling the light intensity emitted by the right light 440. The adjustments to the brightness of the left image 210 and the brightness of the right image 220 are voluntary adjustments to the attention factor of image brightness within the left sensor stimulation stream 215 and right sensor stimulation stream 225.

(42) The person will typically notice his or her interest shift between the left sensor stimulation stream 215 and right sensor stimulation stream 225. The system 400 implements the interest-attention feedback loop 300 to facilitate the person in balancing this shifting of interest, which will suppress binocular fusion 100 and facilitate the dual experience 200. Training protocols include series of sessions where the person attempts to use system 400 to maintain the dual experience 200 for increasing periods of time.

(43) If the person becomes distracted by attention factors in the environment surrounding the person, then the dual experience 200 may not be achieved. As such, the left mirror 450, right mirror 455, left shade 480, and right shade 485 are described above as positioned to block the environment surrounding the person. In addition, in one embodiment, the system 400 may be used in a darkened room.

(44) In other embodiments, the left mirror 450 and right mirror 455 may be offset from each other at angles less than or greater than 90 degrees, so as to properly reflect the left image 210 into the left eye of the person and the right image 220 into the right eye of the person.

(45) In other embodiments, the illumination intensity controller 470 could be joystick, physical lever, or other mechanism that controls the light intensity emitted by the left light 430 and right light 440. In these alternative embodiments, the person could manipulate the illumination intensity controller 470 with a foot, finger, head, or other body part. In still other embodiments, the left light 430 and right light 440 could be replaced with a single light that can be repositioned by the illumination intensity controller 470 to change the amount of light intensity shining at the left picture 410 and right picture 420.

(46) In other embodiments, one or more of left picture 410, left light 430, right picture 420, and right light 440 could be replaced by other mechanism for projecting the left image 210 at the left mirror 450 and right image 220 at the right mirror 455, such as one or more moving objects or one or more digital displays.

(47) FIG. 5 shows one embodiment of a system using a computer to generate the left image 210 and the right image 220 that are presented on screens mounted in front of the left and right eye of a person. As shown, the system 500 includes:

(48) Right screen 520 coupled to the computer 540 by an interface 550 that presents the left image 210 to the left eye of the person as the left sensor stimulation stream 215.

(49) Left screen 510 coupled to the computer 540 by an interface 555 and presents the right image 220 to the right eye of the person as the right sensor stimulation stream 225.

(50) A frame 530 that holds the right screen 532 and left screen 534 and includes top shade 532, left shade 534, and right shade 536. The frame 530 can either be attached to a table mounted stand that the person holds his or her head against or alternatively integrated into a headband or helmet that is worn on the head of the person. The top shade 532, left shade 534, and right shade 536 are shaped to the contour of a human face, so as to blocks the eyes of the person from being able to see anything beyond the right screen 520 and left screen 510, including light or objects from the surrounding environment or the frame 530 itself.

(51) Computer 540 includes one or more microprocessors and memory.

(52) Feedback controller 560 that is coupled to the computer 540 by the interface 565. The feedback controller 560 is manipulated by the person to determine his or her interest in the left sensor stimulation stream 215 and right sensor stimulation stream 225, similarly to the illumination intensity controller 470 in system 400. However, in system 500, the person reports his or her interest in the left sensor stimulation stream 215 and right sensor stimulation stream 225 by manipulating the feedback controller 560. Instructions stored as one or more programs in the memory of the computer 540 are executed by the one or more microprocessors of the computer 540 to repeatedly monitor the state of the feedback controller 560 to determine the interest of the person in the separate left sensor stimulation stream 215 and right sensor stimulation stream 225, determine adjustments to the attention factors based on the interest of the person in the left sensor stimulation stream 215 and right sensor stimulation stream 225, and apply the adjustments the attention factors in left sensor stimulation stream 215 and right sensor stimulation stream 225.

(53) The one or more programs in computer 540 also include instructions to apply the adjustments to the attention factors in left sensor stimulation stream 215 and right sensor stimulation stream 225 by modifying the left image 210 and right image 220, transferring the left image 210 to the left screen 510 via interface 555, and transferring the right image 220 to the right screen 520 via interface 550.

(54) The one or more programs executed by the computer 540 include instructions to adjust the attention factors in the left sensor stimulation stream 215 and right sensor stimulation stream 225 according to the interest-attention feedback loop 300 to facilitate, or train, the person to operate within the dual experience 200. As discussed, the one or more programs do not include instructions to perform medical corrective procedures of faulty binocular fusion, as found in the prior art.

(55) System 500 implements a voluntary measurement of interest, where the system 500 determines the interest of the person in the separate left sensor stimulation stream 215 and right sensor stimulation stream 225 based on the voluntary actions of the person in controlling the position of the feedback controller 560.

(56) In other embodiments, the computer 540 could be one or more computers, mobile devices, smart phones, or another suitable electronic device for generating a left image and right image. In still other embodiments, the computer 540 and/or the Illumination intensity controller 560 may be integrated into the frame 530 or into each other.

(57) FIG. 6 shows one embodiment of a system 600 that includes electro-encephalogram (“EEG”) scalp mounted electrodes to measure the interest of a person in left sensor stimulation stream 215 and right sensor stimulation stream 225. As shown, the system 600 includes:

(58) The right screen 520, left screen 510, interface 550, interface 555, frame 530, top shade 532, left shade 534, and right shade 536 are from system 500.

(59) A plurality of EEG electrodes 620, 622, 624, and 626 that are coupled to the computer 640 by the interface 630 and held against the scalp of the person by the EEG mount 610.

(60) Embodiments such as system 600 operate similarly to embodiment such as system 500, where a computer 640 executes the one or more programs to adjust the attention factors in the left sensor stimulation stream 215 and right sensor stimulation stream 225 to facilitate, or train, the person to operate within the dual experience 200. However, system 600 implements an involuntary measurement of interest, where EEG electrodes 620, 622, 624, and 626 are used to determine the interest of the person in the left sensor stimulation stream 215 and right sensor stimulation stream 225. The EEG electrodes 620, 622, 624, and 626 are placed on the scalp of the person and detect electrical activity, or EEG signals, in the brain of the person. Instructions stored as one or more programs in the memory of the computer 640 are executed by the one or more microprocessors of the computer 640 to repeatedly monitor and interpret the signals received from the EEG electrodes 620, 622, 624, and 626 via the interface 630. The one or more programs also include instructions to interpret the signals received from the EEG electrodes 620, 622, 624, and 626 into data representing a measurement of the interest of the person in the separate left and right sensor stimulation streams. As such, the one or more programs that include instructions to interpret the signals received from the EEG electrodes 620, 622, 624, and 626 and the EEG electrodes 620, 622, 624, and 626, form a feedback controller that determines an involuntary measurement of interest.

(61) The one or more programs executed by computer 640 also include instructions to determine adjustments to the attention factors based on the measurement of the interest of the person in the separate left and right sensor stimulation streams from the EEG electrodes 620, 622, 624, and 626, and apply the adjustments the attention factors in left sensor stimulation stream 215 and right sensor stimulation stream 225. Like computer 540, computer 640 also includes programs with instructions to apply the adjustments to the attention factors in left sensor stimulation stream 215 and right sensor stimulation stream 225 by modifying the left image 210 and right image 220, transferring the left image 210 to the left screen 510 via interface 555, and transferring the right image 220 to the right screen 520 via interface 550.

(62) As described, the operation of embodiments such as system 600 is different than embodiments such as system 400 or 500. The determination of the interest of the person in the left sensor stimulation stream 215 and right sensor stimulation stream 225 is performed by the system 600 based on measuring the state of the person, thus relieving the person the task of manually performing some voluntary actions. Without having to perform such actions, the person may be able to better focus on selecting and interacting with data from either the left image 210 or right image 220 and performing manual operations in response to the data.

(63) Further, embodiments such as system 600 may execute the interest-attention feedback loop 300 more quickly than system 400 or 500, which may better facilitate the person to operate within the dual experience 200.

(64) EEG electrodes and programs to monitor the signals from the EEG electrodes are commercially available and known in the prior art. One skilled in the arts could implement a computer 640 that includes one or more programs to monitor and interpret the signals from the EEG electrodes 620, 622, 624, and 626. However, utilization of such technology in an interest-attention feedback loop 300 or to facilitate the dual experience 200 is not known in the prior art.

(65) In other embodiments the plurality of EEG electrodes 620, 622, 624, and 626 could be any reasonable number of EEG.

(66) Furthermore, one skilled in the arts can realize EEG electrodes are not the only sensors that may be used to measure the interest of the person in the left sensor stimulation stream 215 and right sensor stimulation stream 225. Other embodiments could include other sensors and accompanying programs in the computer 640 to form a feedback controller that measures the interest of a person in the left sensor stimulation stream 215 and right sensor stimulation stream 225, such as sensors for eye tracking, pupil dilation, and facial expressions.

(67) In other embodiments, the computer 640 could be one or more computers, mobile devices, smart phones, or other suitable electronic device for generating a left image and right image. In still other embodiments, the computer 640 may be integrated into the frame 530 and/or the frame 530 may also be integrated with the EEG mount 610 and hold the EEG electrodes 620, 622, 624, and 626.

(68) FIG. 7 shows one embodiment of a system with separate left and right audio generators to be placed over the left and right ear and tactile patches to be placed on the left and right side of the body of a person to present additional inputs to the left sensor stimulation stream and right sensor stimulation stream.

(69) The right screen 520, left screen 510, interface 550, interface 555, frame 530, top shade 532, left shade 534, and right shade 536, feedback controller 560, interface 565 are from system 500

(70) Left tactile generator 730 is attached to skin surface on the left side of the person. A small patch is shown, but larger patches with larger coverage area can be used in other embodiments. The left tactile generator 730 is capable of generating tactile stimulations, such as various vibrations or temperatures.

(71) Right tactile generator 732 is attached to skin surface on the right side of the person. A small patch is shown, but larger patches with larger coverage area can be used in other embodiments. The right tactile generator 732 is capable of generating tactile stimulations, such as various vibrations or temperatures.

(72) Left audio generator 720 is placed proximate to the left ear of the person to transmit sound to the left ear of the person. The left audio generator 720 could include baffles to reduce outside noise.

(73) Right audio generator 722 is placed proximate to the right ear of the person to transmit sound to the right ear of the person. The right audio generator 722 could include baffles to reduce outside noise.

(74) Embodiments such as system 700 operate similarly to embodiment such as system 500, where a computer 740 executes the one or more programs to adjust the attention factors in the left sensor stimulation stream 215 and right sensor stimulation stream 225 to facilitate, or train, the person to operate within the dual experience 200.

(75) Similar to the computer 540, the computer 740 includes one or more programs that calculate and apply adjustment to the attention factors in the left sensor stimulation stream 215 and right sensor stimulation stream 225 based on the interest of the person in the left sensor stimulation stream 215 and right sensor stimulation stream 225 as determined from the manipulation of the feedback controller 560 by the person. However, the computer 740 also includes one or more programs to determine and apply adjustments to the attention factors in the left sensor stimulation stream 215 and right sensor stimulation stream 225 by manipulating the tactile sensations produced by the left tactile generator 730 and right tactile generator 732 and the sound produced by the left audio generator 720 and right audio generator 722.

(76) In one embodiment, the one or more programs may adjust the adjust the attention factors in the left sensor stimulation stream 215 and right sensor stimulation stream 225 by increasing or decreasing the volume of the sound produced by the left audio generator 720 and right audio generator 722. In some embodiments manipulations of the left image 210 and right image 220 may correspond to changes in the sound produced adjustments by the left audio generator 720 and right audio generator 722.

(77) Though only a single feedback controller 560 is shown in system 700, in other embodiments additional controllers can be added and assigned to determine the visual, audio, or tactile attention factors of the left sensor stimulation stream 215 and right sensor stimulation stream 225.

(78) In still other embodiments, the left audio generator 720, the right audio generator 722, the left tactile generator 730, and/or the right tactile generator 732 could be combined with the system 400 or the system 600.