SERIAL TEXT DISPLAY FOR OPTIMAL RECOGNITION APPARATUS AND METHOD
20170229101 · 2017-08-10
Assignee
Inventors
- Maik Steffen Maurer (Stoneham, MA, US)
- Mattias Klein (Otterfing, DE)
- Francis Abbott Waldman (Stoneham, MA, US)
Cpc classification
International classification
Abstract
Various embodiments are disclosed that relate to serially displaying text on an electronic display using techniques for placement of an optimal recognition position of words at a fixed display location. In some embodiments, an optimal recognition position character is displayed at the fixed display location. In other embodiments, an optimal recognition proportionate position is displayed at the fixed display location. Various related techniques for processing and displaying text are further disclosed herein.
Claims
1. A method of displaying text on an electronic display, the text being dividable into a plurality of respective display elements, at least some of the plurality of respective display elements corresponding to respective sets of words, the respective sets of words comprising no more than 20 characters in length, a word comprising a recognizable set of one or more characters, at least some of the respective sets of words having an optimal recognition position, the method comprising: serially displaying, on the electronic display, a plurality of respective display elements such that an optimal recognition position of at least some display elements of the plurality of respective display elements is displayed at a substantially same location on the electronic display, referred to as a fixed display location.
2. The method of claim 1 wherein the at least some display elements include display elements having a length of greater than three characters.
3. The method of claim 1 wherein the at least some display elements include display elements having a length of greater than four characters.
4. The method of claim 1 further comprising providing a visual aid to mark the fixed display location.
5. The method of claim 4 wherein the visual aid comprises vertical lines above and below the fixed display location.
6. The method of claim 4 wherein providing the visual aid comprises using a different color font for a character displayed at the fixed display location than is used for other characters.
7. The method of claim 1 wherein a character is at least one of a group consisting of an alphabetic character, a numeric character, and a symbolic character.
8. The method of claim 1 wherein the optimal recognition position is identified as a character within a display element (“an optimal recognition position character”) and the optimal recognition position character is displayed at the fixed display location.
9. The method of claim 8 wherein if a total number of characters in the display element is three, four, or five, then the optimal recognition position character is the second character in the display element.
10. The method of claim 8 wherein if the total number of characters in the display element is six, seven, eight, or nine, then the optimal recognition position character is the third character in the display element.
11. The method of claim 8 wherein if the total number of characters in the display element is ten, eleven, twelve, or thirteen, then the optimal recognition position character is the fourth character in the display element.
12. The method of claim 11 wherein if the total number of characters is fourteen, fifteen, sixteen, seventeen, eighteen, nineteen or twenty, then the optimal recognition position character is the fifth character in the display element.
13. The method of claim 8 wherein the optimal recognition character is displayed at the fixed display location prior to display of characters in the display element that are located to the left and right of the optimal recognition character.
14. The method of claim 1 wherein the optimal recognition position of a display element of the at least some display elements is located at a position along a reading direction of the display element that is a distance in pixels from a beginning of the display element, the distance in pixels being a proportion of the display element's pixel width (“optimal proportionate position”).
15. The method of claim 14 wherein the proportion of the display element's pixel width is a function of at least the display element's number of characters and an empirically determined recognition position ratio.
16. The method of claim 15 wherein the proportion of the display element's pixel width is equal to the empirically determined recognition position ratio added to a quotient of 0.5 divided by the number of characters in the display element.
17. The method of claim 16 wherein the empirically determined recognition ratio is an average position ratio of respective optimal recognition position characters for respective display elements from a length of three characters to a length of at least thirteen characters.
18. The method of claim 17 wherein the average position ratio is equal or substantially equal to 0.265.
19. The method of claim 14 wherein the distance in pixels from the beginning of the display element is greater than or equal to 0.20 and less than or equal to 0.45 of the display element's total width.
20. The method of claim 15 wherein the optimal proportionate position provides an offset amount for a pixel at the beginning of the display element (“the beginning pixel”), the method further comprising displaying the display element such that the beginning pixel of the display element is at a position that is the offset amount away from the fixed display location.
21-85. (canceled)
86. The method of claim 1 wherein the respective sets of words comprise one or two words.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0015] The novel features of the invention are set forth in the appended claims. However, for purpose of explanation, several aspects of a particular embodiment of the invention are described by reference to the following figures.
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
DETAILED DESCRIPTION OF THE INVENTION
[0027] The following description is presented to enable any person skilled in the art to make and use the invention, and is provided in the context of particular applications and their requirements. Various modifications to the exemplary embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
[0028]
[0029] End user device 210 includes a display 205. Computer program product 211 configures device 210 to serially present text in a Rapid Serial Visual Presentation (“RSVP”) display area 200 on display 205 (for convenience, referenced herein simply as “RSVP display 200”). User device 210 may include any type of electronic device capable of controlling text display. Some examples include desktop computers and portable electronic devices such as mobile phones, smartphones, multi-media players, e-readers, tablet/touchpad, notebook, or laptop PCs, and other communication devices. In some implementations (e.g., a smart phone or e-reader), the display 205 may be packaged together with the rest of device 210. However, in other implementations, a separate display device (e.g., a monitor) maybe be attached to device 210. While the illustrated embodiment shows a graphical border around RSVP display 200, RSVP display 200 simply refers to a region (e.g., a window) on display 205 where text is serially presented in accordance with an embodiment of the presentation and in particular implementations, RSVP display 200 may or may not be outlined by a graphical border.
[0030] In one embodiment, user device 210 has typical computer components including a processor, memory and an input/output subsystem. In the illustrated embodiment, computer program product 211 is loaded into memory (not separately shown) to configure device 210 in accordance with the present invention. In one embodiment, text data may be loaded into memory for text processing and display processing by device 210 as will be further described herein. Text data loaded into memory for text processing and display processing may be retrieved from persistent storage on a user device such as device 210 and/or may be received from one or more server computers 101 through a connection to Internet 102 (or other computer network). In an alternative embodiment, at least some processing/pre-processing of text data for display in accordance with the principles illustrated herein may be carried out by one or more remote computers such as server computers 101 and then sent to end user device 210 for display on RSVP display 200 on display 205. In such an alternative, some or all of a computer program product such as computer program product 211 for implementing an embodiment of the present invention may reside on one or more computers such as server computers 101 that are remote from end user device 210. In some embodiments, the entire computer program product may be stored and executed on remote computers and the results presented within a browser application component (e.g. a media player application) of user device 210 (browser application and media player application not separately shown).
[0031] In an embodiment of the invention, text (which includes, for example, strings of characters—e.g., letters, numbers, symbols, etc.—which constitute words, numeric figures, and combinations of both with punctuation marks and symbols) is presented serially (for example, one word at a time) within RSPV display 200. As referenced herein, a “display element” will refer to a group of text data that is displayed at one time within RSPV display 200. In other words, display elements are displayed serially. In the primary embodiment discussed herein, a display element will generally consist of one word. However, in alternative embodiments, two words may be presented as a single display element. Also, in the primary embodiment, two words are sometimes part of a single display element such as, for example, when a number e.g., “9,” is displayed together with a unit, e.g. “feet,” so that, for example, the text “9 feet” may be constitute a single display element and be presented together.
[0032] Also, in some embodiments, a word having a length of greater than thirteen characters is divided into first and second display elements such that a first portion of the word is displayed first (along with a hyphen) and then the second portion of the word is displayed next.
[0033] In some embodiments of the present invention, an empirically determined optimal recognition position (“ORP”) of each display element is presented at a fixed location of the RSVP display 200. For example, each word of a plurality of words is serially presented and positioned in the display such that the ORP is displayed at a fixed display location within display 200 and this enables recognition of each word in succession with minimal saccade by the reader.
[0034] In a first embodiment, hereinafter referred to as the ORP character position method, the optimal recognition position has been determined empirically by positioning the word such that a specific character is located in the ORP. This character is hereinafter referred to as the ORP character, whose position is specified from the beginning of the word. Brysbaert and Nazir had provided recommendations for the ORP character position only for words of 3, 5, 7, and 9 characters in length. Certain embodiments of the present invention rely on having determined ORP character positions for words of 4, 6, 8, and 10-13 characters in length. A ratio based on the ORP character position was created in order to interpolate between the established values for words of 3, 5, 7, and 9 characters in length, and to extrapolate for words of 10-13 characters in length. This ORP character position ratio is determined by the following formula:
ORP Character Position Ratio=(ORP Character Position−1)/Total Number of Text Characters
[0035] The values of the ORP character position for words of 4, 6, 8, and 10-13 characters in length are determined by keeping the ORP character position ratio between 0.20 to 0.33 and applying the above formula. The resulting values of the ORP character positions, which are summarized in TABLE I, were empirically tested and confirmed by the inventors with 20 subjects utilizing texts displayed according to this embodiment. TABLE I summarizes the ORP character position as the total number of text characters ranges from 3 characters to preferably 13 characters, but not more than 20 characters (note that “characters” in this context—i.e. for purposes of counting the number of characters in a word display element—only include parts of the word itself, e.g., letters, and do not include punctuation characters, even though, as explained in the context of
TABLE-US-00001 TABLE 1 Total Number of Text ORP Character ORP Character Position Characters Position Ratio 3 2 0.33 4 2 0.25 5 2 0.20 6 3 0.33 7 3 0.29 8 3 0.25 9 3 0.22 10 4 0.30 11 4 0.27 12 4 0.25 13 4 0.23 14-20 5 NA
[0036] While TABLE I specifies a set of values for the ORP based on whole characters, it is possible to have other embodiments in which the ORP is determined as a proportion of the display element's pixel width. In one such alternative (described in detail in the context of
[0037] The average of the ORP character position ratio values in TABLE I yields an average ORP character position ratio of 0.265. This can be used to determine the ORP offset to position a text in terms of pixels from the ORP to the first pixel in the text, according to the following formula:
ORP Offset=(Width*Average ORP Character Position Ratio)+(0.5*Average Character Width)
where Width is the total width of the text (e.g., a word to be displayed) in pixels and Average Character Width is the Width divided by the total number of characters in the text. This will account for the use of proportionally spaced fonts, as both the Width and Average Character Width will change depending upon various combinations of characters. Different formulas or different distributions for the values of the ORP character position can be incorporated into other embodiments. Note that in the ORP position ratio method (sometimes referenced herein as the offset method), the optimal recognition position is at a position that can be determined to be at a specific proportion of the display element's width from the beginning of the word. This position will be referenced herein as the “optimal proportionate position.”
[0038] Note that although, as used herein, “length” is generally used to reference the length of words in terms of characters and the length of sentences in terms of words, “width” on the other hand is generally used to refer to the width of characters and words in terms of pixels. However, “width” and “length” in these contexts both refer to the same “dimension” of words and characters in the sense that they refer to the dimension extending parallel to the direction of reading.
[0039]
[0040]
[0041]
[0042]
[0043] Step 405 also calculates parameters for the display time of each display element. While, in alternative embodiments, it is possible to display each element for the same amount of time, it has been demonstrated empirically that a longer display time is beneficial for comprehension of longer words. It has also been demonstrated empirically that a longer pause between sentences is beneficial for comprehension of longer sentences.
[0044]
[0045] Returning to the description of
[0046]
[0047] Steps 608 then set the multiplier (“m”) based on the value of wl, progressively testing wl until the appropriate value of m is selected. The values of m specified in steps 608 have been determined empirically, but different values could be utilized in other embodiments to provide for additional display time for words of varying length. Step 609 determines if wl is greater than thirteen. If the result of step 609 is yes, then step 610 sets m to 1.6; if the result of step 609 is no, then step 611 determines whether wl is greater than seven. If the result of step 611 is yes, then step 612 sets m to 1.3; if the result of step 611 is no, then step 613 sets m to 1.0. Once m is set (step 610, 612, or 613), step 614 then tests to see if the display element is a blank element (wl=0); if the result of step 614 is no, then step 615 increments the wis and with counters by 1 and increments the rtd counter by the value of m. Step 616 then directs selection of the next word and processing 600 returns to step 606 so that the next word can be processed.
[0048] If the result of step 614 is yes, (i.e., the current display element is a blank element), the end of a sentence has been reached (step 603 inserts blank elements between sentences). Steps 617 then set the blank element multiplier based on the value of wis, progressively testing the value until the appropriate value of m is selected. The values of the wis thresholds and corresponding values of m specified in steps 617 have been determined empirically but different values could be utilized in other embodiments to provide for additional display time of the blank element for sentences of varying length. Step 618 determines whether wis is greater than twenty-two. If the result of step 618 is yes, then step 619 sets m to 3.3. If the result of step 620 is no, then step 620 determines whether wis is greater than seven. If the result of step 620 is yes, then step 621 sets m to 2.2. If the result of step 620 is no, then step 622 sets m to 1.0. Once m is set for the end-of-sentence blank element (step 619, 621, or 622), step 623 stores all display elements (including word display elements processed by steps 608 and the end-of-sentence blank display element processed by steps 618) for that sentence in pairs with corresponding multiplier values in the array 306. Step 624 determines whether the end of the text has been reached. If the result of step 624 is no, then processing 600 returns to step 604 so that the next sentence can be processed. If the result of step 624 is yes, then text processing ends at step 626.
[0049]
[0050] Step 702 selects and loads the word-multiplier pair to be processed for display (which is either the first pair in the stored array referenced in 623 of
[0051] Steps 704 then sets the ORP character (“orpc”) based on the value of wl, progressively testing the length until the appropriate value of orpc is selected for that word, in accordance with the recommendations in TABLE I. Step 705 determines if wl=1. If the result of step 705 is yes, then step 706 sets the orpc to 1 and processing 700 proceeds to step 714. If the result of step 705 is no, then step 707 determines if wl is greater than 1 and less than 6. If the result of step 707 is yes, then step 708 sets the orpc to 2 and processing 700 proceed to step 714. If the result of step 707 is no, then step 709 determines if wl is greater than 5 and less than 10. If the result of step 709 is yes, then step 710 sets the orpc to 3 and processing 700 proceeds to step 714. If the result of step 709 is no, then step 711 determines if wl is greater than 9 and less than 14. If the result of step 711 is yes, then step 712 sets the orpc to 4 and processing 700 proceeds to step 714. If the result of step 711 is no, the step 713 sets the orpc to 5 and processing 700 proceeds to step 714.
[0052] Step 714, displays ORP character (as selected by step 706, 608, 710, 712, or 713) at fixed display location 201 in ORP display 200 (as illustrated by way of example in the window just to the right of step 714 in
[0053] Step 717 then tests to see if the end of the text has been reached. If the result of step 717 is no, then step 718 calculates the average word relative duration (“awdr”) by dividing the rtd by the wit. Step 710 then calculates the default update time (“dut”) by dividing the update time (“ut”) (which is retrieved from display settings module 308 of
[0054]
[0055] Step 801 receives text from the ORP text processor 303 or from text data store 311. Step 802 selects and loads the word-multiplier pair to be processed for display (which is either the first pair in the stored array referenced in 623 of
[0056] Step 804 then determines the first pixel position for the display of the word in ORP-RSVP display 200 (an exemplary ORP display 200 is shown just to the left of step 805 in
[0057] When the beginning pixel is displayed at the ORPRO from fixed display location 201, the ORP of the word, which in this case is identified as the optimal proportionate position along the width of the word (rather than being identified as a particular character), will be displayed at fixed display location 201.
[0058] Step 807 tests to see if the end of the text has been reached. If the result of step 807 is no, then then step 808 calculates the average word relative duration (“awdr”) by dividing the rtd by the wit. Step 809 then calculates the default update time (“dut”) by dividing the update time (“ut”), which is retrieved from the display settings module 308, by the awdr. Step 810 then sets a timer and the word is displayed for a time equal to the product of the relative time multiplier and the dut. Step 811 directs that the next word-multiplier pair is selected and processing 800 returns to step 802 so that the next word-multiplier can be processed. If the result of step 807 is yes, then display processing 800 ends at step 812.
[0059] The example of
[0060] As an alternative to processing all text before beginning the display processing, it is possible to display each display element (e.g., a word) after it has been processed. Referencing such an alternative in the context of modifying the processing order of steps shown in
[0061] Referencing such an alternative in the context of modifying the processing order of steps shown in
[0062] In serial text display, saccades are most noticeably a problem for words that are five or more characters in length. Therefore, a preferred embodiment of the present invention places the ORP at the fixed display location at least for display elements that are five or more characters in length. For such display elements (and for display elements of length four), the optimal recognition position is off-center toward the beginning of the display element (from the perspective of a reader of the display). However, while display of the ORP at the fixed display location for words that are fewer than five characters length is not necessary for achieving the benefits of particular embodiments of the invention, in a preferred embodiment, words of lengths four or less are also displayed using the ORP character position method or the ratio position offset method (which, for word lengths of three or less, will not necessarily result in the fixed display location being off center toward the beginning of the word). However, when such words (length four or less) are displayed at the fixed display location, exactly which character or proportionate position of these words is displayed at the fixed display location is not necessarily critical for minimizing saccades. At the same time, however, displaying words of length four or less such that their optimal recognition position is at the fixed display location does provide some smoothing benefit in that eye displacement from one word to the next is reduced, and therefore a preferred embodiment places an optimal recognition potions of all words, including words of length four or less at the fixed display location.
[0063]
[0064] Other embodiments would enable the invention to be deployed on a variety of electronic devices, such as various computer operating systems, mobile phone operating systems, video gaming platforms, and portable electronic devices such as digital watches, cameras, and music players. While the basic embodiment described herein provides for ORP processing of text that is stored locally on the electronic device, it is possible that the text in a standard format or preprocessed ORP format could be streamed to the electronic device from a server via a wired or wireless network connection. While a preferred embodiment of the present invention is the display of text on small displays, if a large display is available then it would be possible to display the full text in a companion display, such that the progress through the text can be indicated by a moving highlight that corresponds to the word being currently display in the ORP Display.
[0065] While the present invention has been particularly described with respect to the illustrated embodiments, it will be appreciated that various alterations, modifications and adaptations may be made based on the present disclosure and are intended to be within the scope of the present invention. While the invention has been described in connection with what are presently considered to be the most practical and preferred embodiments, it is to be understood that the present invention is not limited to the disclosed embodiment but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the scope of the appended claims.