US20170229101A1 - Serial text display for optimal recognition apparatus and method - Google Patents
Serial text display for optimal recognition apparatus and method Download PDFInfo
- Publication number
- US20170229101A1 US20170229101A1 US15/433,983 US201715433983A US2017229101A1 US 20170229101 A1 US20170229101 A1 US 20170229101A1 US 201715433983 A US201715433983 A US 201715433983A US 2017229101 A1 US2017229101 A1 US 2017229101A1
- Authority
- US
- United States
- Prior art keywords
- display
- character
- characters
- display element
- word
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/22—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of characters or indicia using display control signals derived from coded signals representing the characters or indicia, e.g. with a character-code memory
- G09G5/32—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of characters or indicia using display control signals derived from coded signals representing the characters or indicia, e.g. with a character-code memory with means for controlling the display position
-
- G06F17/211—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/103—Formatting, i.e. changing of presentation of documents
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/22—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of characters or indicia using display control signals derived from coded signals representing the characters or indicia, e.g. with a character-code memory
- G09G5/24—Generation of individual character patterns
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/02—Recognising information on displays, dials, clocks
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0464—Positioning
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/14—Solving problems related to the presentation of information to be displayed
- G09G2340/145—Solving problems related to the presentation of information to be displayed related to small screens
Definitions
- the present invention relates to apparatuses and methods for enabling improved reading in an electronic display.
- RSVP Rapid Serial Visual Presentation
- RSVP reduces saccades but does not eliminate them.
- each word (or multiple words in some implementations) is centered in the display.
- Previous research on word recognition has demonstrated that the eye tends to fixate on characters that are to the left of the center.
- O'Regan conducted experiments on the fixation point in words ranging in length up to 11 characters, clearly showing that word recognition (naming acuity) depends strongly on the position in the word where the eye is fixating at the moment the word appears. (See “Convenient Fixation Location Within Isolated Words of Different Length and Structure” J. K. O'Regan et al. in Journal of Experimental Psychology 1984 Vol. 10, No. 2, 250-257) (“O'Regan”).
- Words longer than three characters have an optimal fixation position to the left of the middle character for which the time required for word recognition is the shortest. For each letter of deviation from this optimal position, about 20 milliseconds (“ms”) are added to lexical decision time or naming latency.
- ms milliseconds
- Rayner conducted similar research that demonstrated that it is possible to get information about a word from up to 4 characters from the left side of the fixation position and up to 15 characters to the right side, resulting in a perceptual span of 20 characters. (See Keith Rayner et al., “Asymmetry of the effective visual field in reading,” in Perception and Psychophysics, 1980, 27(6), 537-534) (“Rayner 1980”).
- Hyrskytar see Hyrskykari, Aulikki, “Eyes in Attentive Interfaces: Experiences from Creating iDict, a Gaze-Aware Reading Aid”, Academic Dissertation, Department of Computer Sciences, University of Tampere, in Dissertations in Interactive Technology, Number 4, Tampere 2006, pg 49
- Danhaene see Dehaene, Stanislas, “Les Neurones de la Lecture”, Editions Odile Jacob, France, September 2007
- each word such that the optimal fixation position does not shift in the display.
- the focal point of the reader can then remain fixed on the optimal fixation position, which is a specific point in each word that is determined by the total number of characters or width of the word.
- This optimal recognition position hereinafter referred to as the “ORP”
- ORP-RSVP An RSVP which incorporates an ORP is hereinafter referred to as “ORP-RSVP.”
- ORP-RSVP text can then be presented at a faster rate because no saccades occur during the presentation.
- the elimination of saccades reduces eye fatigue and makes it more comfortable, resulting in a better reading experience for the user.
- ORP-RSVP which enables more information to be presented faster in a very small display. It can be utilized not just on computers for faster reading of long texts, but preferably also on portable electronic devices such as mobile phones, smartphones, multi-media players, e-readers, tablet/touchpad or laptop PCs, and other communication devices.
- One embodiment of the present invention provides a method for serially displaying text on an electronic display comprising identifying an optimal recognition position for a plurality of words to be displayed and serially displaying the plurality of words such that the optimal recognition position of each word is displayed at a fixed display location on the electronic display.
- the optimal recognition position is identified as a character in the word.
- the optimal recognition position is identified as a proportionate position relative to the width of the word in pixels.
- visual aids are used to mark the fixed display location (e.g., hash marks) and/or an optimal recognition position within the word (e.g., different colored font).
- Some embodiments of the invention further comprise using a relative display multiplier for each word based at least in part on word length, the relative display multiplier being used in determining a display time for the word.
- blank elements are inserted between first and second sentences and displayed for a length of time that varies based on a word length of the first sentence.
- words over thirteen characters long are displayed such that a first portion of the word is displayed (along with a hyphen) as a first display element and a second portion of the word is displayed as a second display element.
- Some embodiments comprise a computer program product including instructions for displaying text in accordance with principles of the present invention. Some embodiments comprise a computer program product including instructions for preparing and streaming text to be displayed in accordance with principles of the present invention. Some embodiments comprise an apparatus configured to carry out serial text display in accordance with principles of the present invention. Some embodiments comprise an apparatus configured to prepare and stream text to be displayed in accordance with principles of the present invention.
- FIG. 1 illustrates a text display system in accordance with an embodiment of the present invention.
- FIGS. 2 a - d illustrate the display portion of the embodiment of FIG. 1 .
- FIGS. 2 a and 2 b show examples of the display area before presentation of text
- FIGS. 2 c and 2 d show two examples of displayed words of different lengths.
- FIG. 3 illustrates an architectural block diagram of an embodiment of the present invention.
- FIG. 4 provides a flow chart architectural diagram of the embodiment of FIG. 3 .
- FIGS. 5 a and 5 b illustrate display time multipliers for display elements (text and blank elements).
- FIG. 6 is a flow chart diagram of text pre-processing in accordance with an embodiment of the present invention.
- FIG. 7 is a flow chart diagram of text display processing according to an embodiment of the present invention.
- FIG. 8 is a flow chart diagram of processing and display of text according to an alternative embodiment of the present invention.
- FIG. 9 shows a display in accordance with an embodiment of the present invention, including user controls and indicators.
- FIG. 1 illustrates a text display system 2000 in accordance with an embodiment of the present invention.
- the text display system is implemented on an end user device 210 , which is configured by computer program product 211 to implement an embodiment of the present invention.
- End user device 210 includes a display 205 .
- Computer program product 211 configures device 210 to serially present text in a Rapid Serial Visual Presentation (“RSVP”) display area 200 on display 205 (for convenience, referenced herein simply as “RSVP display 200 ”).
- RSVP display 200 may include any type of electronic device capable of controlling text display. Some examples include desktop computers and portable electronic devices such as mobile phones, smartphones, multi-media players, e-readers, tablet/touchpad, notebook, or laptop PCs, and other communication devices. In some implementations (e.g., a smart phone or e-reader), the display 205 may be packaged together with the rest of device 210 .
- RSVP display 200 simply refers to a region (e.g., a window) on display 205 where text is serially presented in accordance with an embodiment of the presentation and in particular implementations, RSVP display 200 may or may not be outlined by a graphical border.
- user device 210 has typical computer components including a processor, memory and an input/output subsystem.
- computer program product 211 is loaded into memory (not separately shown) to configure device 210 in accordance with the present invention.
- text data may be loaded into memory for text processing and display processing by device 210 as will be further described herein. Text data loaded into memory for text processing and display processing may be retrieved from persistent storage on a user device such as device 210 and/or may be received from one or more server computers 101 through a connection to Internet 102 (or other computer network).
- At least some processing/pre-processing of text data for display in accordance with the principles illustrated herein may be carried out by one or more remote computers such as server computers 101 and then sent to end user device 210 for display on RSVP display 200 on display 205 .
- some or all of a computer program product such as computer program product 211 for implementing an embodiment of the present invention may reside on one or more computers such as server computers 101 that are remote from end user device 210 .
- the entire computer program product may be stored and executed on remote computers and the results presented within a browser application component (e.g. a media player application) of user device 210 (browser application and media player application not separately shown).
- text which includes, for example, strings of characters—e.g., letters, numbers, symbols, etc.—which constitute words, numeric figures, and combinations of both with punctuation marks and symbols
- a “display element” will refer to a group of text data that is displayed at one time within RSPV display 200 .
- display elements are displayed serially.
- a display element will generally consist of one word.
- two words may be presented as a single display element.
- two words are sometimes part of a single display element such as, for example, when a number e.g., “9,” is displayed together with a unit, e.g. “feet,” so that, for example, the text “9 feet” may be constitute a single display element and be presented together.
- a word having a length of greater than thirteen characters is divided into first and second display elements such that a first portion of the word is displayed first (along with a hyphen) and then the second portion of the word is displayed next.
- an empirically determined optimal recognition position (“ORP”) of each display element is presented at a fixed location of the RSVP display 200 .
- ORP optimal recognition position
- each word of a plurality of words is serially presented and positioned in the display such that the ORP is displayed at a fixed display location within display 200 and this enables recognition of each word in succession with minimal saccade by the reader.
- the optimal recognition position has been determined empirically by positioning the word such that a specific character is located in the ORP.
- This character is hereinafter referred to as the ORP character, whose position is specified from the beginning of the word.
- Brysbaert and Nazir had provided recommendations for the ORP character position only for words of 3, 5, 7, and 9 characters in length.
- Certain embodiments of the present invention rely on having determined ORP character positions for words of 4, 6, 8, and 10-13 characters in length.
- a ratio based on the ORP character position was created in order to interpolate between the established values for words of 3, 5, 7, and 9 characters in length, and to extrapolate for words of 10-13 characters in length.
- This ORP character position ratio is determined by the following formula:
- ORP Character Position Ratio (ORP Character Position ⁇ 1)/Total Number of Text Characters
- the values of the ORP character position for words of 4, 6, 8, and 10-13 characters in length are determined by keeping the ORP character position ratio between 0.20 to 0.33 and applying the above formula.
- the resulting values of the ORP character positions which are summarized in TABLE I, were empirically tested and confirmed by the inventors with 20 subjects utilizing texts displayed according to this embodiment.
- TABLE I summarizes the ORP character position as the total number of text characters ranges from 3 characters to preferably 13 characters, but not more than 20 characters (note that “characters” in this context—i.e. for purposes of counting the number of characters in a word display element—only include parts of the word itself, e.g., letters, and do not include punctuation characters, even though, as explained in the context of FIG. 6 , text may be parsed such that a punctuation mark is included as part of the same display element as a word). Note that the ORP character position shifts progressively further from the middle of the word as the total number of characters increases beyond three characters.
- TABLE I specifies a set of values for the ORP based on whole characters, it is possible to have other embodiments in which the ORP is determined as a proportion of the display element's pixel width.
- an offset is calculated indicating the pixel offset from the fixed display location for placing a first pixel at the beginning edge of the display element. (“Beginning” refers to the beginning from the perspective of a reader reading in a reading direction of the language associated with the word, e.g., for English, the left edge of the display element is the “beginning.”)
- the average of the ORP character position ratio values in TABLE I yields an average ORP character position ratio of 0.265. This can be used to determine the ORP offset to position a text in terms of pixels from the ORP to the first pixel in the text, according to the following formula:
- ORP Offset (Width*Average ORP Character Position Ratio)+(0.5*Average Character Width)
- Width is the total width of the text (e.g., a word to be displayed) in pixels and Average Character Width is the Width divided by the total number of characters in the text. This will account for the use of proportionally spaced fonts, as both the Width and Average Character Width will change depending upon various combinations of characters. Different formulas or different distributions for the values of the ORP character position can be incorporated into other embodiments. Note that in the ORP position ratio method (sometimes referenced herein as the offset method), the optimal recognition position is at a position that can be determined to be at a specific proportion of the display element's width from the beginning of the word. This position will be referenced herein as the “optimal proportionate position.”
- width is generally used to reference the length of words in terms of characters and the length of sentences in terms of words
- width is generally used to refer to the width of characters and words in terms of pixels.
- width and length in these contexts both refer to the same “dimension” of words and characters in the sense that they refer to the dimension extending parallel to the direction of reading.
- FIG. 2 a shows a basic ORP-RSVP display 200 in accordance with the first embodiment of the present invention.
- the ORP-RSVP display 200 can accommodate text of up to 20 characters in length without saccades, although it is preferred to limit the display to 13 characters for improved comprehension. Words longer than 13 characters can be hyphenated and displayed as two consecutive segments. Research has confirmed that approximately two-thirds of the users preferred the hyphenated technique over the single display of the full word.
- Fixed display location 201 is positioned within the display 200 to accommodate at least four characters to its left and can be identified with hash marks 202 . Other identifiers such as circles, colors or textures may be used.
- FIG. 1 shows a basic ORP-RSVP display 200 in accordance with the first embodiment of the present invention.
- the ORP-RSVP display 200 can accommodate text of up to 20 characters in length without saccades, although it is preferred to limit the display to 13 characters for improved comprehension. Words longer than 13 characters can be hyphenated and displayed as two consecutive segments. Research
- FIG. 2 b shows how a circulating arrow 203 can be used to direct the user's eye to focus at fixed display location 201 before the words are serially presented.
- a countdown indicator 204 may also be utilized to indicate the amount of time before the words begin to be serially presented.
- FIG. 2 c illustrates positioning of the word “present” in ORP-RSVP display 200 .
- the first word is displayed in the ORP-RSVP display 200 such that ORP character 205 is positioned at fixed display location 201 .
- the total number of characters in the word “present” is seven and so, from TABLE I, the 3 rd character “e” is positioned at fixed display location 201 .
- a colored font, such as a red font, may be utilized to emphasize the ORP character 205 as shown in FIG. 2 c .
- FIG. 2 d shows the display of the longer word “presentation”, where the 5 th character is the ORP character 205 and is displayed at fixed display location 201 .
- FIG. 3 is a block diagram of computer application 300 in accordance with an embodiment of the present invention to be utilized on an electronic device which includes a digital processor, memory, and a display (and/or that is adapted for communication with a separate display).
- Computer application 300 is designed to accomplish text display in an ORP-RSVP display such as ORP-RSVP display 200 on a display such as display 205 .
- User interface subsystem 301 provides features for user interaction via a graphical windowing system, including, in certain cases, windows, menus, dialogs, and similar features, as well as input selection means from an input device such as a mouse, keypad, touchpad, touch stick, joy stick, touch-screen, natural user interface, or voice recognition system.
- User interface 301 enables the user to select text to be displayed, either in standard formats or text that has been pre-processed into the necessary ORP display format, as well as to make or change display settings.
- Text to be processed by application 300 may be stored in memory 302 in a variety of standard formats, such as xml, txt, pdf, and doc.
- the ORP text processor subsystem 303 converts the stored text into the format necessary for display by ORP display processor 307 . It contains text parser subsystem 304 , display element constructor 305 , and data repository 306 which stores the processed text as display elements with display parameters.
- ORP display processor subsystem 307 accesses the text from the in-memory data repository 306 or from a stored ORP file 311 and prepares it for RSVP presentation in the ORP-RSVP display 200 on the electronic device display 205 .
- the ORP display processor 307 also includes, in this example, display settings module 308 , which enables the user to make or change display settings such as the overall speed in average words-per-minute or average display time of words.
- FIG. 4 provides a high level flow chart of processing 400 which implements information processing of computer application 300 of FIG. 3 .
- a user provides user manual input 401 which is received by user interface 301 (see FIG. 3 ).
- step 402 selects the text to be presented. For example, a selection of a text file from a list may be made using a mouse, keypad, or touch-screen. A selection may also be made from within a full text that is currently displayed. In this example, it is assumed text selected to be displayed is stored on the electronic device.
- Step 403 retrieves the stored text data. However, in alternative examples, the text may be retrieved from a remote device.
- ORP text processor 303 then initiates step 404 to load the data and uses text parser 302 to parse the text to identify sections (such as paragraphs, chapters, etc.), sentences, words, numeric figures, and punctuation marks.
- Display element constructor 305 then initiates step 405 to create an array sequence of display elements, including the insertion of a blank element at the end of each sentence.
- Step 405 also calculates parameters for the display time of each display element. While, in alternative embodiments, it is possible to display each element for the same amount of time, it has been demonstrated empirically that a longer display time is beneficial for comprehension of longer words. It has also been demonstrated empirically that a longer pause between sentences is beneficial for comprehension of longer sentences.
- FIG. 5 a provides a set of recommended values for a text element display multiplier 502 as a function of the text element character length 501 .
- FIG. 5 b provides a set of recommended values for the blank element display multiplier 504 as a function of the number of text elements in the sentence 503 .
- the calculated display parameters are then stored for each display element in the array to create the in-memory representation 406 , which may also be stored as a file 311 in non-volatile memory.
- step 408 adjusts the display time parameter of each display element based on a setting of the overall speed which has been selected at step 407 based on user manual input 401 .
- the ORP display processor 307 includes display settings module 308 which stores the display settings, including a profile that has been previously selected by the user.
- the display settings may also include options for other settings, for example the initial display speed (providing a ramp from a lower speed at the start to the higher overall speed setting), the color of the display background, the color or texture of the ORP indicators, and the text font type and size.
- the ORP display processor 307 then carries out step 409 to display each display element sequentially for its adjusted display time with its ORP character positioned at fixed display location 201 in ORP-RSVP display 200 on the electronic device display 205 if using the ORP character position method. If using the ORP ratio position method, the ORP display processor 307 carries out step 409 to display each display element sequentially for its adjusted display time with the first character positioned at a distance from fixed display location 201 equal to the amount of the ORP offset calculated for that specific display element.
- FIG. 6 provides a flow chart of processing 600 which illustrates further details of processing carried by computer application 300 of the embodiment of FIG. 3 .
- processing 600 is carried out by OPR text processor 303 of FIG. 3 .
- Step 601 receives text.
- Step 602 creates an empty array of ordered pairs for display elements and their display parameters.
- Counters for words-in-text (“wit”), and relative text duration (“rtd”) are initialized at 0 .
- Step 603 parses the text to split it into sentences and inserts blank elements at the end of each sentence.
- Step 604 selects the sentence to be processed by step 605 (which is either the first sentence on an initial processing loop, or a next sentence in response to step 625 ).
- step 605 spits it into words and initializes the counter for words-in-sentence (“wis”) at zero.
- step 606 selects the word to be processed by step 607 (which is either the first word on an initial processing loop for a particular sentence, or a next word in response to step 616 ).
- step 607 calculates the word length (“wl”) with punctuation trimmed from that word.
- wl is calculated without including punctuation for purposes of calculating a display multiplier and determining an optimal recognition position character or offset (described later).
- alternative embodiments may utilize punctuation (or certain types of punctuation) for calculating certain display parameters, particularly to the extent particular empirical results dictate that factoring in punctuation can benefit reading results.
- Steps 608 then set the multiplier (“m”) based on the value of wl, progressively testing wl until the appropriate value of m is selected.
- the values of m specified in steps 608 have been determined empirically, but different values could be utilized in other embodiments to provide for additional display time for words of varying length.
- Step 609 determines if wl is greater than thirteen. If the result of step 609 is yes, then step 610 sets m to 1.6; if the result of step 609 is no, then step 611 determines whether wl is greater than seven. If the result of step 611 is yes, then step 612 sets m to 1.3; if the result of step 611 is no, then step 613 sets m to 1.0.
- step 614 determines whether wis is greater than twenty-two. If the result of step 618 is yes, then step 619 sets m to 3.3.
- step 620 determines whether wis is greater than seven. If the result of step 620 is yes, then step 621 sets m to 2.2. If the result of step 620 is no, then step 622 sets m to 1.0. Once m is set for the end-of-sentence blank element (step 619 , 621 , or 622 ), step 623 stores all display elements (including word display elements processed by steps 608 and the end-of-sentence blank display element processed by steps 618 ) for that sentence in pairs with corresponding multiplier values in the array 306 . Step 624 determines whether the end of the text has been reached. If the result of step 624 is no, then processing 600 returns to step 604 so that the next sentence can be processed. If the result of step 624 is yes, then text processing ends at step 626 .
- FIG. 7 provides a flow chart of processing 700 which illustrates further details of processing carried by computer application 300 of the embodiment of FIG. 3 .
- processing 700 is carried out by OPR display processor 307 of FIG. 3 .
- ORP display processor 307 implements the ORP character position method previously described.
- an ORP character is identified and placed at fixed display location 201 .
- Processing 700 begins at step 701 which receives processed text from ORP text processor 303 or from stored text data 311 .
- Step 702 selects and loads the word-multiplier pair to be processed for display (which is either the first pair in the stored array referenced in 623 of FIG. 6 on an initial processing loop, or a next pair in response to step 721 ).
- Step 703 determines the length in characters (“word length” or “wl”) of the word to be displayed.
- word length in this embodiment is the number of characters excluding punctuation.
- the word length calculated at step 607 of FIG. 6 could be stored in the word array (along with the display element and the word multiplier) so that it does not have to be recalculated in step 703 .
- Steps 704 then sets the ORP character (“orpc”) based on the value of wl, progressively testing the length until the appropriate value of orpc is selected for that word, in accordance with the recommendations in TABLE I.
- step 710 sets the orpc to 3 and processing 700 proceeds to step 714 . If the result of step 709 is no, then step 711 determines if wl is greater than 9 and less than 14. If the result of step 711 is yes, then step 712 sets the orpc to 4 and processing 700 proceeds to step 714 . If the result of step 711 is no, the step 713 sets the orpc to 5 and processing 700 proceeds to step 714 .
- Step 714 displays ORP character (as selected by step 706 , 608 , 710 , 712 , or 713 ) at fixed display location 201 in ORP display 200 (as illustrated by way of example in the window just to the right of step 714 in FIG. 7 ).
- Step 715 displays the characters to the left of the ORP character one by one with the offset defined by the font width (as illustrated by way of example in the window just to the right of step 715 in FIG. 7 ).
- Step 716 displays characters to the right of the ORP character are then displayed in the same manner (as illustrated by way of example in the window just to the right of step 716 in FIG. 7 ).
- Step 717 then tests to see if the end of the text has been reached. If the result of step 717 is no, then step 718 calculates the average word relative duration (“awdr”) by dividing the rtd by the wit. Step 710 then calculates the default update time (“dut”) by dividing the update time (“ut”) (which is retrieved from display settings module 308 of FIG. 3 ) by the awdr. Step 720 then sets a timer and the word is displayed for a time equal to the product of the relative time multiplier and the dut. Step 721 directs that that the next word-multiplier pair is selected and processing 700 returns to step 702 so that the next word-multiplier can be processed. If the result of step 717 is yes, then display processing ends at step 722 .
- awdr average word relative duration
- ut update time
- FIG. 8 provides a flow chart of processing 800 in accordance with an alternative to the embodiment of FIG. 7 for the processing of ORP display processor 307 .
- the ORP ratio position method described earlier is used.
- processing 800 utilizes a proportionate position for the optimal recognition position which, multiplied by the word with, provides an offset value from the fixed display location for placing a pixel that is at the beginning of the word.
- Step 801 receives text from the ORP text processor 303 or from text data store 311 .
- Step 802 selects and loads the word-multiplier pair to be processed for display (which is either the first pair in the stored array referenced in 623 of FIG. 6 on an initial processing loop, or a next pair in response to step 721 ).
- Step 803 then calculates the total width of the word (“ww”) in pixels and the average character width (“acw”) in pixels.
- the word “width” in this context is calculated along the same dimension (in line with the reading direction) as is the word “length” referenced in the context earlier figures. The difference is that as used herein, “ww” is measured in pixels and “wl” is measured in number of characters.
- Step 804 determines the first pixel position for the display of the word in ORP-RSVP display 200 (an exemplary ORP display 200 is shown just to the left of step 805 in FIG. 8 ) by calculating the ORP ratio offset (“ORPRO”).
- ORPRO ORP ratio offset
- the word is displayed with the first pixel of the first character located at the ORPRO position 806 (which is a distance in pixels equal to the ORPRO from the fixed display location 201 ). This may be referenced as the “beginning pixel” of the word from the perspective of a reading direction of a reader of the display. Note that, for left to right languages, the beginning pixel is at the left edge of the word.
- beginning pixel will simply refer to any pixel at the beginning edge of the word.
- the ORP of the word which in this case is identified as the optimal proportionate position along the width of the word (rather than being identified as a particular character), will be displayed at fixed display location 201 .
- Step 807 tests to see if the end of the text has been reached. If the result of step 807 is no, then then step 808 calculates the average word relative duration (“awdr”) by dividing the rtd by the wit. Step 809 then calculates the default update time (“dut”) by dividing the update time (“ut”), which is retrieved from the display settings module 308 , by the awdr. Step 810 then sets a timer and the word is displayed for a time equal to the product of the relative time multiplier and the dut. Step 811 directs that the next word-multiplier pair is selected and processing 800 returns to step 802 so that the next word-multiplier can be processed. If the result of step 807 is yes, then display processing 800 ends at step 812 .
- awdr average word relative duration
- ut update time
- FIG. 8 uses the average position ratio of character position ratios based on the values in TABLE I. However, as previously indicated other values could be used while still achieving benefits of the present invention. Such values may result in somewhat different proportions of a word being displayed to the left (for left to right languages) of the fixed display location. In some alternative embodiments, the proportion of a word (in particular, at least words that are greater than four characters in length) that is displayed from the word's beginning to the fixed display location is greater than or equal to 0.2 and less than or equal to 0.45.
- each display element e.g., a word
- the order of steps would be modified as follows: After step 615 , the processing would proceed to step 703 . After step 720 , then the processing would return to step 606 in order to prepare the next word for display. If step 614 determined that it is a blank element, then step 617 would proceed in order to prepare the blank element for display in step 714 . Then the processing would return to step 624 to continue the processing of the next sentence or it reaches the end of text processing and display processing.
- step 615 after step 615 , the next step would be step 803 .
- step 810 the processing would then return to step 606 in order to prepare the next word for display. If step 614 determined that it was a blank element, then step 617 would proceed in order to prepare the blank element for display in step 810 . Then the processing returns to step 624 to continue the processing of the next sentence or it reaches the end of text processing and display processing.
- a preferred embodiment of the present invention places the ORP at the fixed display location at least for display elements that are five or more characters in length. For such display elements (and for display elements of length four), the optimal recognition position is off-center toward the beginning of the display element (from the perspective of a reader of the display).
- words of lengths four or less are also displayed using the ORP character position method or the ratio position offset method (which, for word lengths of three or less, will not necessarily result in the fixed display location being off center toward the beginning of the word).
- the ORP character position method or the ratio position offset method which, for word lengths of three or less, will not necessarily result in the fixed display location being off center toward the beginning of the word.
- displaying words of length four or less such that their optimal recognition position is at the fixed display location does provide some smoothing benefit in that eye displacement from one word to the next is reduced, and therefore a preferred embodiment places an optimal recognition potions of all words, including words of length four or less at the fixed display location.
- FIG. 9 illustrates several features that can be added to a basic embodiment of the present invention to improve its effectiveness.
- User interface 301 and ORP display 200 can be enhanced to enable the user to interact with the display process.
- standard controls including starting control 901 , pausing control 904 , repeating control 905 , and fast forwarding control 906 to control display of the text can be provided.
- a visual indicator 902 can be provided to indicate the progress of the display as a fraction of the total amount of text to be displayed.
- a slider 903 could also be used to enable jumping to any point in the text.
- An indicator 907 of the display speed in average words per minute could be provided, which could also enable the user to change the speed during the presentation.
- a bookmark icon 909 could enable the user to click and set a bookmark during the presentation, and provide the means to restart the presentation at the point that the bookmark was set.
- a settings icon 908 could be provided to enable the user to change for preferences for the presentation, such as the initial display speed, the color of the display background, the color or texture of the ORP indicators, and the text font type and size.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Artificial Intelligence (AREA)
- Controls And Circuits For Display Device (AREA)
- Digital Computer Display Output (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
Description
- This application is a continuation of co-pending U.S. patent application Ser. No. 14/542,409 filed on Nov. 14, 2014, which is a continuation of U.S. patent application Ser. No. 13/547,982 filed on Jul. 12, 2012 and issued as U.S. Pat. No. 8,903,174 on Dec. 2, 2014. The entire disclosures of those applications are hereby incorporated by reference herein.
- The present invention relates to apparatuses and methods for enabling improved reading in an electronic display.
- Despite heavy technological (digital) advances, the illustration of textual information has not fundamentally changed. Texts are typically displayed in lines such that the reader's eye moves sequentially from word to word. With each eye movement (“saccade”) time is spent refixating the eye on the new word in order to recognize and process its meaning. The fixation takes about 240 milliseconds (“ms”) per word on average. Only 20% of the time for fixation is used for processing the content. It is also very common that a saccade does not reach the correct fixation point, so additional eye movement is required for reading a word.
- One display technique for reducing saccades is Rapid Serial Visual Presentation, hereinafter referred to as “RSVP.” RSVP was first introduced in the 1970s as a technique for presenting text one word at a time in a display. Many references since then have provided information on the use of RSVP in a variety of applications. Commercially available products based on RSVP include “Zap Reader” (www.zapreader.com/reader) and “Spreeder” (www.spreeder.com). Some prior methods exist for improving the effectiveness of an RSVP by varying the display time of a word in the display based on word length and word type (see, U.S. Pat. No. 6,130,968 to Mclan et al. (“McIan”)) and based on word frequency (see WO/37256 by Goldstein et al. (“Goldstein 2002”)). While these techniques are beneficial in improving comprehension of the displayed text, none of these teach how to minimize saccade movement during the presentation of a word or words in the RSVP display.
- RSVP reduces saccades but does not eliminate them. In previous references on RSVP, each word (or multiple words in some implementations) is centered in the display. Previous research on word recognition, however, has demonstrated that the eye tends to fixate on characters that are to the left of the center. O'Regan conducted experiments on the fixation point in words ranging in length up to 11 characters, clearly showing that word recognition (naming acuity) depends strongly on the position in the word where the eye is fixating at the moment the word appears. (See “Convenient Fixation Location Within Isolated Words of Different Length and Structure” J. K. O'Regan et al. in Journal of Experimental Psychology 1984 Vol. 10, No. 2, 250-257) (“O'Regan”). Brysbaert and Nazir (“VISUAL CONSTRAINTS IN WRITTEN WORD RECOGNITION: EVIDENCE FROM THE OPTIMAL VIEWING POSITION EFFECT,” paper by Marc Brysbaert, Royal Holloway, University of London and Tatjana Nazir, Université Lyon 1, contact address: Marc Brysbaert Royal Holloway, University of London, Department of Psychology Egham TW20 OEX, United Kingdom, [email protected]) (“Brysbaert and Nazir”) determined that there is an optimal viewing position for maximum reading speed and empirically determined this viewing position for words of 3, 5, 7, and 9 characters in length. However, not only was this research never applied to RSVP, it provides insufficient information for a practical RSVP application. Therefore, embodiments of the present invention rely on the inventors having established the ORP character positions for words of 4, 6, 8, and 10-13 characters in length.
- Words longer than three characters have an optimal fixation position to the left of the middle character for which the time required for word recognition is the shortest. For each letter of deviation from this optimal position, about 20 milliseconds (“ms”) are added to lexical decision time or naming latency. Rayner conducted similar research that demonstrated that it is possible to get information about a word from up to 4 characters from the left side of the fixation position and up to 15 characters to the right side, resulting in a perceptual span of 20 characters. (See Keith Rayner et al., “Asymmetry of the effective visual field in reading,” in Perception and Psychophysics, 1980, 27(6), 537-534) (“Rayner 1980”). Hyrskytar (see Hyrskykari, Aulikki, “Eyes in Attentive Interfaces: Experiences from Creating iDict, a Gaze-Aware Reading Aid”, Academic Dissertation, Department of Computer Sciences, University of Tampere, in Dissertations in Interactive Technology,
Number 4, Tampere 2006, pg 49) and Danhaene (see Dehaene, Stanislas, “Les Neurones de la Lecture”, Editions Odile Jacob, France, September 2007) have also taught that the maximum character length of a word without saccade movement is 20 characters. However, further research by Rayner demonstrated that comprehension of the word was significantly less if the total number of characters is greater than 13 characters. (See Rayner, K. “Eye movements and cognitive processes in reading, visual search, and scene perception.” In J. M. Findlay, R. Walker, & R. W. Kentridge (Eds.), Eye movement research: Mechanisms, processes and applications (pp. 3-22). Amsterdam: North Holland, 1995) (“Rayner 1995”). - Therefore, it is possible to have good recognition of words of up to 13 characters in length from a single fixation that is positioned on a specific character that is off center toward the beginning of the word (e.g., to the left of the middle character for languages that are read from left to right). Words are rarely greater than 13 characters (according to Sigurd, only 0.4% of the words in the English language are longer than 13 characters—see Sigurd, B. et al, “Word Length, Sentence Length and Frequency—ZIPF Revisited”, Studia Lingustica 58(1), pp 37-52, Blackwell Publishing Ltd, Oxford UK, 2004) and therefore, for the vast majority of words, it is preferable to limit the number of characters to the right side of the fixation point to 8 characters.
- None of the previous research on word recognition has been applied to RSVP. In a conventional RSVP, the optimal fixation position will shift as words of differing lengths are sequentially displayed in the center of the display, resulting in saccade movements as the eyes shift to the optimal fixation position. The reader has to refocus on the display every time a new word appears that is of a different length than the previous word. The reader's eyes will move from one character to the next to find the optimal position, which is also referred to as a recovery saccade. In addition, when a longer word follows a shorter one, the saccadic movement direction will be from right to left. When reading text in lines in a traditional paragraph display, most saccadic movement is from left to right so the reader is accustomed to this type of eye movement. Only occasionally, if the optimal fixation position is not found directly, the reader may have to move back from right to left. Thus conventional RSVP forces the reader to experience saccades which are not normal. Conventional RSVP approaches offer no solution to these problems.
- In order to prevent or minimize recovery saccades in an RSVP, it is preferable to display each word such that the optimal fixation position does not shift in the display. The focal point of the reader can then remain fixed on the optimal fixation position, which is a specific point in each word that is determined by the total number of characters or width of the word. This optimal recognition position, hereinafter referred to as the “ORP,” can be identified in the display such that the reader's eyes are directed to focus there as the words are serially presented. An RSVP which incorporates an ORP is hereinafter referred to as “ORP-RSVP.” With an ORP-RSVP, text can then be presented at a faster rate because no saccades occur during the presentation. In addition, the elimination of saccades reduces eye fatigue and makes it more comfortable, resulting in a better reading experience for the user.
- Many application areas benefit from an ORP-RSVP which enables more information to be presented faster in a very small display. It can be utilized not just on computers for faster reading of long texts, but preferably also on portable electronic devices such as mobile phones, smartphones, multi-media players, e-readers, tablet/touchpad or laptop PCs, and other communication devices.
- One embodiment of the present invention provides a method for serially displaying text on an electronic display comprising identifying an optimal recognition position for a plurality of words to be displayed and serially displaying the plurality of words such that the optimal recognition position of each word is displayed at a fixed display location on the electronic display. In one embodiment, the optimal recognition position is identified as a character in the word. In another embodiment, the optimal recognition position is identified as a proportionate position relative to the width of the word in pixels. In some embodiments, visual aids are used to mark the fixed display location (e.g., hash marks) and/or an optimal recognition position within the word (e.g., different colored font).
- Some embodiments of the invention further comprise using a relative display multiplier for each word based at least in part on word length, the relative display multiplier being used in determining a display time for the word. In some embodiment of the invention, blank elements are inserted between first and second sentences and displayed for a length of time that varies based on a word length of the first sentence. In some embodiments of the invention, words over thirteen characters long are displayed such that a first portion of the word is displayed (along with a hyphen) as a first display element and a second portion of the word is displayed as a second display element.
- Some embodiments comprise a computer program product including instructions for displaying text in accordance with principles of the present invention. Some embodiments comprise a computer program product including instructions for preparing and streaming text to be displayed in accordance with principles of the present invention. Some embodiments comprise an apparatus configured to carry out serial text display in accordance with principles of the present invention. Some embodiments comprise an apparatus configured to prepare and stream text to be displayed in accordance with principles of the present invention.
- These and other embodiments are more fully described below.
- The novel features of the invention are set forth in the appended claims. However, for purpose of explanation, several aspects of a particular embodiment of the invention are described by reference to the following figures.
-
FIG. 1 illustrates a text display system in accordance with an embodiment of the present invention. -
FIGS. 2a-d illustrate the display portion of the embodiment ofFIG. 1 . -
FIGS. 2a and 2b show examples of the display area before presentation of text, and -
FIGS. 2c and 2d show two examples of displayed words of different lengths. -
FIG. 3 illustrates an architectural block diagram of an embodiment of the present invention. -
FIG. 4 provides a flow chart architectural diagram of the embodiment ofFIG. 3 . -
FIGS. 5a and 5b illustrate display time multipliers for display elements (text and blank elements). -
FIG. 6 is a flow chart diagram of text pre-processing in accordance with an embodiment of the present invention. -
FIG. 7 is a flow chart diagram of text display processing according to an embodiment of the present invention. -
FIG. 8 is a flow chart diagram of processing and display of text according to an alternative embodiment of the present invention. -
FIG. 9 shows a display in accordance with an embodiment of the present invention, including user controls and indicators. - The following description is presented to enable any person skilled in the art to make and use the invention, and is provided in the context of particular applications and their requirements. Various modifications to the exemplary embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
-
FIG. 1 illustrates atext display system 2000 in accordance with an embodiment of the present invention. In this embodiment, the text display system is implemented on anend user device 210, which is configured bycomputer program product 211 to implement an embodiment of the present invention. -
End user device 210 includes adisplay 205.Computer program product 211 configuresdevice 210 to serially present text in a Rapid Serial Visual Presentation (“RSVP”)display area 200 on display 205 (for convenience, referenced herein simply as “RSVP display 200”).User device 210 may include any type of electronic device capable of controlling text display. Some examples include desktop computers and portable electronic devices such as mobile phones, smartphones, multi-media players, e-readers, tablet/touchpad, notebook, or laptop PCs, and other communication devices. In some implementations (e.g., a smart phone or e-reader), thedisplay 205 may be packaged together with the rest ofdevice 210. However, in other implementations, a separate display device (e.g., a monitor) maybe be attached todevice 210. While the illustrated embodiment shows a graphical border aroundRSVP display 200,RSVP display 200 simply refers to a region (e.g., a window) ondisplay 205 where text is serially presented in accordance with an embodiment of the presentation and in particular implementations,RSVP display 200 may or may not be outlined by a graphical border. - In one embodiment,
user device 210 has typical computer components including a processor, memory and an input/output subsystem. In the illustrated embodiment,computer program product 211 is loaded into memory (not separately shown) to configuredevice 210 in accordance with the present invention. In one embodiment, text data may be loaded into memory for text processing and display processing bydevice 210 as will be further described herein. Text data loaded into memory for text processing and display processing may be retrieved from persistent storage on a user device such asdevice 210 and/or may be received from one ormore server computers 101 through a connection to Internet 102 (or other computer network). In an alternative embodiment, at least some processing/pre-processing of text data for display in accordance with the principles illustrated herein may be carried out by one or more remote computers such asserver computers 101 and then sent to enduser device 210 for display onRSVP display 200 ondisplay 205. In such an alternative, some or all of a computer program product such ascomputer program product 211 for implementing an embodiment of the present invention may reside on one or more computers such asserver computers 101 that are remote fromend user device 210. In some embodiments, the entire computer program product may be stored and executed on remote computers and the results presented within a browser application component (e.g. a media player application) of user device 210 (browser application and media player application not separately shown). - In an embodiment of the invention, text (which includes, for example, strings of characters—e.g., letters, numbers, symbols, etc.—which constitute words, numeric figures, and combinations of both with punctuation marks and symbols) is presented serially (for example, one word at a time) within
RSPV display 200. As referenced herein, a “display element” will refer to a group of text data that is displayed at one time withinRSPV display 200. In other words, display elements are displayed serially. In the primary embodiment discussed herein, a display element will generally consist of one word. However, in alternative embodiments, two words may be presented as a single display element. Also, in the primary embodiment, two words are sometimes part of a single display element such as, for example, when a number e.g., “9,” is displayed together with a unit, e.g. “feet,” so that, for example, the text “9 feet” may be constitute a single display element and be presented together. - Also, in some embodiments, a word having a length of greater than thirteen characters is divided into first and second display elements such that a first portion of the word is displayed first (along with a hyphen) and then the second portion of the word is displayed next.
- In some embodiments of the present invention, an empirically determined optimal recognition position (“ORP”) of each display element is presented at a fixed location of the
RSVP display 200. For example, each word of a plurality of words is serially presented and positioned in the display such that the ORP is displayed at a fixed display location withindisplay 200 and this enables recognition of each word in succession with minimal saccade by the reader. - In a first embodiment, hereinafter referred to as the ORP character position method, the optimal recognition position has been determined empirically by positioning the word such that a specific character is located in the ORP. This character is hereinafter referred to as the ORP character, whose position is specified from the beginning of the word. Brysbaert and Nazir had provided recommendations for the ORP character position only for words of 3, 5, 7, and 9 characters in length. Certain embodiments of the present invention rely on having determined ORP character positions for words of 4, 6, 8, and 10-13 characters in length. A ratio based on the ORP character position was created in order to interpolate between the established values for words of 3, 5, 7, and 9 characters in length, and to extrapolate for words of 10-13 characters in length. This ORP character position ratio is determined by the following formula:
-
ORP Character Position Ratio=(ORP Character Position−1)/Total Number of Text Characters - The values of the ORP character position for words of 4, 6, 8, and 10-13 characters in length are determined by keeping the ORP character position ratio between 0.20 to 0.33 and applying the above formula. The resulting values of the ORP character positions, which are summarized in TABLE I, were empirically tested and confirmed by the inventors with 20 subjects utilizing texts displayed according to this embodiment. TABLE I summarizes the ORP character position as the total number of text characters ranges from 3 characters to preferably 13 characters, but not more than 20 characters (note that “characters” in this context—i.e. for purposes of counting the number of characters in a word display element—only include parts of the word itself, e.g., letters, and do not include punctuation characters, even though, as explained in the context of
FIG. 6 , text may be parsed such that a punctuation mark is included as part of the same display element as a word). Note that the ORP character position shifts progressively further from the middle of the word as the total number of characters increases beyond three characters. -
TABLE 1 Total Number of Text ORP Character ORP Character Position Characters Position Ratio 3 2 0.33 4 2 0.25 5 2 0.20 6 3 0.33 7 3 0.29 8 3 0.25 9 3 0.22 10 4 0.30 11 4 0.27 12 4 0.25 13 4 0.23 14-20 5 NA - While TABLE I specifies a set of values for the ORP based on whole characters, it is possible to have other embodiments in which the ORP is determined as a proportion of the display element's pixel width. In one such alternative (described in detail in the context of
FIG. 8 ) an offset is calculated indicating the pixel offset from the fixed display location for placing a first pixel at the beginning edge of the display element. (“Beginning” refers to the beginning from the perspective of a reader reading in a reading direction of the language associated with the word, e.g., for English, the left edge of the display element is the “beginning.”) - The average of the ORP character position ratio values in TABLE I yields an average ORP character position ratio of 0.265. This can be used to determine the ORP offset to position a text in terms of pixels from the ORP to the first pixel in the text, according to the following formula:
-
ORP Offset=(Width*Average ORP Character Position Ratio)+(0.5*Average Character Width) - where Width is the total width of the text (e.g., a word to be displayed) in pixels and Average Character Width is the Width divided by the total number of characters in the text. This will account for the use of proportionally spaced fonts, as both the Width and Average Character Width will change depending upon various combinations of characters. Different formulas or different distributions for the values of the ORP character position can be incorporated into other embodiments. Note that in the ORP position ratio method (sometimes referenced herein as the offset method), the optimal recognition position is at a position that can be determined to be at a specific proportion of the display element's width from the beginning of the word. This position will be referenced herein as the “optimal proportionate position.”
- Note that although, as used herein, “length” is generally used to reference the length of words in terms of characters and the length of sentences in terms of words, “width” on the other hand is generally used to refer to the width of characters and words in terms of pixels. However, “width” and “length” in these contexts both refer to the same “dimension” of words and characters in the sense that they refer to the dimension extending parallel to the direction of reading.
-
FIG. 2a shows a basic ORP-RSVP display 200 in accordance with the first embodiment of the present invention. The ORP-RSVP display 200 can accommodate text of up to 20 characters in length without saccades, although it is preferred to limit the display to 13 characters for improved comprehension. Words longer than 13 characters can be hyphenated and displayed as two consecutive segments. Research has confirmed that approximately two-thirds of the users preferred the hyphenated technique over the single display of the full word. Fixeddisplay location 201 is positioned within thedisplay 200 to accommodate at least four characters to its left and can be identified with hash marks 202. Other identifiers such as circles, colors or textures may be used.FIG. 2b shows how a circulatingarrow 203 can be used to direct the user's eye to focus at fixeddisplay location 201 before the words are serially presented. Acountdown indicator 204 may also be utilized to indicate the amount of time before the words begin to be serially presented. -
FIG. 2c illustrates positioning of the word “present” in ORP-RSVP display 200. When the serial presentation begins, the first word is displayed in the ORP-RSVP display 200 such thatORP character 205 is positioned at fixeddisplay location 201. In the example inFIG. 2c , the total number of characters in the word “present” is seven and so, from TABLE I, the 3rd character “e” is positioned at fixeddisplay location 201. A colored font, such as a red font, may be utilized to emphasize theORP character 205 as shown inFIG. 2c .FIG. 2d shows the display of the longer word “presentation”, where the 5th character is theORP character 205 and is displayed at fixeddisplay location 201. -
FIG. 3 is a block diagram ofcomputer application 300 in accordance with an embodiment of the present invention to be utilized on an electronic device which includes a digital processor, memory, and a display (and/or that is adapted for communication with a separate display).Computer application 300 is designed to accomplish text display in an ORP-RSVP display such as ORP-RSVP display 200 on a display such asdisplay 205.User interface subsystem 301 provides features for user interaction via a graphical windowing system, including, in certain cases, windows, menus, dialogs, and similar features, as well as input selection means from an input device such as a mouse, keypad, touchpad, touch stick, joy stick, touch-screen, natural user interface, or voice recognition system.User interface 301 enables the user to select text to be displayed, either in standard formats or text that has been pre-processed into the necessary ORP display format, as well as to make or change display settings. Text to be processed byapplication 300 may be stored inmemory 302 in a variety of standard formats, such as xml, txt, pdf, and doc. The ORPtext processor subsystem 303 converts the stored text into the format necessary for display byORP display processor 307. It containstext parser subsystem 304,display element constructor 305, anddata repository 306 which stores the processed text as display elements with display parameters. ORPdisplay processor subsystem 307 accesses the text from the in-memory data repository 306 or from a storedORP file 311 and prepares it for RSVP presentation in the ORP-RSVP display 200 on theelectronic device display 205. TheORP display processor 307 also includes, in this example,display settings module 308, which enables the user to make or change display settings such as the overall speed in average words-per-minute or average display time of words. -
FIG. 4 provides a high level flow chart of processing 400 which implements information processing ofcomputer application 300 ofFIG. 3 . A user provides usermanual input 401 which is received by user interface 301 (seeFIG. 3 ). In response to usermanual input 401,step 402 selects the text to be presented. For example, a selection of a text file from a list may be made using a mouse, keypad, or touch-screen. A selection may also be made from within a full text that is currently displayed. In this example, it is assumed text selected to be displayed is stored on the electronic device. Step 403 retrieves the stored text data. However, in alternative examples, the text may be retrieved from a remote device.ORP text processor 303 then initiates step 404 to load the data and usestext parser 302 to parse the text to identify sections (such as paragraphs, chapters, etc.), sentences, words, numeric figures, and punctuation marks.Display element constructor 305 then initiates step 405 to create an array sequence of display elements, including the insertion of a blank element at the end of each sentence. - Step 405 also calculates parameters for the display time of each display element. While, in alternative embodiments, it is possible to display each element for the same amount of time, it has been demonstrated empirically that a longer display time is beneficial for comprehension of longer words. It has also been demonstrated empirically that a longer pause between sentences is beneficial for comprehension of longer sentences.
-
FIG. 5a provides a set of recommended values for a textelement display multiplier 502 as a function of the textelement character length 501.FIG. 5b provides a set of recommended values for the blankelement display multiplier 504 as a function of the number of text elements in thesentence 503. The calculated display parameters are then stored for each display element in the array to create the in-memory representation 406, which may also be stored as afile 311 in non-volatile memory. - Returning to the description of
FIG. 4 ,step 408 adjusts the display time parameter of each display element based on a setting of the overall speed which has been selected atstep 407 based on usermanual input 401. As referenced above, theORP display processor 307 includesdisplay settings module 308 which stores the display settings, including a profile that has been previously selected by the user. In addition to the overall speed setting, the display settings may also include options for other settings, for example the initial display speed (providing a ramp from a lower speed at the start to the higher overall speed setting), the color of the display background, the color or texture of the ORP indicators, and the text font type and size. TheORP display processor 307 then carries outstep 409 to display each display element sequentially for its adjusted display time with its ORP character positioned at fixeddisplay location 201 in ORP-RSVP display 200 on theelectronic device display 205 if using the ORP character position method. If using the ORP ratio position method, theORP display processor 307 carries outstep 409 to display each display element sequentially for its adjusted display time with the first character positioned at a distance from fixeddisplay location 201 equal to the amount of the ORP offset calculated for that specific display element. -
FIG. 6 provides a flow chart of processing 600 which illustrates further details of processing carried bycomputer application 300 of the embodiment ofFIG. 3 . Specifically, processing 600 is carried out byOPR text processor 303 ofFIG. 3 . Step 601 receives text. Step 602 creates an empty array of ordered pairs for display elements and their display parameters. Counters for words-in-text (“wit”), and relative text duration (“rtd”) are initialized at 0. Step 603 parses the text to split it into sentences and inserts blank elements at the end of each sentence. Step 604 selects the sentence to be processed by step 605 (which is either the first sentence on an initial processing loop, or a next sentence in response to step 625). For that sentence, step 605 spits it into words and initializes the counter for words-in-sentence (“wis”) at zero. Step 606 selects the word to be processed by step 607 (which is either the first word on an initial processing loop for a particular sentence, or a next word in response to step 616). For that word,step 607 calculates the word length (“wl”) with punctuation trimmed from that word. In this embodiment, wl is calculated without including punctuation for purposes of calculating a display multiplier and determining an optimal recognition position character or offset (described later). However, alternative embodiments may utilize punctuation (or certain types of punctuation) for calculating certain display parameters, particularly to the extent particular empirical results dictate that factoring in punctuation can benefit reading results. -
Steps 608 then set the multiplier (“m”) based on the value of wl, progressively testing wl until the appropriate value of m is selected. The values of m specified insteps 608 have been determined empirically, but different values could be utilized in other embodiments to provide for additional display time for words of varying length. Step 609 determines if wl is greater than thirteen. If the result ofstep 609 is yes, then step 610 sets m to 1.6; if the result ofstep 609 is no, then step 611 determines whether wl is greater than seven. If the result ofstep 611 is yes, then step 612 sets m to 1.3; if the result ofstep 611 is no, then step 613 sets m to 1.0. Once m is set (step step 614 then tests to see if the display element is a blank element (wl=0); if the result ofstep 614 is no, then step 615 increments the wis and with counters by 1 and increments the rtd counter by the value of m. Step 616 then directs selection of the next word andprocessing 600 returns to step 606 so that the next word can be processed. - If the result of
step 614 is yes, (i.e., the current display element is a blank element), the end of a sentence has been reached (step 603 inserts blank elements between sentences).Steps 617 then set the blank element multiplier based on the value of wis, progressively testing the value until the appropriate value of m is selected. The values of the wis thresholds and corresponding values of m specified insteps 617 have been determined empirically but different values could be utilized in other embodiments to provide for additional display time of the blank element for sentences of varying length. Step 618 determines whether wis is greater than twenty-two. If the result ofstep 618 is yes, then step 619 sets m to 3.3. If the result ofstep 620 is no, then step 620 determines whether wis is greater than seven. If the result ofstep 620 is yes, then step 621 sets m to 2.2. If the result ofstep 620 is no, then step 622 sets m to 1.0. Once m is set for the end-of-sentence blank element (step steps 608 and the end-of-sentence blank display element processed by steps 618) for that sentence in pairs with corresponding multiplier values in thearray 306. Step 624 determines whether the end of the text has been reached. If the result ofstep 624 is no, then processing 600 returns to step 604 so that the next sentence can be processed. If the result ofstep 624 is yes, then text processing ends atstep 626. -
FIG. 7 provides a flow chart of processing 700 which illustrates further details of processing carried bycomputer application 300 of the embodiment ofFIG. 3 . Specifically, processing 700 is carried out byOPR display processor 307 ofFIG. 3 . In the embodiment illustrated inFIG. 7 ,ORP display processor 307 implements the ORP character position method previously described. In particular, an ORP character is identified and placed at fixeddisplay location 201. Processing 700 begins atstep 701 which receives processed text fromORP text processor 303 or from storedtext data 311. - Step 702 selects and loads the word-multiplier pair to be processed for display (which is either the first pair in the stored array referenced in 623 of
FIG. 6 on an initial processing loop, or a next pair in response to step 721). Step 703 determines the length in characters (“word length” or “wl”) of the word to be displayed. As previously discussed in the context ofFIG. 6 , the word length in this embodiment is the number of characters excluding punctuation. Note that, in alternative embodiments, the word length calculated atstep 607 ofFIG. 6 could be stored in the word array (along with the display element and the word multiplier) so that it does not have to be recalculated instep 703. -
Steps 704 then sets the ORP character (“orpc”) based on the value of wl, progressively testing the length until the appropriate value of orpc is selected for that word, in accordance with the recommendations inTABLE I. Step 705 determines if wl=1. If the result ofstep 705 is yes, then step 706 sets the orpc to 1 andprocessing 700 proceeds to step 714. If the result ofstep 705 is no, then step 707 determines if wl is greater than 1 and less than 6. If the result ofstep 707 is yes, then step 708 sets the orpc to 2 andprocessing 700 proceed to step 714. If the result ofstep 707 is no, then step 709 determines if wl is greater than 5 and less than 10. If the result ofstep 709 is yes, then step 710 sets the orpc to 3 andprocessing 700 proceeds to step 714. If the result ofstep 709 is no, then step 711 determines if wl is greater than 9 and less than 14. If the result ofstep 711 is yes, then step 712 sets the orpc to 4 andprocessing 700 proceeds to step 714. If the result ofstep 711 is no, thestep 713 sets the orpc to 5 andprocessing 700 proceeds to step 714. -
Step 714, displays ORP character (as selected bystep display location 201 in ORP display 200 (as illustrated by way of example in the window just to the right ofstep 714 inFIG. 7 ). Step 715 then displays the characters to the left of the ORP character one by one with the offset defined by the font width (as illustrated by way of example in the window just to the right ofstep 715 inFIG. 7 ). Step 716 then displays characters to the right of the ORP character are then displayed in the same manner (as illustrated by way of example in the window just to the right ofstep 716 inFIG. 7 ). - Step 717 then tests to see if the end of the text has been reached. If the result of
step 717 is no, then step 718 calculates the average word relative duration (“awdr”) by dividing the rtd by the wit. Step 710 then calculates the default update time (“dut”) by dividing the update time (“ut”) (which is retrieved fromdisplay settings module 308 ofFIG. 3 ) by the awdr. Step 720 then sets a timer and the word is displayed for a time equal to the product of the relative time multiplier and the dut. Step 721 directs that that the next word-multiplier pair is selected and processing 700 returns to step 702 so that the next word-multiplier can be processed. If the result ofstep 717 is yes, then display processing ends atstep 722. -
FIG. 8 provides a flow chart of processing 800 in accordance with an alternative to the embodiment ofFIG. 7 for the processing ofORP display processor 307. Specifically, in the embodiment ofFIG. 8 , the ORP ratio position method described earlier is used. Rather than using an identified ORP character, processing 800 utilizes a proportionate position for the optimal recognition position which, multiplied by the word with, provides an offset value from the fixed display location for placing a pixel that is at the beginning of the word. - Step 801 receives text from the
ORP text processor 303 or fromtext data store 311. Step 802 selects and loads the word-multiplier pair to be processed for display (which is either the first pair in the stored array referenced in 623 ofFIG. 6 on an initial processing loop, or a next pair in response to step 721). Step 803 then calculates the total width of the word (“ww”) in pixels and the average character width (“acw”) in pixels. As previously discussed, the word “width” in this context is calculated along the same dimension (in line with the reading direction) as is the word “length” referenced in the context earlier figures. The difference is that as used herein, “ww” is measured in pixels and “wl” is measured in number of characters. - Step 804 then determines the first pixel position for the display of the word in ORP-RSVP display 200 (an
exemplary ORP display 200 is shown just to the left ofstep 805 inFIG. 8 ) by calculating the ORP ratio offset (“ORPRO”). Instep 805, the word is displayed with the first pixel of the first character located at the ORPRO position 806 (which is a distance in pixels equal to the ORPRO from the fixed display location 201). This may be referenced as the “beginning pixel” of the word from the perspective of a reading direction of a reader of the display. Note that, for left to right languages, the beginning pixel is at the left edge of the word. Depending on the shape of the beginning character, there may be multiple pixels located a distance of ORPRO from the fixed display location (for example, in many fonts, the letter “b” would include several pixels at the left most edge of the word). As used herein, the “beginning pixel” will simply refer to any pixel at the beginning edge of the word. - When the beginning pixel is displayed at the ORPRO from fixed
display location 201, the ORP of the word, which in this case is identified as the optimal proportionate position along the width of the word (rather than being identified as a particular character), will be displayed at fixeddisplay location 201. - Step 807 tests to see if the end of the text has been reached. If the result of
step 807 is no, then then step 808 calculates the average word relative duration (“awdr”) by dividing the rtd by the wit. Step 809 then calculates the default update time (“dut”) by dividing the update time (“ut”), which is retrieved from thedisplay settings module 308, by the awdr. Step 810 then sets a timer and the word is displayed for a time equal to the product of the relative time multiplier and the dut. Step 811 directs that the next word-multiplier pair is selected and processing 800 returns to step 802 so that the next word-multiplier can be processed. If the result ofstep 807 is yes, then display processing 800 ends atstep 812. - The example of
FIG. 8 uses the average position ratio of character position ratios based on the values in TABLE I. However, as previously indicated other values could be used while still achieving benefits of the present invention. Such values may result in somewhat different proportions of a word being displayed to the left (for left to right languages) of the fixed display location. In some alternative embodiments, the proportion of a word (in particular, at least words that are greater than four characters in length) that is displayed from the word's beginning to the fixed display location is greater than or equal to 0.2 and less than or equal to 0.45. - As an alternative to processing all text before beginning the display processing, it is possible to display each display element (e.g., a word) after it has been processed. Referencing such an alternative in the context of modifying the processing order of steps shown in
FIG. 6 andFIG. 7 (which implements the ORP character position method), the order of steps would be modified as follows: Afterstep 615, the processing would proceed to step 703. Afterstep 720, then the processing would return to step 606 in order to prepare the next word for display. Ifstep 614 determined that it is a blank element, then step 617 would proceed in order to prepare the blank element for display instep 714. Then the processing would return to step 624 to continue the processing of the next sentence or it reaches the end of text processing and display processing. - Referencing such an alternative in the context of modifying the processing order of steps shown in
FIG. 6 andFIG. 8 (which implements the ORP ratio position offset method), afterstep 615, the next step would bestep 803. Afterstep 810, the processing would then return to step 606 in order to prepare the next word for display. Ifstep 614 determined that it was a blank element, then step 617 would proceed in order to prepare the blank element for display instep 810. Then the processing returns to step 624 to continue the processing of the next sentence or it reaches the end of text processing and display processing. - In serial text display, saccades are most noticeably a problem for words that are five or more characters in length. Therefore, a preferred embodiment of the present invention places the ORP at the fixed display location at least for display elements that are five or more characters in length. For such display elements (and for display elements of length four), the optimal recognition position is off-center toward the beginning of the display element (from the perspective of a reader of the display). However, while display of the ORP at the fixed display location for words that are fewer than five characters length is not necessary for achieving the benefits of particular embodiments of the invention, in a preferred embodiment, words of lengths four or less are also displayed using the ORP character position method or the ratio position offset method (which, for word lengths of three or less, will not necessarily result in the fixed display location being off center toward the beginning of the word). However, when such words (length four or less) are displayed at the fixed display location, exactly which character or proportionate position of these words is displayed at the fixed display location is not necessarily critical for minimizing saccades. At the same time, however, displaying words of length four or less such that their optimal recognition position is at the fixed display location does provide some smoothing benefit in that eye displacement from one word to the next is reduced, and therefore a preferred embodiment places an optimal recognition potions of all words, including words of length four or less at the fixed display location.
-
FIG. 9 illustrates several features that can be added to a basic embodiment of the present invention to improve its effectiveness.User interface 301 andORP display 200 can be enhanced to enable the user to interact with the display process. As illustrated inFIG. 9 , standard controls including startingcontrol 901, pausingcontrol 904, repeatingcontrol 905, andfast forwarding control 906 to control display of the text can be provided. Avisual indicator 902 can be provided to indicate the progress of the display as a fraction of the total amount of text to be displayed. Aslider 903 could also be used to enable jumping to any point in the text. Anindicator 907 of the display speed in average words per minute could be provided, which could also enable the user to change the speed during the presentation. Abookmark icon 909 could enable the user to click and set a bookmark during the presentation, and provide the means to restart the presentation at the point that the bookmark was set. Asettings icon 908 could be provided to enable the user to change for preferences for the presentation, such as the initial display speed, the color of the display background, the color or texture of the ORP indicators, and the text font type and size. - Other embodiments would enable the invention to be deployed on a variety of electronic devices, such as various computer operating systems, mobile phone operating systems, video gaming platforms, and portable electronic devices such as digital watches, cameras, and music players. While the basic embodiment described herein provides for ORP processing of text that is stored locally on the electronic device, it is possible that the text in a standard format or preprocessed ORP format could be streamed to the electronic device from a server via a wired or wireless network connection. While a preferred embodiment of the present invention is the display of text on small displays, if a large display is available then it would be possible to display the full text in a companion display, such that the progress through the text can be indicated by a moving highlight that corresponds to the word being currently display in the ORP Display.
- While the present invention has been particularly described with respect to the illustrated embodiments, it will be appreciated that various alterations, modifications and adaptations may be made based on the present disclosure and are intended to be within the scope of the present invention. While the invention has been described in connection with what are presently considered to be the most practical and preferred embodiments, it is to be understood that the present invention is not limited to the disclosed embodiment but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the scope of the appended claims.
Claims (22)
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/433,983 US20170229101A1 (en) | 2012-07-12 | 2017-02-15 | Serial text display for optimal recognition apparatus and method |
US16/455,700 US20190325848A1 (en) | 2012-07-12 | 2019-06-27 | Electronic display of serial text using optimal recognition positions |
US16/716,286 US20200193939A1 (en) | 2012-07-12 | 2019-12-16 | Electronic display of serial text using optimal recognition positions |
US17/202,218 US20210312890A1 (en) | 2012-07-12 | 2021-03-15 | Electronic display of serial text using optimal recognition positions |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/547,982 US8903174B2 (en) | 2012-07-12 | 2012-07-12 | Serial text display for optimal recognition apparatus and method |
US14/542,409 US20150199944A1 (en) | 2012-07-12 | 2014-11-14 | Serial text display for optimal recognition apparatus and method |
US15/433,983 US20170229101A1 (en) | 2012-07-12 | 2017-02-15 | Serial text display for optimal recognition apparatus and method |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/542,409 Continuation US20150199944A1 (en) | 2012-07-12 | 2014-11-14 | Serial text display for optimal recognition apparatus and method |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/455,700 Division US20190325848A1 (en) | 2012-07-12 | 2019-06-27 | Electronic display of serial text using optimal recognition positions |
Publications (1)
Publication Number | Publication Date |
---|---|
US20170229101A1 true US20170229101A1 (en) | 2017-08-10 |
Family
ID=49914042
Family Applications (6)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/547,982 Active 2033-07-09 US8903174B2 (en) | 2012-07-12 | 2012-07-12 | Serial text display for optimal recognition apparatus and method |
US14/542,409 Abandoned US20150199944A1 (en) | 2012-07-12 | 2014-11-14 | Serial text display for optimal recognition apparatus and method |
US15/433,983 Abandoned US20170229101A1 (en) | 2012-07-12 | 2017-02-15 | Serial text display for optimal recognition apparatus and method |
US16/455,700 Abandoned US20190325848A1 (en) | 2012-07-12 | 2019-06-27 | Electronic display of serial text using optimal recognition positions |
US16/716,286 Abandoned US20200193939A1 (en) | 2012-07-12 | 2019-12-16 | Electronic display of serial text using optimal recognition positions |
US17/202,218 Abandoned US20210312890A1 (en) | 2012-07-12 | 2021-03-15 | Electronic display of serial text using optimal recognition positions |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/547,982 Active 2033-07-09 US8903174B2 (en) | 2012-07-12 | 2012-07-12 | Serial text display for optimal recognition apparatus and method |
US14/542,409 Abandoned US20150199944A1 (en) | 2012-07-12 | 2014-11-14 | Serial text display for optimal recognition apparatus and method |
Family Applications After (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/455,700 Abandoned US20190325848A1 (en) | 2012-07-12 | 2019-06-27 | Electronic display of serial text using optimal recognition positions |
US16/716,286 Abandoned US20200193939A1 (en) | 2012-07-12 | 2019-12-16 | Electronic display of serial text using optimal recognition positions |
US17/202,218 Abandoned US20210312890A1 (en) | 2012-07-12 | 2021-03-15 | Electronic display of serial text using optimal recognition positions |
Country Status (6)
Country | Link |
---|---|
US (6) | US8903174B2 (en) |
EP (1) | EP2872984B1 (en) |
JP (1) | JP6243418B2 (en) |
CN (1) | CN104685464B (en) |
ES (1) | ES2700224T3 (en) |
WO (1) | WO2014011884A1 (en) |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2007051129A2 (en) | 2005-10-25 | 2007-05-03 | Brubaker Curtis M | Method and apparatus for obtaining revenue from the distribution of hyper-relevant advertising |
US8903174B2 (en) * | 2012-07-12 | 2014-12-02 | Spritz Technology, Inc. | Serial text display for optimal recognition apparatus and method |
US20140189586A1 (en) | 2012-12-28 | 2014-07-03 | Spritz Technology Llc | Methods and systems for displaying text using rsvp |
US9483109B2 (en) | 2012-07-12 | 2016-11-01 | Spritz Technology, Inc. | Methods and systems for displaying text using RSVP |
EP2972734A2 (en) | 2013-03-12 | 2016-01-20 | Dirk Keune | New uses of smartphones and comparable mobile digital terminal devices |
US9524568B2 (en) * | 2013-06-06 | 2016-12-20 | Apple Inc. | Movement of position indicator on touchscreen |
US9028067B1 (en) | 2014-05-28 | 2015-05-12 | Sightex LLC | Relocated virtual retinal image method and system |
US10601980B1 (en) | 2014-09-16 | 2020-03-24 | Ultratec, Inc. | Captioning system and method for the vision impaired |
US20160371240A1 (en) * | 2015-06-17 | 2016-12-22 | Microsoft Technology Licensing, Llc | Serial text presentation |
JP2017167433A (en) * | 2016-03-17 | 2017-09-21 | 株式会社東芝 | Summary generation device, summary generation method, and summary generation program |
WO2018124965A1 (en) * | 2016-12-28 | 2018-07-05 | Razer (Asia-Pacific) Pte. Ltd. | Methods for displaying a string of text and wearable devices |
DE202017101642U1 (en) | 2017-03-21 | 2017-08-22 | Readio Gmbh | Application software for a mobile, digital terminal |
US10725540B2 (en) | 2018-06-29 | 2020-07-28 | International Business Machines Corporation | Augmented reality speed reading |
US11749132B2 (en) | 2018-11-21 | 2023-09-05 | International Business Machines Corporation | Enhanced speed reading with eye tracking and blink detection |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2008051510A2 (en) * | 2006-10-20 | 2008-05-02 | Vubotics, Inc. | System and method for analyzing and delivering information |
US8903174B2 (en) * | 2012-07-12 | 2014-12-02 | Spritz Technology, Inc. | Serial text display for optimal recognition apparatus and method |
Family Cites Families (72)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3938139A (en) * | 1974-12-30 | 1976-02-10 | Young Communications Corporation | Miniature display communicator |
US5137027A (en) | 1987-05-01 | 1992-08-11 | Rosenfeld Joel P | Method for the analysis and utilization of P300 brain waves |
US4932416A (en) | 1987-05-01 | 1990-06-12 | Rosenfeld Joel P | Method for the analysis, display and classification of event related potentials by interpretation of P3 responses |
US4845645A (en) | 1987-08-28 | 1989-07-04 | The United States Of America As Represented By The Secretary Of The Air Force | Sequential rapid communication visual displays |
AUPN520495A0 (en) | 1995-09-04 | 1995-09-28 | Charon Holdings Pty Ltd | Reading aid |
US6292176B1 (en) | 1996-02-26 | 2001-09-18 | Motorola, Inc. | Method and system for displaying textual information |
US5873109A (en) | 1996-06-03 | 1999-02-16 | High; Clifford R. | Device and method for displaying text of an electronic document on a screen in real time |
US6067069A (en) | 1997-03-14 | 2000-05-23 | Krause; Philip R. | User interface for dynamic presentation of text with a variable speed based on a cursor location in relation to a neutral, deceleration, and acceleration zone |
US6098085A (en) | 1997-03-17 | 2000-08-01 | At&T Corp. | Word-serial reader for network devices having limited display capabilities |
US6130968A (en) | 1997-10-03 | 2000-10-10 | Mcian; Peter | Method of enhancing the readability of rapidly displayed text |
US6353824B1 (en) | 1997-11-18 | 2002-03-05 | Apple Computer, Inc. | Method for dynamic presentation of the contents topically rich capsule overviews corresponding to the plurality of documents, resolving co-referentiality in document segments |
EP1208419A2 (en) | 1999-10-20 | 2002-05-29 | Koninklijke Philips Electronics N.V. | Information processing device |
US6652283B1 (en) | 1999-12-30 | 2003-11-25 | Cerego, Llc | System apparatus and method for maximizing effectiveness and efficiency of learning retaining and retrieving knowledge and skills |
US7475334B1 (en) | 2000-01-19 | 2009-01-06 | Alcatel-Lucent Usa Inc. | Method and system for abstracting electronic documents |
US6515690B1 (en) | 2000-02-25 | 2003-02-04 | Xerox Corporation | Systems and methods providing an interface for navigating dynamic text |
KR100524590B1 (en) | 2000-08-04 | 2005-11-01 | 박규진 | Reading apparatus and method using display device |
SE524403C2 (en) | 2000-11-06 | 2004-08-03 | Ericsson Telefon Ab L M | System and method for customizable RSVP-based text display |
US7159172B1 (en) | 2000-11-08 | 2007-01-02 | Xerox Corporation | Display for rapid text reading |
FI117524B (en) | 2000-12-15 | 2006-11-15 | Nokia Corp | Procedure and arrangement for displaying hypertext pages |
US6816174B2 (en) | 2000-12-18 | 2004-11-09 | International Business Machines Corporation | Method and apparatus for variable density scroll area |
US20020133521A1 (en) * | 2001-03-15 | 2002-09-19 | Campbell Gregory A. | System and method for text delivery |
US7404142B1 (en) | 2001-06-29 | 2008-07-22 | At&T Delaware Intellectual Property, Inc. | Systems and method for rapid presentation of structured digital content items |
US20030038754A1 (en) | 2001-08-22 | 2003-02-27 | Mikael Goldstein | Method and apparatus for gaze responsive text presentation in RSVP display |
US6925613B2 (en) | 2001-08-30 | 2005-08-02 | Jim Gibson | Strobe reading technology and device |
SE0103151D0 (en) | 2001-09-19 | 2001-09-19 | Ericsson Telefon Ab L M | Method for navigation and selection at a terminal device |
US7549114B2 (en) | 2002-02-21 | 2009-06-16 | Xerox Corporation | Methods and systems for incrementally changing text representation |
US20030184560A1 (en) | 2002-03-27 | 2003-10-02 | Pierce James W. | Display system for increasing legibility of small electronic device displays |
GB2395804A (en) | 2002-11-27 | 2004-06-02 | Sony Uk Ltd | Information retrieval |
US20040119684A1 (en) * | 2002-12-18 | 2004-06-24 | Xerox Corporation | System and method for navigating information |
US7991920B2 (en) | 2002-12-18 | 2011-08-02 | Xerox Corporation | System and method for controlling information output devices |
US7139006B2 (en) | 2003-02-04 | 2006-11-21 | Mitsubishi Electric Research Laboratories, Inc | System and method for presenting and browsing images serially |
US8292433B2 (en) | 2003-03-21 | 2012-10-23 | Queen's University At Kingston | Method and apparatus for communication between humans and devices |
JP3982454B2 (en) | 2003-05-27 | 2007-09-26 | ソニー株式会社 | Portable electronic device, web page processing method and program |
US7613731B1 (en) | 2003-06-11 | 2009-11-03 | Quantum Reader, Inc. | Method of analysis, abstraction, and delivery of electronic information |
GB2403558A (en) | 2003-07-02 | 2005-01-05 | Sony Uk Ltd | Document searching and method for presenting the results |
JP2005251034A (en) | 2004-03-05 | 2005-09-15 | Konami Co Ltd | Character string display system, character string display method and program |
US8472791B2 (en) | 2004-03-17 | 2013-06-25 | Hewlett-Packard Development Company, L.P. | Variable speed video playback |
US7454717B2 (en) | 2004-10-20 | 2008-11-18 | Microsoft Corporation | Delimiters for selection-action pen gesture phrases |
US8458152B2 (en) * | 2004-11-05 | 2013-06-04 | The Board Of Trustees Of The Leland Stanford Jr. University | System and method for providing highly readable text on small mobile devices |
US7598977B2 (en) | 2005-04-28 | 2009-10-06 | Mitsubishi Electric Research Laboratories, Inc. | Spatio-temporal graphical user interface for querying videos |
US8418057B2 (en) | 2005-06-01 | 2013-04-09 | Cambridge Reading Project, Llc | System and method for displaying text |
US8069466B2 (en) | 2005-08-04 | 2011-11-29 | Nds Limited | Advanced digital TV system |
CN101300573A (en) * | 2005-08-29 | 2008-11-05 | 乔舒亚·F·克雷格 | System, device, and method for conveying information using a rapid serial presentation technique |
US20090066722A1 (en) * | 2005-08-29 | 2009-03-12 | Kriger Joshua F | System, Device, and Method for Conveying Information Using Enhanced Rapid Serial Presentation |
EP1793577A1 (en) | 2005-12-05 | 2007-06-06 | Microsoft Corporation | Playback of digital images |
US8245142B2 (en) | 2005-12-29 | 2012-08-14 | Ozmiz Pty. Ltd. | Method and system for displaying data on a mobile terminal |
US8374687B2 (en) | 2006-01-21 | 2013-02-12 | Honeywell International Inc. | Rapid serial visual presentation triage prioritization based on user state assessment |
US7835581B2 (en) | 2006-08-30 | 2010-11-16 | Honeywell International Inc. | Neurophysiologically driven high speed image triage system and method |
US8165407B1 (en) | 2006-10-06 | 2012-04-24 | Hrl Laboratories, Llc | Visual attention and object recognition system |
US8214309B1 (en) | 2008-12-16 | 2012-07-03 | Hrl Laboratories, Llc | Cognitive-neural method for image analysis |
US8285052B1 (en) | 2009-12-15 | 2012-10-09 | Hrl Laboratories, Llc | Image ordering system optimized via user feedback |
US8363939B1 (en) | 2006-10-06 | 2013-01-29 | Hrl Laboratories, Llc | Visual attention and segmentation system |
US8699767B1 (en) * | 2006-10-06 | 2014-04-15 | Hrl Laboratories, Llc | System for optimal rapid serial visual presentation (RSVP) from user-specific neural brain signals |
US20080141126A1 (en) | 2006-11-17 | 2008-06-12 | Vincent Lee Johnson | Method and system to aid in viewing digital content |
US8059136B2 (en) | 2007-12-11 | 2011-11-15 | Honeywell International Inc. | Hierarchichal rapid serial visual presentation for robust target identification |
US8244475B2 (en) | 2007-12-27 | 2012-08-14 | Teledyne Scientific & Imaging, Llc | Coupling human neural response with computer pattern analysis for single-event detection of significant brain responses for task-relevant stimuli |
US8265743B2 (en) | 2007-12-27 | 2012-09-11 | Teledyne Scientific & Imaging, Llc | Fixation-locked measurement of brain responses to stimuli |
WO2009089532A1 (en) | 2008-01-11 | 2009-07-16 | Oregon Health & Science University | Rapid serial presentation communication systems and methods |
US7991195B2 (en) | 2008-02-25 | 2011-08-02 | Honeywell International Inc. | Target specific image scaling for effective rapid serial visual presentation |
US8369652B1 (en) | 2008-06-16 | 2013-02-05 | Hrl Laboratories, Llc | Visual attention system for salient regions in imagery |
US8335751B1 (en) | 2008-12-16 | 2012-12-18 | Hrl Laboratories, Llc | System for intelligent goal-directed search in large volume imagery and video using a cognitive-neural subsystem |
US7946707B1 (en) | 2009-02-05 | 2011-05-24 | Mcdonald Ii James Edward | Eye dominance evaluation apparatus and method |
CN101599127B (en) * | 2009-06-26 | 2011-09-14 | 安徽大学 | Method for extracting and identifying characteristics of electro-ocular signal |
US20110117969A1 (en) | 2009-11-17 | 2011-05-19 | Research In Motion Limited | Mobile wireless communications device displaying textual content using rapid serial visual presentation and associated methods |
EP2323357A1 (en) | 2009-11-17 | 2011-05-18 | Research In Motion Limited | A mobile wireless communications device displaying textual content using rapid serial visual presentation and associated methods |
US8274592B2 (en) | 2009-12-22 | 2012-09-25 | Eastman Kodak Company | Variable rate browsing of an image collection |
JP2011138234A (en) * | 2009-12-26 | 2011-07-14 | Asahi Build Engineering:Kk | Array form of fast reading text and fast reading method |
US8483816B1 (en) | 2010-02-03 | 2013-07-09 | Hrl Laboratories, Llc | Systems, methods, and apparatus for neuro-robotic tracking point selection |
WO2012004785A1 (en) | 2010-07-05 | 2012-01-12 | Cognitive Media Innovations (Israel) Ltd. | System and method of serial visual content presentation |
FI20100380L (en) | 2010-11-17 | 2012-05-18 | Icergo Oy | The method presents readable information on a digital display board |
CN102073377B (en) * | 2010-12-31 | 2013-01-02 | 西安交通大学 | Man-machine interactive type two-dimensional locating method based on human eye-glanced signal |
US20130159850A1 (en) | 2011-12-19 | 2013-06-20 | Barnesandnoble.Com Llc | Enhanced rapid serial visual presentation speed-reading for electronic reading devices |
-
2012
- 2012-07-12 US US13/547,982 patent/US8903174B2/en active Active
-
2013
- 2013-07-11 CN CN201380047445.9A patent/CN104685464B/en not_active Expired - Fee Related
- 2013-07-11 ES ES13816590T patent/ES2700224T3/en active Active
- 2013-07-11 JP JP2015521810A patent/JP6243418B2/en active Active
- 2013-07-11 EP EP13816590.7A patent/EP2872984B1/en active Active
- 2013-07-11 WO PCT/US2013/050081 patent/WO2014011884A1/en active Application Filing
-
2014
- 2014-11-14 US US14/542,409 patent/US20150199944A1/en not_active Abandoned
-
2017
- 2017-02-15 US US15/433,983 patent/US20170229101A1/en not_active Abandoned
-
2019
- 2019-06-27 US US16/455,700 patent/US20190325848A1/en not_active Abandoned
- 2019-12-16 US US16/716,286 patent/US20200193939A1/en not_active Abandoned
-
2021
- 2021-03-15 US US17/202,218 patent/US20210312890A1/en not_active Abandoned
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2008051510A2 (en) * | 2006-10-20 | 2008-05-02 | Vubotics, Inc. | System and method for analyzing and delivering information |
US8903174B2 (en) * | 2012-07-12 | 2014-12-02 | Spritz Technology, Inc. | Serial text display for optimal recognition apparatus and method |
Non-Patent Citations (2)
Title |
---|
Brysbaert Visual Constraints in Written Word recognition evidence from the optimal viewing-position effect, Journal of Research in Reading, ISSN 0141-0423, Volume 28, Issue 3, PP 216-228, 2005 * |
Marc Brysbaert et al. (Visual Constraints in Written Word recognition: evidence from the optimal viewing-position effect", Journal of Research in Reading, ISSN 0141-0423, Volume 28, Issue 3, PP 216-228, 2005). * |
Also Published As
Publication number | Publication date |
---|---|
EP2872984A1 (en) | 2015-05-20 |
US20150199944A1 (en) | 2015-07-16 |
CN104685464A (en) | 2015-06-03 |
ES2700224T3 (en) | 2019-02-14 |
US20210312890A1 (en) | 2021-10-07 |
EP2872984B1 (en) | 2018-09-12 |
US8903174B2 (en) | 2014-12-02 |
EP2872984A4 (en) | 2016-04-20 |
US20200193939A1 (en) | 2020-06-18 |
JP2015523662A (en) | 2015-08-13 |
US20190325848A1 (en) | 2019-10-24 |
CN104685464B (en) | 2017-05-03 |
WO2014011884A1 (en) | 2014-01-16 |
JP6243418B2 (en) | 2017-12-06 |
US20140016867A1 (en) | 2014-01-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20210312890A1 (en) | Electronic display of serial text using optimal recognition positions | |
US10983667B2 (en) | Methods and systems for displaying text using RSVP | |
CN106471458B (en) | Intelligent sliding and wiping strip in electronic book navigation interface | |
US10192341B2 (en) | Systems and methods for improving the readability of content | |
US9275017B2 (en) | Methods, systems, and media for guiding user reading on a screen | |
US8135574B2 (en) | Creating and displaying bodies of parallel segmented text | |
US20150143234A1 (en) | Ergonomic micro user interface display and editing | |
EP2851901A1 (en) | Playback system for synchronised soundtracks for electronic media content | |
US9684641B1 (en) | Presenting content in multiple languages | |
US20150269126A1 (en) | Portlet display on portable computing devices | |
EP2867756A1 (en) | Input method editor | |
CN107533568B (en) | System and method for determining application zoom level | |
US20150363954A1 (en) | Optimized serial text display for chinese and related languages | |
US20140195900A1 (en) | Computer readable medium for enhanced display of digital text | |
US20220261528A9 (en) | Clutter reduction in composite-text display | |
CN106020749B (en) | Display control method, display control device, and display device | |
JP7145609B2 (en) | Computer program and text data display processing system | |
JP6286897B2 (en) | Document display device, document display method, and document display program | |
GB2619735A (en) | Reading method and apparatus | |
JP6550713B2 (en) | Text display device, program and control method | |
Morey et al. | Interface development for a gaze-controlled reading support application | |
Amin et al. | Blaise On-the-Go: Using Blaise IS With Mobile Devices | |
US20230236711A1 (en) | Automatic ebook page turning system | |
Heath | The effect of multi-device design on website efficiency and user preference | |
CN115935002A (en) | Searching method and device and electronic equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SPRITZ HOLDING LLC, UTAH Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SPRITZ TECHNOLOGY, INC.;REEL/FRAME:042169/0132 Effective date: 20170312 |
|
AS | Assignment |
Owner name: SPRITZ TECHNOLOGY, INC., UTAH Free format text: CHANGE OF NAME;ASSIGNOR:SPRITZ TECHNOLOGY LLC;REEL/FRAME:049342/0694 Effective date: 20131230 Owner name: SPRITZ TECHNOLOGY LLC, MASSACHUSETTS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MAURER, MAIK STEFFEN;KLEIN, MATTHIAS;WALDMAN, FRANCIS ABBOTT;REEL/FRAME:047934/0947 Effective date: 20120712 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |