TEXT TO SPEECH SYSTEM WITH REAL-TIME AMENDMENT CAPABILITY

Abstract

An application configured to be a text-to-speech (“TTS”) application wherein the application is capable of reading a document aloud to a reviewer via a device, such as a smartphone, an mp3 device, or a tablet, while the reviewer is able to make amendments to the document in real-time is presented.

Claims

1. A method of highlighting text in a text-to-speech system, the system comprising the steps of: providing a text to speech application (TTS app); installing the TTS app on a computing device; installing text onto the TTS app; reading text by the TTS app aloud to a reviewer; transmitting a first signal to the TTS app by the reviewer while the TTS app is reading the text; highlighting a portion of the text by the TTS app in response to receiving the first signal by the reviewer simultaneously while continuing to read text.

2. The method of claim 1, wherein the first signal is a button press of a remote control device.

3. The method of claim 1, wherein the first signal is a first voice command.

4. The method of claim 1, wherein the computing device is smartphone.

5. The method of claim 1, further comprising the step of highlighting a predetermined amount of text before the transmission of the first signal.

6. The method of claim 1, further comprising the step of highlighting a predetermined amount of text after the transmission of the first signal.

7. The method of claim 1, further comprising the step of highlighting a predetermined portion of the text in response to the transmission of the first signal, such as highlighting a predetermined number of sentences or paragraphs.

8. The method of claim 1, further comprising the step of transmitting a report of the highlighted text in response to a second signal.

9. The method of claim 1, wherein the text is highlighted without the need to interrupt reading of the text.

10. The method of claim 1, wherein the text is highlighted without the need to rewind reading of the text.

11. The method of claim 1, further comprising the step displaying the text as it is read on a display of the computing device.

12. A method of highlighting text in a text-to-speech system, the system comprising the steps of: providing a text to speech application (TTS app); installing the TTS app on a computing device; installing text onto the TTS app; reading text by the TTS app aloud to a reviewer; transmitting a first signal to the TTS app by the reviewer while the TTS app is reading the text; highlighting a portion of the text by the TTS app in response to receiving the first signal by the reviewer simultaneously while continuing to read text; wherein the highlighting of the text does not require interrupting the reading of the text or rewinding the reading of the text.

13. The method of claim 12, wherein the first signal is a button press of a remote control device.

14. The method of claim 12, wherein the first signal is a first voice command.

15. The method of claim 12, wherein the computing device is smartphone.

16. The method of claim 12, further comprising the step of highlighting a predetermined amount of text before the transmission of the first signal.

17. The method of claim 12, further comprising the step of highlighting a predetermined amount of text after the transmission of the first signal.

18. The method of claim 1, further comprising the step of highlighting a predetermined portion of the text in response to the transmission of the first signal, such as highlighting a predetermined number of sentences or paragraphs.

19. The method of claim 1, further comprising the step of transmitting a report of the highlighted text in response to a second signal.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0031] For a more complete understanding of the present disclosure, the objects and advantages thereof, reference is now made to the ensuing descriptions taken in connection with the accompanying drawings briefly described as follows.

[0032] FIG. 1 is a flowchart showing the text-to-speech system, according to an embodiment of the present disclosure; and

[0033] FIG. 2 is a plan view of the key fob controller for the disclosure, according to an embodiment.

DETAILED DESCRIPTION OF THE DISCLOSURE

[0034] In the following detailed description, reference is made to the accompanying drawings which form a part thereof, and in which is shown by way of illustration of specific embodiments in which the disclosure may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the disclosure, and it is to be understood that other embodiments may be utilized and that mechanical, procedural, and other changes may be made without departing from the spirit and scope of the disclosure(s). The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the disclosure(s) is defined only by the appended claims, along with the full scope of equivalents to which such claims are entitled.

[0035] Notably, while the term “highlight” or “highlighting” is used herein this term is to be construed broadly and is intended to mean selection of text. This highlighting may include changing the color of the text and/or the background color surrounding the text, however changing the color or adding color or highlighting, as it is known, is not required. Instead, the term highlighting is to be construed broadly as indicating text of interest to the reviewer.

[0036] As one example, embodiments of the disclosure and their advantages may be understood by referring to FIGS. 1-2, wherein like reference numerals refer to like elements.

[0037] The system, in an embodiment of an app, such as an application, software, code or the like, running on a computing device such as a smartphone, computer, laptop, smart watch, or the like, allows the reviewer to highlight, underline or otherwise flag one or more of: (a) the current sentence or sentences or paragraph or paragraphs (question and answer in a deposition, for example), (b) the previous sentence or sentences or paragraph paragraphs (question and answer in a deposition, for example), or (c) the entire page, or (d) the entire paragraph, or (e) a predetermined number of words before and/or a predetermined number of words after initiation of the highlighting (such as 100 words before and 25 words after, for example), or (f) a predetermined amount of time before and/or a predetermined amount of time and/or after initiation of the highlighting (such as ten seconds before and five seconds after, for example), without ever stopping the TTS.

[0038] As the TTS reads the text to the reviewer, when the reviewer hears an area of interest, such as an important portion of a deposition, the reviewer initiates a signal to be provided to the app to commence highlighting the area of interest. This signal may be a button press on a remote control device, a button press on a touch screen, a voice command, or any other signal. In one arrangement, once the signal is transmitted to the app, a predetermined amount of text is highlighted, such as a predetermined number of sentences before and/or after transmission of the signal, a predetermined amount of words before and/or after transmission of the signal, a predetermined amount of time before and/or after transmission of the signal, or any other amount of text. In an alternative arrangement, after the initial signal is transmitted, the amount of text that is highlighted is affected by a second signal that is provided by the reviewer. This second signal may be a similar or identical signal as the first signal and may be a button press on a remote control device, a button press on a touch screen, a voice command, or any other signal. In one arrangement, once the second signal is transmitted to the app, a predetermined amount of text is highlighted, such as a predetermined number of sentences before and/or after transmission of the first signal and second signal, a predetermined amount of words before and/or after transmission of the first signal and second signal, a predetermined amount of time before and/or after transmission of the first signal and second signal, or any other amount of text. A such, the use of a second signal allows the reviewer to have greater amount of control over the amount of text that is highlighted. Alternatively, the second signal indicates when the highlighting is to be stopped and the application highlights the text between the first signal and the second signal. This process may be perceived as “On-the-Go Highlighting”.

[0039] In one arrangement, there is also an audible background feedback noise, slightly quieter than the TTS voice, to indicate successful highlighting while the text is being highlighted. In one embodiment, a chime sound indicates the start of the highlighting, and another chime sound indicates the end of the highlighting. The highlighting may involve changing the color or background of the text, underlining, italicizing, flagging, bolding, highlighting or any other marking of the text to set it apart from the rest of the document. In one arrangement, when the formatted text is re-read, the highlighted text also exhibits a sound during the highlighting to indicate the highlighting of the text, such as a different tone, a background noise, a tone at the beginning and end of the highlighted text, or any other audible indication.

[0040] The system is compatible with controls on ear buds, stylus, smartphones, smart watches, a wireless remote, a voice control device any device using a wireless protocol such as Bluetooth, ZigBee, Z-Wave, Wi-Fi, or any other wireless protocol, or any other electronic device for accepting audio commands. In one embodiment, there is also a proprietary wireless device associated with the system to provide input to the app, such as a remote control, a key fob or the like. In one arrangement, buttons are provided on the remote control or key fob in order to play/pause the text or to move forward or backward among the text, a page, a paragraph or one line at a time. Buttons are also provided for highlighting the preceding page, paragraph or line. Further buttons may be available for starting and stopping highlighting as the text is being read. The remote control or key fob automatically syncs with the computing device, such as a smartphone, through a wireless protocol, such as Bluetooth or a similar network technology, and contains a battery to operate on its own power.

[0041] The signal may be provided by a push-button, for example, on the screen of the smartphone or other electronic device, or by a remote control or remote control 100 such as a key fob. Alternatively, a unique word or signal spoken by the reviewer and recognized by the app may be used so that the reviewer may provide signals by hands-free means to the app. An ongoing verbal signal may be used to indicate ongoing highlighting of the document in order to highlight text as passages are being read. The resulting solution makes document review with TTS a hands-off process, simple, and interruption-free.

[0042] With reference to FIG. 1, at step 10, a Text-to-Speech (TTS) application or (app) 12 (TTS app 12) having a Text-to-Speech (TTS) engine 14 is downloaded onto, installed onto or run on a computing device 16, such as a laptop, computer, smart phone, tablet, smart watch, a digital voice assistant such as the Amazon Echo, Google Home, Apple Siri Hub, or other digital voice assistant or any other computing device having an TTS app 12 installed thereon. In one arrangement, the TTS engine 14 is a module or portion of software code that reads text 20 and converts it to a spoken or natural voice 22 though a speaker 24 connected, directly or indirectly, to computing device 16.

[0043] At step 26 text 20 is downloaded onto the TTS application 12 having TTS engine 14 and the TTS app reads text 20 with a natural voice 22 aloud through speaker 24. At step 28 when the reviewer 30 hears text 20 that he or she wishes to highlight, the reviewer 30 provides a first signal 32 to the TTS app 12 to select the text 20 contemporaneous with when it is spoken, or shortly after it is spoken. First signal 32 may be a predefined verbal signal, such as a voice command such as “highlight” or the like, to benefit from hands-free operation. Or, alternatively, first signal 32 may be a push of a button (110, 115, 120, 125, 130, 135) on a remote control 100. First signal 32 is wirelessly transmitted to computing device 16.

[0044] It is to be understood that the functionality of the remote control 100 may be incorporated within the TTS app 12 itself and therefore that the remote control 100 is optional. That is, the buttons (110, 115, 120, 125 130, 135) of remote control 100 may be displayed on a display of the computing device 16, and/or buttons or keys of the computing device 16 may take on the functionality of the buttons (110, 115, 120, 125 130, 135) of remote control 100. In this way, the need for remote control device 100 is eliminated. However, use of the remote control device 100 may increase convenience and ease of use in some arrangements.

[0045] According to the instructions stored in memory 34 of computing device 16, the selection of text 20 is highlighted at step 36. The highlighting is registered on the text file 38 within the TTS app 12, and stored in a modified text version 40 of the text file 38 within the TTS app 12. In one arrangement, once the first signal 32 is transmitted to the TTS app 12, a predetermined amount of text 20 is highlighted, such as a predetermined number of sentences before and/or after transmission of the first signal 32, a predetermined amount of words before and/or after transmission of the first signal 32, a predetermined amount of time before and/or after transmission of the first signal 32, or any other amount of text 20. In an alternative arrangement, after the first signal 32 is transmitted, the amount of text 20 that is highlighted is affected by a second signal 42 that is provided by the reviewer 30. This second signal 42 may be a similar or identical signal as the first signal 32 and may be a press of a button (110, 115, 120, 125, 130, 135) on a remote control device 100, a press of a button (110, 115, 120, 125, 130, 135) on a touch screen, a voice command, or any other signal. In one arrangement, once the second signal 42 is transmitted to the TTS app 12, a predetermined amount of text 20 is highlighted, such as a predetermined number of sentences before and/or after transmission of the first signal 32 and second signal 40, a predetermined amount of words before and/or after transmission of the first signal 32 and second signal 42, a predetermined amount of time before and/or after transmission of the first signal 32 and second signal 42, or any other amount of text. A such, the use of a second signal 42 allows the reviewer 30 to have greater amount of control over the amount of text 20 that is highlighted. Alternatively, the second signal 42 indicates when the highlighting is to be stopped and the TTS app 12 highlights the text 20 between the first signal 32 and the second signal 42. This process may be perceived as “On-the-Go Highlighting”.

[0046] At step 44, the speech-to-text may be advanced or backtracked by page, paragraph or line either by a reviewer's verbal command or by a push of a button (110, 115, 120, 125, 130, 135) on the remote control 100.

[0047] At step 46, the text 20 of the highlighted portions may be read back as a verbal summary or provided to the reviewer 30. This may be accomplished by issuing a third signal 48, such as a press of a button (110, 115, 120, 125, 130, 135) of remote control 100, or a verbal command. Any number of other commands or buttons can be used to control operation of the TTS app 12.

[0048] In one arrangement, to represent different text effects, such as highlighting and other forms of emphasis, lower-level background noise is used, which may be heard continually with the voice reading the text 20 to indicate the highlighting. At step 50, a remote control 100 or key fob may synchronize with the computing device 16, such as a smartphone on which the TTS app 12 is running.

[0049] At step 54, in one arrangement, as the text 20 is read aloud by TTS app 12, the text 20, and any highlighting or other operations, are displayed simultaneously on a display 52 of computing device 16, such as a smartphone.

[0050] At step 56 the TTS app 12 provides controls 58 to move forward or backward by line, paragraph, or page. In one arrangement, controls 58 are displayed on display 52 of computing device 16.

[0051] At step 60 the remote control 100 or key fob allows the transmission of a signal (32, 42, 48) by a reviewer 30 to indicate that text 20 is to be highlighted, either by line, paragraph or page, without stopping the reading.

[0052] At step 62 the TTS app 12 transmits a report 64 identifying the highlighted portions of text 20, as well as an account of the amount of time that was spent reviewing the text 20 to a digital account, such as an email address 66 or database 68 by recognizing a fifth command 70 to transmit the report 64.

[0053] At step 72, the app tracks time spent reviewing and editing the text 20 in document from the opening of the document through to the closing or sending of the document. This ability is extremely useful to report a summary of time spent reviewing and editing a document to a time-tracking application as used by law firms, for example.

[0054] With reference to FIG. 2, a remote control 100, for example, a key fob or a smartphone, is presented for use with the TTS app 12, is shown. In one arrangement, the remote control 100 has a housing with a keyring 105 attached thereon for retaining keys or attaching to a lanyard or another component. A split ring style may be used to mount one or more keys thereon. The remote control 100 has a plurality of buttons button (110, 115, 120, 125, 130, 135) thereon, namely, the following types of buttons: (1) a button to highlight the sentence previously read (“line button”) 110 which enables the reviewer 30 to recall and highlight a sentence before the one that was just heard without stopping the reading of the document; (2) a highlight previous paragraph button 115, which enables the reviewer 30 to highlight the paragraph that was just read without stopping the reading of the document; and (3) a page button 120 which highlights the current page in its entirety. On the other side of remote control 100 is a highlight current sentence button 125, a highlight current paragraph button 130 and a play/pause button 135 which controls the playback of the document reading without losing the present position. The housing of remote control 100 contains electronics to transmit the command to the TTS app wirelessly (for example, via Bluetooth or Wi-Fi, however any other wireless protocol is hereby contemplated for use) when pushed by the reviewer 30. In an embodiment, the buttons button (110, 115, 120, 125, 130, 135) are push buttons, and in another embodiment, the buttons may be contact buttons where mere contact of a reviewer's finger transmits the command, such as a touch screen.

[0055] The disclosure has been described herein using specific embodiments for the purposes of illustration only. It will be readily apparent to one of ordinary skill in the art, however, that the principles of the disclosure can be embodied in other ways. Therefore, the disclosure should not be regarded as being limited in scope to the specific embodiments disclosed herein, but instead as being fully commensurate in scope with the following claims.