Augmented reader and method for augmented reading of texts

Abstract

The invention relates to an augmented reader and to a method for augmented reading of text. A subject matter of the invention is an augmented text reader comprising at least one controller capable of controlling an action relating to a portion of a text, the action being a function of a neural signal received. This means that the user does not have to manipulate the real or virtual content containing the text to trigger the control of the action. This will facilitate accessibility to the reading of real or virtual content, including for disabled users, but also regardless of the context in which the user reads the content, particularly in a work context wherein the user is handling tools.

Description

Description Title of the invention: Augmented reader and method for augmented reading of texts technical field

[0001] The invention relates to an augmented reader and a method for augmented reading of texts. State of the art

[0002] When reading a printed book, highlighting text, taking notes, looking up a word in the dictionary, or marking a page requires external equipment (pencil, paper, dictionary, bookmark), which necessitates pausing the reading. Indeed, handling an object other than the book means that the reader can only hold the book with one hand, or even has to put the book down.

[0003] Furthermore, highlighting and dog-earing a page as a bookmark damages the book, which is not necessarily desirable either.

[0004] Technologies like ebooks can facilitate certain actions but have limitations and drawbacks. Ebooks require manual manipulation to access their functions (making them inaccessible to some types of disabilities or in certain contexts of use).

[0005] Voice recognition could then be considered. However, voice recognition is not suitable for environments requiring discretion or noisy environments.

[0006] Furthermore, these techniques only apply to digital books, not to paper content or other reading media. Description of the invention

[0007] One of the aims of the present invention is to provide improvements over the prior art.

[0008] An object of the invention is an augmented text reader comprising at least one controller capable of commanding an action relating to a portion of a text, the action being a function of a received neural signal.

[0009] Therefore, the user will not have to manipulate the physical or virtual content containing the text to trigger the action. This will facilitate access to reading physical or virtual content, including for users with disabilities, and regardless of the context in which the user reads the content, particularly in a work environment where the user is manipulating tools.

[0010] Advantageously, the portion of the text is a function of a user's eye-tracking data.

[0011] Thus, Faction can be performed on the entire text or only a part of it.

[0012] Advantageously, the portion of the text is a text area captured based on eye-tracking data.

[0013] Thus, Faction can be performed on printed text on a real medium.

[0014] Advantageously, the augmented text reader includes an eye-tracking device providing eye-tracking data of a user.

[0015] Advantageously, the augmented text reader includes a text sensor capable of capturing a text area based on eye-tracking data, the captured text area constituting the text portion.

[0016] Advantageously, the augmented text reader includes an analyzer capable of determining a user's gesture relative to the portion of text based on the received neural signal.

[0017] Thus, Commanded Faction corresponds to a real action that would be performed by the user's gesture if the gesture were real and the text support were real.

[0018] Advantageously, the gesture is a real or simulated gesture.

[0019] Thus, even a user in a situation where the gesture is not actually executable can trigger the command via the Faction controller by mentally simulating that gesture.

[0020] Advantageously, the controller controls one or more of the following devices: - a text editor, - a translator, - a dictionary, - a robotic manipulator of real textual content, - a voice synthesizer, - an augmented reality system.

[0021] Thus, the controller commands respectively: - Text editing functions, such as highlighting a section of text, adding a note related to that section of text, adding a bookmark, etc. - a translation of the portion of the text into a language either predefined or selected by another neural signal, - providing a definition of a word corresponding to the text section, or even an encyclopedic article corresponding to the field to which the text section relates, - movements of a robotic manipulator, in particular a robotic arm (allowing you to turn a page, close content, open content on a bookmark, insert a bookmark, dog-ear a page, highlight text...), - a spoken reproduction of the text of the text section, - an augmented reality reproduction of elements generated by other controlled devices (highlighting, translation, definition, bookmarking...).

[0022] Advantageously, the augmented text reader includes one or more of the controlled devices.

[0023] Advantageously, the reader includes a recorder capable of storing information generated by the implementation of the action relating to the text. Thus, the text can be consulted later by the user in its edited version or in its user-enhanced version.

[0024] An object of the invention is also a method for augmented reading of texts comprising at least one command for an action relating to a portion of a text, the action being a function of a received neural signal.

[0025] Advantageously, the augmented text reading process involves detecting the portion of the text by tracking the user's gaze.

[0026] Advantageously, the augmented text reading process includes a recording of information generated by the action on the part of the text.

[0027] Advantageously, according to one implementation of the invention, the various steps of the process according to the invention are implemented by a software or computer program, this software comprising software instructions intended to be executed by a data processor of an augmented text reader and being designed to control the execution of the various steps of this process.

[0028] The invention therefore also relates to a program comprising program code instructions for the execution of the steps of the augmented text reading process when said program is executed by a processor.

[0029] This program can use any programming language and be in the form of source code, object code, or intermediate code between source code and object code, such as in a partially compiled form or in any other desirable form. Brief description of the drawings

[0030] The features and advantages of the invention will become clearer upon reading the description, given by way of example, and the related figures which represent:

[0031] [Fig. 1], a simplified diagram of an augmented text reader according to the invention,

[0032] [Fig.2], a simplified diagram of an architecture comprising an augmented text reader according to the invention,

[0033] [Fig.3], a simplified diagram of an augmented text reading method according to the invention. Description of the implementation methods

[0034] Figure 1 illustrates a simplified diagram of an augmented text reader according to the invention.

[0035] The augmented text reader 1 includes at least one controller 10 capable of commanding cmd an action ac relative to a portion of a text ptxt: cmd(a,ptxt), the action ac being a function of a received neural signal sn. For example, the controller 10 commands the action ac by means of a command signal cmd: cmd(ac, ptxt).

[0036] In particular, a text content 2 is read. When area 21 of this text content 2 is read, if the augmented text reader 1 receives a neural signal sn then the augmented text reader 1 commands an action ac relative to the portion of text ptxt included in this area 21.

[0037] Textual content is understood to mean any physical or virtual medium containing text, such as a paper or digital book, a paper or electronic magazine, but also a paper or digital poster, the physical packaging of a product, a label affixed to an object or product...

[0038] The user does not manipulate the actual or virtual content containing the text to trigger the action. This facilitates access to reading actual or virtual content, including for users with disabilities, and regardless of the context in which the user reads the content, particularly in a work environment where the user is manipulating tools.

[0039] Figure 2 illustrates a simplified diagram of an architecture comprising an augmented text reader according to the invention.

[0040] The augmented text reader 1 includes a controller 10. Controller 10 commands a cmd action ac on a portion of text ptxt. The portion of text ptxt corresponds in particular to text included in a zone 21, 21 R 21 v of a textual content 2, possibly respectively a real textual content 2 R , or virtual textual content 2 V .

[0041] In particular, the command signal cmd controls an action ac of an interaction device on the textual content 2, specifically a virtual interaction device 3, 13 with real textual content 2 R or virtual 2 V , respectively a real interaction device 7 with real textual content 2 R or a reproduction of virtual textual content 2V.

[0042] By real interaction is meant a physical interaction in a real environment. In particular, physical interaction is carried out on real textual content such as a paper book, or on virtual textual content reproduced such as an e-book displayed on a tablet, smartphone, e-reader, etc.

[0043] And, respectively, virtual interaction is understood to mean interaction within a virtual environment or within a virtual part of an augmented reality environment. For example, virtual interaction is performed on virtual text content in a virtual environment, such as a digital book reproduced in virtual reality or more simply on an electronic reader, or without acting directly on real textual content but in a virtual part of an augmented reality environment placed superimposed on the real textual content, such as a paper book.

[0044] For example, the commanded action ac corresponds to an actual gesture of the real interaction device 7 R , in particular a real automated device such as a robot or more simply a robotic arm or a mechanical device for manipulating real textual content 2 R or virtual 2 V , in particular an electric, electronic and / or automated page turner especially for paper books and / or e-readers.

[0045] Alternatively, the commanded action ac corresponds to a virtual gesture in a virtual environment of a virtual interaction device 3, 13 relative to a virtual textual content 2 V or real 2 R, such as a function of a virtual content editor, a virtual gesture of an avatar in a virtual environment reproducing the virtual textual content and / or virtual information (such as text highlighting, a bookmark, a translation, a definition of the text section, etc.) generated by the virtual gesture superimposed on the real textual content... In particular, the generated virtual information constitutes virtual content 32 v superimposed on the actual textual content 2 R .

[0046] In particular, the portion of the ptxt text is a function of eye-tracking data. sr of a user. The action ac is then performed on the entire portion of the text ptxt or only a part of it. An eye-tracking device, also called an eye detector, 5, 35, 135 detects the movement, the eye movement mr of the user U.

[0047] Specifically, the augmented text reader 1 receives eye-tracking data from sr of an external gaze detector 5, 35, for example, of a gaze detector 35 integrated into augmented reality glasses or a headset 3. Alternatively, the augmented text reader 1 includes the gaze detector 135, also called an eye-tracking device, providing eye-tracking data of sr from a user.

[0048] In particular, the portion of text ptxt is a text area captured zc based on eye-tracking data d sr The ac action is then carried out in particular on printed text on a real medium, also called real textual content.

[0049] In particular, a text sensor 6, 36, 136, such as a camera, captures a text area 21 based on eye-tracking data srand provides a captured text area zc. Optionally, the eye tracking device 5, 35, 135 and the text sensor 6, 36, 136 use the same visual sensor(s), in particular a single camera.

[0050] Specifically, the augmented text reader 1 receives the captured area zc from a sensor external texts 6,36, for example, from a text sensor 36 integrated into augmented reality glasses or a headset 3. Alternatively, the augmented text reader 1 includes the text sensor 136, in particular a camera capable of capturing a text area zc based on eye-tracking data d sr The captured text area zc constitutes the portion of text ptxt.

[0051] In particular, the augmented text reader 1 includes an analyzer 14, 141 capable of determining a user's gesture gd relative to the portion of text ptxt as a function of the received neuronal signal sn.

[0052] Thus, the commanded action ac corresponds to a real action that would be performed by the user's gesture gd if the gesture were real and the text support were real.

[0053] In particular, the gesture gd is a real or simulated gesture. Specifically, when the user actually performs a gesture, for example, a hand movement at a distance from the real or remote content, a neural interface 4 detects a specific neural signal sn at the moment the gesture is performed. This neural signal sn is transmitted to the analyzer 14, 141, which determines the actual gesture performed by the user and commands an action ac to execute the result of the real gesture on the textual content. Thus, everything happens as if the user were performing this gesture directly on the textual content. If the user, either due to a disability or because their hands are already used, cannot manipulate the content directly or remotely, the user mentally simulates the gesture they would like to perform: the gesture is then said to be simulated. This mental simulation of the gesture triggers a neural signal in the user's brain equivalent to the neural signal triggered by the real gesture.The neural signal sn detected during the simulated gesture is transmitted to the analyzer 14, 141, which determines the actual gesture mentally visualized by the user and commands an action ac to execute the result of the actual gesture on the text content. Thus, everything happens as if the user were actually performing this gesture directly on the text content. Therefore, even a user in a situation where the gesture is not actually executable can trigger the action command by the controller by mentally simulating the gesture.

[0054] In particular, controller 10 controls one or more of the following controlled devices (not shown): - a text editor 80, 180, 380, - a translator 81, 181, 381, 781, - a dictionary 82, 182, 382, ​​782, - a robotic manipulator of real textual content 7 R , - a 32-bit voice synthesizer, - an augmented reality system 3.

[0055] Thus, controller 10 commands respectively: - Text editing functions, such as highlighting parts of the text, adding a note relating to this part of the text, a bookmark... - a translation of the portion of the text into a language either predefined or selected by another neural signal, - providing a definition of a word corresponding to the text section, or even an encyclopedic article corresponding to the field to which the text section relates, - movements of a robotic manipulator, in particular a robotic arm (allowing you to turn a page, close content, open content on a bookmark, insert a bookmark, dog-ear a page, highlight text...), - a spoken reproduction of the text of the text section, - an augmented reality reproduction of elements generated by other controlled devices (highlighting, translation, definition, bookmarking...).

[0056] In particular, the augmented text reader 1 includes one or more of the interaction devices 3, 7, or even controlled devices such as one of the controlled text management devices 8, 18, 38, 78, in particular a text editor 80, 180, 380; a translator 81, 1801, 381, 781; and / or a dictionary 82, 1802, 382, ​​782; etc. Such a text management device constitutes a device specific to 8, 18, 180, 38, 78, 80, 1800, 380, 81, 1801, 381, 781, 82, 1802, 382, ​​782 or implemented in a system 8, 18, 180, 38, 78.The specific text management device or text management system including such a text management device is either a text management device 8, 80, 81, 82, separate from the devices used for augmented reading 1, 3, 7 R; or a text management device 18, 180, 1800, 1801, 1802 implemented in the augmented text reader 1; or a text management device 38, 380, 381, 382, ​​78, 870, 871, 872 implemented in the virtual interaction device 3 or real interaction device 7.

[0057] In particular, reader 1 includes a recorder 181 capable of storing information generated i k by implementing the action ac related to the text. Thus, the text can be consulted later by the user in its edited version or in its user-enhanced version.

[0058] In particular, reader 1 includes a storage device 182 such as a memory or a database also called an augmented reading information database i k in which the reader records generated information i k by implementing the action ac relating to the text. Thus, the annotations (highlighting, notes, bookmarks, etc.) made by the user using the augmented reader 1 can be reproduced later during a new reading of the text content 2 by a virtual interaction device 3.

[0059] In the case of a real interaction device 7 comprising a robotic arm, the real interaction device 7 includes, in particular, a manipulation device 72, an axis 73 relative to which the manipulation device 72 is movable, by example with vertical movements mv and / or horizontal movements rnh, and / or a rod 71 placed between the axis 71 and the manipulation device. The manipulation device 72 is capable of interacting with virtual textual content 2 V , in particular with a reproduction device 32 R virtual textual content such as an e-reader, or with real textual content 2 R , in particular by manipulating the pages of the actual textual content 2 R and / or a pencil on the pages of this actual textual content 2 R etc. The manipulation device 72 is notably a controllable gripper. Optionally, the actual interaction device 7 further comprises, a text management device 78 and / or a projector 783 possibly implemented in the text management device 78 or connected to a text management device 8, 18 external to the actual interaction device.

[0060] Consider a user U reading text on text content 2. User U wants to highlight the text in text area 21 of this text content 2. They can either physically highlight this text area 21 remotely from text 2, or mentally simulate highlighting this text area 21. The neural interface 4 detects a neural signal sn and transmits it to the augmented text reader 1. The augmented text reader 1 receives the transmitted neural signal sn. In particular, the augmented text reader 1 includes a neural signal receiver 1. n which receives the transmitted neuronal signal sn.

[0061] The augmented reader 1 has a controller 10. The controller 10 commands cmd an action ac relative to a portion of text ptxt as a function of the received neuronal signal sn.

[0062] In particular, the augmented text reader 1 determines a gesture gd of the user based on the received neural signal sn. The determined gesture gd corresponds either to the gesture actually performed by the user or to the gesture mentally simulated by the user upon detection of the received neural signal sn. Then, the controller 10 commands the action ac relative to a portion of text ptxt based on this determined gesture gd. Notably, the augmented text reader 1 includes an analyzer 14, 141 capable of determining a gesture based on a neural signal.

[0063] Optionally, the augmented text reader 1, or even the controller 10, generates a command action ag based on the received neural signal sn, or even the determined gesture gd. In particular, the augmented text reader 1 includes an action generator 14, 142 capable of generating a command action ag based on the received neural signal sn, or even the determined gesture gd. For example, the augmented text reader 1 includes an action generator 14 comprising an analyzer 141 and an action generator itself 142; the analyzer 141 provides a determined gesture gd based on the neural signal sn to the action generator itself 142.

[0064] The augmented text reader 1 sends the cmd command signal to a device real interaction 7 or virtual interaction 3, either directly or via a text management device 8 (not illustrated), 18. In particular, the augmented reader 1 includes a command transmitter 11' capable of transmitting the command signal cmd to an external device 3,7,8.

[0065] In particular, the ptxt text portion is a function of dsr eye-tracking data. Specifically, the augmented text reader 1 retrieves the dsr eye-tracking data, either it receives it from an external eye-tracking device 5, 35, or it obtains it by means of an internal eye-tracking device 135.

[0066] In particular, the text portion ptxt corresponds to a text area captured zc based on gaze tracking data dsr. Specifically, the augmented text reader 1 retrieves the text area zc based on gaze tracking data dsr, either receiving it from an external text sensor 6, 36, or obtaining it by means of an internal text sensor 136. The sensor 6, 36, 136 is notably a camera.

[0067] For example, the augmented text reader 1 includes a receiver for captured data 1 I e originating from eye-tracking device 5,35, and / or text sensor 6,36. Alternatively, the augmented text reader 1 includes an eye-tracking device 135, and / or a text sensor 136. Optionally, the augmented text reader 1 includes a virtual interaction device 13 comprising an eye-tracking device 135, and / or a text sensor 136.

[0068] In particular, the augmented text reader 1 determines the portion of text ptxt based on gaze-tracking data dsr, or even on a text area zc captured from the gaze-tracking database dsr. Specifically, the augmented text reader 1 includes a text detector 12 capable of determining the portion of text ptxt. Optionally, the text detector 12 includes a character recognition device 120 capable of extracting the portion of text ptxt from an image of a captured text area zc. Optionally, in an embodiment not shown, the text detector includes the gaze-tracking device 135 and / or the text sensor 136.

[0069] In an unillustrated embodiment, an augmented or virtual reality device 3 comprises a virtual interaction device 13, 33, a neural interface 34 and / or the augmented text reader 31. The virtual interaction device 13, 33 is either a virtual interaction device 33 distinct from the augmented text reader 1, or a virtual interaction device 13 implemented in the augmented text reader 1, 31.

[0070] Figure 3 illustrates a simplified diagram of an augmented text reading method according to the invention.

[0071] The PLA augmented text reading process includes at least one command signal (cmd) for an action (ac) relative to a portion of a text file (ptxt). The action (ac) is a function of a received neural signal (sn). In particular, the command (cmd) controls the action (ac) to be performed on the text portion (ptxt) by means of a command signal. cmd: cmd(ac, ptxt). The neuronal signal sn is notably received from a neural interface BI. The neural interface BI allows, for example, the capture of neuronal signals in the brain of the user U.

[0072] In particular, the CMD command controls a TID interaction device and / or a Txt_MNGT text management system. Specifically, the TID interaction device is controlled by the CMD command based on augmented read information i k provided by the Txt_MNGT text management: cmd(i k ). In particular, the Txt_MNGT text management is implemented by the TID interaction device or included by the PLA augmented reading process.

[0073] In particular, the PLA augmented text reading process includes neural signal analysis NLZ detects gd the real or simulated gesture of the user U as a function of the neural signal sn received from a neural interface BI.

[0074] In particular, the PLA augmented text reading process involves determining an action AG_DT based on the detected gesture gd, for example, through neural signal analysis NLZ. This action might be one previously associated with the detected gesture. Specifically, the AG_DT action determination consults an action database BDAG (not shown) in which gesture-action pairs are stored following the association of a gesture and an action. These gesture-action pairs are either predefined or established through learning (for example, if and when user U and / or another user can perform the gestures directly on the text content), etc. This process may occur before or during the use of PLA augmented text reading.

[0075] In particular, the PLA augmented text reading process includes a neural link (LN), also called a neural signal interface stage, which allows the CMD to exchange a signal related to a neural signal (sn) received from a neural interface (BI). Specifically, the LN provides the CMD with an intermediate signal, such as a detected gesture (gd) or an associated action (ag), from which the CMD controls an action (ac) to be performed on the text portion (ptxt). The LN includes, for example, NLZ analysis and / or AG_DT action determination.

[0076] In particular, the PLA augmented text reading process includes Txt_DTC text portion detection via user eye tracking (dsr). Specifically, dsr eye-tracking data is obtained by detecting Txt_DTC text portions: for example, received from the SSR eye-tracking device, or determined by E_SV eye tracking based on eye-tracking data captured from the user's eyes (U). E_SV eye tracking may be performed by detecting Txt_DTC text portions or implemented by the SSR eye tracking device. In the case where the Txt_DTC text portion detection includes E_SV eye tracking, they receive eye data captured from a CR eye sensor.

[0077] In particular, the obtained gaze tracking data (dsr) is used for CAPT capture of a text area within text content (T_DOC), specifically a text area (zl) currently being viewed and / or read by user U. CAPT text area capture yields a captured text area (zc). If CAPT capture targets a text area (zl) currently being viewed and / or read by user U, then the captured text area (zc) corresponds to the text area (zl) being viewed and / or read at the time the capture command was issued, for example, using gaze tracking data (dsr) obtained at that time. Specifically, Txt_DTC text portion detection includes CAPT text area capture. Thus, the text portion (ptxt) may correspond to the captured text area (zc).

[0078] In particular, the Txt_DTC text portion detection includes Txt_RCG text recognition, which notably implements character recognition for handwritten characters, such as alphabetic characters, symbols, etc., within an image. Txt_RCG text recognition receives the captured text area zc based on gaze tracking data dsr, for example, from the CAPT capture, and recognizes a text portion ptxt inscribed within the captured text area zc.

[0079] In particular, the PLA text augmented reading process includes an STCK record of information generated ila by the ac action on the ptxt text part.

[0080] In particular, STCK recording is performed in a BDLA storage device such as a memory or a database, also called an augmented read information base. k in which the PLA augmented reading process records STCK of generated information i kby implementing the action ac relating to the text. Thus, the annotations (highlighting, notes, bookmarks, etc.) made by the user using the augmented reader 1 can be reproduced later during a new reading of the text content 2 by a virtual interaction device 3.

[0081] In particular, the PLA augmented text reading process includes an IRA_GEN implementation of the ac action relative to the ptxt text generating augmented reading information ila, including an augmented reading information generator controlled by the command signal cmd(ac, ptxt).

[0082] In particular, the PLA augmented text reading process includes a Txt_MNGT text management system, also called text editing, which implements actions on a text, possibly actions controlled by neural signals. Implementing these controlled actions on a portion of text generates augmented reading information. Optionally, the management of Txt_MNGT texts include the generation of augmented reading information IRA_GEN and / or the STCK recording.

[0083] The augmented reading information thus generated i k are possibly used, in particular by the PLA augmented reading process, to control cmd(i k ) a virtual or real text interaction device (TID). For example, the command signal cmd(i k) containing the augmented reading information will control the reproduction by a virtual TID textual interaction device of this augmented reading information i k Reproduction includes visual and / or audio reproduction. In the case of a real TID text interaction device, the command signal cmd(i kThe MVT_CNV signal, containing the augmented reading information, will be converted into one or more control signals for the motorized element(s) constituting the actual TID text interaction device, either by the actual TID text interaction device itself or by the PLA augmented reading process. Specifically, a motorized element control signal commands the movement of the motorized element: direction, distance, and / or angle, etc. Thus, the motorized elements of a robotic stocking constituting an actual TID text interaction device can be controlled to turn a page in the reading direction or in the reverse reading direction, pick up a highlighter and highlight a portion of text horizontally or vertically in the reading direction, or dog-ear the corner of a page, or add a bookmark, etc.

[0084] The invention therefore also relates to a program comprising program code instructions for the execution of the steps of the augmented text reading process when said program is executed by a processor.

[0085] The invention also relates to a storage medium. The information storage medium can be any entity or device capable of storing the program. For example, the medium can include a storage means, such as a ROM, for example a CD-ROM or a microelectronic circuit ROM, or a magnetic recording means, for example a floppy disk or a hard disk drive.

[0086] On the other hand, the information medium can be a transmissible medium such as an electrical or optical signal that can be transmitted via an electrical or optical cable, by radio, or by other means. The program according to the invention can, in particular, be downloaded onto a network, notably the Internet.

[0087] Alternatively, the information carrier may be an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the process in question.

[0088] In another implementation, the invention is implemented using software and / or hardware components. In this context, the term module can refer to either a software component or a hardware component. A software component corresponds to one or more computer programs, one or more subroutines of a program, or more generally to any element of a program or software capable of implementing a function or set of functions as described above. A hardware component corresponds to any element of a hardware assembly capable of implementing a function or set of functions.

[0089] Thus, the augmented text reading according to the invention, whether implemented in the form of an augmented text reader 1 or an augmented text reading method PLA, proposes to combine a neural interface 4, BI, in particular in the form of a BCI headset (direct neural interface enabling the control of connected objects by thought, i.e. EEG signals) with at least one eye tracking 5, 35, 135, E_SV, SSR, also called "eye tracking" in English) or even a sensor 6, 36, 136, or a CAPT capture, in particular in the form of glasses equipped with a camera 36 and an eye tracking system 35.

[0090] The glasses' camera 36 detects the text on the page. This works on both printed and digital books. The glasses 3 are equipped with an eye-tracking system 35, which allows them to know which part of the text (i.e., which words) is being read.

[0091] To activate a function (among those possible) through thought, the user U must think about moving a limb or muscle. Thinking about moving a body part has the same effect in the motor cortex (a region of the brain) as actually moving it. This movement or gesture (even simulated) by the user can therefore be detected via an EEG headset with sensors positioned on this brain region.

[0092] Specifically, by associating different movements or gestures gd, or different neural signals sn corresponding to these movements, with different actions ag, the user U mentally simulating (thinking) raising their left arm will trigger the action ac of translating the last text area read. Similarly, a simulated gesture of highlighting or marking a page (for example, placing a bookmark or dog-earing a page), etc., by the user U will trigger the highlighting, page marking, etc., by the text interaction device 3, 7, TDI.

[0093] For the bookmark function, another gesture by user U could be associated with page marking by the text interaction device 3, è, TDI, such as the user, reader U, focusing on the page number. The camera 6, 36, 136 (used for eye tracking) will recognize the isolated number and the information i kwill be stored 181, STCK in the augmented reading device 1 or virtual or augmented reality device 3 implementing the PLA augmented reading process having a memory 182, BDLA.

[0094] The translation of a word or sequence of text may appear in augmented reality on the lens of the glasses or be played via headphones.

[0095] Beyond its use by the general public with the functions mentioned above, the highlighting feature can be used by technicians to memorize (and easily recall) keywords or passwords read on equipment or in operator manuals in situations where it is difficult to have their hands free (wearing gloves, working at the top of a pylon, etc.). In the same context, the easy translation of certain instructions can be very useful.

Claims

Demands

1. Augmented text reader comprising at least one controller capable of commanding an action relating to a portion of a text, the action being a function of a received neural signal.

2. Augmented text reader according to the preceding claim, wherein the portion of the text is a function of eye-tracking data of a user.

3. Augmented text reader according to the preceding claim, wherein the portion of text is a text area captured based on eye-tracking data.

4. Augmented text reader according to any one of claims 2 or 3, wherein the augmented text reader includes an eye-tracking device providing eye-tracking data of a user.

5. Augmented text reader according to any one of claims 2 to 4, wherein the augmented text reader comprises a text sensor capable of capturing a text area based on eye-tracking data, the captured text area constituting the text portion.

6. Augmented text reader according to any one of the preceding claims, wherein the augmented text reader includes an analyzer capable of determining a user gesture relative to the portion of text based on the received neural signal.

7. Augmented reader of texts according to the preceding claim, in which the gesture is a real or simulated gesture.

8. An augmented text reader according to any one of the preceding claims, wherein the controller operates one or more of the following devices: - a text editor, - a translator, - a dictionary, - a robotic manipulator of real textual content, - a voice synthesizer, - an augmented reality system.

9. Augmented text reader according to the preceding claim, wherein the augmented text reader comprises one or more of the controlled devices.

10. Augmented text reader according to any one of the claims previous ones, in which the reader includes a recorder capable of storing information generated by the implementation of the action relating to the text.

11. Augmented reading method for texts comprising at least one command for an action relating to a portion of a text, the action being a function of a received neural signal.

12. Augmented text reading method according to the preceding claim, wherein the reading method includes detection of the portion of the text by eye-tracking the user.

13. Augmented text reading method according to any one of claims 11 or 12, wherein the reading method comprises a recording of information generated by the action on the part of the text.

14. A program comprising program code instructions for executing the steps of the augmented text reading method according to any one of claims 11 to 13 when said program is executed by a processor.

Images