Inspection device, method for setting display format, and program for setting display format

Abstract

This invention provides an inspection device capable of displaying text on a display unit in a display format suitable for the user, a method for setting the display format, and a program for setting the display format. [Solution] The inspection device comprises a display unit, a display control unit capable of displaying inspection text in multiple display formats on the display unit, a viewpoint detection unit that detects the user's viewpoint on the display unit, and a speech recognition unit that recognizes the voice spoken by the user. The display control unit sets one of the multiple display formats as the user's inspection display format based on at least one of the detection result of the viewpoint detection unit and the recognition result of the speech recognition unit when the text is displayed in multiple different display formats on the display unit.

Description

Technical Field

[0001] The present invention relates to an inspection device, a method for setting a display form, and a program for setting a display form.

Background Art

[0002] The inspection of literacy ability associated with learning disabilities and the like is performed by a doctor at a specialized medical institution or the like. If the inspection of literacy ability can be easily performed by a dedicated device without relying on a medical institution or the like, it becomes possible to provide appropriate learning support to users with learning disabilities. Patent Document 1 describes an apparatus that allows a user to read aloud text displayed on a display unit and recognizes and evaluates the user's reading aloud.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the configuration described in Patent Document 1, when a user views the text displayed on the display unit, for example, for each user, the readability may change depending on the combination of the color, size, thickness, background color, etc. of the text. Therefore, a technique that can display text on the display unit in a display form suitable for the user is required.

[0005] The present invention has been made in view of the above, and an object thereof is to provide an inspection device, a method for setting a display form, and a program for setting a display form that can display text on a display unit in a display form suitable for a user.

Means for Solving the Problems

[0006] The inspection apparatus according to the present invention comprises a display unit, a display control unit capable of displaying inspection text in a plurality of display modes on the display unit, a viewpoint detection unit for detecting the user's viewpoint on the display unit, and a speech recognition unit for recognizing the voice spoken by the user. The display control unit sets one of the plurality of display modes as the user's inspection display mode based on at least one of the detection result of the viewpoint detection unit and the recognition result of the speech recognition unit when the text is displayed in a plurality of different display modes on the display unit.

[0007] The method for setting a display format according to the present invention includes: displaying inspection text in a plurality of different display formats on a display unit; performing at least one of the following operations on the display unit: detecting the user's gaze and recognizing the voice spoken by the user while the text is displayed in each of the aforementioned display formats; and setting one of the plurality of display formats as the user's inspection display format based on the results of the above operations while the text is displayed in each of the aforementioned display formats on the display unit.

[0008] The display mode setting program according to the present invention causes a computer to perform the following operations: display inspection text in multiple display modes on a display unit; perform at least one of the operations of detecting the user's gaze and recognizing the voice spoken by the user while the text is displayed in each of the display modes on the display unit; and set one of the multiple display modes as the user's inspection display mode based on the results of the operations while the text is displayed in each of the display modes on the display unit. [Effects of the Invention]

[0009] According to the present invention, text can be displayed on the display unit in a display format suitable for the user. [Brief explanation of the drawing]

[0010] [Figure 1] Figure 1 is a block diagram showing an example of the configuration of the inspection apparatus according to this embodiment. [Figure 2] Figure 2 is a diagram illustrating the overview of the processing of the inspection apparatus according to this embodiment. [Figure 3] Figure 3 is a flowchart showing the flow of a basic literacy test method using the testing device according to this embodiment. [Figure 4] Figure 4 illustrates an example of a method for detecting the user's viewpoint. [Figure 5] Figure 5 illustrates another example of how to detect the user's viewpoint. [Figure 6] Figure 6 shows an example of how text can be displayed. [Figure 7] Figure 7 shows an example of the procedure for setting the display format for inspection. [Figure 8] Figure 8 shows another example of the procedure for setting the display format for inspection. [Figure 9] Figure 9 is a flowchart showing an example of a method for setting the display format according to this embodiment. [Modes for carrying out the invention]

[0011] Hereinafter, embodiments of the inspection apparatus, display format setting method, and display format setting program according to the present invention will be described with reference to the drawings. However, the present invention is not limited to these embodiments. Furthermore, the components in the following embodiments include those that are easily substituted or substantially identical to those that are easily substituted by those skilled in the art.

[0012] As shown in Figure 1, the testing device 10 comprises an input unit 12, an eye-tracking sensor 14, a microphone 16, a display unit 18, an audio output unit 20, a communication unit 22, a storage unit 24, and a control unit 26. The testing device 10 is, but is not limited to, a notebook PC (Personal Computer), a desktop PC, a tablet terminal, a smartphone, an HMD (Head Mounted Display), or smart glasses. The testing device 10 may also be a dedicated device. The testing device 10 is a device for testing a user's literacy ability.

[0013] Figure 2 is a diagram illustrating the overview of the testing device's process. The testing device 10 tests the literacy ability of the subject, user U. The testing device 10 displays a sentence on the display unit 18 for user U to read aloud. For example, as shown in Figure 2, the display unit 18 displays the sentence "saita saita sakura ga saita" (The cherry blossoms have bloomed, they have bloomed), and user U sees the sentence and says "saita saita sakura ga saita" (The cherry blossoms have bloomed, they have bloomed). Here, if the sentence displayed on the display unit 18 is in Japanese, it is assumed that the language spoken by user U is also Japanese. In other words, the testing device 10 tests literacy ability by having user U speak the sentence displayed on the display unit 18 in the language displayed. The testing device 10 detects user U's gaze toward the characters displayed on the display unit 18. The testing device 10 recognizes the voice of user U reading the sentence displayed on the display unit 18. Based on the detected gaze and the recognized voice, the testing device 10 tests user U's literacy ability.

[0014] The input unit 12 receives various input operations for the inspection device 10. The input unit 12 can be implemented using various input devices such as a keyboard, mouse, touch panel, buttons, and switches.

[0015] The line-of-sight sensor 14 detects the user's line of sight. The line-of-sight sensor 14 outputs the detected user's line of sight to the control unit 26. The line-of-sight sensor 14 has at least an imaging unit that images the user. The line-of-sight sensor 14, for example, images the user's eyeballs when characters are displayed on the display unit 18. The line-of-sight sensor 14 can be configured to include, for example, an infrared light emitting unit composed of an infrared LED (Light Emitting Diode) group and a pair of infrared cameras. Note that the line-of-sight sensor 14 may not include an infrared light emitting unit. The line-of-sight sensor 14 may be, for example, a visible light camera. The line-of-sight sensor 14 may be provided separately from the inspection device 10. The line-of-sight sensor 14 outputs imaging data to the control unit 26. The line-of-sight sensor 14 may be provided, for example, in smart glasses worn by the user. In this case, the line-of-sight sensor 14 outputs the captured imaging data to the control unit 26 by a wired or wireless communication method. The line-of-sight sensor 14 can detect the user's line of sight, for example, at a predetermined cycle.

[0016] The microphone 16 detects the user's voice. The microphone 16, for example, detects the voice of reading out the characters displayed on the display unit 18 when characters are displayed on the display unit 18. The microphone 16 outputs the detected voice to the control unit 26. The microphone 16 may be provided separately from the inspection device 10.

[0017] The display unit 18 displays various kinds of information. The display unit 18 is realized by a display including, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display.

[0018] The voice output unit 20 is a speaker that outputs various kinds of voices. The voice output unit 20 outputs, for example, a guide voice when the user inspects literacy ability.

[0019] The communication unit 22 is a communication interface that performs communication between the inspection device 10 and an external device. The communication unit 22 is realized by, for example, a wireless LAN (Local Area Network), a wired LAN, Wi-Fi (registered trademark), etc.

[0020] The memory unit 24 stores various types of information. The memory unit 24 stores the calculation contents of the control unit 26 and information such as programs. The memory unit 24 includes, for example, at least one of the following: RAM (Random Access Memory), main memory such as ROM (Read Only Memory), and external memory such as HDD (Hard Disk Drive).

[0021] The storage unit 24 stores a display format setting program that causes the computer to execute the following: a process of displaying the inspection text on the display unit 18 in multiple display formats; a process of detecting the user's gaze and recognizing the voice spoken by the user while the text is displayed on the display unit 18 in each display format; and a process of setting one of the multiple display formats as the user's inspection display format based on the results of the operations while the text is displayed on the display unit 18 in each display format.

[0022] The control unit 26 controls the operation of the inspection device 10. The control unit 26 includes a processor such as a CPU (Central Processing Unit) and memory such as ROM (Read Only Memory) and RAM (Random Access Memory).

[0023] The control unit 26 includes a display control unit 30, a viewpoint detection unit 32, a voice recognition unit 34, a measurement unit 36, and a biological information detection unit 38.

[0024] The display control unit 30 controls the display unit 18 to display various types of information on it. For example, the display control unit 30 displays test text on the display unit 18 to test the user's literacy ability. The test text includes text data such as characters, numbers, words, and sentences.

[0025] The display control unit 30 can display the inspection text on the display unit 18 in multiple different display formats. The display control unit 30 can achieve different display formats by changing at least one of the following: text size, text thickness, text color, text font, text writing direction, text line spacing, background color, and contrast between text and background.

[0026] The display control unit 30 sets one display mode from the multiple display modes as the user's inspection display mode based on at least one of the detection results of the gaze detection unit 32 and the recognition results of the speech recognition unit 34 when text is displayed on the display unit 18 in multiple display modes. The display control unit 30 can further set the inspection display mode using biometric information detected by the biometric information detection unit 38. Examples of biometric information include heart rate, blood pressure, pulse wave, skin temperature, sweat amount, electroencephalogram, blood flow rate, etc.

[0027] The viewpoint detection unit 32 detects the position of the user's viewpoint on the display unit 18 based on the detection result of the user's gaze by the gaze sensor 14. The viewpoint detection unit 32 can, for example, detect the position of the intersection point between the user's gaze detected by the gaze sensor 14 and the display unit 18 as the viewpoint. The viewpoint detection unit 32 can, for example, detect the position of the user's viewpoint at predetermined intervals based on the detection result of the user's gaze by the gaze sensor 14.

[0028] The speech recognition unit 34 recognizes the speech spoken by the user using the inspection device 10 based on the results of the user's voice detection by the microphone 16. For example, the speech recognition unit 34 can recognize the speech of the user reading the characters displayed on the display unit 18 based on the results of the user's voice detection by the microphone 16.

[0029] The measurement unit 36 ​​determines the literacy ability of the user using the testing device 10. The measurement unit 36 ​​determines the user's literacy ability based, for example, on viewpoint information indicating the position of the user's viewpoint detected by the viewpoint detection unit 32 and audio information indicating the voice recognized by the voice recognition unit 34. The measurement unit 36 ​​can determine the user's literacy ability based, for example, on the comparison result between the viewpoint information detected by the viewpoint detection unit 32 and the audio information recognized by the voice recognition unit 34 and the literacy ability determination information stored in the memory unit 24.

[0030] The biometric information detection unit 38 detects the user's biometric information. The biometric information detection unit 38 can detect the user's biometric information based, for example, on the detection result of the biometric information sensor 40. The biometric information sensor 40 may be provided in the inspection device 10, or it may be provided separately from the inspection device 10. Alternatively, some components or functions of the inspection device 10 may be used as the biometric information sensor 40. For example, it is possible to detect the user's heart rate based on image data captured by the camera constituting the gaze sensor 14. In this case, the camera of the gaze sensor 14 can be used as the biometric information sensor 40.

[0031] In the control unit 26, the processor reads various programs from each unit and loads them into memory, thereby executing information processing corresponding to the functions of each unit. Examples of various programs include programs received by the communication unit 22, programs stored in the storage unit 24, and programs recorded on an external recording medium. The control unit 26 functions as an information processing device (computer) that executes various information processing. Note that other information processing devices different from the control unit 26 may execute various programs, or the control unit 26 and other information processing devices may cooperate to execute various programs.

[0032] (Basic operation of the inspection device) Next, an example of the operation of the testing device 10 according to this embodiment will be described. First, the basic operation of detecting literacy ability using the testing device 10 will be described. Figure 3 is a flowchart showing the flow of a basic literacy ability testing method using the testing device 10.

[0033] As shown in Figure 3, first, the display control unit 30 displays characters for testing the user's literacy ability on the display unit 18 (step S10).

[0034] The gaze detection unit 32 detects the position of the user's gaze on the display unit 18 based on the gaze detection result from the gaze sensor 14 (step S12). Furthermore, the gaze detection unit 32 sets the time when characters are displayed on the display unit 18 (for example, the time in step S10) as time 0 and detects the correspondence between the time and the position of the user's gaze.

[0035] Figure 4 illustrates an example of a method for detecting the position of the user's viewpoint. Figure 4(a) shows the characters displayed on the display unit 18. For example, the display unit 18 displays "Bloomed, bloomed, the cherry blossoms have bloomed" in vertical writing. Figure 4(b) shows the position of the viewpoint relative to the display unit 18 and the transition of the viewpoint. As shown in Figure 4(b), the viewpoint detection unit 32 divides the display unit 18 into, for example, 5x5 blocks and detects which block the user has placed their viewpoint on and for how long. For example, the viewpoint detection unit 32 sets a time threshold of 0.25 seconds to determine whether the user's viewpoint has stopped, and detects blocks where the viewpoint has been placed for 0.25 seconds or more as the position where the user's viewpoint stopped.

[0036] In Figure 4(b), points P1, P2, P3, P4, and P5 represent the positions where the user's viewpoint stopped. Points P1 through P5 are each greater than 0.25 seconds, which is the time threshold for determining whether the user's viewpoint stopped or not. The size of points P1 through P5 is displayed according to the amount of time the user's viewpoint was stopped. The viewpoint detection unit 32 detects that the user's viewpoint has moved along the trajectory 41 in the order of point P1 → point P2 → point P3 → point P4 → point P5. The viewpoint detection unit 32 detects the time the user focused their viewpoint on each block. The viewpoint detection unit 32 adds time information 42 to each block indicating the time the user focused their viewpoint. The viewpoint detection unit 32 outputs viewpoint information indicating the viewpoint detection result in the manner shown in Figure 4(b).

[0037] Figure 5 illustrates another example of how to detect the user's viewpoint. As shown in Figure 5(a), the display unit 18 may display text horizontally, for example, "The weather today is sunny. Let's go somewhere." Even in this case, the viewpoint detection unit 32 detects that the user's viewpoint has moved along the trajectory 41 in the order of point P11 → point P12 → point P13 → point P14 → point P15 → point P16.

[0038] Returning to Figure 3, the speech recognition unit 34 recognizes the voice of the user reading the text displayed on the display unit 18 based on the results of detecting the user's voice via the microphone 16 (step S14). Furthermore, the speech recognition unit 34 recognizes the correspondence between the time and the text or characters read by the user, with the time at which the text was displayed on the display unit 18 (for example, the time in step S10) as time 0. For example, in the example shown in Figure 4(a), the speech recognition unit 34 recognizes the voice of the user reading "The cherry blossoms have bloomed, they have bloomed" displayed on the display unit 18. In the example shown in Figure 5(a), the speech recognition unit 34 recognizes the voice of the user reading "Today's weather is sunny, let's go somewhere" displayed on the display unit 18.

[0039] The measurement unit 36 ​​determines whether the literacy measurement is complete or not (step S16). Specifically, the measurement unit 36 ​​determines that the literacy measurement is complete when the pre-set time limit has expired or when the reading aloud of the characters displayed on the display unit 18 is complete. If it is determined that the literacy measurement is complete (step S16; Yes), the process proceeds to step S18. If it is not determined that the literacy measurement is complete (step S16; No), the process proceeds to step S12 and is repeated.

[0040] The measurement unit 36 ​​determines the literacy ability (step S18). Specifically, the measurement unit 36 ​​determines the user's literacy ability based on viewpoint information indicating the position of the user's viewpoint detected by the viewpoint detection unit 32 and audio information indicating the voice recognized by the voice recognition unit 34.

[0041] More specifically, the measurement unit 36 ​​determines the user's literacy ability based on conditions such as "whether the text is read aloud correctly," "whether the gaze moves in accordance with the text," "whether there are any significant pauses in the gaze," "the position of the gaze when the text is started to be read aloud," "the relationship between the gaze position and the characters being read aloud," and "the relationship between the utterance and the part where the gaze is still." However, the conditions used by the measurement unit 36 ​​to determine literacy ability are not limited to these.

[0042] The measurement unit 36 ​​determines whether the user is reading the text correctly, for example, based on whether the text displayed on the display unit 18 and the speech recognition result recognized by the speech recognition unit 34 match to a predetermined degree or higher. The measurement unit 36 ​​determines whether there is a match, for example, when voice and text are input, using a trained model generated by machine learning to output the degree of match.

[0043] The measurement unit 36 ​​determines whether the user's gaze is moving in accordance with the text, for example, based on whether the position of the user's gaze detected by the gaze detection unit 32 is moving in accordance with the text displayed on the display unit 18 by a predetermined amount or more. The measurement unit 36 ​​determines whether there is a match, for example, by using a trained model generated by machine learning to output a degree of agreement, when it receives the position of the gaze detected by the gaze detection unit 32 and the displayed text as input. Here, the measurement unit 36 ​​may also determine whether the position of the user's gaze detected by the gaze detection unit 32 is moving appropriately with respect to the text displayed on the display unit 18. This is because users who are considered to have high literacy ability may not necessarily read with their gaze aligned with the text, but may skip characters to some extent.

[0044] The measurement unit 36 ​​determines, for example, whether there is a significant dwell time at the user's viewpoint, based on whether the position of the user's viewpoint detected by the viewpoint detection unit 32 remains at one location for a predetermined time or longer. The measurement unit 36 ​​uses a trained model generated by machine learning to determine whether there is a significant dwell time at the viewpoint, for example, when it receives the position of the viewpoint detected by the viewpoint detection unit 32 as input. Alternatively, the measurement unit 36 ​​may determine that there is a significant dwell time at the viewpoint if the information on the position of the viewpoint detected by the viewpoint detection unit 32 includes a point where the viewpoint remained for a longer time than a preset threshold.

[0045] The measurement unit 36 ​​determines the user's literacy ability based, for example, on the relationship between the position of the user's gaze detected by the gaze detection unit 32 and the characters the user is reading aloud, as recognized by the speech recognition unit 34.

[0046] The measurement unit 36 ​​determines the user's literacy ability based, for example, on the position of the user's viewpoint and the position where the character the user is reading aloud is displayed. For example, the measurement unit 36 ​​determines that the user's literacy ability is normal if the position of the user's viewpoint is located at a predetermined distance further than the character the user is reading aloud among the characters displayed on the display unit 18. Here, the "prior character" refers to a character located later in the sentence than the character being read aloud. For example, the measurement unit 36 ​​determines that the user's literacy ability is normal if the position of the user's viewpoint coincides within a predetermined range with the position where the character the user is reading aloud is displayed among the characters displayed on the display unit 18. Specifically, in the example shown in Figure 4, if the character the user is reading aloud is "ga" in "sakura ga", the measurement unit 36 ​​determines the user's literacy ability based on the position of the user's viewpoint corresponding to the time when "ga" was pronounced. For example, consider the case in the example shown in Figure 4 where the position of the viewpoint corresponding to the time when the user pronounced "ga" is point P4. Here, point P4 corresponds to the "ta" in "sakura ga saita" (cherry blossoms bloomed), and is located at a predetermined distance ahead of the character being read aloud by the user among the characters displayed on the display unit 18. Furthermore, it matches the position of the character being read aloud by the user within a predetermined range, so it is determined that the literacy ability is normal.

[0047] The measurement unit 36 ​​determines the user's literacy ability based, for example, on the position of the user's viewpoint relative to the display unit 18 when the user begins to read aloud the characters. The measurement unit 36 ​​determines that the user's literacy ability is normal if, for example, the position of the user's viewpoint relative to the display unit 18 when the user begins to read aloud is within a predetermined range from the first character displayed on the display unit 18. The measurement unit 36 ​​also determines that the user's literacy ability is normal if, for example, the position of the user's viewpoint relative to the display unit 18 when the user begins to read aloud is located more than a predetermined distance ahead from the first character displayed on the display unit 18. Specifically, in the example shown in Figure 4, if the first "sa" in "saita saita" is the character the user is reading aloud, the measurement unit 36 ​​determines the user's literacy ability based on the position of the user's viewpoint corresponding to the time when "sa" was pronounced. For example, consider the case in the example shown in Figure 4 where the position of the viewpoint corresponding to the time when the user first pronounced "sa" is point P2. Here, point P2 corresponds to the second "i" in "saita saita" (bloomed, bloomed), and is located at a predetermined distance ahead of the character being read aloud by the user among the characters displayed on the display unit 18. Furthermore, it matches the position of the character being read aloud by the user within a predetermined range, so it is determined that the literacy ability is normal.

[0048] The measurement unit 36 ​​determines the location where the user's speech and gaze stopped, based on the position of the user's gaze detected by the gaze detection unit 32 and the characters the user is reading aloud, as recognized by the speech recognition unit 34. For example, by extracting characters that the user has difficulty with from the location where the speech and gaze stopped, and saving them as data, it can be used for subsequent diagnosis and learning support.

[0049] The measurement unit 36 ​​determines, for example, that the user has successfully read the text displayed on the display unit 18 if the text is read aloud correctly, the user's gaze follows the text, and there is no significant hesitation in the gaze. The measurement unit 36 ​​determines, for example, that there is a minor abnormality in literacy ability even if the text is read aloud correctly, if other conditions are not met. The measurement unit 36 ​​determines, for example, that the user has not successfully read the text if the text is not read aloud correctly and a predetermined time limit has elapsed. The measurement unit 36 ​​determines, for example, that if it performs literacy ability measurements multiple times and determines that there is a minor abnormality three times, it determines that the user has not successfully read the text once. The measurement unit 36 ​​determines, for example, that if it integrates the results of multiple measurements and determines that more than half of the texts are not read aloud correctly, the user needs learning support. Up to this point, the measurement unit 36 ​​has been described as only determining whether or not the text was read aloud correctly, but it is not limited to this. In other words, each of the following conditions can be judged and used as information for assessing literacy ability: "whether the text is read aloud correctly," "whether the gaze moves in accordance with the text," "whether there are any significant pauses in the gaze," "the position of the gaze when the text is started to be read aloud," "the relationship between the gaze position and the characters being read," and "the parts where the speech and gaze stop."

[0050] (How to set the display format) As described above, when testing literacy, readability may vary depending on the combination of text color, size, boldness, background color, etc., for each user. Therefore, in this embodiment, a display format that makes the text easier to read is pre-set for each user, and each user performs the literacy test using the set display format. An example of the operation when setting the display format for each user is described below. Note that the setting of the display format described below can be positioned as a calibration operation performed prior to the formal test when testing literacy. Note that the setting of the display format may also be performed using the results of the formal literacy test.

[0051] The display control unit 30 causes the display unit 18 to display text in multiple different display modes, each for each user, by changing at least one display element from among the following: text size, text thickness, text color, text font, text writing direction, text line spacing, background color, and contrast between text and background.

[0052] As an example, a base form (reference form) can be set in advance for each of the above display elements, and for one display element to be changed, the text can be displayed on the display unit 18 for each display form obtained by changing that one display element using another display element as the base form.

[0053] The following explanation will provide examples assuming three display elements: text color, text size, and contrast between text and background. Figure 6 shows an example of text display format. As shown in Figure 6, for example, the default format for "text color" can be set to black, the default format for "text size" to 12 points, and the default format for "contrast between text and background" to 500:1. Note that the default format is not limited to the above and may be set to other colors, sizes, or ratios.

[0054] From this state, when changing the "text color" as one display element, the other display elements, "text size" and "text-to-background contrast," remain at 12 points and 500:1 respectively, while the "text color" is displayed in the display unit 18 in various display formats such as black, red, blue, green, yellow, etc. Similarly, when changing the "text size" as one display element, the other display elements, "text color" and "text-to-background contrast," remain at black and 500:1 respectively, while the "text size" is displayed in the display unit 18 in various display formats such as 12 points, 14 points, 18 points, etc. Furthermore, when changing the "text-to-background contrast" as one display element, the other display elements, "text color" and "text size," remain at black and 12 points respectively, while the "text-to-background contrast" is displayed in various display formats such as 500:1, 750:1, 1000:1, etc., while the "text-to-background contrast" is displayed in the display unit 18. Figure 6 shows how the text color, text size, and text-to-background contrast can be varied in three different display modes. However, the system is not limited to these, and variations may be applied in two or four or more display modes.

[0055] Another example is that all combinations of changing all display elements can be displayed as separate display modes on the display unit 18. In this case, although the number of checks during calibration increases, all combinations of changed display elements can be checked without omission.

[0056] For each display mode, the user reads the text aloud while moving their gaze over the display unit 18 as described above. The gaze detection unit 32 detects the user's gaze over the display unit 18. The speech recognition unit 34 recognizes the voice spoken by the user. The measurement unit 36 ​​performs inspections based on the detection results of the gaze detection unit 32 and the recognition results of the speech recognition unit 34. For example, it determines conditions such as "whether the text is read aloud correctly," "whether the gaze moves in accordance with the text," "whether there is any significant stagnation of the gaze," "the position of the gaze when the text is started to be read aloud," "the relationship between the gaze position and the characters being read aloud," and "parts where the speech and gaze are still."

[0057] The display control unit 30 sets the inspection display format based on the inspection results of the measurement unit 36. For example, in the above inspection, if the display unit 18 displays only the display elements to be changed in a display format that is different from the standard format, the display control unit 30 can set the inspection display format as a display format that combines the display elements that yielded the best inspection results for each display element. Figure 7 is a diagram showing an example of the procedure for setting the inspection display format. In the example shown in Figure 7, the display control unit 30 can set the inspection display format as a display format that combines the text color that yielded the best inspection results when the text color was changed (text color 1), the text size that yielded the best inspection results when the text size was changed (text size 2), and the contrast that yielded the best inspection results when the contrast was changed (contrast 2).

[0058] Figure 8 shows another example of the procedure for setting the display format for inspection. As shown in Figure 8, when all combinations of changing all display elements are displayed on the display unit 18 as display formats and the above inspection is performed, the display control unit 30 can set the display format that yielded the best inspection result among all display formats (the format enclosed by the dashed line) as the display format for inspection. In this case, the display control unit 30 may exclude from the evaluation any display formats that clearly did not yield a good inspection result during the measurement process by the measurement unit 36. This reduces the number of display formats for which the inspection results are compared.

[0059] After setting the display format for testing as described above, the display control unit 30 will display the text using the display format set for each user when conducting a formal literacy test. While the above explanation uses changing the text color, text size, and contrast between text and background as examples of display elements, the system is not limited to these. For example, the display format for testing may be set by changing any of the following display elements: text size, text weight, text color, text font, text writing direction, text line spacing, background color, and contrast between text and background.

[0060] Figure 9 is a flowchart showing an example of a method for setting the display format according to this embodiment. As shown in Figure 9, first, the display unit 18 displays the inspection text in multiple different display formats with varying display elements (step S20), and at least one of the following operations is performed: detection of the user's gaze and recognition of the voice spoken by the user, while the display unit 18 is displaying the text in each display format (step S22). In this embodiment, the case in step S22 is described as an example in which both gaze detection and voice recognition operations are performed, but it is not limited to this. In step S22, either gaze detection or voice recognition may be performed.

[0061] Next, the display unit 18 performs an inspection based on the results of the operation while text is displayed in each display mode, and based on the inspection results, one display mode is selected from the multiple display modes and set as the user's inspection display mode (step S24).

[0062] As described above, the inspection device 10 according to this embodiment includes a display unit 18, a display control unit 30 capable of displaying inspection text on the display unit 18 in multiple display modes, a viewpoint detection unit 32 that detects the user's viewpoint on the display unit 18, and a speech recognition unit 34 that recognizes the voice spoken by the user. The display control unit 30 sets one display mode from the multiple display modes as the user's inspection display mode based on at least one of the detection result of the viewpoint detection unit 32 and the recognition result of the speech recognition unit 34 when the text is displayed on the display unit 18 in multiple different display modes.

[0063] The method for setting the inspection display format according to this embodiment includes: displaying inspection text on the display unit 18 in multiple different display formats; performing at least one of the following actions: detecting the user's gaze and recognizing the voice spoken by the user while the text is displayed on the display unit 18 in each display format; and setting one of the multiple display formats as the user's inspection display format based on the results of the actions performed while the text is displayed on the display unit 18 in each display format.

[0064] The display mode setting program according to this embodiment causes the computer to perform the following operations: display the inspection text on the display unit 18 in multiple display modes; perform at least one of the operations of detecting the user's gaze and recognizing the voice spoken by the user while the text is displayed on the display unit 18 in each display mode; and set one of the multiple display modes as the user's inspection display mode based on the results of the operations while the text is displayed on the display unit 18 in each display mode.

[0065] With this configuration, when the display unit 18 displays the inspection text in multiple different display modes, one display mode is set as the user's inspection display mode based on at least one of the detection results of the viewpoint detection unit 32 and the recognition results of the speech recognition unit 34, making it possible to display the text on the display unit in a display mode suitable for the user.

[0066] In the inspection device 10 according to this embodiment, the display control unit 30 creates different display forms by changing at least one of the following: text size, text thickness, text color, text font, text writing direction, text line spacing, background color, and contrast between text and background.

[0067] This configuration makes it possible to display text on the screen with a size, thickness, color, font, writing direction, line spacing, background color, and contrast with the background that is suitable for the user.

[0068] The inspection device 10 according to this embodiment further includes a biometric information detection unit 38 that detects the user's biometric information, and the display control unit 30 further uses the biometric information detected by the biometric information detection unit 38 to set the display format for inspection.

[0069] With this configuration, by further using biometric information to set the display format for testing, the display format for testing can be set with high accuracy. For example, the display control unit 30 may, among multiple display formats, set the display format that detects the user's gaze or the display format that recognizes the user's spoken voice as the user's display format for testing, or exclude it from the list of display formats for testing, if the numerical value of the biometric information detected by the biometric information detection unit 38 rises above a predetermined value (a normal value, or a pre-set threshold, etc.).

[0070] The technical scope of the present invention is not limited to the embodiments described above, and modifications can be made as appropriate without departing from the spirit of the invention. [Explanation of symbols]

[0071] 10...Inspection device, 12...Input unit, 14...Eye-gaze sensor, 16...Microphone, 18...Display unit, 20...Audio output unit, 22...Communication unit, 24...Storage unit, 26...Control unit, 30...Display control unit, 32...Eye-gaze detection unit, 34...Audio recognition unit, 36...Measurement unit, 38...Biometric information detection unit, 40...Biometric information sensor

Claims

1. Display unit and The display unit includes a display control unit capable of displaying inspection text in multiple display formats, The display unit includes a viewpoint detection unit that detects the user's viewpoint, The voice recognition unit recognizes the voice spoken by the user. Equipped with, The display control unit sets one of the multiple display modes as the user's inspection display mode based on at least one of the detection result of the viewpoint detection unit and the recognition result of the speech recognition unit when the text is displayed on the display unit in multiple different display modes. Inspection device.

2. The display control unit changes at least one of the following to create different display forms: the size of the text, the thickness of the text, the color of the text, the font of the text, the writing direction of the text, the line spacing of the text, the background color of the text, and the contrast between the text and the background. The inspection apparatus according to claim 1.

3. The system further includes a biometric information detection unit for detecting the user's biometric information, The display control unit further uses the biological information detected by the biological information detection unit to set the display format for the inspection. The inspection apparatus according to claim 1.

4. The display unit will show inspection text in multiple different display formats, The display unit performs at least one of the following operations: detecting the user's gaze and recognizing the voice spoken by the user, while the text is displayed in each of the aforementioned display modes. Based on the result of the operation while the text is displayed in each of the display modes on the display unit, one of the multiple display modes is set as the user's inspection display mode. How to set the display format, including the format.

5. The process of displaying inspection text in multiple display formats on the display unit, The process includes detecting the user's gaze and recognizing the voice spoken by the user while the text is displayed on the display unit in each of the aforementioned display modes, A process to set one of the multiple display modes as the user's inspection display mode based on the result of the operation when the text is displayed in each of the aforementioned display modes on the display unit. A program for configuring the display format that causes a computer to execute a specific action.

Images