Reading device

Abstract

To provide a convenient reading device that can be worn around the neck and operated with one hand.SOLUTION: A reading device includes: an imaging unit that is provided on a worn device to be worn by a user and images the user in the front direction; an extraction unit extracting characters from an image imaged by the imaging unit; a conversion unit converting the characters extracted by the extraction unit into voice; a speaker provided on the worn device and emitting the voice; an operation input unit provided on the worn device and receiving operation input from the user; a control unit provided in the worn device and performing playback control of the voice emitted from the speaker based on the input from the user received via the operation input unit; and a housing part holding the speaker, the operation input unit, and the control unit. The housing part has a voice passage hole and an exposed hole that exposes the operation input unit to the outside in a plate-shaped wall part provided in a direction in which the speaker emits the voice.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a text-to-speech device that converts text into speech and reads it out loud. This relates to the method of installation. [Background technology]

[0002] In recent years, devices that support the vision of people with weak vision or dyslexia who have difficulty reading characters have been developed. For example, Patent Document 1 discloses a wearable display that can capture and display a forward field of view so that people with low vision can walk outdoors, even at night. According to the wearable display for people with low vision in Patent Document 1, the contrast and brightness of a captured image are converted and displayed. It also discloses that, when a captured image contains characters, character recognition processing is performed to inform the user of the characters by voice. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2014-165616 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, the wearable display for low vision persons described in Patent Document 1 only describes that characters are transmitted to low vision persons through a speaker by character recognition processing, and does not disclose how voice is transmitted specifically. Also, in the case of the wearable display for low vision persons described in Patent Document 1, since it is configured to be operated by bringing the hand close to the face for each operation, there is a problem that it is not possible to react immediately when you want to hear information about the field of vision by sound, and you need to bring your hand close to your face when you miss a sound or change the playback speed, which results in a lack of usability.

[0005] Therefore, the present invention has been made in consideration of the above problems, and aims to provide a reading device that can be worn around the neck and placed near the user's torso, allowing it to be operated with one hand, and which is more convenient for users than the wearable display for low vision users described in Patent Document 1 above. [Means for solving the problem]

[0006] In order to solve the above problems, a reading device of the present invention includes an imaging unit that images a front direction of a user, an extraction unit that extracts characters from an image captured by the imaging unit, a conversion unit that converts the characters extracted by the extraction unit into sound, and a wearing device that is worn by the user, the wearing device including a speaker that emits the sound, one or more operation input units that accept operation inputs from the user, a control unit that controls playback of the sound emitted from the speaker based on the operation inputs from the user accepted by the one or more operation input units, and a right side a housing part that holds the speaker, the one or more operation input units, and the control unit and is hung from the neck of the user when worn; and a shutter button for instructing the imaging unit to capture an image, the imaging unit being provided on the right hinge part or the left hinge part of the wearable glasses, and the housing part having a rectangular plate-like front surface, a rectangular plate-like back surface that is disposed so as to face the front surface, a top surface that is disposed in a direction intersecting the front surface and the back surface, and a bottom surface a left side surface and a right side surface, the housing portion having a sound passing hole provided on the front surface through which the sound emitted by the speaker passes, and an exposure hole provided on the front surface through which one of the one or more operation input units is exposed to the outside, the one or more operation input units including a speed change switch for adjusting a playback speed of the sound emitted from the speaker, or a volume switch for changing the volume of the sound emitted from the speaker, and the one or more operation input units provided on the front surface are configured to be operated by the user when the user operates the device. The present invention is characterized in that, when the front side is located between the right hinge portion and the left hinge portion in the horizontal direction when the user wears the wearing device, the shutter button is located on the hinge portion side where the imaging unit is provided, of the right hinge portion or the left hinge portion, and the shutter button is located on the imaging portion, or, when the front side is located between the right hinge portion and the left hinge portion in the horizontal direction when the user wears the wearing device, the shutter button is located on the hinge portion side where the imaging unit is provided, of the right hinge portion or the left hinge portion. Effect of the Invention

[0007] With the above configuration, the present invention can be worn around the neck and the main body can be placed near the user's torso, allowing it to be operated with one hand, and providing greater convenience for users than the wearable display for low vision persons described in Patent Document 1 above. [Brief description of the drawings]

[0008] [Figure 1A] FIG. 13 is a diagram showing an example of the appearance of a user wearing the wearing equipment. [Figure 1B] 1A and 1B are diagrams showing an example of the appearance of a wearing device for capturing an image and reading aloud; [Diagram 2] FIG. 1 illustrates an example of the configuration of a reading device. [Figure 3A] FIG. 2 is an external view of a controller 150. [Figure 3B] FIG. 2 is an external view of a controller 150. [Figure 4] FIG. 2 is a diagram showing the internal component configuration of a controller 150. [Diagram 5] 1 is a diagram showing the internal component configuration of a controller 150 as viewed from the front side. [Figure 6] FIG. 2A is a diagram showing an example of the configuration of data that the wearing tool transmits to the server, and FIG. 2B is a diagram showing an example of the configuration of reading voice information that the server stores for each user. [Figure 7] FIG. 11 is a sequence diagram showing communication between the wearing tool and a server. [Figure 8] 10 is a flowchart showing the operation of the wearing tool. [Figure 9] 13 is a flowchart showing the operation of the server. [Figure 10] 13A and 13B are diagrams illustrating an example of a range in which characters are preferentially extracted from an image. [Figure 11] FIG. 13 is a diagram showing an example of a screen for playing back a read-aloud voice using a map. [Figure 12] FIG. 13 is a diagram showing another example of the configuration of the reading device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, a reading system according to an embodiment of the present invention will be described in detail with reference to the drawings.

[0010] <Embodiment> <Configuration> Fig. 1A is a diagram showing an example of the appearance of a user wearing a wearing tool 100 related to the reading system 1. Fig. 1B is a diagram showing an example of the appearance of a state in which an image is captured and reading is performed using the wearing tool 100. Fig. 2 is a diagram showing an example of the system configuration of the reading system 1.

[0011] 1 and 2, the reading system 1 is provided in a wearing tool 100 worn by a user, and includes an imaging unit 111 that captures an image in the front direction of the user, an extraction unit 231 that extracts characters from an image captured by the imaging unit 111, a conversion unit 232 that converts the characters extracted by the extraction unit 231 into sound, an output unit 156 that is provided in the wearing tool 100 and outputs sound, an input unit 154 that is provided in the wearing tool 100 and serves as an operation input unit that accepts input operations from the user, and a control unit 155 that is provided in the wearing tool 100 and controls the playback speed of the sound output from the output unit 156 based on input from the user accepted via the input unit 154. Such a reading system 1 will be described in detail below.

[0012] 1A and 1B, a user 10 wears and uses wearable glasses 110. In this embodiment, the wearable glasses 110 are a device in which an imaging unit (comprised of an imaging section 111, a communication I / F 112, and a shutter switch (not shown)) is attached to ordinary glasses.

[0013] The imaging unit is detachable from the frame of commercially available glasses. When the imaging unit is attached to the frame of glasses, the imaging unit 111 is disposed in the wearable glasses 110 at a position where it can capture an image in front of the user according to an instruction from the user.

[0014] In this embodiment, a shutter switch (not shown) is provided on the imaging unit, and the user can take an image by pressing the shutter button in a manner similar to the action of touching glasses.

[0015] The imaging unit 111 is a so-called camera. The imaging unit is connected to the controller 150 via a cable 140. The cable 140 may connect the imaging unit and the controller 150 via a cord 120 via an earphone 130.

[0016] Furthermore, the user 10 can wear the earphones 130 on his / her ears and listen to the reading voice transmitted from the controller 150. The earphones 130 are connected to the controller 150 via the cord 120. As will be described later, the user 10 may directly listen to the voice from the speaker 1502 provided on the controller 150. As shown in FIG. 1A, the user 10 holds the controller 150 and can use the controller 150 to instruct imaging and to instruct reproduction of the reading voice. As shown in FIG. 1B, when the user instructs imaging, the imaging unit 111 captures an image of the imaging range 160. Then, the characters included in the imaging range 160 are recognized, and the characters are converted into machine-synthesized voice and read out. Thus, the reading system 1 can provide information on characters that are difficult to read to people with weak eyesight, etc.

[0017] 2 shows an example of the system configuration of the reading system 1, which includes a wearing tool 100 and a server 200. The wearing tool 100 and the server 200 are configured to be able to communicate with each other via a network 300. The wearing tool 100 and the network 300 communicate with each other via wireless communication. Any communication protocol may be used as long as wireless communication can be performed. The server 200 also communicates with the network, and this may be either wireless communication or wired communication, and any communication protocol may be used as long as communication can be performed.

[0018] As shown in Fig. 2, the wearing tool 100 includes wearable glasses 110, earphones 130, and a controller 150. That is, in the present embodiment, the wearable glasses 110, the earphones 130, and the controller 150 are collectively referred to as the wearing tool 100 as shown in Fig. 2. Also, although the wearing tool 100 is referred to here as wearable glasses 110, it goes without saying that it is not limited to eyeglasses as long as it can capture an image in the front direction (field of vision) of the user 10.

[0019] The wearable glasses 110 include an imaging unit 111 and a communication I / F 112 .

[0020] The imaging unit 111 is a camera capable of capturing an image in the front direction of the user. The imaging unit 111 captures an image upon receiving an imaging signal instructed by the communication I / F 112. The imaging unit 111 may be provided anywhere in the wearable glasses 110 as long as the imaging unit 111 is provided so as to be able to capture an image in the front direction of the user.

[0021] 1 shows an example in which the imaging unit 111 is provided on the left hinge part of the wearable glasses, but the imaging unit 111 may be provided on the right hinge part or on the bridge part. The imaging unit 111 transmits the captured image to the communication I / F 112.

[0022] In addition, the imaging unit 111 may have a detection function of analyzing the captured images to detect the presence or absence of text in the captured images while sequentially capturing images, and if it determines that text is included in the captured image, it transmits a presence signal to the communication I / F 112 indicating that text is present in front of the user.

[0023] The communication I / F 112 is a communication interface having a function of communicating with the controller 150. The communication I / F 112 is communicably connected to the communication I / F 151 of the controller 150. Here, it is assumed that the connection is by wire as shown in FIG. 1, but this may be a wireless connection. The communication I / F 112 transmits an imaging signal transmitted from the communication I / F 151 of the controller 150 to the imaging unit 111. In addition, the communication I / F 112 transmits the captured image transmitted from the imaging unit 111 and a presence signal indicating that a character is present in front of the user to the communication I / F 151.

[0024] The earphones 130 are connected to the output unit 156 of the controller 150, and have a function of outputting an audio signal transmitted from the output unit 156 as sound. Here, as shown in Fig. 1, the earphones 130 are connected to the controller 150 by a wire, but may be connected wirelessly. The earphones 130 output a voice reading out characters detected based on a captured image, a sound indicating that the characters are being analyzed, and a sound indicating that characters are present in front of the imaging unit 111.

[0025] The speaker 1502 is connected to the output unit 156 of the controller 150, and has a function of emitting an audio signal transmitted from the output unit 156 as sound. The speaker 1502 is connected to the controller 150, for example, by wire, so as to be capable of communicating information with the controller 150. The speaker 1502 outputs a voice that reads out characters detected based on a captured image, a voice indicating that the characters are being analyzed, and a voice indicating that characters are present in front of the imaging unit 111.

[0026] The controller 150 includes a communication I / F 151, a communication unit 152, a storage unit 153, an input unit 154, a control unit 155, and an output unit 156. As shown in Fig. 1, the individual units of the controller 150 are connected to one another via a bus.

[0027] The communication I / F 151 is a communication interface having a function of communicating with the communication I / F 112 of the wearable glasses 110. When the communication I / F 151 receives an imaging signal from the control unit 155, the communication I / F 151 transmits the imaging signal to the communication I / F 112. In addition, when the communication I / F 151 receives a captured image or a presence signal from the communication I / F 112, the communication I / F 151 transmits the captured image or a presence signal to the control unit 155.

[0028] The communication unit 152 is a communication interface having a function of executing communication with the server 200 via the network 300. The communication unit 152 functions as a transmitter for transmitting a captured image to the server 200 in accordance with an instruction from the control unit 155, and also functions as a receiver for receiving a reading voice obtained by converting characters included in the captured image into voice from the server 200. When the communication unit 152 receives the reading voice from the server 200, it transmits the reading voice to the control unit 155.

[0029] The storage unit 153 has a function of storing various programs and data required for the controller 150 to function. The storage unit 153 can be realized by, for example, a hard disc drive (HDD), a solid state drive (SSD), a flash memory, or the like, but is not limited to these.

[0030] The storage unit 153 stores a reading program executed by the control unit 155, images captured by the imaging unit 111, information on the reading voice received by the communication unit 152, and the like.

[0031] The storage unit 153 also stores audio information to be issued to notify the user at a timing other than when the voice is read out. The audio information includes, for example, audio information output from the output unit 156 during the period from when the communication unit 152 transmits the captured image to the server 200 until when the communication unit 152 receives the read-out voice, which indicates that characters are being converted into voice, and audio information for notifying the user 10 when there is a character in the imaging direction of the imaging unit 111.

[0032] The input unit 154 can receive an input operation from the user 10. The input unit 154 can be realized, for example, by a hard key provided on the controller 150, but may also be realized by a touch panel or the like.

[0033] The input unit 154 includes at least a shutter button 1501 with which the user 10 instructs the imaging unit 111 to capture an image. In addition to the shutter button 1501, the input unit 154 may include, for example, a replay switch 1507 for instructing audio replay, a speed change switch 1508 for adjusting the audio playback speed, a volume switch 1511 for changing the audio volume, etc. In response to the pressing of each button, the input unit 154 transmits a signal indicating the pressed content to the control unit 155.

[0034] The control unit 155 is a processor having a function of controlling each unit of the controller 150. The control unit 155 executes various programs stored in the storage unit 153 to thereby achieve the functions to be executed by the controller 150.

[0035] When an image capture instruction is transmitted from the input unit 154 , the control unit 155 instructs the communication I / F 151 to transmit an image capture signal to the wearable glasses 110 .

[0036] Furthermore, when a captured image is transmitted from the communication I / F 151, the control unit 155 instructs the communication unit 152 to transmit the captured image to the server 200. After receiving the instruction, the control unit 155 reads, from the storage unit 153, audio information indicating that characters included in the captured image are being converted into audio, and instructs the output unit 156 to output the audio information.

[0037] When the reading voice is transmitted from the communication unit 152, the control unit 155 instructs the output unit 156 to stop outputting the voice information indicating that conversion is in progress. Then, the control unit 155 instructs the output unit 156 to output the reading voice.

[0038] In addition, when a presence signal is transmitted from communication I / F 151, control unit 155 reads out from memory unit 153 a voice indicating that text is present in front of user 10, and instructs output unit 156 to output it.

[0039] Furthermore, the control unit 155 executes a playback control process of the read-aloud voice in response to an instruction from the user 10 transmitted from the input unit 154. For example, when a pause instruction is received, the control unit 155 instructs the output unit 156 to temporarily stop the playback of the read-aloud voice.

[0040] Also, for example, when a slow playback instruction is received, the control unit 155 instructs the output unit 156 to execute slow playback of the read-aloud voice. The slow playback instruction can also be replaced by an instruction to adjust the playback speed, and the control unit 155 can also speed up or slow down the playback speed of the read-aloud voice. Also, when a replay instruction is received, the control unit 155 instructs the output unit 156 to replay the read-aloud voice that was previously output.

[0041] The output unit 156 has a function of outputting an audio signal instructed by the control unit 155 to at least one of the earphone 130 and the speaker 1502. The output unit 156 outputs a reading voice, a voice indicating that characters are being converted into voice, and a voice indicating that characters are present in front of the user 10 to at least one of the earphone 130 and the speaker 1502.

[0042] The above is a description of the configuration of the wearing tool 100.

[0043] Next, a description will be given of the server 200. As shown in Fig. 2, the server 200 includes a communication unit 210, a storage unit 220, and a control unit 230. The communication unit 210, the storage unit 220, and the control unit 230 are connected to each other via a bus.

[0044] The communication unit 210 is a communication interface having a function of executing communication with the wearing tool 100 (controller 150) via the network 300. The communication unit 210 functions as a transmitting unit that transmits a reading voice to the wearing tool 100 according to an instruction from the control unit 230, and also functions as a receiving unit that receives a captured image. When the communication unit 210 receives a captured image from the wearing tool 100, it transmits the captured image to the control unit 230.

[0045] The storage unit 220 stores various programs and data required for the operation of the server 200. The storage unit 220 can be realized by, for example, a hard disk drive (HDD), a solid state drive (SSD), a flash memory, etc., but is not limited to these. The storage unit 220 stores a character recognition program for extracting characters from an image, a voice conversion program for converting the recognized characters into voice, and reading voice information. The reading voice information will be described in detail later.

[0046] The control unit 230 is a processor having a function of controlling each unit of the server 200. The control unit 230 executes various programs stored in the storage unit 220 to fulfill the functions to be executed by the server 200. The control unit 230 functions as an extraction unit 231 by executing a character recognition program, and functions as a conversion unit 232 by executing a voice conversion program.

[0047] The extraction unit 231 has a function of analyzing a captured image and extracting characters contained in the captured image. The analysis technique can be an existing character recognition process.

[0048] The conversion unit 232 has a function of converting the characters extracted by the extraction unit 231 into voice (reading voice). For this conversion technology, an existing conversion process can be used.

[0049] This concludes the description of the configuration of the server 200.

[0050] <Configuration of the controller 150> 3A and 3B are external views of controller 150. As shown in Fig. 3A, controller 150 is formed in a rectangular parallelepiped shape. Therefore, each face of controller 150 is formed in a rectangular shape. Note that each face of controller 150 does not necessarily have to be rectangular, and may include curves or curved surfaces depending on the design.

[0051] In this embodiment, when the user wears the controller 150 shown in FIG. 1A around his neck, the surface facing outward from the user (the imaging direction of the imaging unit 111) is the front surface FS (first surface). The surface facing inward from the user, that is, facing (facing) the user's body or in contact with the user's body, is the back surface BK. The surface facing the user's face (upward in the direction of gravity) is the top surface US (second surface), and the surface facing the user's feet (downward in the direction of gravity) is the bottom surface BT (third surface). The surface on the user's left hand side is the left side LS (fourth surface), and the surface on the user's right hand side is the right side RS.

[0052] A shutter button 1501 that accepts an image capturing operation from a user is provided on the front surface FS of the controller 150. The shutter button 1501 is provided so as to be exposed and protrude in a direction perpendicular to the front surface FS. A sound passing hole SH through which sound emitted from a speaker 1502 is output to the outside of the controller 150 is provided on the front surface FS of the controller 150.

[0053] On the right side surface RS of the controller 150, there are arranged a speed change switch 1508 for changing the speed of the sound reproduced through the speaker 1502 and the earphone 130, and a terminal section 156A to which a USB (Universal Serial Bus) terminal can be connected.

[0054] A replay switch 1507 is provided on the upper surface US of the controller 150 for replaying audio that has been played once in the speaker 1502 and the earphone 130.

[0055] A strap attachment portion 1500A to which a strap can be attached is provided at a portion transitioning from the top surface US to the left side surface LS. Also, a strap attachment portion 1500B to which a strap can be attached is provided at a portion transitioning from the top surface to the right side surface RS. The strap is formed in a string-like shape, and both ends may be provided with, for example, annular connecting members.

[0056] The strap attachment parts 1500A and 1500B are formed so as to be connectable to one of the ends of a strap. In this embodiment, the strap attachment parts 1500A and 1500B have a recess formed in a concave shape recessed from the surface of the controller 150 and a rod-shaped hook part formed in the recess from the front surface FS to the back surface BK.

[0057] The strap attachment parts 1500A and 1500B can be disposed anywhere on the controller 150. For example, the strap attachment part 1500A may be provided at the location transitioning from the left side surface LS to the front surface FS, and the strap attachment part 1500B may be provided at the location transitioning from the right side surface RS to the front surface FS. Also, for example, the strap attachment part 1500A may be provided at the location transitioning from the left side surface LS to the top surface US, and the strap attachment part 1500B may be provided at the location transitioning from the left side surface LS to the bottom surface BT.

[0058] Fig. 3B shows the appearance of the controller 150 as seen from the bottom surface BT side. As shown in Fig. 3B, an earphone jack 1509 and an HDMI (registered trademark) terminal 156A are provided on the bottom surface BT of the controller 150. The earphones 130 are connected to the earphone jack 1509 via the cord 120, and are thus connected to the controller 150. In addition, a USB terminal 156A is provided on the right side surface RS of the controller 150.

[0059] In this way, since the user wears the strap attached to strap attachment portions 1500A, 1500B around the shoulder (neck), the top surface US of controller 150 is visible when the user tilts his / her head down.

[0060] The front surface FS and the back surface BK are the surfaces of the controller 150 that have the largest areas.

[0061] The axis perpendicular to the left side LS and right side RS of the controller 150 is the X-axis, and the direction in which the left side LS is located when viewed from the right side RS is the positive direction. Similarly, the axis perpendicular to the top US and bottom BT of the controller 150 is the Y-axis, and the direction in which the top US is located when viewed from the bottom BT is the positive direction. The axis perpendicular to the front FS and back BK is the Z-axis, and the direction in which the front US is located when viewed from the back BK is the positive direction.

[0062] In this case, the lengths of the controller 150 in the X-axis, Y-axis, and Z-axis directions satisfy the following relationship: Length of controller 150 in the Z-axis direction (XL)< Length of controller 150 in the Y-axis direction (YL)< Length of controller 150 in the X-axis direction (ZL). It is preferable that the length of controller 150 in the Y-axis direction (YL) be such that it can be held by a person's hand.

[0063] 4 is a diagram showing the internal configuration of the controller 150. The first housing 150A is formed in a plate shape including a wall portion that becomes the back surface BK. The first housing 150A has a rib RB formed thereon in accordance with the electronic device to be mounted on the controller 150.

[0064] The second housing 150B includes walls that form a front surface FS, a top surface US, a bottom surface BT, a right side surface RS, and a left side surface LS. The walls that form the front surface FS, the top surface US, the bottom surface BT, the right side surface RS, and the left side surface LS are formed in a plate shape. The cross section of the housing 150B in a direction perpendicular to the wall that forms the front surface is formed in a U-shape.

[0065] The second housing unit 150B has a sound passing hole SH in a wall portion that is the front surface FS, which passes through the sound emitted from the speaker 1502. The sound passing hole SH is formed in the wall portion that is the front surface FS so as to penetrate in a direction perpendicular to the front surface.

[0066] The second housing unit 150B has, in a wall portion that is the front surface FS, an exposure hole EP that exposes to the outside a shutter button 1501 that is one of the input units 154. The exposure hole EP is formed so as to penetrate the wall portion that is the front surface FS in a direction perpendicular to the front surface.

[0067] The first housing 150A and the second housing 150B are formed so as to be fastened to each other by a screw member such as a screw. Therefore, a storage space capable of storing electronic devices mounted on the controller 150 is defined by the member that forms the back surface of the first housing 150A and the members that form the front surface, top surface, bottom surface, right side surface, and left side surface of the second housing. That is, the first housing 150A and the second housing 150B can be combined with each other in the Z-axis direction. Therefore, the housing section of the controller 150 is configured by the first housing 150A and the second housing 150B.

[0068] In the housing space of the housing, various electronic components are arranged, including at least a speaker 1502, an input unit 154, and a control unit 155. Specifically, the housing of the controller 150 holds electronic components such as a shutter button 1501, a speaker 1502, a communication unit 1503 as a communication unit that communicates with the speaker 1502, a battery 1504, a first board unit 1505, a second board unit 1506, a replay switch 1507, a speed change switch 1508, an earphone jack 1509, an HDMI (registered trademark) terminal 156A, a volume switch 1511 which is a dial type in this embodiment, and a power switch PS.

[0069] A plate-shaped first board unit 1505 is mounted on the first housing 150A. The first board unit 1505 is mounted on one end side of the longitudinal direction of the back surface BK on the first housing 150A. In the figure, a processor (control unit 155) that performs signal calculations and other electronic components such as transistors are mounted on the first board unit 1505.

[0070] A plate-shaped second board unit 1506 is mounted on the first board unit 1505. The second board unit 1506 and the first board unit 1505 are disposed opposite each other.

[0071] Here, the processor (control unit 155) and other electronic components such as transistors may be mounted on either the first board unit 1505 or the second board unit 1506.

[0072] Other electronic components such as a processor and transistors are disposed between the first board unit 1505 and the second board unit 1506 when viewed in the Z-axis direction. In other words, other electronic components such as a processor and transistors are disposed on the front side FS when mounted on the first board unit 1505. Moreover, these other electronic components are disposed on the back side BK when mounted on the second board unit 1506.

[0073] In other words, if electronic components are placed on the first board unit 1505, the electronic components are arranged so that they protrude to the positive side in the Z-axis direction, and if electronic components are placed on the second board unit 1506, the electronic components are arranged so that they protrude to the negative side in the Z-axis direction.

[0074] In addition, an input unit 154, such as a replay switch 1507, a speed change switch 1508, and a volume switch 1511, are disposed between the first board unit 1505 and the second board unit 1506. In addition, an earphone jack 1509, which is an example of a terminal unit 156A, and an HDMI (registered trademark) terminal (not shown) are disposed.

[0075] This allows the switches, terminals, and electronic components to be disposed between the first board unit 1505 and the second board unit 1506, thereby minimizing the thickness in the Z-axis direction.

[0076] A rectangular parallelepiped battery 1504 is mounted on the first housing 150A. The battery 1504 supplies power to the control unit 155. The battery 1504 is mounted on the first housing 150A so as to extend from the other end side to one end side in the longitudinal direction of the back surface BK. The power button PS of the controller 150 is connected to the other end side of the battery 1504 of the first housing 150A.

[0077] A rectangular parallelepiped communication unit 1503 is mounted on the first housing 150A. The communication unit 1503 is mounted on the first housing 150A so as to extend from the other end side to one end side in the longitudinal direction of the back surface BK. The communication unit 1503 is also arranged to face the battery 1504. The communication unit 1503 and the battery 1504 are arranged so that their facing surfaces are parallel to each other.

[0078] A cylindrical speaker 1502 is mounted on the communication unit 1503. The speaker 1502 is disposed so that the direction from which sound is emitted faces the front. The speaker 1502 and the communication unit 1503 are disposed so as to overlap on the Z axis (a direction perpendicular to the wall surface (front surface FS) of the wall part of the controller 150).

[0079] A cylindrical shutter button 1501 is mounted on the second substrate unit 1506. The shutter button 1501 is mounted so as to be able to fit into an exposure hole EP of the second housing 150B when the first housing 150A and the second housing 150B are fastened together.

[0080] In this manner, the housing has the sound passing hole SH and the exposure hole EP formed in the wall of the front surface SF that is provided in the direction in which the speaker 1502 emits sound.

[0081] The controller 150 may also be provided with a volume change switch for changing the volume of the sound reproduced from at least one of the earphone 130 and the speaker 1502 (not shown).

[0082] Note that the thicknesses of the speaker 1502 and the communication unit 1503 in the Z-axis direction are made thinner than the thickness of the battery 1504 in the Z-axis direction. That is, if the thickness of the speaker 1502 in the Z-axis direction is Z1502, the thickness of the communication unit 1503 in the Z-axis direction is Z1503, and the thickness of the battery 1504 in the Z-axis direction is Z1504, then the relationships Z1502 < Z1504 and Z1503 < Z1504 hold. In other words, the heights of the speaker 1502, the communication unit 1503, and the battery 1504 in the direction perpendicular to the wall portion (front surface FS) of the housing portion are different from each other. Also, the relationship Z1502 + Z1503 ≤ Z1504 holds. In other words, the sum of the lengths of the speaker 1502 and the communication unit 1503 in the Y-axis direction (the short side direction of the front surface FS) is the same as or shorter than the length of the battery 1504 in the Y-axis direction (the short side direction of the front surface FS).

[0083] FIG. 5 is a view of the internal members of the controller 150 as seen from the positive side in the Z-axis direction.

[0084] The speaker 1502 and the communication unit 1503 are arranged to overlap when viewed from the Z-axis direction (the direction perpendicular to the front surface FS, i.e., top view). The speaker 1502 is arranged on the front surface FS side (positive side in the Z-axis direction) of the communication unit 1503. The speaker 1502 is arranged to emit sound toward the front surface FS. The communication unit 1503 is arranged on the back surface BK side (negative side in the Z-axis direction) of the speaker 1502.

[0085] Note that the speaker 1502 needs to emit sound from the front surface FS side of the controller 150. This is because if the speaker 1502 emits sound from the back surface BK side, when the controller 150 is used in a neck-worn manner (the way shown in FIG. 1A), the sound will come out toward the body side, and for example, the voice that should assist a user with visual impairment will be difficult to hear.

[0086] Furthermore, the speaker 1502 and the communication unit 1503 are arranged side by side, overlapping (along) the Y axis direction (short side direction of the front surface FS) of the battery 1504 and the controller 150, but do not overlap in the X axis direction (long direction of the front surface FS) or Z axis direction. Both the communication unit 1503 and the battery 1504 have a rectangular shape when viewed from above, with their respective long sides arranged along the X axis direction (long direction of the front surface FS) and their respective short sides arranged along the Y axis direction (short side direction of the front surface FS).

[0087] As shown in FIG. 5, the first board unit 1505 and the second board unit 1506 are disposed adjacent to the speaker 1502 and the communication unit 1503, and are disposed adjacent to the battery 1504.

[0088] The first board unit 1505 and the second board unit 1506 are disposed in the positive direction of the X-axis when viewed from the speaker 1502 and the communication unit 1503, and are also disposed in the positive direction of the X-axis when viewed from the battery 1504.

[0089] The second board unit 1506 is disposed in the positive direction of the Z axis (toward the front FS) than the first board unit 1505. As described above, these board units 1505 and 1506 are disposed so as to overlap in the Z axis direction.

[0090] The speaker 1502 and the shutter button 1501 are arranged side by side along the X-axis direction (the long side direction of the wall of the front FS). The speaker 1502 and the battery 1504 are arranged side by side along the Y-axis direction (the short side direction of the wall of the front FS).

[0091] By arranging each component in this manner, the speaker 1502, communication unit 1503, battery 1504, first board unit 1505, and second board unit 1506 can be efficiently arranged within the housing, allowing each component 1502, 1503, 1504, 1505, and 1506 to be efficiently arranged in the X-axis and Y-axis directions while minimizing the thickness in the Z-axis direction.

[0092] <Data> FIG. 6 is a diagram showing an example of a data structure of data related to the reading system 1. As shown in FIG.

[0093] FIG. 6(a) is a diagram showing an example of the data structure (format example) of the transmission data 310 (captured image) transmitted by the wearing tool 100 (controller 150) to the server 200. As shown in FIG.

[0094] As shown in FIG. 6(a), the transmission data 310 is information in which a user ID 311, captured image information 312, and capture time information 313 are associated with each other.

[0095] The user ID 311 is identification information that can uniquely identify the user 10 who uses the wearing tool 100. This allows the server 200 to identify which user the captured image is from and manage the captured image and the generated reading voice for each user.

[0096] The captured image information 312 is information indicating actual data of the captured image captured by the imaging section 111 .

[0097] The image capturing time information 313 is information indicating the date and time when the captured image indicated by the captured image information 312 was captured. This information can be acquired from an internal clock of the image capturing unit 111, although not shown.

[0098] 6(b) is a diagram showing an example of the data configuration of the reading voice information stored in the storage unit 220 of the server 200 and managed for each user who uses the reading system 1. This data is information for managing the reading voices obtained by the server 200 through conversion in the past.

[0099] As shown in FIG. 6B, the reading voice information 320 is information in which image capture time information 321, captured image information 322, and reading voice 323 are associated with each other.

[0100] The image capturing time information 321 is information indicating the date and time when the corresponding captured image was captured, and is the same information as the image capturing time information 313 .

[0101] The captured image information 322 is information indicating actual data of a captured image, and is the same information as the captured image information 312 .

[0102] The read-aloud voice 323 is actual data indicating a read-aloud voice obtained by extracting characters from the corresponding captured image information 322 by the extraction unit 231 and converting the characters by the conversion unit 232 .

[0103] The reading voice information 320 allows the server 200 to manage past reading voices.

[0104] The above is an explanation of the information mainly related to the reading system 1.

[0105] <Operation> Next, we will explain the operation of the reading system 1. First, we will explain the overall operation of the reading system 1 using the sequence diagram shown in Fig. 7, and then we will explain the detailed operations of the wearing tool 100 and the server 200 using the flowcharts in Fig. 8 and Fig. 9, respectively.

[0106] Fig. 7 is a sequence diagram showing an exchange between the wearing tool 100 and the server 200. As shown in Fig. 7, the wearing tool 100 captures an image of the front direction of the user 10 (step S401). Then, the wearing tool 100 transmits the captured image to the server 200 (step S402).

[0107] The server 200 receives the captured image transmitted from the wearing tool 100 (step S403). The server 200 then extracts characters from the received captured image (step S404). The server 200 then converts the extracted characters into voice and generates a reading voice (step S405). After generating the reading voice, the server 200 transmits it to the wearing tool 100 (step S406).

[0108] The wearing device 100 receives the reading voice transmitted from the server 200 (step S407). Then, the wearing device 100 outputs the received reading voice (step S408). This allows the reading system 1 to recognize characters present in the front direction (line of sight) of the user 10 and convey the characters to the user 10 by sound.

[0109] FIG. 8 is a flowchart showing the operation of the wearing tool 100.

[0110] First, the input unit 154 of the wearing tool 100 determines whether or not there has been an input from the user based on whether or not various buttons have been pressed (step S501). If there has been an input from the user (YES in step S501), the process proceeds to step S502, and if there has been no input (NO in step S501), the process proceeds to step S512.

[0111] In step S502, the control unit 155 determines whether or not the input received by the input unit 154 is an image capture instruction (step S502). If the input is an image capture instruction (YES in step S502), the process proceeds to step S503, and if the input is not an image capture instruction (NO in step S502), the process proceeds to step S506.

[0112] In step S503, when the input unit 154 accepts an image capture instruction from the user, the image capture instruction is transmitted to the control unit 155. In response to this, the control unit 155 instructs the communication I / F 151 to transmit an image capture signal to the wearable glasses 110. The communication I / F 151 transmits the image capture signal to the communication I / F 112 in accordance with the instruction. Then, the communication I / F 112 transmits the image capture signal to the image capture unit 111, and the image capture unit 111 executes image capture (step S503).

[0113] The imaging unit 111 transfers the captured image to the communication I / F 112, and the communication I / F 112 transfers the captured image to the communication I / F 151. The communication I / F 151 transfers the transferred captured image to the control unit 155, and the control unit 155 instructs the communication unit 152 to transmit the captured image to the server 200. Upon receiving the instruction, the communication unit 152 transmits the captured image to the server 200 via the network 300 (step S504).

[0114] Then, after transmitting the captured image, the control unit 155 reads out from the storage unit 153 a sound indicating that the characters in the captured image are being converted into sound, and instructs the output unit 156 to output the sound. In response to this, the output unit 156 outputs the sound to the earphone 130, which notifies the user of the sound (step S505), and the process returns to step S501. By notifying the user of the sound indicating that the characters included in the captured image are being converted into sound, the user 10 can recognize that the process of converting the characters into sound is currently in progress, and can wait without getting annoyed, as compared to a case where no sound is heard (no notification is given to the user 10).

[0115] On the other hand, if it is determined in step S502 that the input instruction is not an image capture instruction (NO in step S502), it is determined whether the input was an audio replay (step S506). If the input was an audio replay (YES in step S506), the control unit 155 instructs the output unit 156 to replay the audio that was output immediately before. In response to this instruction, the output unit 156 starts outputting the audio that was output immediately before (step S507), and the process returns to step S501. This replay is continued until a new playback instruction is input, or until a complete stop instruction is input.

[0116] In step S506, when it is determined that the input instruction is not a replay instruction (NO in step S506), it is determined whether the input is an instruction to change the playback speed (step S508). When the input is an instruction to change the playback speed (YES in step S508), the control unit 155 instructs the output unit 156 to change the audio being output. Specifically, the speed is increased (fast playback) or decreased (slow playback) depending on the input direction of the speed change switch 1508. In this embodiment, the speed change switch 1508 is paired, and the playback speed can be increased by pressing the switch in the US direction on the top surface, and the playback speed can be decreased by pressing the switch on the BT side on the bottom surface. In other words, the speed change switch 1508 has a consistent concept of up and down, with the upper switch increasing the playback speed and the lower switch decreasing the playback speed, so that the user can intuitively operate it. Upon receiving the instruction, the output unit 156 starts high-speed or slow playback of the audio being output (step S509), and returns to the process of step S501. This allows, for example, in the case of slow playback, even users who have difficulty hearing fast-paced speech to correctly recognize speech, and when the playback speed is increased, it can help reduce the time it takes to get an overview of the text contained in the captured content.

[0117] In step S508, if it is determined that the input instruction is not slow play (NO in step S508), the process returns to step S501.

[0118] If there is no input from the user in step S501 (NO in step S501), the control unit 155 determines whether or not a reading voice has been received from the server 200 (step S510). If a reading voice has not been received (NO in step S510), the process returns to step S501.

[0119] When a read-out voice has been received (YES in step S510), the control unit 155 first instructs the output unit 156 to stop outputting the voice indicating that the output characters are being converted into voice. In response to this instruction, the output unit 156 stops outputting the voice (step S511).

[0120] Then, the control unit 155 instructs the output unit 156 to output the reading voice transmitted from the communication unit 132. The output unit 156 starts outputting the reading voice transmitted from the control unit 155 (step S512), and the process returns to step S501.

[0121] The above is a description of the operation of the wearing tool 100 (controller 150).

[0122] FIG. 9 is a flowchart showing the operation of the server 200 when the server 200 receives a captured image from the wearing tool 100.

[0123] First, the communication unit 210 of the server 200 receives a captured image from the wearing tool 100 via the network 300 (step S601).

[0124] The control unit 230, functioning as the extraction unit 231, analyzes the transferred captured image and extracts characters (step S602). The extraction unit 231 transfers the extracted character string to the conversion unit 232.

[0125] The conversion unit 232 converts the extracted character string into a voice (step S603) and generates a reading voice, which is a synthetic voice of the machine voice. The conversion unit 232 transmits the generated reading voice to the communication unit 210.

[0126] The communication unit 210 transmits the converted synthetic voice as a reading voice to the wearing tool 100 via the network 300 (step S604).

[0127] Thereafter, the control unit 230 registers the received captured image, the capture date and time of the captured image, and the read-aloud audio obtained from the captured image as captured image information 322, capture time information 321, and read-aloud audio 323, respectively, in the read-aloud audio information (step S605), and terminates the processing.

[0128] The above is the operation of the server 200. By executing the above-described operation, the reading system 1 can play back audio that is easy for the user to hear, rather than simply reading out recognized characters.

[0129] <Summary> The reading system 1 can recognize characters included in a captured image, convert them into sound, and output them. In this case, the reading system 1 allows the user to perform operations such as slow playback, pausing, and replaying the reading sound, so that the user can play the sound in a way that is easy to listen to according to their individual preferences. Therefore, a reading system that is highly convenient for users can be provided. In addition, while the reading system 1 is executing a process of generating a reading sound from a captured image, a sound indicating that the process is in progress is notified, thereby allowing the user 10 to recognize the situation.

[0130] <Supplementary Information> The reading system according to the above embodiment is not limited to the above embodiment, and may be realized by other methods. Various modifications will be described below. (1) In the above embodiment, the controller 150 is used to output the audio, but the wearable glasses 110 may be provided with a speaker, and the output unit 156 may output the read-out audio from the speaker. With this configuration, even a user who finds it painful to wear earphones 130 can hear the read-out audio close to his or her face. (2) In the above embodiment, the wearing equipment 100 includes the wearable glasses 110, the earphones 130, and the controller 150, and is configured as separate devices. However, this is not limited to the above, and the wearable glasses 110, the earphones 130, and the controller 150 may be integrally formed. That is, the wearable glasses 110 may have a speaker as an alternative to the function of outputting sound from the earphones 130, and may retain the function of the controller 150. For example, the temple portion of the wearable glasses 110 may be hollow, and the processor, memory, communication module, etc. of the controller 150 may be mounted inside the hollow structure. Various buttons for sound playback control and image capture instructions may be arranged on the exterior side of the temple or rim of the wearable glasses 110. (3) In the above embodiment, the wearing tool 100 and the server 200 are described as separate devices, but the wearing tool 100 may have the functions of the server 200 (the functions of the extraction unit and the conversion unit). For example, the controller 150 may be configured to have a chip that realizes the functions of the server 200. In this configuration, the wearing tool 100 can constitute a stand-alone reading system. Also, the latency associated with the transmission of captured images and the reception of reading audio can be suppressed. (4) In the above embodiment, the range in which characters are extracted from the captured image is determined in advance, but this is not limited thereto. For example, the wearable glasses 110 may be configured to include a camera for capturing an image of the user's eyes, detect the gaze direction, apply a predetermined range centered on the gaze direction to the captured image, and detect characters within the predetermined range. For example, the wearable glasses 110 transmit a first captured image captured by the imaging unit 111 and a second captured image capturing the user's eyes to the controller 150, and the controller 150 transmits the first captured image and the second captured image to the server 200. The extraction unit 231 of the server 200 may be configured to identify the gaze direction of the user 10 from the second captured image, identify a predetermined range including the identified gaze direction, and extract characters from a location in the first captured image that corresponds to the predetermined range. (5) In the above embodiment, the imaging unit 111 captures an image upon receiving an image capture instruction input to the controller 150, but the trigger for capturing an image is not limited to this. For example, the wearable glasses 110 or the controller 150 may be provided with a microphone, and the microphone may capture a voice uttered by the user. Then, the image may be captured based on a specific word uttered by the user. That is, the image may be captured based on a voice input.

[0131] Alternatively, a camera for capturing an image of the user's eyes may be provided in the wearable glasses 110, and the blinking of the user's eyes may be used as a trigger for capturing an image. (6) In the above embodiment, the input unit 154 is provided in the controller 150 . However, this is not limited to the above, and the input unit 154 may be provided somewhere along the cable 140 . (7) Although not specifically mentioned in the above embodiment, the reading system 1 may include a setting unit that can set the language of the reading voice. The reading system 1 may also include a translation unit that translates the characters extracted by the extraction unit 231 into the language set in the setting unit, and the conversion unit 232 may convert the characters translated by the translation unit into voice. With this configuration, the reading system 1 can function as an interpretation system for written characters, and can be a useful system not only for people with weak eyesight, but also for users in other countries. (8) Although not specifically described in the above embodiment, the extraction unit 231 may limit the range from which characters are extracted from the captured image to a predetermined range, rather than the entire captured image. Fig. 10 shows an example of a captured image 700, and the extraction unit 231 may extract characters only from a predetermined range 710 of the captured image 700. Alternatively, the predetermined range 710 may be preferentially set as the range from which characters are extracted. The term "preferentially set as the range from which characters are extracted" means that the range is first set as the range from which characters are extracted, and if characters cannot be extracted from the predetermined range 710, processing is performed to extract characters from outside the predetermined range 710.

[0132] Here, the predetermined range 710 may be set by a user who uses the reading system 1. In general, users tend to look slightly downward rather than straight ahead. Therefore, it is effective to set the predetermined range 710 toward the bottom of the captured image 700.

[0133] Moreover, the predetermined range 710 may be set by the control unit 230. Specifically, the range from which characters can be extracted is identified for a large number of captured images received by the server 200. Then, the average range may be set as the predetermined range 710 for extracting characters.

[0134] Furthermore, the wearable glasses 110 may be equipped with various sensors, and the predetermined range 710 may be determined based on sensing data obtained from the sensors. For example, a gyro sensor may be mounted on the wearable glasses 110, and the wearing equipment 100 may transmit sensing data of the gyro sensor to the server 200 together with the captured image. Then, the extraction unit 231 may determine the predetermined range 710 based on the sensing data of the gyro sensor. For example, when it is estimated from the sensing data that the user 10 is looking downward, the predetermined range 710 may be set to a position lower than the entire captured image 700.

[0135] By not analyzing the entire captured image 700, the time required for the conversion process to audio can be shortened. (9) Although not specifically mentioned in the above embodiment, the server 200 may be configured to transmit the corresponding reading voice information 320 as a past log to an information processing device such as a PC held by the user 10. With this configuration, the user 10 can listen to the past reading voices at any time.

[0136] Furthermore, the wearing tool 100 may include a location information acquisition unit for acquiring location information indicating the location of the own device. The location information acquisition unit can be realized by using, for example, a Global Positioning System (GPS) or a Global Navigation Satellite System (GNSS).

[0137] Then, every time the imaging unit 111 obtains a captured image, the position information acquisition unit acquires position information and associates the acquired position information with the captured image. The wearing tool 100 transmits the captured image associated with the position information to the server 200. The server 200 may further associate and manage the image capture position information indicating the image capture position as the reading voice information 320.

[0138] Then, the server 200 transmits information including the location information as the voice reading information 320 to the information processing device of the user 10, so that the information processing device of the user 10 can further present the voice reading together with the map application as shown in FIG. 11. That is, the user 10 can recognize when and where the voice reading was obtained on the map. Then, by positioning the cursor 803 on the log information 801 or 802 of the map information and clicking it, the information processing device may reproduce the voice reading by voice reproduction software or the like. For example, as shown in the map 1100 of FIG. 11, the log information 801 and the log information 802 enable the user to recognize where the voice reading was obtained based on the captured image. (10) In the above embodiment, the operation of the wearing tool 100 is not described in detail, but the imaging unit 111 may sequentially capture images and detect whether or not the captured images contain characters. When it is detected that characters are included, it may transmit that fact to the controller 150, and the control unit 155 may issue a sound to make the user 10 recognize that characters exist in the front direction at that time. Then, the user 10 can input an imaging instruction to the input unit 154 at that timing. With this configuration, when the user 10 is weak-sighted, particularly when the user 10 is blind, and cannot even see the existence of characters, the user 10 can recognize the existence of characters, and a reading-aloud system 1 that is highly convenient for the user 10 can be provided. (11) Although not specifically described in the above embodiment, the image capturing unit 111 may change the image capturing conditions according to the environment in which the user (wearable glasses 110) is placed. For example, the wearable glasses 110 may include various sensors (e.g., an illuminance sensor) and may change the exposure time and the angle of view. (12) Although not specifically described in the above embodiment, when the server 200 cannot extract characters from an image, cannot convert the extracted characters into sound, or does not include characters in the image, an error signal may be sent to the wearing tool 100, and the wearing tool 100 may receive the signal and output a sound indicating an error from the output unit 156. In addition to the error sound and the sound indicating conversion as described in the above embodiment, for example, various sounds such as a startup sound when the wearing tool 100 is started, an image capture sound (shutter sound) when the image capture unit 111 captures an image, a sound indicating standby, and a cancellation sound when the user inputs a cancellation of processing may be stored in the storage unit 153, and the control unit 155 may output a corresponding sound from the output unit 156 according to the state of the wearing tool 100. In addition, when the communication unit 152 cannot communicate (cannot connect to the network), a sound indicating that fact may be output from the output unit 156. By adopting a configuration for outputting sounds according to various states in this way, the wearing tool 100 can notify the user of the state of the device only by sound. (13) Although not specifically mentioned in the above embodiment, the server 200 may change the manner of the reading voice generated depending on the location from which characters are extracted from the captured image and the proportion of the range from which the characters are extracted to the captured image.

[0139] Changing the manner of the sound depending on the location where the characters are extracted means changing the direction from which the user hears the sound depending on the location in the captured image where the characters are extracted from the captured image. For example, if the location from which the characters are extracted is on the right side of the captured image, the output unit 156 may be configured to output the reading sound so that it can be heard from the right side of the user. This configuration allows the user to intuitively recognize in which direction the characters are being read out from the user's perspective.

[0140] Also, changing the manner of the generated voice reading in accordance with the proportion of the range of the extracted characters to the captured image may be configured to change the volume of the voice reading in accordance with the proportion of the range of the extracted characters to the captured image. That is, the percentage of the proportion and the volume at which the voice reading is output may be stored in correspondence with each other, the volume at which the voice reading is output may be determined in accordance with the percentage of the range of the extracted characters from the captured image, and the voice reading may be output at the determined volume. (14) In the above embodiment, the transmission data 310 is associated with the user ID 311, the captured image information 312, and the image capture time information 313, but various other information may be associated with the transmission data 310. For example, as described in the supplementary explanation above, position information indicating the location where the wearing tool 100 is present, and sensing data information such as a gyro sensor or an acceleration sensor that can identify the posture of the wearing tool 100 may also be associated with the transmission data 310.

[0141] In addition, the reading audio information is described as information in which the imaging time information 321, the captured image information 322, and the reading audio 323 are associated with each other, but in addition to these, text data of characters obtained by analyzing the captured image, position information and sensing data included in the transmission data 310, etc. may also be associated with the information.

[0142] The read-aloud voice information can be used as a life log for each user by accumulating and collecting a larger number of various types of information. In addition, the server 200 may include a providing unit that provides designated information from among the accumulated information in response to a request from the user. For example, by accumulating location information, it is possible to provide information on the amount of movement of the user per unit time (e.g., one day), to provide information on where the user has been, or to provide posture information (e.g., good or bad posture, etc.) by identifying the user's posture using information from a gyro sensor. (15) In the above embodiment, the reading system 1 performs the voice reading by executing a reading program or the like using a processor (control unit 155, control unit 230) functioning as each functional unit constituting the reading system 1. However, this may be realized by incorporating a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)) or the like. These circuits may be realized by one or more integrated circuits, and the functions of the multiple functional units shown in the above embodiment may be realized by one integrated circuit. LSIs are sometimes called VLSIs, super LSIs, ultra LSIs, etc., depending on the degree of integration. That is, as shown in FIG. 12, each functional unit in the wearing tool 100 and the server 200 constituting the reading system 1 may be realized by a physical circuit. 12, the wearing tool 100 may be composed of wearable glasses 110 including an imaging circuit 111a and a communication I / F circuit 112a, earphones 130, a communication I / F circuit 151a, a communication circuit 152a, a memory circuit 153a, an input circuit 154a, a control circuit 155a, and an output circuit 156a, and may have the same functions as the corresponding functional units in the above embodiment. Similarly, the server 200 may be composed of a communication circuit 210a, a memory circuit 220a, and a control circuit 230a including an extraction circuit 231a and a conversion circuit 232a.

[0143] The reading program may be recorded on a processor-readable recording medium, and the recording medium may be a "non-transitory tangible medium" such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, etc. The reading program may be supplied to the processor via any transmission medium capable of transmitting the reading program (such as a communication network or a broadcast wave). The present invention may also be realized in the form of a data signal embedded in a carrier wave, in which the reading program is embodied by electronic transmission.

[0144] The read-aloud program can be implemented using, for example, a scripting language such as ActionScript or JavaScript (registered trademark), an object-oriented programming language such as Objective-C or Java (registered trademark), or a markup language such as HTML5. (16) The configurations described in the above embodiment and supplementary notes may be combined as appropriate. [Explanation of symbols]

[0145] 1. Reading System 100 Wearing equipment 110 Wearable Glasses 111 Imaging unit 112 Communication I / F 130 Earphones 150 Controller 151 Communication I / F 152 Communications Department 153 Storage section 154 Input section 155 Control Unit 156 Output section 200 Servers 210 Communications Department 220 Storage section 230 Control Unit 231 Extraction part 232 Conversion unit 1501 Shutter button 1502 Speaker 1504 Battery 1505 First board unit 1506 Second board unit SH Sound passage hole EP exposed hole

Claims

1. An imaging unit that captures an image in the front direction of a user; an extraction unit that extracts characters from the image captured by the imaging unit; a conversion unit that converts the characters extracted by the extraction unit into sound; A wearing tool that is worn by the user, The wearing tool is A speaker that emits the sound; the one or more operation input units that accept operation input from the user; a control unit that controls playback of the sound emitted from the speaker based on an operation input from the user received by the one or more operation input units; Wearable glasses having a right hinge portion and a left hinge portion; a housing portion that holds the speaker, the one or more operation input portions, and the control portion, and that is hung around the neck of the user when worn; a shutter button for instructing the imaging unit to capture an image; The imaging unit is provided at the right hinge portion or the left hinge portion of the wearable glasses, the housing is formed in a rectangular parallelepiped shape with a front plate-like surface formed in a rectangular shape, a rear plate-like surface formed in a rectangular shape and disposed so as to face the front plate-like surface, a top surface, a bottom surface, a left side surface, and a right side surface disposed in a direction intersecting the front plate-like surface and the rear plate-like surface, the housing has a sound passing hole provided on the front surface through which the sound emitted by the speaker passes, and an exposure hole provided on the front surface through which one operation input unit of the one or more operation input units is exposed to the outside, the one or more operation input units include a speed change switch for adjusting a playback speed of the sound emitted from the speaker, or a volume switch for changing a volume of the sound emitted from the speaker, the one or more operation input units provided on the front surface are disposed on a side of the hinge portion on which the imaging unit is provided, of the right hinge portion or the left hinge portion, when the front surface is located between the right hinge portion and the left hinge portion in a horizontal direction when the user wears the wearing device; The shutter button is arranged on the imaging unit, or, when the front surface is positioned horizontally between the right-side hinge portion and the left-side hinge portion when the user wears the attachment, on the side of the right-side hinge portion or the left-side hinge portion on which the imaging unit is provided.

2. The reading device according to claim 1 , wherein the first operation input unit receives an operation input from the user to the imaging unit.

3. the housing holds a communication unit that communicates with the speaker and a battery that supplies power to the control unit; The speaker and the first operation input unit are arranged side by side along a longitudinal direction of the front surface, The speaker and the battery are arranged side by side along a short side direction of the front surface, The reading device according to claim 1 , wherein the speaker and the communication unit are arranged so as to overlap each other in a direction perpendicular to the front wall surface.

4. The imaging unit captures a first captured image capturing a front direction of the user and a second captured image capturing an eye of the user, The reading device according to claim 1, characterized in that the extraction unit identifies the user's gaze direction from the second captured image, identifies a predetermined range including the identified gaze direction, and extracts characters from a location in the first captured image that corresponds to within the predetermined range.

Images