Detection device

The detection device addresses the challenge of converting printed documents into sound by using an optical sensor and processing circuit to capture and convert images directly into sound, simplifying the process for visually impaired individuals.

JP2026010533APending Publication Date: 2026-01-22JAPAN DISPLAY INC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024110460
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-07-09
Publication Date
2026-01-22

AI Technical Summary

Technical Problem

Conventional OCR and speech synthesis technologies require visually impaired individuals to manually scan printed documents, making it difficult to convert type-printed documents into electronic data, especially when headers and footers are included.

Method used

A detection device with an optical sensor and processing circuit that captures images from a sheet medium and generates sound information, allowing for direct conversion of printed documents into sound without the need for manual scanning.

Benefits of technology

Facilitates easier conversion of printed documents into sound, enabling visually impaired individuals to independently recognize document contents without the need for manual scanning.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026010533000001_ABST
    Figure 2026010533000001_ABST
Patent Text Reader

Abstract

To provide a detection device capable of more easily converting a printed document into sound and outputting the sound.SOLUTION: A detection device 1 includes an optical sensor 10 which has translucency and in which a plurality of sensor pixels are arranged in a planar shape, and a processing circuit 70 which acquires an image of a sheet-like medium M abutting on or approaching one surface of the optical sensor 10 and generates sound information on the basis of the image.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a detection device. [Background technology]

[0002] Conventionally, a technology has been disclosed that combines so-called OCR (Optical Character Recognition) with speech synthesis, in which a document printed on paper is captured by a camera or scanner, converted into electronic data, and characters contained in the captured image are recognized and output as audio through earphones or speakers (for example, Patent Document 1). This is said to enable visually impaired people to independently recognize the contents of printed documents. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 11-355627 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in order to convert a type-printed document into electronic data using the above-mentioned conventional technology, it is necessary to acquire the document printed on paper in advance using a camera or scanner, which makes it extremely difficult for visually impaired people to convert type-printed documents into electronic data in the first place.In addition, it is necessary to acquire and store in advance image information including characters and illustrations that are less useful, such as headers and footers.

[0005] SUMMARY OF THE INVENTION An object of the present invention is to provide a detection device that can more easily convert a printed document into sound and output it. [Means for solving the problem]

[0006] A detection device according to one aspect of the present invention comprises an optical sensor having translucency and having a plurality of sensor pixels arranged in a plane, and a processing circuit that acquires an image of a sheet medium that is in contact with or close to one side of the optical sensor and generates sound information based on the image. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a plan view schematically showing the detection device according to the first embodiment. [Figure 2] FIG. 2 is a cross-sectional view schematically showing the detection device according to the first embodiment. [Figure 3] FIG. 3 is a block diagram showing an example of the configuration of the processing circuit. [Figure 4] FIG. 4 is a flowchart illustrating an example of processing in the detection device according to the first embodiment. [Figure 5] FIG. 5 is a plan view showing a first example of an object to be converted extracted by the detection device according to the first embodiment. [Figure 6] FIG. 6 is a sub-flowchart showing a first example of the conversion process in the detection device according to the first embodiment. [Figure 7] FIG. 7 is a sub-flowchart showing a second example of the conversion process in the detection device according to the first embodiment. [Figure 8] FIG. 8 is a plan view showing a second example of the object to be converted extracted by the detection device according to the first embodiment. [Figure 9] FIG. 9 is a diagram showing the correspondence between the objects and sound files in the second example of the objects to be converted shown in FIG. [Figure 10] FIG. 10 is a sub-flowchart illustrating a third example of the conversion process in the detection device according to the first embodiment. [Figure 11] FIG. 11 is a plan view showing a third example of the object to be converted extracted by the detection device according to the first embodiment. [Figure 12] FIG. 12 is a diagram showing the correspondence between the objects and sound files in the third example of the objects to be converted shown in FIG. [Figure 13] FIG. 13 is a sub-flowchart illustrating a fourth example of the conversion process in the detection device according to the first embodiment. [Figure 14] FIG. 14 is a cross-sectional view schematically showing a detection device according to the second embodiment. [Figure 15] FIG. 15 is a flowchart illustrating an example of processing in the detection device according to the second embodiment. [Figure 16] FIG. 16 is a plan view showing a first example of an object to be converted extracted by the detection device according to the second embodiment. [Figure 17] FIG. 17 is a plan view showing a second example of the object to be converted extracted by the detection device according to the second embodiment. [Figure 18] FIG. 18 is a plan view showing a third example of the object to be converted extracted by the detection device according to the second embodiment. [Figure 19] FIG. 19 is a cross-sectional view schematically showing a detection device according to the third embodiment. [Figure 20] FIG. 20 is a schematic cross-sectional view of a transparent display. [Figure 21] FIG. 21 is a flowchart illustrating an example of processing in the detection device according to the third embodiment. [Figure 22] FIG. 22 is a plan view showing a first example of an object to be converted selected by the detection device according to the third embodiment. [Figure 23] FIG. 23 is a plan view showing a second example of the object to be converted selected by the detection device according to the third embodiment. [Figure 24] FIG. 24 is a plan view showing a third example of an object to be converted selected by the detection device according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] Modes (embodiments) for carrying out the present invention will be described in detail with reference to the drawings. The present disclosure is not limited to the contents described in the following embodiments. Furthermore, the components described below include those that can be easily imagined by a person skilled in the art and those that are substantially identical. Furthermore, the components described below can be combined as appropriate. Note that the disclosure is merely an example, and any appropriate modifications that a person skilled in the art can easily make while maintaining the gist of the present disclosure are naturally included within the scope of the present disclosure. Furthermore, for clarity of explanation, the drawings may schematically depict the width, thickness, shape, etc. of each part compared to the actual embodiment. However, these are merely examples and are not intended to limit the interpretation of the present disclosure. Furthermore, in this disclosure and each figure, elements similar to those previously described with reference to the preceding figures may be designated by the same reference numerals, and detailed descriptions may be omitted as appropriate.

[0009] In the present disclosure, when expressing an aspect of placing another structure on top of a certain structure, the term "on top" is used, unless otherwise specified, to include both a case in which another structure is placed directly on top of a certain structure so as to be in contact with the certain structure, and a case in which another structure is placed above a certain structure via yet another structure.

[0010] (Embodiment 1) Fig. 1 is a plan view schematically showing a detection device 1 according to embodiment 1. Fig. 2 is a cross-sectional view schematically showing the detection device 1 according to embodiment 1.

[0011] As shown in Fig. 1, the detection device 1 includes an optical sensor 10 and a processing circuit 70. A sound output device 80, such as an earphone or a speaker, is connected to the processing circuit 70. In the present disclosure, the detection device 1 is a device that acquires, as an image, information printed in type on a sheet-like medium M, such as a paper medium, and outputs sound information related to the image. Note that, in the present disclosure, objects to be converted into sound information include image information, such as illustrations and photographs, in addition to text information, such as sentences and words.

[0012] The optical sensor 10 has a plurality of sensor pixels 13 provided between two opposing substrates 11 and 12. In the present disclosure, the two substrates 11 and 12 are resin films made of a resin such as transparent polyimide.

[0013] 1, the plurality of sensor pixels 13 are arranged in a matrix in the first direction Dx and the second direction Dy in a plan view. However, the present invention is not limited to this, and the plurality of sensor pixels 13 may be arranged in a staggered manner in a plan view.

[0014] In the present disclosure, the first direction Dx is a direction in a plane parallel to the substrates 11 and 12. The second direction Dy is a direction in a plane parallel to the substrates 11 and 12 and is a direction perpendicular to the first direction Dx. The third direction Dz is a direction perpendicular to the Dx-Dy plane.

[0015] Each of the sensor pixels 13 has a photodiode. The photodiode outputs a potential corresponding to the light irradiated thereon. More specifically, the photodiode is an OPD (organic photodiode) photodiode using an organic semiconductor.

[0016] A processing circuit 70 is provided at one end of the optical sensor 10. In the present disclosure, the processing circuit 70 is a component that controls detection timing and performs detection processing in the optical sensor 10, and processes images acquired by the detection processing and converts them into sound. The processing circuit 70 is composed of, for example, an MCU (Micro Control Unit), RAM, EEPROM, ROM, etc. Note that while FIG. 1 illustrates an example in which the optical sensor 10 and the processing circuit 70 are integrated into one unit, the optical sensor 10 and the processing circuit 70 may be provided as separate components.

[0017] In the first embodiment, the detection device 1 includes a light guide plate LG that overlaps the optical sensor 10 in the third direction Dz in a plan view, and a light source L provided at one end of the light guide plate LG. In the present disclosure, the light emission timing of the light source L is controlled by a processing circuit 70.

[0018] The light guide plate LG is a light-transmitting film made of a polymer compound such as TAC (Triacetylcellulose).

[0019] Examples of the light source L include an inorganic LED (Light Emitting Diode), an organic EL (Organic Light Emitting Diode), and a semiconductor laser LD (Laser Diode).

[0020] A light-shielding layer 14 is provided on the surface of the sensor pixel 13 facing the light guide plate LG. An opening d is provided between adjacent sensor pixels 13. The sheet medium M is placed in contact with or close to the surface of the optical sensor 10 opposite to the surface on which the light guide plate LG is provided (hereinafter also referred to as the "detection surface of the optical sensor 10").

[0021] Light emitted from the light source L propagates through the light guide plate LG and is irradiated onto the optical sensor 10. Incident light IL irradiated onto the optical sensor 10 from the light guide plate LG passes through the opening d and reaches the sheet medium M. Reflected light RL from the sheet medium M is incident on the sensor pixels 13, and an electrical signal corresponding to the reflected light RL is output from each sensor pixel 13.

[0022] The processing circuit 70 controls the detection timing of the optical sensor 10 and the light emission timing of the light source L, and acquires an image of the surface of the sheet medium M (for example, the printed surface of a type book) that is placed in contact with or close to the detection surface of the optical sensor 10, based on the electrical signal for each sensor pixel 13 output from the optical sensor 10. This reduces the difficulty for visually impaired people in acquiring an image to be converted into sound.

[0023] Furthermore, the reflected light RL from the sheet-like medium M passes through the opening d of the optical sensor 10, allowing a visually impaired person to visually recognize the surface of the sheet-like medium M (for example, the printed surface of a printed book) that has passed through the optical sensor 10. This allows, for example, a visually impaired person assisting a visually impaired person to accurately position the image acquisition range of the optical sensor 10 relative to the image on the surface of the sheet-like medium M that is to be converted into sound.

[0024] 3 is a block diagram showing an example configuration of the processing circuit 70. In this disclosure, components and processes for executing various timing controls and detection processes in the optical sensor 10 will be omitted, and components and processes for performing image generation processing, image recognition processing, and sound conversion processing will be described.

[0025] As shown in FIG. 3, the processing circuit 70 includes an image generation circuit 71, an analysis circuit 72, a conversion circuit 73, and a storage circuit 74 as components that perform image generation processing, image recognition processing, and sound conversion processing.

[0026] FIG. 4 is a flowchart showing an example of processing in the detection device 1 according to the first embodiment.

[0027] The image generation circuit 71 binarizes the detection value for each sensor pixel 13 acquired from the optical sensor 10, and acquires an image including the object to be converted (image acquisition processing step S100). The image acquisition processing in the image generation circuit 71 is not limited to binarization processing.

[0028] The analysis circuit 72 performs layout analysis on the images acquired by the image generation circuit 71 to turn them into objects, and extracts, from the objectified images, images to be converted into sound (hereinafter also referred to as "objects OBJ to be converted") (layout analysis processing step S200). In the present disclosure, the objects to be converted whose regions are extracted by layout analysis include sentences (hereinafter also referred to as "objects OBJ (SNT)"), words (hereinafter also referred to as "objects OBJ (WORD)"), and images other than character information (hereinafter also referred to as "objects OBJ (IMG)").

[0029] The conversion circuit 73 is a component that converts, into sound, the conversion target object OBJ extracted by the analysis circuit 72. The memory circuit 74 stores programs and data for converting, into sound, the conversion target object OBJ extracted by the analysis circuit 72.

[0030] Fig. 5 is a plan view showing a first example of an object OBJ to be converted extracted by the detection device 1 according to embodiment 1. Fig. 5 illustrates an example in which an object OBJ(SNT) is extracted as the object OBJ to be converted within the image acquisition range of the optical sensor 10, and text information of the object OBJ(SNT) is speech-synthesized.

[0031] FIG. 6 is a sub-flowchart showing a first example of the conversion process in the detection device 1 according to the first embodiment.

[0032] 6, the conversion circuit 73 performs OCR (Optical Character Recognition) processing and voice synthesis processing on the object OBJ (SNT). Specifically, the conversion circuit 73 executes character identification processing on the object OBJ (SNT) (step S301), generates text data (step S302), performs voice synthesis on the generated text data (step S303), and outputs sound from the sound output device 80 (FIG. 4, step S400).

[0033] Fig. 7 is a sub-flowchart showing a second example of the conversion process in the detection device 1 according to embodiment 1. Fig. 7 illustrates an example in which text data (for example, Japanese) is machine-translated and converted into another language (for example, English).

[0034] 7, the conversion circuitry 73 performs OCR processing, machine translation processing, and voice synthesis processing on the object OBJ (SNT). Specifically, the conversion circuitry 73 performs character identification processing on the object OBJ (SNT) (step S311), generates text data (step S312), performs machine translation processing on the generated text data (step S313), performs voice synthesis on the text data translated into another language (step S314), and outputs sound from the sound output device 80 (FIG. 4, step S400).

[0035] Fig. 8 is a plan view showing a second example of the object OBJ to be converted extracted by the detection device 1 according to the first embodiment. Fig. 8 illustrates an example in which an object OBJ (WORD) is extracted as the object OBJ to be converted within the image acquisition range of the optical sensor 10, and a sound file corresponding to the object OBJ (WORD) is read out and played. The sound file corresponding to the object OBJ (WORD) is stored in advance in the storage circuitry 74.

[0036] Fig. 9 is a diagram showing the correspondence between the object OBJ(WORD) and the sound file (WORD).*** in the second example of the object OBJ to be converted shown in Fig. 8. In the embodiment shown in Fig. 8, for example, an animal name or a musical instrument name is registered as the object OBJ(WORD), and the animal cry or musical instrument sound corresponding to the object OBJ(WORD) is registered as the sound file (WORD).*** corresponding to the object OBJ(WORD). The present disclosure is not limited by the file format of the sound file (WORD).***.

[0037] FIG. 10 is a sub-flowchart showing a third example of the conversion process in the detection device 1 according to the first embodiment.

[0038] In the conversion process shown in FIG. 10, the conversion circuit 73 reads out the sound file (WORD).*** corresponding to the object OBJ(WORD) from the storage circuit 74 (step S321), and outputs the sound from the sound output device 80 (FIG. 4, step S400).

[0039] Fig. 11 is a plan view showing a third example of the object OBJ to be converted extracted by the detection device 1 according to the first embodiment. Fig. 11 illustrates an example in which an object OBJ (IMG) is extracted as the object OBJ to be converted within the image acquisition range of the optical sensor 10, and an audio file corresponding to the object OBJ (IMG) is read out and played. In the example shown in Fig. 11, the audio file corresponding to the object OBJ (IMG) is stored in advance in the storage circuitry 74.

[0040] Fig. 12 is a diagram showing the correspondence between the object OBJ(IMG) and the sound file (IMG).*** in the third example of the object OBJ to be converted shown in Fig. 11. In the embodiment shown in Fig. 11, for example, an image of a painting is registered as the object OBJ(IMG), and a music file corresponding to the image of the object OBJ(IMG) is registered as the sound file (IMG).*** corresponding to the object OBJ(IMG). The present disclosure is not limited by the file format of the sound file (IMG).***.

[0041] FIG. 13 is a sub-flowchart showing a fourth example of the conversion process in the detection device 1 according to the first embodiment.

[0042] In the conversion process shown in FIG. 13, the conversion circuit 73 reads out the sound file (IMG).*** corresponding to the object OBJ(IMG) from the storage circuit 74 (step S331), and outputs the sound from the sound output device 80 (FIG. 4, step S400).

[0043] (Embodiment 2) 14 is a cross-sectional view schematically showing a detection device 1a according to embodiment 2. In embodiment 2, a configuration will be described in which a healthy person can specify an area for extracting a conversion target within the image acquisition range of the optical sensor 10. In the following description, descriptions similar to those in embodiment 1 may be omitted.

[0044] In the second embodiment, the detection device 1a includes a touch sensor TP that overlaps the optical sensor 10 in the third direction Dz in a plan view. The touch sensor TP is a touch detection device (touch panel) that detects a detectable object that contacts a detection surface (hereinafter also referred to as "touch detection"). In the present disclosure, the touch sensor TP performs touch detection using, for example, a capacitance method (self-capacitance method or mutual capacitance method). FIG. 14 illustrates a configuration in which a touch panel (touch sensor TP) is mounted on a light guide plate LG.

[0045] In the second embodiment, the processing circuit 70a is a component that controls the detection timing and performs the detection process in the touch sensor TP in addition to the processes described in the first embodiment. Note that in the present disclosure, the components and processes for controlling the detection timing and performing the detection process in the touch sensor TP are omitted.

[0046] 15 is a flowchart showing an example of processing in the detection device 1a according to the second embodiment. In the second embodiment, the processing circuit 70a determines whether or not an area from which the conversion target object OBJ is to be extracted has been set by the touch sensor TP (step S001). If an area from which the conversion target object OBJ is to be extracted has not been set (step S001; No), the processing circuit 70a repeatedly executes the processing of step S001. Then, if an area from which the conversion target object OBJ is to be extracted has been set (step S001; Yes), the processing circuit 70 performs the same processing as in the first embodiment described above within the area set by the touch sensor TP. This makes it possible to explicitly specify an area including the conversion target object OBJ to be extracted.

[0047] Fig. 16 is a plan view showing a first example of a conversion target object OBJ extracted by the detection device 1a according to embodiment 2. In Fig. 16, an image including the conversion target object is acquired within an area AR set by the touch sensor TP (image acquisition processing step S100a), the image within the acquired area AR is subjected to layout analysis to be converted into an object, and an object OBJ(SNT) is extracted as the conversion target object OBJ (layout analysis processing step S200a).

[0048] Then, in the conversion process shown in FIG. 6, the conversion circuit 73 executes character identification processing of the object OBJ (SNT) (step S301), generates text data (step S302), synthesizes the generated text data into voice (step S303), and outputs the voice from the sound output device 80 (FIG. 4, step S400).

[0049] Alternatively, in the conversion process shown in FIG. 7, the conversion circuit 73 performs character identification processing of the object OBJ (SNT) (step S311), performs machine translation processing of the generated text data (step S313), performs voice synthesis on the text data in another language (step S314), and outputs sound from the sound output device 80 (FIG. 4, step S400).

[0050] Fig. 17 is a plan view showing a second example of the conversion target object OBJ extracted by the detection device 1a according to embodiment 2. In Fig. 17, an image including the conversion target object is acquired within an area AR set by the touch sensor TP (image acquisition processing step S100a), the image within the acquired area AR is subjected to layout analysis to be converted into an object, and an object OBJ (WORD) is extracted as the conversion target object OBJ (layout analysis processing step S200a).

[0051] Then, in the conversion process shown in FIG. 10, the conversion circuit 73 reads out the sound file (WORD).*** corresponding to the object OBJ(WORD) from the storage circuit 74 (step S321), and outputs the sound from the sound output device 80 (FIG. 4, step S400).

[0052] Fig. 18 is a plan view showing a third example of the conversion target object OBJ extracted by the detection device 1a according to embodiment 2. In Fig. 18, an image including the conversion target object is acquired within an area AR set by the touch sensor TP (image acquisition processing step S100a), the image within the acquired area AR is subjected to layout analysis to be converted into an object, and an object OBJ (IMG) is extracted as the conversion target object OBJ (layout analysis processing step S200a).

[0053] In the conversion process shown in FIG. 13, the conversion circuit 73 reads out the sound file (IMG).*** corresponding to the object OBJ(IMG) from the storage circuit 74 (step S331), and outputs the sound from the sound output device 80 (FIG. 4, step S400).

[0054] (Embodiment 3) 19 is a cross-sectional view schematically showing a detection device 1b according to embodiment 3. In embodiment 3, a configuration will be described in which a healthy person can select a conversion target within the image acquisition range of the optical sensor 10. In the following description, explanations similar to those in embodiment 1 or embodiment 2 may be omitted.

[0055] In the third embodiment, the detection device 1b includes a transparent display DP, instead of the light guide plate LG, that overlaps the optical sensor 10 in the third direction Dz in a plan view. Fig. 19 illustrates a so-called on-cell type configuration in which a touch sensor TP (touch panel) is mounted on the transparent display DP.

[0056] FIG. 20 is a schematic cross-sectional view of a transparent display DP.

[0057] The transparent display DP has a first substrate 30 and a second substrate 20 facing each other, and a liquid crystal 3 sealed between the two substrates.

[0058] The first substrate 30 includes a light-transmitting substrate 35, a pixel electrode 2, and an insulating layer 55. The pixel electrode 2 is provided for each pixel Pix. The second substrate 20 includes a light-transmitting substrate 21, a common electrode 6, and an insulating layer 56.

[0059] In the present disclosure, the liquid crystal 3 is a polymer dispersed liquid crystal (PDLC). In other words, in this embodiment, the display panel DISP is a liquid crystal panel in which a polymer dispersed liquid crystal is sealed. Specifically, the liquid crystal 3 includes a bulk 51 and fine particles 52. The orientation of the fine particles 52 changes within the bulk 51 depending on the potential difference between the pixel electrode 2 and the common electrode 6. The potential of the pixel electrode 2 is individually controlled for each pixel Pix, thereby controlling the scattering state of the liquid crystal 3 for each pixel Pix.

[0060] Figure 20 shows an example in which the pixel electrode 2 and the common electrode 6 are arranged opposite each other with the liquid crystal 3 in between, but the display panel DISP may also be configured in such a way that the pixel electrode 2 and the common electrode 6 are provided on a single substrate, and the orientation changes due to the electric field generated by the pixel electrode 2 and the common electrode 6, thereby controlling the scattering state of the liquid crystal 3.

[0061] In the third embodiment, the processing circuit 70b is a component that controls the display timing and performs the display processing on the transparent display DP in addition to the processing described in the second embodiment. Note that in the present disclosure, the components and processing for controlling the display timing and performing the display processing on the transparent display DP will be omitted.

[0062] 21 is a flowchart showing an example of processing in the detection device 1b according to the third embodiment. In the third embodiment, an image acquired by the image generation circuit 71 is subjected to layout analysis processing to be converted into an object (layout analysis processing S200b), and the image converted into an object by the layout analysis processing is highlighted on the display DP (step S002). This makes it possible to explicitly select the object OBJ to be converted. As a mode for highlighting the image converted into an object by the layout analysis processing on the display DP, for example, a mode in which a line surrounding the objectified image is displayed on the display DP, or a mode in which a schematic image along the objectified image is displayed on the display DP may be used.

[0063] The processing circuit 70b determines whether any of the objects highlighted on the display DP has been selected as the conversion target object OBJ by the touch sensor TP (step S003), and if not selected (step S003; No), repeats the processing of step S003. Then, if the conversion target object OBJ is selected (step S003; Yes), the conversion circuit 73 performs the same processing as in the first embodiment on the conversion target object OBJ selected by the touch sensor TP.

[0064] Fig. 22 is a plan view showing a first example of an object OBJ to be converted that is selected by the detection device 1b according to embodiment 3. Fig. 22 illustrates an example in which an object OBJ (SNT) indicated by a dashed dotted line is selected as the object OBJ to be converted from among the objects that are highlighted on the transparent display DP.

[0065] In the conversion process shown in FIG. 6, the conversion circuit 73 executes character identification processing of the object OBJ (SNT) (step S301), generates text data (step S302), synthesizes the generated text data into voice (step S303), and outputs the voice from the sound output device 80 (FIG. 4, step S400).

[0066] Alternatively, in the conversion process shown in FIG. 7, the conversion circuit 73 performs character identification processing of the object OBJ (SNT) (step S311), performs machine translation processing of the generated text data (step S313), performs voice synthesis on the text data in another language (step S314), and outputs sound from the sound output device 80 (FIG. 4, step S400).

[0067] Fig. 23 is a plan view showing a second example of an object OBJ to be converted selected by the detection device 1b according to embodiment 3. Fig. 23 illustrates an example in which an object OBJ (WORD) indicated by a dashed dotted line is selected as the object OBJ to be converted from among the objects highlighted on the transparent display DP.

[0068] In the conversion process shown in FIG. 10, the conversion circuit 73 reads out the sound file (WORD).*** corresponding to the object OBJ(WORD) from the storage circuit 74 (step S321), and outputs the sound from the sound output device 80 (FIG. 4, step S400).

[0069] Fig. 24 is a plan view showing a third example of an object OBJ to be converted selected by the detection device 1b according to embodiment 3. Fig. 24 illustrates an example in which an object OBJ (IMG) indicated by a dashed dotted line is selected as the object OBJ to be converted from among the objects highlighted on the transparent display DP.

[0070] In the conversion process shown in FIG. 13, the conversion circuit 73 reads out the sound file (IMG).*** corresponding to the object OBJ(IMG) from the storage circuit 74 (step S331), and outputs the sound from the sound output device 80 (FIG. 4, step S400).

[0071] Although preferred embodiments of the present invention have been described above, the present invention is not limited to such embodiments. The contents disclosed in the embodiments are merely examples, and various modifications are possible without departing from the spirit of the present invention. Appropriate modifications made without departing from the spirit of the present invention naturally fall within the technical scope of the present invention. At least one of various omissions, substitutions, and modifications of components can be made without departing from the spirit of each of the above-described embodiments and modifications. [Explanation of symbols]

[0072] 1, 1a, 1b Detection device 10 Optical Sensor 11,12 PCB 13 sensor pixels 70, 70a, 70b Processing circuit 71 Image generation circuit 72 Analysis circuit 73 Conversion circuit 74 Memory circuit DP Transparent Display L light source LG light guide plate OBJ Object to be converted OBJ(IMG) Object (image other than text information) OBJ(SNT) Object (Text) OBJ(WORD) Object (word) TP Touch Sensor

Claims

1. an optical sensor having light-transmitting properties and including a plurality of sensor pixels arranged in a plane; a processing circuit for acquiring an image of a sheet of medium that is in contact with or close to one surface of the optical sensor and generating sound information based on the image; Equipped with Detection device.

2. Each of the plurality of sensor pixels has an OPD (Organic Photodiode). The detection device according to claim 1 .

3. a touch sensor provided on the optical sensor and capable of visually checking the sheet medium from the other side; The detection device according to claim 2 .

4. The processing circuitry acquiring the image within the area selected by the touch sensor; The detection device according to claim 3 .

5. The processing circuitry an image of the sheet-like medium is subjected to a layout analysis to be converted into an object, and an image selected by the touch sensor from the converted object images is converted into sound information; The detection device according to claim 3 .

6. a light guide member that is provided over the optical sensor and that allows the sheet medium to be viewed from the other side; a light source provided at one end of the light guide member; Equipped with 6. A detection device according to any one of claims 1 to 5.

7. a transparent display provided over the optical sensor and allowing the sheet medium to be viewed from the other side; a light source provided at one end of the transparent display; Equipped with the transparent display highlights the image objectified by the processing circuitry; The detection device according to claim 5 .

8. The transparent display has a PDLC (Polymer Dispersed Liquid Crystal) encapsulated between two opposing substrates. The detection device according to claim 7.

Citation Information

Patent Citations

  • Digital still camera

    JP1999355627A