Image-forming device

Abstract

To expand the degree of practical use of information expressed by Braille such that copying of Braille, copying of text, conversion from text to Braille, and conversion from Braille to text can be performed collectively.SOLUTION: An image-forming device 10 has an image-reading section 11, an image-forming section 12, a Braille-forming section 18B, and a control section 31. The image-reading section 11 reads a document image or a Braille document. The image-forming section 12 forms characters in recording paper. The Braille-forming section 18B forms Braille in Braille paper. The control section 31 recognizes characters included in the image of a document read by the image-reading section 11, converts characters to Braille, forms Braille in a Braille sheet by the Braille-forming section 18B, determines Braille included in a Braille document read by the image-reading section 11, converts Braille to characters, and forms characters in recording paper by the image-forming section 12.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an image forming apparatus that reads an image of a document and forms it on a recording paper, and particularly relates to a technique for mutually converting and using Braille and characters included in the image of the document.

Background Art

[0002] In an image forming apparatus, an image reading unit reads an image of a document, and an image forming unit forms the image of the document on a recording paper.

[0003] On the other hand, there is an apparatus for forming Braille on Braille paper. For example, in the Braille copier described in Patent Document 1, at least one Braille cell is detected from a scanned image of an original Braille document, the coordinates and code of the Braille cell are determined, and an embossed copy of the original Braille document is created based on the determined coordinates and code of the Braille cell.

[0004] Also, in the method and system for converting a Portable Document Format file described in Patent Document 2 into Braille, scanned text is input, and a Braille tactile display that outputs the raising and lowering of each pin representing Braille by a person's touch is read.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0006] As described above, the braille copier of Patent Document 1 copies braille documents, and the system of Patent Document 2 inputs text and tactually displays this text in braille, targeting visually impaired persons. On the other hand, an image forming apparatus reads an image of a document and forms the image of the document on a recording sheet, and copies text and the like included in the image of the document, targeting sighted persons.

[0007] However, even if there are provided devices for copying braille, devices for copying text, devices for converting text to braille, devices for converting braille to text, etc., there has been no device that can comprehensively perform these operations, and thus no device that is easy to use for both visually impaired persons and sighted persons has been provided.

[0008] The present invention has been made in view of the above circumstances, and an object thereof is to enable comprehensive copying of braille, copying of text, conversion from text to braille, and conversion from braille to text, and to expand the degree of utilization of information expressed in braille.

Means for Solving the Problems

[0009] An image forming apparatus according to an aspect of the present invention includes an image reading unit that reads an image of a document or a braille document, an image forming unit that forms characters on a recording sheet, a braille forming unit that forms braille on a braille sheet, a control unit that recognizes characters included in the image of the document read by the image reading unit, converts the characters into braille, causes the braille to be formed on the braille sheet by the braille forming unit, determines braille included in the braille document read by the image reading unit, converts the braille into characters, and causes the characters to be formed on the recording sheet by the image forming unit.

Effects of the Invention

[0010] According to the present invention, by enabling comprehensive copying of braille, copying of text, conversion from text to braille, and conversion from braille to text, the degree of utilization of information expressed in braille can be expanded.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3A

Figure 3B

Figure 3C

Figure 3D

Figure 3E

Figure 3F

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Embodiments for Carrying Out the Invention

[0012] Hereinafter, an image forming apparatus according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a cross-sectional view showing an image forming apparatus according to an embodiment of the present invention. As shown in FIG. 1, the image forming apparatus 10 of the present embodiment includes an image reading unit 11, an image forming unit 12, and a braille forming unit 18.

[0013] The image reading unit 11 has an image sensor (CCD sensor, CIS) that optically reads an image of a document, and a document image is generated from the output of this image sensor.

[0014] The image forming unit 12 forms an image indicated by the above image data on a recording sheet, and includes a magenta image forming unit 3M, a cyan image forming unit 3C, a yellow image forming unit 3Y, and a black image forming unit 3Bk. In any of the image forming units 3M, 3C, 3Y, and 3Bk, the surface of the photosensitive drum 4 is uniformly charged, the surface of the photosensitive drum 4 is exposed by the exposure unit 2 to form an electrostatic latent image on the surface of the photosensitive drum 4, the electrostatic latent image on the surface of the photosensitive drum 4 is developed into an image made of toner by the developing device 7, and the image on the surface of the photosensitive drum 4 is primarily transferred to the intermediate transfer belt 5. As a result, a color image is formed on the intermediate transfer belt 5. This color image is secondarily transferred to the recording paper P conveyed through the conveyance path 8 from the paper feeding unit 14 in the nip region N between the intermediate transfer belt 5 and the secondary transfer roller 6.

[0015] Thereafter, the recording paper P is heated and pressed by the fixing device 15, so that the toner image on the recording paper P is fixed by thermocompression bonding, and further the recording paper P is discharged to the discharge tray 17 through the discharge roller 16.

[0016] Above the image forming unit 12, a braille forming unit 18 is provided. The braille forming unit 18 includes a braille paper storage unit 18A for storing braille paper, a braille forming unit 18B for forming braille on the braille paper, and a braille paper supply unit 18C for pulling out the braille paper from the braille paper storage unit 18A and supplying it to the braille forming unit 18B.

[0017] The braille paper supply unit 18C includes a pickup roller for pulling out the braille paper from the braille paper storage unit 18A, a conveyance path for guiding the braille paper from the braille paper storage unit 18A to the braille forming unit 18B, a conveyance roller for conveying the braille paper, and the like.

[0018] The braille forming unit 18B is a mechanism that sequentially moves the braille paper in the column direction and the row direction and embosses the braille on the braille paper by a known method. For example, the braille forming unit 18B may be provided with a mold for embossing the braille on the braille paper for each of a plurality of brailles, or may be configured to selectively insert and remove a plurality of pins and press them against the braille paper to emboss the braille paper.

[0019] The braille paper is discharged from the discharge port (not shown) on the front side of the braille forming unit 18B and is discharged to a tray (not shown) provided at this discharge port.

[0020] Next, FIG. 2 is a block diagram showing the main internal configuration of the image forming apparatus 10 of the present embodiment. As shown in FIG. 2, the image forming apparatus 10 of the present embodiment includes an image reading unit 11, an image forming unit 12, a braille forming unit 18, a display unit 21, an operation unit 22, a touch panel 23, an image memory 27, a storage unit 28, and a control unit 29. These components can transmit and receive data or signals to and from each other through a bus. The touch panel 23 functions as a part of the operation unit 22.

[0021] The display unit 21 is composed of a liquid crystal display (LCD) or an organic EL (OLED) display, etc.

[0022] The operation unit 22 is provided with physical keys such as numeric keys, enter keys, and start keys. The operation unit 22 receives various instructions according to the operations of the above keys by the user.

[0023] A touch panel 23 is arranged on the screen of the display unit 21. The touch panel 23 is a touch panel such as a so-called resistive film method or a capacitance method. The touch panel 23 detects the contact (touch) of the user's finger or the like on the touch panel 23 together with the contact position, and outputs a detection signal indicating the coordinates of the contact position to a control unit 31 (described later) of the control unit 29, etc.

[0024] The original image read by the image reading unit 11 is stored in the image memory 27.

[0025] The storage unit 28 is a large-capacity storage device such as an SSD (Solid State Drive) or an HDD (Hard Disk Drive), and stores various application programs and various data.

[0026] The control unit 29 is composed of a processor, a RAM (Random Access Memory), and a ROM (Read Only Memory), etc. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit), etc. The control unit 29 functions as a control unit 31 when the control program stored in the above ROM or the storage unit 28 is executed by the above processor.

[0027] The control unit 31 comprehensively controls the image forming apparatus 10. The control unit 29 is connected to an image reading unit 11, an image forming unit 12, a Braille forming unit 18, a display unit 21, an operation unit 22, a touch panel 23, an image memory 27, a storage unit 28, and the like. The control unit 31 controls the operations of these components and performs signal or data transmission and reception with each of these components.

[0028] The control unit 31 serves as a processing unit that executes various processes necessary for image formation by the image forming apparatus 10.

[0029] Also, the control unit 31 receives an operation instruction input by the user based on a detection signal output from the touch panel 23 or an operation of a physical key of the operation unit 22. For example, the control unit 31 receives a touch operation on a GUI (Graphical User Interface) or the like displayed on the screen of the display unit 21 through the touch panel 23. Further, the control unit 31 has a function of controlling the display operation of the display unit 21.

[0030] Also, the control unit 31 controls the Braille forming unit 18 to cause the Braille paper supply unit 18C to pull out Braille paper from the Braille paper storage unit 18A and supply it to the Braille forming unit 18B, and cause the Braille forming unit 18B to form Braille on the Braille paper.

[0031] In the image forming apparatus 10 having such a configuration, when a document is set in the image reading unit 11, the control unit 31 causes the image reading unit 11 to read the image of the document, temporarily stores the document image in the image memory 27, inputs this image data to the image forming unit 12, and causes the image forming unit 12 to form the image of the document indicated by this image data on a recording sheet, thereby copying the image of the document.

[0032] Also, when the braille original is set in the image reading unit 11, the control unit 31 causes the image reading unit 11 to read the image of the braille original and temporarily stores the braille original image in the image memory 27. The control unit 31 analyzes the braille original image, determines each braille formed on the braille original, generates respective braille data indicating each braille, sends these braille data to the braille forming unit 18, and causes the braille forming unit 18 to form each braille indicated by these braille data on the braille paper. Thereby, the braille original is copied.

[0033] The analysis of the braille original image is performed by a known method. For example, the braille original image obtained by reading the braille original is binarized, each braille is extracted from the binarized image, and for each braille, at least one or more convex portions constituting the braille and their positions are detected, and braille data indicating the braille is generated based on information indicating the number and positions of these convex portions.

[0034] Also, as described above, in addition to causing the braille forming unit 18 to form each braille indicated by the respective braille data generated by the control unit 31 indicating each braille formed on the braille original on the braille paper, the control unit 31 converts the respective braille data indicating each braille included in the braille original into each character, generates image data indicating text composed of these characters, and causes the image forming unit 12 to form the text indicated by this image data on the recording paper. Further, the control unit 31 recognizes each character of the text included in the image of the original, causes the image forming unit 12 to form the text on the recording paper, also converts each character into respective braille, generates respective braille data indicating each braille, and causes the braille forming unit 18 to form each braille indicated by these braille data on the braille paper.

[0035] Further, the control unit 31 generates a braille file indicating each braille data and a document file indicating a text composed of each character, stores them in the storage unit 28, reads the braille file from the storage unit 28, and causes the braille forming unit 18 to form each braille indicated by each braille data of the braille file on the braille paper. Also, the control unit 31 reads the document file from the storage unit 28 and causes the image forming unit 12 to form the text indicated by the document file on the recording paper.

[0036] The format of the braille data is a known format, such as the BET format, BES format, BSE format, etc.

[0037] The braille file is, for example, PEF (Portable Embosser Format). Also, the document file is, for example, PDF (Portable Document Format).

[0038] As described above, in the image forming apparatus 10 of this embodiment, the processes related to braille, such as copying of braille images, printing of text composed of each character converted from each braille of the braille image, copying of text in the original image, forming of each braille converted from each character of the text in the original image, storing of the braille file indicating each braille, and storing of the document file indicating the text, are comprehensively performed.

[0039] Next, in accordance with the user's instruction, a control procedure for performing the above-described processes related to braille will be described with reference to flowcharts shown in FIGS. 3A to 3F.

[0040] For example, when a setting instruction for the braille mode is input to the operation unit 22 by a touch operation on the GUI displayed on the display unit 21 by the user, the control unit 31 sets the braille mode according to the instruction (S101), and causes the display unit 21 to display a first selection screen G1 as shown in the example of FIG. 4 (S102).

[0041] On the first selection screen G1 shown in FIG. 4, there are displayed a selection key K11 for selecting the processing of a braille image, a selection key K12 for selecting the processing of a manuscript image, a selection key K13 for selecting the processing of a braille file, and a selection key K14 for selecting the processing of a document file.

[0042] For example, when a selection instruction for selecting the processing of a braille image is received at the operation unit 22 by a touch operation on the selection key K11 by the user (S103 "Braille"), the control unit 31 causes the display unit 21 to display a second selection screen G2 as shown in FIG. 5 (S104).

[0043] On the second selection screen G2 shown in FIG. 5, there are displayed a selection key K21 for selecting the copying of a braille image, a selection key K22 for selecting the printing of text composed of each character converted from each braille of the braille image, a selection key K23 for selecting the generation of a braille file indicating each braille, and a selection key K24 for selecting the generation of a document file indicating the text.

[0044] The user touches any one of the selection keys K21 to K24 on the second selection screen G2, sets the braille manuscript on the image reading unit 11, and operates the start key of the operation unit 22.

[0045] At this time, when the user touches the selection key K21 and a selection instruction to select a copy of the braille image is received by the operation unit 22, and further a manuscript reading instruction is received by the operation unit 22 by operating the start key (S105 "Braille formation"), the control unit 31 causes the image reading unit 11 to read the image of the braille manuscript, and temporarily stores the obtained braille manuscript image in the image memory 27 (S106). The control unit 31 analyzes the braille manuscript image, determines each braille formed on the braille manuscript, and generates respective braille data indicating each braille (S107). Then, the control unit 31 sends these braille data to the braille forming unit 18, and causes the braille forming unit 18 to form each braille indicated by these braille data on the braille paper (S108). Thereby, the braille manuscript is copied. Then, the control unit 31 causes the display unit 21 to display a third selection screen G3 as shown in FIG. 6 for selecting the type of language represented by the braille (S109).

[0046] On the third selection screen G3 shown in FIG. 6, respective buttons B11 are displayed in association with a plurality of types of languages, and for braille in which a plurality of grades are set, respective buttons B12 are displayed in association with each grade. For example, when English is represented by each braille of the braille manuscript and each braille is of grade 1, the user touches the button B11 associated with English and the button B12 associated with grade 1 to select English and grade 1. Thereby, a selection instruction to select English and grade 1 is received by the operation unit 22.

[0047] The user touches the button B11 associated with the language of the braille of the braille manuscript on the third selection screen G3, and if the braille has a plurality of grades set, also touches the button B12 associated with the grade of the braille of the braille manuscript. Thereby, a selection instruction to select English and grades 1 and grade 2 is received by the operation unit 22.

[0048] The control unit 31 determines the type of language and grade of the braille based on the content of the selection instruction received by the operation unit 22 (S110).

[0049] The control unit 31 generates a braille file indicating each braille data generated in S107 and the type and grade of the language of each braille determined in S110, and stores it in the storage unit 28 (S111).

[0050] Also, when the user touches the selection key K22 on the second selection screen G2 and a selection instruction to select text printing is received by the operation unit 22, and further a manuscript reading instruction is received by the operation unit 22 by operating the start key (S105 "text printing"), the control unit 31 causes the image reading unit 11 to read an image of the braille manuscript and temporarily stores the braille manuscript image in the image memory 27 (S112). The control unit 31 analyzes the braille manuscript image, determines each braille formed on the braille manuscript (S113), and causes the display unit 21 to display the third selection screen G3 for selecting the type of language represented by the braille (S114).

[0051] The control unit 31 determines the type and grade of the language of the braille based on the content of the selection instruction received by the operation unit 22 (S115).

[0052] In the storage unit 28, as shown in the example in FIG. 7, for each of a plurality of languages, respective braille character conversion tables GT associating braille with characters are stored in advance. For braille in which a plurality of grades are set, respective braille character conversion tables GT associating braille with characters are stored in advance for each grade.

[0053] The control unit 31 reads and acquires from the storage unit 28 the braille character conversion table GT associated with the type and grade of the language of the braille determined in S115 (S116).

[0054] The control unit 31 refers to the braille character conversion table GT acquired in S116, and converts each braille character determined in S113 into each corresponding character (S117). The control unit 31 generates image data indicating the text composed of these characters, and causes the image forming unit 12 to form the text indicated by this image data on the recording paper (S118). Further, the control unit 31 generates a document file indicating the text composed of each character and stores it in the storage unit 28 (S119).

[0055] Also, when the user touches the selection key K23 on the second selection screen G2 and a selection instruction to select the generation of a braille file is received by the operation unit 22, and further a manuscript reading instruction is received by the operation unit 22 by operating the start key (S105 "braille file"), the control unit 31 causes the image reading unit 11 to read the image of the braille manuscript in response to the operation of the start key, and temporarily stores the braille manuscript image in the image memory 27 (S120). The control unit 31 analyzes the braille manuscript image, determines each braille character formed on the braille manuscript, generates respective braille data indicating each braille character (S121), and causes the third selection screen G3 to be displayed on the display unit 21 (S122).

[0056] The control unit 31 determines the type and grade of the braille language based on the content of the selection instruction received by the operation unit 22 (S123), generates a braille file indicating each braille data generated in S121 and the type and grade of each braille language determined in S123, and stores it in the storage unit 28 (S124).

[0057] Also, when the user touches the selection key K24 on the second selection screen G2 to give a selection instruction to the operation unit 22 to select the generation of a document file, and further gives a manuscript reading instruction to the operation unit 22 by operating the start key (S105 "document file"), the control unit 31 causes the image reading unit 11 to read the image of the braille manuscript in response to the operation of the start key, and temporarily stores the braille manuscript image in the image memory 27 (S125). The control unit 31 analyzes the braille manuscript image, determines each braille formed on the braille manuscript (S126), and causes the display unit 21 to display the third selection screen G3 shown in FIG. 6 (S127).

[0058] The control unit 31 determines the type and grade of the braille language based on the content of the selection instruction received by the operation unit 22 (S128). Then, the control unit 31 reads and acquires the braille character conversion table GT associated with the determined type and grade of the braille language from the storage unit 28 (S129).

[0059] The control unit 31 refers to the braille character conversion table GT acquired in S129, and converts each braille of the braille manuscript determined in S126 into each character (S130). The control unit 31 generates a document file indicating the text composed of each character and stores it in the storage unit 28 (S131).

[0060] Therefore, when the processing of the braille image is selected on the first selection screen G1, as shown in the example of FIG. 8, (i) the braille manuscript TG is copied onto the braille paper TP, (ii) each braille of the braille manuscript TG is converted into each character, and the text composed of each character is formed on the recording paper P, (iii) a braille file RF composed of each braille data indicating each braille of the braille manuscript TG is formed, or (iv) each braille of the braille manuscript TG is converted into each character, and a document file BF indicating the text composed of each character is formed.

[0061] Also, when a selection instruction to select the processing of the image of the document is received at the operation unit 22 by a touch operation on the selection key K12 on the first selection screen G1 by the user (S103 "Text"), the fourth selection screen G4 as shown in FIG. 9 is displayed on the display unit 21 (S132).

[0062] On the fourth selection screen G4 shown in FIG. 9, there are displayed a selection key K31 for selecting the printing of each character of the text included in the image of the document, a selection key K32 for forming each Braille character converted from each character of the text on Braille paper, a selection key K33 for selecting the generation of a document file indicating the text, and a selection key K34 for selecting the generation of a Braille file indicating each Braille character.

[0063] The user touches and selects any one of the selection keys K31 to K34 on the fourth selection screen G4, sets the document on the image reading unit 11, and operates the start key of the operation unit 22.

[0064] For example, when the user touches the selection key K31 and a selection instruction to select the printing of each character of the text is received at the operation unit 22, and further a document reading instruction is received at the operation unit 22 by operating the start key (S133 "Text Printing"), the control unit 31 causes the image reading unit 11 to read the image of the document, and temporarily stores the obtained document image in the image memory 27 (S134).

[0065] Based on the document image, the control unit 31 discriminates and recognizes each character of the text included in the document image by a known OCR (Optical Character Reader) function or an AI (artificial intelligence)-OCR function (S135), and generates image data indicating each character of the text (S136). Further, based on this image data, the control unit 31 causes the text to be formed on the recording paper by the image forming unit 12 (S137), and generates a document file indicating the text composed of each character and stores it in the storage unit 28 (S138).

[0066] Also, when the user touches the selection key K32 on the fourth selection screen G4, and the operation unit 22 receives a selection instruction to select the formation of each Braille character converted from each character of the text, and further when a manuscript reading instruction is received by the operation unit 22 by operating the start key (S133 "Braille formation"), the control unit 31 causes the image reading unit 11 to read the image of the manuscript, and temporarily stores the obtained manuscript image in the image memory 27 (S139). The control unit 31 recognizes each character included in the manuscript image by the OCR function or the AI - OCR function based on the manuscript image (S140), and determines the type of language of each character by a known application program (S141).

[0067] The control unit 31 reads and obtains the Braille character conversion table GT associated with the type of language determined in S141 from the storage unit 28 (S142). At this time, when a plurality of grades are set for the Braille corresponding to the type of language, the control unit 31 displays a GUI for selecting any of the grades on the screen of the display unit 21, detects the grade selected by the user's touch operation through the touch panel 23, and reads and obtains the Braille character conversion table GT associated with the language and the grade from the storage unit 28 (S142).

[0068] The control unit 31 refers to the Braille character conversion table GT obtained in S142, converts each character recognized in S140 into each Braille character (S143), and generates respective Braille data indicating each Braille character (S144). The control unit 31 sends these Braille data to the Braille forming unit 18, and causes the Braille forming unit 18 to form each Braille character indicated by these Braille data on the Braille paper (S145). Further, the control unit 31 generates a Braille file indicating each Braille data, the type of language of each Braille character determined in S141, and the grade, and stores it in the storage unit 28 (S146).

[0069] Also, when the user touches the selection key K33 on the fourth selection screen G4 and a selection instruction to select the generation of a document file indicating text is received by the operation unit 22, and further a manuscript reading instruction is received by the operation unit 22 by operating the start key (S133 "document file"), the control unit 31 causes the image reading unit 11 to read the image of the manuscript and temporarily stores the manuscript image in the image memory 27 (S147). The control unit 31 recognizes each character of the text included in the manuscript image by the OCR function or the AI-OCR function based on the manuscript image (S148), and generates a document file indicating the text composed of each character and stores it in the storage unit 28 (S149).

[0070] Also, when the user touches the selection key K34 on the fourth selection screen G4 and a selection instruction to select the generation of a braille file indicating each braille is received by the operation unit 22, and further a manuscript reading instruction is received by the operation unit 22 by operating the start key (S133 "braille file"), the control unit 31 causes the image reading unit 11 to read the image of the manuscript and temporarily stores the manuscript image in the image memory 27 (S150). The control unit 31 recognizes each character included in the manuscript image by the OCR function or the AI-OCR function based on the manuscript image (S151), and determines the type of language of each character by a known application program (S152).

[0071] The control unit 31 reads and acquires the braille character conversion table GT associated with the type of language determined in S152 from the storage unit 28. When a plurality of grades are set for the braille associated with the type of language, a GUI for selecting any one of the grades is displayed on the screen of the display unit 21, and when the grade is selected by the touch operation of the user, the braille character conversion table GT associated with the language and the grade is read and acquired from the storage unit 28 (S153).

[0072] The control unit 31 refers to the braille character conversion table GT acquired in S153, converts each character recognized in S151 into respective braille (S154), generates respective braille data indicating each braille (S155), generates a braille file indicating each braille data and the type and grade of the language of each braille determined in S152, and stores it in the storage unit 28 (S156).

[0073] Therefore, when the processing of the image of the original document is selected on the first selection screen G1, as shown in FIG. 10, the image of the original document M is copied onto the recording paper P, or each character of the image of the original document M is converted into respective braille, and each braille is formed on the braille paper TP, or a document file BF indicating the text composed of each character of the image of the original document M is formed, or each character of the image of the original document M is converted into respective braille, and a braille file RF composed of respective braille data indicating each braille is formed.

[0074] Then, when the user touches the selection key K13 on the first selection screen G1 and a selection instruction to select the processing of the braille file is received by the operation unit 22 (S103 "Braille file"), the control unit 31 causes the list of braille files stored in the storage unit 28 in S111, S124, S146, and S156 to be displayed on the screen of the display unit 21 (S157). For example, a list RT of braille files as shown in FIG. 11 is displayed on the screen of the display unit 21.

[0075] When the user touches an arbitrary braille file in the list RT and a selection instruction to select the arbitrary braille file is received by the operation unit 22, the control unit 31 reads and acquires the selected arbitrary braille file from the storage unit 28 (S158), and causes the fifth selection screen G5 as shown in FIG. 12 to be displayed on the display unit 21 (S159).

[0076] On the fifth selection screen G5, a selection key K41 for selecting the formation of each braille indicated by each braille data of the braille file and a selection key K42 for selecting the printing of the text composed of each character converted from each braille of the braille image are displayed.

[0077] When a selection instruction for the user to touch the selection key K41 and select the formation of each Braille indicated by each Braille data of the Braille file is received by the operation unit 22 (S160 "Braille formation"), the control unit 31 causes the Braille formation unit 18 to input each Braille data of the Braille file acquired in S158, and causes the Braille formation unit 18 to form each Braille indicated by these Braille data on the Braille paper (S161).

[0078] Also, when a selection instruction for the user to touch the selection key K42 and select the printing of text composed of each character converted from each Braille of the Braille image is received by the operation unit 22 (S160 "text printing"), the control unit 31 reads and acquires the Braille character conversion table GT associated with the type and grade of the language indicated by the Braille file acquired in S158 from the storage unit 28 (S162).

[0079] The control unit 31 refers to the Braille character conversion table GT acquired in S162, and converts each Braille indicated by each Braille data of the Braille file acquired in S158 into each character (S163). The control unit 31 generates image data indicating text composed of these characters, and causes the image forming unit 12 to form the text indicated by this image data on the recording paper (S164).

[0080] When the processing of the Braille file is selected on the first selection screen G1 in this way, each Braille indicated by each Braille data of the Braille file is formed on the Braille paper, or each Braille of the Braille original TG is converted into each character, and text composed of each character is formed on the recording paper P.

[0081] Then, when the user touches the selection key K14 on the first selection screen G1 and a selection instruction to select the processing of the braille file is received by the operation unit 22 (S103 "document file"), the control unit 31 causes the list of document files stored in the storage unit 28 in S119, S131, S138, and S149 to be displayed on the screen of the display unit 21 (S165). For example, a list BT of document files as shown in FIG. 13 is displayed on the screen of the display unit 21.

[0082] When the user touches an arbitrary document file in the list BT and a selection instruction to select the arbitrary document file is received by the operation unit 22 (S165), the control unit 31 reads out and acquires the selected arbitrary document file from the storage unit 28 (S166), and causes the sixth selection screen G6 as shown in FIG. 14 to be displayed on the display unit 21 (S167).

[0083] On the sixth selection screen G6, a selection key K51 for selecting the printing of the text indicated by the document file and a selection key K52 for selecting the formation of each braille converted from each character of the text are displayed.

[0084] When the user touches the selection key K51 and a selection instruction to select the printing of the text indicated by the document file is received by the operation unit 22 (S168 "text printing"), the control unit 31 generates image data indicating the text of the document file acquired in S166, inputs this image data to the image forming unit 12, and causes the text to be formed on the recording paper by the image forming unit 12 (S169).

[0085] Also, when the user touches the selection key K52 and a selection instruction to select the formation of each braille converted from each character of the text is received by the operation unit 22 (S168 "braille formation"), the control unit 31 determines the language type of each character of the text indicated by the document file by a known application program for determining the language type (S170).

[0086] The control unit 31 reads and obtains from the storage unit 28 a Braille character conversion table GT associated with the type of language determined in S170 (S171). At this time, if a plurality of grades are set for the Braille corresponding to the type of language, the control unit 31 causes a GUI for selecting any one of the grades to be displayed on the screen of the display unit 21. When a selection instruction for selecting a grade is received by the operation unit 22 due to a touch operation by the user, the control unit 31 reads and obtains from the storage unit 28 a Braille character conversion table GT associated with the selected grade (S171).

[0087] The control unit 31 refers to the Braille character conversion table GT obtained in S171, converts each character of the text indicated by the document file obtained in S166 into respective Braille (S172), generates respective Braille data indicating each Braille (S173), inputs these Braille data to the Braille forming unit 18, and causes the Braille forming unit 18 to form each Braille indicated by these Braille data on Braille paper (S174).

[0088] When the processing of the document file is selected on the first selection screen G1 in this way, the text of the document file is formed on the recording paper, or each character of the image of the original document M is converted into respective Braille, and each Braille is formed on the Braille paper TP.

[0089] As described above, in this embodiment, by comprehensively performing processes related to braille, such as copying a braille image, printing text composed of each character converted from each braille of the braille image, copying text in a document image, forming each braille converted from each character of the text in the document image, storing a braille file indicating each braille, and storing a document file indicating the text, there is no need to selectively use devices such as a device for copying a document image, a device for copying a braille image, a device for converting braille to characters, and a device for converting characters to braille. Thus, convenience can be improved for both visually impaired and sighted persons. Therefore, according to this embodiment, by comprehensively performing braille copying, text copying, conversion from text to braille, and conversion from braille to text, the degree of utilization of information expressed in braille can be expanded.

[0090] Note that the configuration and processing of the above-described embodiment described with reference to FIGS. 1 to 14 are merely examples of the present invention and are not intended to limit the present invention to such configuration and processing.

Explanation of Reference Numerals

[0091] 10 Image forming apparatus 11 Image reading unit 12 Image forming unit 18 Braille forming unit 21 Display unit 22 Operation unit 23 Touch panel 27 Image memory 28 Storage unit 29 Control unit 31 Control section

Claims

1. An image reading unit that reads an image of a document or a braille document, An image forming unit that forms characters on a recording paper, A braille forming unit that forms braille on a braille paper, Recognize the characters included in the image of the document read by the image reading unit, convert the characters into braille, and cause the braille forming unit to form the braille on the braille paper, An image forming apparatus comprising: a control unit that determines the braille included in the braille document read by the image reading unit, converts the braille into characters, and causes the image forming unit to form the characters on a recording paper.

2. Comprising a storage unit, The control unit, Recognize the characters included in the image of the document read by the image reading unit, convert the characters into braille, generate braille data indicating the braille, and store the braille data in the storage unit, The image forming apparatus according to claim 1, wherein the braille data is read out from the storage unit, and the braille indicated by the braille data is formed on a braille paper by the braille forming unit.

3. The image forming apparatus according to claim 2, wherein the control unit reads out the braille data from the storage unit, converts the braille indicated by the braille data into characters, and causes the image forming unit to form the characters on a recording paper.

4. Comprising a storage unit, The control unit, Determine the braille included in the image of the document read by the image reading unit, convert the braille into characters, and store the characters in the storage unit, The image forming apparatus according to claim 1, wherein the characters are read out from the storage unit, and the characters are formed on a recording paper by the image forming unit.

5. The image forming apparatus according to claim 4, wherein the control unit reads out the characters from the storage unit, converts the characters into braille, and causes the braille forming unit to form the braille on a braille paper.

Images