Image-forming device

Abstract

In the present invention, a display means displays an option of at least one language of a first language and a second language from the start of reading a document by a reading means to generation of image data.

Description

Image forming device

[0001] The present invention relates to an image forming apparatus that forms an image on a sheet.

[0002] Conventional image forming devices are equipped with an image scanner and are capable of performing character recognition processing on image data of a document scanned by the image scanner to obtain text data. Recently, image forming devices have also become known that have a translation application that translates the obtained text data into any document. As an example of an image forming device equipped with such a translation function, Japanese Patent Application Laid-Open No. 2022-47014 proposes a method in which a user selects a language to be translated and a language to be translated from a document on a display means of the image forming device, and the document is translated using character recognition processing according to the selected language.

[0003] In Japanese Patent Laid-Open Publication No. 2022-47014, a user must select a source language and a target language from multiple options. Specifically, when translating text data corresponding to a document scanned by an image scanner, the image forming device of Patent Literature 1 first prompts the user to select both the source language and the target language, and then the image forming device begins scanning the document. Therefore, if the user takes time to select the language, the start of scanning the document is delayed accordingly, and the time required to complete the translation increases.

[0004] Japanese Patent Application Laid-Open No. 2022-47014

[0005] SUMMARY OF THE INVENTION In view of the above-mentioned problems, an object of the present invention is to reduce the time required for language selection before starting to read a document when using a translation function.

[0006] In order to achieve the above-mentioned object, the image forming apparatus of the present invention comprises a reading means for reading a document and generating image data, a character recognition means for performing character recognition on the image data generated by the reading means and generating a character string in a first language, an acquisition means for acquiring a character string in a second language translated from the character string in the first language generated by the character recognition means, a display means for displaying a selection of multiple languages ​​as candidates for the language to be character recognized by the character recognition means or the language to be translated acquired by the acquisition means, and an acceptance means for accepting from a user a selection of at least one of the first language and the second language from the selections displayed on the display means, wherein the display means displays the selections between the time the document starts to be read by the reading means and the time image data is generated.

[0007] According to the present invention, it is possible to provide an image forming apparatus that reduces the time required for language selection before starting to read an original.

[0008] FIG. 1 shows an image forming apparatus. Overall configuration diagram of the system. Block diagram showing the configuration of the image forming apparatus. Data flow diagram in Example 1. Timing diagram in Example 1. Flowchart in Example 1. Selection screen for selecting a first language in Example 1. Selection screen for selecting a second language in Example 1. Confirmation screen for selected language in Example 1. Data flow diagram in Example 2. Selection screen for print layout in Example 2. Flowchart in Example 2. Confirmation screen for selected language in Example 2.

[0009] 1 is a diagram showing an image forming apparatus 101 and an operation unit 211 according to this embodiment, and FIG. 2 is a diagram showing an example of the overall configuration of an image forming system including the image forming apparatus 101 according to this embodiment. The image forming apparatus 101 is connected to a network 100. The network 100 may be configured to be connected by wire, or may be configured to be connected wirelessly to an access point (not shown).

[0010] The image forming apparatus 101 can communicate with a translation server 102 via a network 100. The translation server 102 publishes an API (Application Programming Interface) for translation and has the function of returning a translation result of a string to be translated by passing the string to the API and the source and target languages. The translation server 102 is an example of an external device with a translation function.

[0011] 3 is a block diagram showing the configuration of the image forming apparatus 101. The image forming apparatus 101 is mainly composed of a control unit 210, an operation unit 211, a reading unit 212, a printing unit 214, and a communication unit 215. The control unit 210 has a CPU (for example, a one-chip microcomputer incorporating a ROM, a RAM, etc.) and controls the operation unit 211, the reading unit 212, the storage unit 213, the printing unit 214, and the communication unit 215. The control unit 210 also has an OCR (Optical Character Recognition / Reader) that recognizes character strings from image data and converts them into character string data.

[0012] The operation unit 211 is a touch panel display. The touch panel display functions as a display device that displays information to the user and as an input device that detects operations from the user. By touching keys (e.g., setting item keys corresponding to functions, selection item keys corresponding to setting values ​​of the setting items, etc.) on the screen displayed on the touch panel display, the user's finger is detected, the position is identified, and setting conditions corresponding to the item keys are input. The control unit performs processing in accordance with the user's touch operation.

[0013] The reading unit 212 is, for example, an image scanner. The image scanner serves as a reading unit and acquires image data. The image data collected by the image scanner is corrected, analyzed, and converted by the control unit. The storage unit 213 permanently stores data using flash memory. Flash memory is an electrically erasable non-volatile memory, and data can be electrically written to and erased. While flash memory is assumed as the storage means in this embodiment, auxiliary storage devices such as SSDs, HDDs, and eMMCs may also be used. The printing unit 214 prints image data scanned by the image scanner and print data sent from a host computer on paper. The communication unit 215 transmits and receives various data (e.g., character strings) to and from an external device (a translation server in this embodiment). Information can be obtained from the Internet via an appropriate protocol or gateway to provide network connectivity.

[0014] 4 is a data flow diagram in this embodiment. The reading unit 212 converts original text read by an image scanner using reading means 301 into image data 302. The operation unit 211 has display means 312 and reception means 311. The display means 312 displays options for languages ​​to be translated on a touch panel display. The reception means 311 detects the user's touch operation and generates reception information 310, which is the selection result of the first language and the second language.

[0015] The storage unit 213 stores translation information 309, which is information on the selected translation language. In this embodiment, when a first language is selected, information on the combination of the first language and the second language selected at the same time is stored. Alternatively, the translation information 309 may be the number of times the first language is selected.

[0016] The control unit 210 has character recognition means 303, translation instruction means 305, accepted information update means 307, and acquisition means 341. The character recognition means 303 generates first language character string data (character string in the first language) 304 by extracting a predetermined character string such as an ASCII code string from image data 302 read by the reading unit. The accepted information update means 307 updates the number of times that a first language has been selected from accepted information 310 received from the operation unit 211, and updates the number of times stored in the storage unit 213. In addition, the translation instruction means 305 passes the first language character string data 304 and translation language accepted information 306 to communication means 313. The acquisition means 341 acquires second language character string data (character string in the second language) 340, which is the result of translation by the translation server.

[0017] 5 is a timing diagram showing the timing of reading an original and the display and selection of a first language and a second language in this embodiment. A choice of at least one of the first language and the second language is displayed between the time when the reading unit starts reading the original and the time when image data is generated. Alternatively, the user may select at least one of the first language and the second language between the time when the reading unit starts reading the original and the time when image data is generated.

[0018] 7 shows an example of a first language selection screen. In this embodiment, the first language selection screen displays a title 501 of the screen for selecting the translation source, first language options 502, a scroll bar 503 for selecting the first language, and a first language confirmation button 504. In this embodiment, multiple first language options are displayed in a list format, and one is selected from the list. The options are sorted alphabetically in descending order, and if the user wants to select a language that is not displayed, they scroll to the bottom and select the first language. Language selection does not have to be in a list format, and any format that allows one to be selected from multiple options will suffice.

[0019] FIG. 8 shows an example of a second language selection screen. In this embodiment, the second language selection screen displays a title 501 for selecting the translation source, second language options 502, a scroll bar 503 for selecting the second language, and a second language confirmation button 604. In this embodiment, multiple second language options are displayed in list format on the display unit 312, and the user selects one from the list. The options are sorted alphabetically in descending order, and if the user wants to select a language that is not displayed, they scroll to the bottom and select the second language. Language selection does not have to be in list format; any other format that allows one to be selected from multiple options may be used. Alternatively, the user may select only the second language without selecting the first language, and the language of the document image recognized by the image forming device may be automatically set. Alternatively, the user may select only the first language without selecting the second language, and the language preset in the image forming device may be automatically set.

[0020] 9 shows an example of a confirmation screen for the first and second languages ​​in this embodiment. In this embodiment, a selected first language 701, a selected second language 702, a decision button 703 for confirming the selection, and a cancel button 704 for canceling the translation are displayed.

[0021] 6 is a flowchart of the translation process according to this embodiment. Hereinafter, a flow will be described in which the first language of the source of translation or the second language of the target of translation can be selected even while the document is being read, and translation starts once the document has been read.

[0022] In S401, the reading means 301 starts reading a document written in a first language. In S402, the display means 312 displays options for the first language to be used as the translation source language. In S403, if the confirm button is pressed while one of the first languages ​​displayed in S402 is selected, the control unit 210 proceeds to S404. In S404, the display means 312 displays options for the second language to be used as the translation destination language.

[0023] In S405, if the Confirm button is pressed while one of the second languages ​​displayed in S404 is selected, the control unit 210 proceeds to S406. S406 is a screen for confirming the first language determined in S403 and the second language determined in S405. In this embodiment, the characters on the Confirm button are displayed in a lighter color (light gray) than usual and cannot be pressed until reading of the original is complete. In S407, the reading unit 212 waits for reading of the original by the reading means 301 to be completed. When reading is complete, the process proceeds to S408.

[0024] In S408, the reading unit 212 reads the document written in the first language using the reading means 301 and generates image data 302. In S409, the control unit 210 performs character recognition on the image data 302 generated in S401 using the character recognition means 303 and generates first language character string data 304. In S411, the operation unit 211 enables the decision button for selecting the translation language. In this embodiment, the characters on the decision button are displayed in the normal color (black) to accept operation of the decision button. If the acceptance means 311 recognizes that the decision button has been pressed in S412, it confirms the first language and the second language and proceeds to S415. If the decision button has not been pressed, it proceeds to S413. If the acceptance means 311 recognizes that the cancel button has been pressed in S413, it interrupts processing. If the cancel button has not been pressed, it returns to S412.

[0025] In S415, the control unit 210 instructs the communication unit to perform translation by transmitting the translation language acceptance information 306 and the first language character string data 304 to the translation server via communication via the translation instruction unit 305. In S416, the acquisition unit 341 acquires the second language character string data 340, which is the translation result of the translation server.

[0026] According to this embodiment, the time required to complete the translation can be reduced by selecting the translation language while the document is being read.

[0027] [Example 2] Example 1 described a configuration in which translation is performed after the user confirms the translation language selected on the touch panel display. This example differs from Example 1 in the following respects. Specifically, this example differs from Example 1 in that translation into a second language is performed using the translation function of the image forming apparatus, and that the language selected as the first language by the user is compared with the language recognized by the language recognition means, and if they match, translation begins without user confirmation. In the following description, the same components and controls as those in Example 1 are assigned the same reference numerals, and their description will be omitted.

[0028] 10 is a block diagram of this embodiment. The control unit 210 has a CPU (for example, a one-chip microcomputer incorporating a ROM, a RAM, etc.) and controls an operation unit 211, a reading unit 212, a storage unit 213, a printing unit 214, and a translation unit 220.

[0029] 11 is a data flow diagram of this embodiment. The translation unit 220 has a translation means 320, which translates based on the first language character string data 304 and reception information 310 received from the translation instruction means 305, and passes the translated result to the acquisition means 341.

[0030] The control unit 210 includes a language recognition unit 330 and a first language determination unit 332. The language recognition unit 330 determines the type of language written in the image data 302 and generates a language recognition result 331. In this embodiment, the language recognition unit 330 recognizes a specific language or a language group. Language groups are classified into, for example, Asian languages ​​(Japanese, Chinese, Korean), Western European languages ​​(English, French, etc.), Central European languages ​​(Croatian, Czech, etc.), Baltic languages ​​(Estonian, Latvian, etc.), and Central Asian languages ​​(Hindi, etc.). Chinese may be further classified into simplified characters and traditional characters.

[0031] The first language determination means 332 determines whether the first language selected from the translation language acceptance information 306 matches the language recognition result 331. If they match, the translation instruction means 305 issues a translation instruction without final confirmation from the user. If they do not match, the language recognition result 331 and first language options are displayed on the touch panel display.

[0032] 13 shows an example of a screen displayed on the touch panel display when the first language determination means 332 determines that there is no match in this embodiment. A first box 1101 displays the first language selected by the user from the translation language acceptance information 306, and a second box 1102 displays the second language that is the language recognition result 331. Here, the first language displayed in either the first box 1101 or the second box 1102 is selected and confirmed. This displays a confirm button 1103 for confirming the first language, a cancel button 1104 for canceling the translation function itself, and a rescan button 1105 for re-scanning the document using the reading function.

[0033] FIG. 12 is a flowchart of this embodiment. Starting in S431, the first language determination means 332 compares the first language selected by the user in S403 with the language recognition result 331 selected in S409. If they are the same, the process proceeds to S415. If they are different, the first language selected by the user in S403 and the language recognition result 331 are displayed on the display unit in S409. In S422, the user selects the language displayed in either the first box 1101 or the second box 1102 and presses the enter button 1103. This confirms the language displayed in that box as the first language, and the process proceeds to S415. If the enter button 1103 is not pressed in S422, the process proceeds to S423. If the cancel button 1104 is pressed in S423, the process ends without translation. If the cancel button 1104 is not pressed in S423, the process proceeds to S424. In S424, it is checked whether the rescan button 1105 has been pressed. If the rescan button 1105 is pressed, the process returns to S401 and resumes from reading the document. If the rescan button 1105 is not pressed, the process returns to S422 and checks whether the enter button is pressed.

[0034] As described above, according to this embodiment, the language selected by the user as the first language is compared with the language recognized by the language recognition means, and if they match, translation begins without user confirmation. This allows the time required to complete translation to be further reduced compared to the first embodiment.

[0035] The present invention can also be realized by a process in which a program that realizes one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., an ASIC) that realizes one or more of the functions.

[0036] [Additional Notes] The disclosure of the present embodiment also includes the following configuration examples and method examples.

[0037] (Item 1) An image forming apparatus having: a reading means for reading a document and generating image data; a character recognition means for performing character recognition on the image data generated by the reading means and generating a character string in a first language; an acquisition means for acquiring a character string in a second language translated from the character string in the first language generated by the character recognition means; a display means for displaying a selection of multiple languages ​​as candidates for languages ​​to be character-recognized by the character recognition means or languages ​​to be translated acquired by the acquisition means; and an acceptance means for accepting from a user a selection of at least one of the first language and the second language from the selections displayed on the display means, wherein the display means displays the selections during the period from when the reading means starts reading the document to when image data is generated.

[0038] (Item 2) The image forming apparatus according to Item 1, wherein the accepting unit accepts the selection of at least one of a first language and a second language between the time when the reading unit starts reading the document and the time when the image data is generated.

[0039] (Item 3) The image forming apparatus according to items 1 and 2, wherein the acquisition unit acquires, from an external device, the character string in the second language that has been translated by the external device.

[0040] (Item 4) The image forming apparatus according to items 1 to 3, further comprising a translation unit that translates the first language into the second language, and the acquisition unit acquires the character string in the second language translated by the translation unit.

[0041] (Item 5) The image forming apparatus according to items 1 to 4, further comprising a determination unit that determines whether the first language recognized by the character recognition unit and the first language accepted by the acceptance unit are the same language.

[0042] (Item 6) The image forming apparatus according to items 1 to 5, wherein the character recognition means recognizes language groups classified by language type, and the image forming apparatus has a discrimination means for discriminating whether the language group including the first language recognized by the character recognition means and the language group including the first language accepted by the acceptance means are the same language group.

[0043] (Item 7) The image forming apparatus according to items 1 to 6, wherein when the discrimination means determines that the first language recognized by the character recognition means and the first language accepted by the acceptance means are the same language, the image forming apparatus starts translation without any operation by the user.

[0044] (Item 8) An image forming apparatus according to items 1 to 7, characterized in that, when the discrimination means determines that the first language recognized by the character recognition means and the first language accepted by the acceptance means are different languages, the image forming apparatus displays options for the first language on the display means, allowing the user to select the first language.

[0045] The present invention is not limited to the above-described embodiments, and various modifications and variations can be made without departing from the spirit and scope of the present invention. Therefore, to apprise the public of the scope of the present invention, the following claims are appended.

[0046] This application claims priority based on Japanese Patent Application No. 2024-120926, filed on July 26, 2024, the entire contents of which are incorporated herein by reference.

[0047] 100 Network 101 Image forming device 102 Translation server 210 Control unit 211 Operation unit 212 Reading unit 213 Storage unit 214 Printing unit 215 Communication unit

Claims

1. An image forming apparatus having: a reading means for reading a document and generating image data; a character recognition means for performing character recognition on the image data generated by the reading means and generating a character string in a first language; an acquisition means for acquiring a character string in a second language translated from the character string in the first language generated by the character recognition means; a display means for displaying a selection of multiple languages ​​as candidates for languages ​​to be character-recognized by the character recognition means or languages ​​to be translated acquired by the acquisition means; and an acceptance means for accepting from a user a selection of at least one of the first language and the second language from the selections displayed on the display means, wherein the display means displays the selections during the period from when the reading means begins to read the document to when image data is generated.

2. The image forming apparatus according to claim 1, wherein said accepting means accepts the selection of at least one of a first language and a second language between the time when said reading means starts to read the document and the time when image data is generated.

3. The image forming apparatus according to claim 1, wherein said acquiring means acquires from said external device the character string in the second language that has been translated by said external device.

4. The image forming apparatus according to claim 1, further comprising a translation means for translating the first language into the second language, wherein the acquisition means acquires the character string in the second language translated by the translation means.

5. The image forming apparatus according to claim 1, further comprising a discrimination means for discriminating whether the first language recognized by said character recognition means and the first language accepted by said acceptance means are the same language.

6. The image forming apparatus according to claim 1, characterized in that the character recognition means recognizes language groups classified by language type, and has a discrimination means for determining whether the language group including the first language recognized by the character recognition means and the language group including the first language accepted by the acceptance means are the same language group.

7. The image forming apparatus according to claim 5, characterized in that if the discrimination means determines that the first language recognized by the character recognition means and the first language accepted by the acceptance means are the same language, translation begins without any user operation.

8. The image forming apparatus according to claim 5, characterized in that, when the discrimination means determines that the first language recognized by the character recognition means and the first language accepted by the acceptance means are different languages, the display means displays options for the first language, allowing the user to select the first language.

Images