Image forming apparatus

Abstract

To provide an image forming apparatus for reducing a time required for completing translation.SOLUTION: The display means displays a choice of at least one language of the first language and the second language from the start of reading the document by the reading means to the generation of the image data.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to an image forming apparatus that forms an image on a sheet. [Background technology]

[0002] Conventional image forming apparatuses are equipped with an image scanner and are capable of performing character recognition processing on image data of a document scanned by the image scanner to obtain text data. Recently, image forming apparatuses have also become known that have a translation application that translates the obtained text data into any document. Patent Document 1 proposes an image forming apparatus equipped with such a translation function, in which a user selects a language to be translated and a language to be translated from the document on a display means of the image forming apparatus, and the document is translated using character recognition processing according to the selected language. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-47014 Summary of the Invention [Problem to be solved by the invention]

[0004] In Patent Document 1, the user must select both the source language and the target language from multiple options. Specifically, when translating text data corresponding to a document scanned by an image scanner, the image forming device in Patent Document 1 first prompts the user to select both the source language and the target language, after which the image forming device starts scanning the document. Therefore, if the user takes time to select the language, the start of scanning the document will be delayed accordingly, and the time required to complete the translation will increase.

[0005] SUMMARY OF THE INVENTION In view of the above-mentioned problems, an object of the present invention is to reduce the time required for language selection before starting to read a document when using a translation function. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, the image forming apparatus of the present invention comprises a reading means for reading a document and generating image data, a character recognition means for performing character recognition on the image data generated by the reading means and generating a character string in a first language, an acquisition means for acquiring a character string in a second language translated from the character string in the first language generated by the character recognition means, a display means for displaying a selection of multiple languages ​​as candidates for the language to be character recognized by the character recognition means or the language to be translated acquired by the acquisition means, and an acceptance means for accepting from a user a selection of at least one of the first language and the second language from the selections displayed on the display means, wherein the display means displays the selections between the time the document starts to be read by the reading means and the time image data is generated. [Effects of the Invention]

[0007] According to the present invention, it is possible to provide an image forming apparatus that reduces the time required for language selection before starting to read an original. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 shows an image forming apparatus. [Figure 2] Overall system configuration diagram [Figure 3] Block diagram showing the configuration of an image forming apparatus [Figure 4] Data flow diagram for Example 1 [Figure 5] Timing diagram for Example 1 [Figure 6] Flowchart in Example 1 [Figure 7] Selection screen for selecting a first language in the first embodiment [Figure 8] Selection screen for selecting a second language in the first embodiment [Figure 9]Confirmation screen for the selected language in Example 1 [Figure 10] Data flow diagram in Example 2 [Figure 11] Print layout selection screen in Example 2 [Figure 12] Flowchart in Example 2 [Figure 13] Confirmation screen for selected language in Example 2 DETAILED DESCRIPTION OF THE INVENTION

[0009] [Example 1] Fig. 1 is a diagram showing an image forming apparatus 101 and an operation unit 211 according to this embodiment, and Fig. 2 is a diagram showing an example of the overall configuration of an image forming system including the image forming apparatus 101 according to this embodiment. The image forming apparatus 101 is connected to a network 100. The network 100 may be configured to be connected by wire, or may be configured to be connected wirelessly to an access point (not shown).

[0010] The image forming apparatus 101 can communicate with a translation server 102 via a network 100. The translation server 102 publishes an API (Application Programming Interface) for translation, and has the function of returning the translation result of the string to be translated by passing the string to the API and the source and target languages. The translation server 102 is an example of an external device with a translation function.

[0011] 3 is a block diagram showing the configuration of image forming apparatus 101. Image forming apparatus 101 is mainly composed of control unit 210, operation unit 211, reading unit 212, printing unit 214, and communication unit 215. Control unit 210 has a CPU (for example, a one-chip microcomputer incorporating ROM, RAM, etc.) and controls operation unit 211, reading unit 212, storage unit 213, printing unit 214, and communication unit 215. Control unit 210 also has an OCR (Optical Character Recognition / Reader) that recognizes character strings from image data and converts them into character string data.

[0012] The operation unit 211 is a touch panel display. The touch panel display functions as a display device that displays information to the user and as an input device that detects operations from the user. By touching keys (e.g., setting item keys corresponding to functions, selection item keys corresponding to setting values ​​of the setting items, etc.) on the screen displayed on the touch panel display, the user's finger is detected, the position is identified, and the setting conditions corresponding to the item keys are input. The control unit performs processing in accordance with the user's touch operation.

[0013] The reading unit 212 is, for example, an image scanner. The image scanner serves as a reading unit and acquires image data. The image data collected by the image scanner is corrected, analyzed, and converted by the control unit. The storage unit 213 permanently stores data using flash memory. Flash memory is an electrically erasable non-volatile memory, and data can be electrically written to and erased. In this embodiment, flash memory is assumed as the storage means, but auxiliary storage devices such as SSDs, HDDs, and eMMCs may also be used. The printing unit 214 prints image data read by the image scanner and print data sent from a host computer on paper. The communication unit 215 transmits and receives various data (e.g., character strings) to and from an external device (in this embodiment, a translation server). Information can be obtained from the Internet via an appropriate protocol or gateway to provide network connection.

[0014] Figure 4 is a data flow diagram in this embodiment. The reading unit 212 converts original text read by an image scanner into image data 302 using reading means 301. The operation unit 211 has display means 312 and reception means 311. The display means 312 displays options for languages ​​to be translated on a touch panel display. The reception means 311 detects the user's touch operation and generates reception information 310, which is the selection result of the first language and second language.

[0015] The storage unit 213 stores translation information 309, which is information on the selected translation language. In this embodiment, when a first language is selected, information on the combination of the first language and the second language selected at the same time is stored. Alternatively, the translation information 309 may be the number of times the first language has been selected.

[0016] The control unit 210 has character recognition means 303, translation instruction means 305, accepted information update means 307, and acquisition means 341. The character recognition means 303 generates first language character string data (character string in the first language) 304 by extracting a predetermined character string such as an ASCII code string from image data 302 read by the reading unit. The accepted information update means 307 updates the number of times that a first language is selected from accepted information 310 received from the operation unit 211, and updates the number of times stored in the memory unit 213. In addition, the translation instruction means 305 passes the first language character string data 304 and translation language accepted information 306 to communication means 313. Acquisition means 341 acquires second language character string data (character string in the second language) 340, which is the result of translation by the translation server.

[0017] 5 is a timing diagram showing the timing of reading a document and the display and selection of a first language and a second language in this embodiment. A choice of at least one of the first language and the second language is displayed between the time when the document starts to be read by the reading means and the time when image data is generated. Alternatively, the user may select at least one of the first language and the second language between the time when the document starts to be read by the reading means and the time when image data is generated.

[0018] FIG. 7 is an example of a first language selection screen. In this embodiment, the first language selection screen displays a title 501 of the screen for selecting the translation source, first language options 502, a scroll bar 503 for selecting the first language, and a first language confirmation button 504. In this embodiment, multiple first language options are displayed in a list format, and one is selected from the list. The options are sorted alphabetically in descending order, and if the user wants to select a language that is not displayed, they scroll to the bottom and select the first language. Language selection does not have to be in a list format, and any format that allows one to be selected from multiple options will suffice.

[0019] FIG. 8 shows an example of a second language selection screen. In this embodiment, the second language selection screen displays a title 501 for selecting the translation source, second language options 502, a scroll bar 503 for selecting the second language, and a second language confirmation button 604. In this embodiment, multiple second language options are displayed in list format on the display unit 312, and the user selects one from the list. The options are sorted alphabetically in descending order, and if the user wants to select a language that is not displayed, they scroll to the bottom and select the second language. Language selection does not have to be in list format; any other format that allows one to be selected from multiple options may be used. Alternatively, the user may select only the second language without selecting the first language, and the language of the document image recognized by the image forming device may be automatically set. Alternatively, the user may select only the first language without selecting the second language, and the language preset in the image forming device may be automatically set.

[0020] 9 shows an example of a confirmation screen for the first and second languages ​​in this embodiment. In this embodiment, a selected first language 701, a selected second language 702, a decision button 703 for confirming the selection, and a cancel button 704 for canceling the translation are displayed.

[0021] [Flowchart explanation] 6 is a flowchart of the translation process according to this embodiment. In the following, we will explain the flow of this embodiment, which allows you to select the first language of the source or the second language of the translation destination even while the document is being read, and starts translation once the document has been read.

[0022] In S401, the reading means 301 starts reading a document written in a first language. In S402, the display means 312 displays options for the first language to be used as the translation source language. In S403, if the decision button is pressed while one of the first languages ​​displayed in S402 is selected, the control unit 210 proceeds to S404. In S404, the display means 312 displays options for the second language to be used as the translation destination language.

[0023] In S405, if the decision button is pressed while one of the second languages ​​displayed in S404 is selected, the control unit 210 proceeds to S406. S406 is a screen for confirming the first language decided in S403 and the second language decided in S405. In this embodiment, the characters on the decision button are displayed in a lighter color than usual (light gray) and cannot be pressed until reading of the original is complete. In S407, the reading unit 212 waits for reading means 301 to complete reading of the original. When reading is complete, the process proceeds to S408.

[0024] In S408, the reading unit 212 reads the document written in the first language using the reading means 301, and generates image data 302. In S409, the control unit 210 performs character recognition on the image data 302 generated in S401 using the character recognition means 303, and generates first language character string data 304. In S411, the operation unit 211 enables the decision button for selecting the translation language. In this embodiment, the characters on the decision button are displayed in the normal color (black) to accept operation of the decision button. If the acceptance means 311 recognizes that the decision button has been pressed in S412, it confirms the first language and the second language and proceeds to S415. If the decision button has not been pressed, it proceeds to S413, and if the acceptance means 311 recognizes that the cancel button has been pressed in S413, it interrupts the processing. If the cancel button has not been pressed, it returns to S412.

[0025] In S415, the control unit 210 instructs the translation by transmitting the translation language acceptance information 306 and the first language character string data 304 to the translation server via communication via the translation instruction means 305. In S416, the acquisition means 341 acquires the second language character string data 340, which is the translation result of the translation server.

[0026] According to this embodiment, the time required to complete the translation can be reduced by selecting the translation language while the document is being read.

[0027] [Example 2] In the first embodiment, a configuration was described in which translation is performed after the user confirms the translation language selected on the touch panel display. This embodiment differs from the first embodiment in the following respects. Specifically, this embodiment differs from the first embodiment in that translation into a second language is performed using the translation function of the image forming apparatus, and that the language selected as the first language by the user is compared with the language recognized by the language recognition means, and if they match, translation begins without user confirmation. In the following description, the same components and controls as those in the first embodiment are assigned the same reference numerals and description thereof will be omitted.

[0028] 10 is a block diagram of this embodiment. The control unit 210 has a CPU (for example, a one-chip microcomputer with built-in ROM, RAM, etc.) and controls the operation unit 211, reading unit 212, storage unit 213, printing unit 214, and translation unit 220.

[0029] 11 is a data flow diagram of this embodiment. The translation unit 220 has a translation means 320, which translates based on the first language character string data 304 and reception information 310 received from the translation instruction means 305, and passes the translated result to the acquisition means 341.

[0030] The control unit 210 includes a language recognition means 330 and a first language determination means 332. The language recognition means 330 determines the type of language written in the image data 302 and generates a language recognition result 331. In this embodiment, the language recognition means 330 recognizes either a specific language or a language group. Language groups are categorized, for example, into Asian languages ​​(Japanese, Chinese, Korean), Western European languages ​​(English, French, etc.), Central European languages ​​(Croatian, Czech, etc.), Baltic languages ​​(Estonian, Latvian, etc.), and Central Asian languages ​​(Hindi, etc.). Chinese may be further categorized into simplified and traditional characters.

[0031] First language determination means 332 determines whether the first language selected from translation language acceptance information 306 matches language recognition result 331. If they match, translation instruction means 305 issues a translation instruction without final confirmation from the user. If they do not match, language recognition result 331 and first language options are displayed on the touch panel display.

[0032] 13 shows an example of a screen displayed on the touch panel display when the first language determination means 332 determines that there is no match in this embodiment. A first box 1101 displays the first language selected by the user from the translation language acceptance information 306, and a second box 1102 displays the second language that is the language recognition result 331. Here, the first language displayed in either the first box 1101 or the second box 1102 is selected and confirmed. This displays a confirm button 1103 for confirming the first language, a cancel button 1104 for canceling the translation function itself, and a rescan button 1105 for re-scanning the document using the reading function.

[0033] 12 is a flowchart of this embodiment. Starting in S431, the first language determination means 332 compares the first language determined by the user in S403 with the language recognition result 331 obtained in S409. If they are the same, the process proceeds to S415. If they are different, the first language determined by the user in S403 and the language recognition result 331 obtained in S409 are displayed on the display unit. In S422, the user selects the language displayed in either the first box 1101 or the second box 1102 and presses the enter button 1103, which confirms the language displayed in that box as the first language and the process proceeds to S415. If the enter button 1103 is not pressed in S422, the process proceeds to S423. If the cancel button 1104 is pressed in S423, the process ends without translation. If the cancel button 1104 is not pressed in S423, the process proceeds to S424. In S424, it is checked whether the rescan button 1105 has been pressed. If the rescan button 1105 is pressed, the process returns to S401 and resumes from reading the document. If the rescan button 1105 is not pressed, the process returns to S422 and checks whether the enter button is pressed.

[0034] As described above, according to this embodiment, the language selected by the user as the first language is compared with the language recognized by the language recognition means, and if they match, translation begins without user confirmation. This allows the time required to complete translation to be further reduced compared to the first embodiment.

[0035] [Other embodiments] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0036] [Note] The disclosure of the present embodiment also includes the following configuration examples and method examples.

[0037] (Item 1) a reading means for reading an original and generating image data; character recognition means for performing character recognition on the image data generated by the reading means to generate a character string in a first language; an acquisition means for acquiring a character string in a second language translated from the character string in the first language generated by the character recognition means; a display means for displaying a plurality of language options as candidates for the language to be character-recognized by the character recognition means or the language to be translated acquired by the acquisition means; a receiving means for receiving from a user a selection of at least one of the first language and the second language from the options displayed on the display means; An image forming apparatus having: The image forming apparatus is characterized in that the display means displays the options during the period from when the reading means starts reading the document to when image data is generated.

[0038] (Item 2) Item 1, the image forming apparatus according to item 1, The image forming apparatus is characterized in that the accepting unit accepts selection of at least one of a first language and a second language during the period from when the reading unit starts reading the document to when the image data is generated.

[0039] (Item 3) The image forming apparatus according to items 1 and 2, The image forming apparatus is characterized in that the acquisition unit acquires, from an external device, the character string in the second language that has been translated by the external device.

[0040] (Item 4) The image forming apparatus according to items 1 to 3, a translation means for translating the first language into the second language; The image forming apparatus is characterized in that the acquiring unit acquires the character string in the second language translated by the translating unit.

[0041] (Item 5) The image forming apparatus according to any one of items 1 to 4, an image forming apparatus comprising: a determining means for determining whether the first language recognized by the character recognition means and the first language accepted by the accepting means are the same language;

[0042] (Item 6) The image forming apparatus according to any one of items 1 to 5, the character recognition means recognizes language groups classified by language type, An image forming apparatus characterized in that it is an image forming apparatus having a discrimination means for determining whether the language group including the first language recognized by the character recognition means and the language group including the first language accepted by the acceptance means are the same language group.

[0043] (Item 7) The image forming apparatus according to any one of items 1 to 6, An image forming apparatus characterized in that, when the discrimination means determines that the first language recognized by the character recognition means and the first language accepted by the acceptance means are the same language, translation is started without any user operation.

[0044] (Item 8) The image forming apparatus according to any one of items 1 to 7, When the discrimination means determines that the first language recognized by the character recognition means and the first language accepted by the acceptance means are different languages, the image forming apparatus displays options for the first language on the display means, allowing the user to select the first language. [Explanation of symbols]

[0045] 100 Network 101 Image forming device 102 Translation Server 210 Control Unit 211 Operation section 212 Reading unit 213 Storage section 214 Printing Department 215 Communications Department

Claims

1. a reading means for reading an original and generating image data; character recognition means for performing character recognition on the image data generated by the reading means to generate a character string in a first language; an acquisition means for acquiring a character string in a second language translated from the character string in the first language generated by the character recognition means; a display means for displaying a plurality of language options as candidates for the language to be character-recognized by the character recognition means or the language to be translated acquired by the acquisition means; a receiving means for receiving from a user a selection of at least one of the first language and the second language from the options displayed on the display means; An image forming apparatus having: The image forming apparatus is characterized in that the display means displays the options during the period from when the reading means starts reading the document to when image data is generated.

2. 2. The image forming apparatus according to claim 1, wherein the accepting unit accepts the selection of at least one of a first language and a second language during the period from when the reading unit starts to read the document until the image data is generated.

3. 2. The image forming apparatus according to claim 1, wherein the acquiring unit acquires the character string in the second language translated by an external device from the external device.

4. a translation means for translating the first language into the second language; 2. The image forming apparatus according to claim 1, wherein the acquiring unit acquires the character string in the second language translated by the translating unit.

5. 2. The image forming apparatus according to claim 1, further comprising a determination unit that determines whether the first language recognized by said character recognition unit and the first language accepted by said acceptance unit are the same language.

6. the character recognition means recognizes language groups classified by language type, 2. The image forming apparatus according to claim 1, further comprising a discrimination unit that discriminates whether the language group including the first language recognized by the character recognition unit and the language group including the first language accepted by the acceptance unit are the same language group.

7. 6. The image forming apparatus according to claim 5, wherein when the discrimination means determines that the first language recognized by the character recognition means and the first language accepted by the acceptance means are the same language, translation is started without any user operation.

8. 6. The image forming apparatus according to claim 5, wherein, when the discrimination means determines that the first language recognized by the character recognition means and the first language accepted by the acceptance means are different languages, the display means displays options for the first language, allowing the user to select the first language.

Images