A terminal device with file printing function and an image processing method thereof

Abstract

The present application provides a terminal device with file printing function and an image processing method thereof. The terminal device with file printing function comprises an image reading unit, a processing unit, a user interface display and an image output unit. The image reading unit acquires an original image, the processing unit receives an image processing instruction, and transmits the original image and the image processing instruction to a cloud computing platform. The cloud computing platform modifies the original image according to the image processing instruction by using an image processing model, generates a modified image and returns it to the processing unit. The user interface display displays the original image and the modified image, and the image output unit prints the modified image on a carrier.

Description

Technical Field

[0001] This invention relates to a terminal device with document printing function. Background Technology

[0002] Current applications of generative artificial intelligence (AI) technology are primarily concentrated on mobile internet terminals (smartphones) and desktop network terminals (personal computers), highlighting the limitations of generative AI in terms of application scenarios. Common office equipment, such as document printing devices like multifunction printers, photocopiers, and scanners, often rely solely on their own computing power when processing images, failing to fully utilize cloud or more powerful AI computing resources. Therefore, there is an urgent need for an improved terminal device with document printing capabilities and an improved image processing method. Summary of the Invention

[0003] One of the objectives of this invention is to provide an improved terminal device with document printing function and an image processing method.

[0004] This invention provides a terminal device with document printing function, including an image reading unit, a processing unit, a user interface display, and an image output unit. The image reading unit acquires an original image; the processing unit receives at least one image processing instruction and transmits the at least one image processing instruction and the original image to a cloud computing platform, wherein the cloud computing platform has at least one image processing model, which modifies the original image according to the image processing instruction and generates a modified image, and the cloud computing platform sends the modified image back to the processing unit; the user interface display displays the original image and the modified image; and the image output unit prints the modified image onto a carrier.

[0005] In addition, the original image must include at least a background portion, a stamped portion, or a handwritten portion.

[0006] In addition, at least one image processing instruction includes removing the background portion, removing the stamp portion, or removing the handwritten handwriting portion.

[0007] In addition, the terminal device with document printing function further includes a network connection unit, through which the terminal device with document printing function connects to a cloud computing platform.

[0008] In addition, the terminal device with document printing function further includes a temporary storage unit for storing at least one image processing instruction, the original image, and the modified image.

[0009] In addition, the terminal device with document printing function further includes a user interface input unit, which is used to trigger the transmission of at least one image processing command.

[0010] In addition, the terminal device with document printing function further includes a non-volatile random access storage unit for storing account information and password information, which is used to log in to the cloud computing platform.

[0011] In addition, the image reading unit is a charge-coupled element sensor or a contact image sensor.

[0012] In addition, the processing unit is a digital signal processor, a central processing unit, or a graphics processing unit.

[0013] In addition, the temporary storage unit is a double data rate synchronous dynamic random access memory.

[0014] In addition, the user interface input units are physical buttons or virtual buttons.

[0015] In addition, the user interface display is a touch screen display.

[0016] In addition, the image output unit is a printing device.

[0017] To make the above and other objects, features and advantages of the present invention more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0018] Figure 1 This is a system architecture diagram for image processing according to the present invention.

[0019] Figure 2 This is a flowchart illustrating the mode selection process of the terminal device with document printing function according to the present invention.

[0020] Figure 3 This invention relates to the intelligent mode image processing flow of a terminal device with document printing function.

[0021] Figures 4A to 6B This is a schematic diagram illustrating an example of image processing in the intelligent mode of the terminal device with document printing function according to the present invention.

[0022] Figures 7A to 7C This is a schematic diagram of the user interface display when selecting the mode of the terminal device with document printing function according to the present invention.

[0023] Figures 8A to 8F This is a schematic diagram of the user interface display of the terminal device with document printing function of the present invention when processing images in intelligent mode.

[0024] The reference numerals in the attached figures are explained as follows:

[0025] S: System

[0026] 1: Terminal device with document printing function

[0027] 2: Cloud computing platform

[0028] 3: Network

[0029] 11: Image Reading Unit

[0030] 12: Processing Unit

[0031] 13: Network Connection Unit

[0032] 14: User Interface Display

[0033] 15: Image Output Unit

[0034] 16: User Interface Input Unit

[0035] 17: Temporary storage unit

[0036] 18: Non-volatile random access memory unit

[0037] 171: Image

[0038] 172: Instruction

[0039] 181: Account Password Information

[0040] 21: Image Processing Model

[0041] A1, A2, A3, A4, A31, A411, A412, A413, A421, A422, A423: Process

[0042] B1, B2, B3, B4, B5, B6, B7, B8, B9, B10, B11: Steps

[0043] OI: Original Image

[0044] RI: Image Modification

[0045] ST: Stamped Part

[0046] HW: Handwriting section

[0047] BC: Background section

[0048] CB: Control Panel

[0049] HB: Home button

[0050] WB: Grayscale Key

[0051] CB: Color Key

[0052] OB: Start button

[0053] M1: Homepage

[0054] M11: Normal Mode Icon

[0055] M12: Smart Mode Icon

[0056] OP: Operation Page

[0057] SP: Screen being scanned

[0058] TL: Toolbar

[0059] ZOB: Shrink button

[0060] ZIB: Enlargement button

[0061] ORB: Original Scale Button

[0062] MB: Command Button

[0063] ML: Command List

[0064] OPN: Options

[0065] RW: Prompt Window Detailed Implementation

[0066] Please see Figure 1 This embodiment provides a cloud-based collaborative image processing system S, including a terminal device 1 with document printing function, a cloud computing platform 2, and a network 3 interconnecting the terminal device 1 with document printing function and the cloud computing platform 2. The terminal device 1 with document printing function is responsible for acquiring the original image OI, transmitting image data and processing instructions to the cloud computing platform 2, and receiving and outputting the modified image RI processed by the cloud computing platform 2.

[0067] Specifically, the terminal device 1 with document printing function includes an image reading unit 11, a processing unit 12, a network connection unit 13, a user interface display 14, an image output unit 15, a user interface input unit 16, and a temporary storage unit 17. The image reading unit 11 has an image sensing element, such as a charge-coupled device (CCD) sensor or a contact image sensor (CIS) sensor, to convert physical documents or objects into digital image signals. The image reading unit 11 can be, but is not limited to, a scanning device. Processing unit 12 is a processing unit, such as a Digital Signal Processor (DSP), Central Processing Unit (CPU), or Graphics Processing Unit (GPU). Its function is to receive at least one image processing instruction input by the user through user interface input unit 16, and transmit the original image OI data and at least one image processing instruction to cloud computing platform 2 via network connection unit 13. Processing unit 12 further receives the modified image RI returned from cloud computing platform 2 and controls the operation of user interface display 14 and image output unit 15. Network connection unit 13 is used to connect terminal device 1 with document printing function to network 3. Network connection unit 13 can be a wired network interface or a wireless network interface. User interface display 14 is a user interface, such as a monitor or touch screen, used to provide image preview function. User interface display 14 displays the original image OI and the modified image RI. Image output unit 15 is an image output device, such as a printing device, used to print the image onto a carrier. The user interface input unit 16 is used to allow users to operate the terminal device 1 with document printing function and provide user input commands. The user interface input unit 16 may be, but is not limited to, virtual or physical buttons or a microphone device. In addition, the terminal device 1 with document printing function also includes a temporary storage unit 17, such as double data rate synchronous dynamic random access memory (DDR memory), for temporarily storing images 171 and commands 172; and a non-volatile random access memory unit 18, for storing account information and password information required to log in to the cloud computing platform 2 to ensure the security of system operation.

[0068] The main function of the cloud computing platform 2 is to receive the original image (OI) and processing instructions transmitted from the terminal device 1 with document printing capabilities, and to process the original image OI using at least one image processing model 21 to generate a modified image (RI). The image processing model 21 is a trained artificial intelligence model capable of performing various image processing tasks, such as object recognition, image enhancement, image restoration, image style transfer, and specific task processing, such as removing stamps, handwritten marks, or backgrounds. After processing, the cloud computing platform 2 modifies the image RI and transmits it back to the terminal device 1 with document printing capabilities via network 3.

[0069] Network 3 is a data transmission medium that connects terminal device 1 with document printing capabilities and cloud computing platform 2, and is responsible for the transmission of data and instructions between the two. Network 3 can be, but is not limited to, for example, the Internet or a local area network, and its bandwidth and latency will affect the speed and efficiency of image processing.

[0070] Please see Figure 2 , Figure 2 The diagram shows the mode selection flowchart of the terminal device 1 with document printing function (e.g., a multi-function office machine) according to the present invention. The mode selection process begins in process A1: the terminal device 1 with document printing function receives a mode command. The user can issue a command via touchscreen, physical buttons, voice input, etc., instructing the terminal device 1 to enter either normal mode or smart mode. After receiving the command, the terminal device 1 enters process A2: determining whether it is a smart mode command. If the determination result is negative, i.e., the user selects normal mode, then process A3: the terminal device 1 with document printing function enters normal mode, further entering process A31: performing traditional photocopying processing functions and then ending. Normal mode represents the basic function of the terminal device 1 with document printing function, without connecting to the cloud computing platform 2, mainly providing traditional office functions such as photocopying, scanning, and faxing. This mode is suitable for users who only need to perform basic document processing, or in situations where the network environment is unstable. If the determination result is positive, i.e., the user selects smart mode, then the terminal device 1 with document printing function enters the smart mode processing flow. To ensure the user has permission to use the smart functions, the terminal device 1 with document printing capabilities will execute an account verification procedure, which is to enter process A4: the terminal device 1 with document printing capabilities attempts to read the account information of the cloud computing platform 2 from the built-in non-volatile random access storage unit 18. If the account information is successfully read, the process enters process A411: logging into the cloud computing platform 2, and further executes process A412: entering smart mode and executing process A413: executing smart mode processing functions.

[0071] If the account information cannot be read, the process proceeds to step A421: the user is prompted to enter their platform account password using the user interface display 14. After the user enters their account information using the user interface input unit 16 (e.g., a touchscreen or physical keyboard), the process proceeds to step A422: the cloud computing platform 2 waits to receive the account information. Upon successful receipt, the process proceeds to step A423: the terminal device 1 with document printing function stores the information in the non-volatile random access storage unit 18. This step not only facilitates the user's next login but also ensures data security, avoiding the inconvenience and potential risks caused by repeated input. After obtaining the account information, the terminal device 1 with document printing function proceeds to the login step to the cloud computing platform 2. The terminal device 1 with document printing function transmits the account, password, and other information to the cloud computing platform 2 via the network connection unit 13 for identity verification. Upon successful verification, the cloud computing platform 2 sends back login success information, and the terminal device 1 with document printing function enters smart mode.

[0072] The image processing flow of the terminal device 1 with document printing function of the present invention in smart mode is described in detail below. Please refer to... Figure 3The first step in the intelligent mode image processing flow is step B1: acquiring the original image (OI). In this stage, terminal device 1 acquires the original image (OI) through its built-in image reading unit 11. Next, it proceeds to step B2: storing the original image (OI). Terminal device 1 with document printing function stores the acquired original image (OI) in its built-in temporary storage unit 17, and then proceeds to the next stage, step B3: converting the format of the original image (OI). Terminal device 1 with document printing function can selectively perform format conversion of the original image (OI). The purpose of format conversion is to convert the original image into a format suitable for subsequent processing procedures, such as compressing the image, adjusting the image size, or converting the image color mode. Next, it proceeds to step B4: displaying the original image (OI). Terminal device 1 with document printing function displays the original image (OI) on the user interface display 14. Subsequently, it proceeds to step B5: receiving image processing instructions. The user inputs image processing instructions through the user interface input unit 16 of terminal device 1 with document printing function. The form of the image processing instructions can be, but is not limited to, text, voice, or gestures. The processing instructions may include specific image processing requirements, such as removing stamps, removing handwritten marks, removing backgrounds, image enhancement, or image style conversion. Next, step B6 is performed: the original image OI and image processing instructions are uploaded to the cloud computing platform 2. During this stage, the processing unit 12 of the terminal device 1 with document printing function transmits the original image OI data and the image processing instructions input by the user to the cloud computing platform 2 via the network connection unit 13. After receiving the original image OI data and processing instructions from the terminal device 1 with document printing function, the cloud computing platform 2 enters the image processing stage. Based on the processing instructions input by the user, the cloud computing platform 2 processes the original image OI using at least one image processing model 21. Once the image processing is complete, step B7 is performed: the modified image is obtained from the cloud computing platform 2. During this stage, the cloud computing platform 2 sends the processed modified image RI back to the processing unit 12 of the terminal device 1 with document printing function via the network 3. After receiving the modified image RI from the cloud computing platform 2, the terminal device 1 with document printing function proceeds to step B8: displaying the modified image RI. The user interface display 14 of the terminal device 1 with document printing function displays the modified image RI for the user to preview. Subsequently, it proceeds to step B9: determining whether a new processing instruction has been received. The terminal device 1 with document printing function determines whether a new image processing instruction has been received from the user. If yes, it returns to step B5, the processing instruction input stage, and repeats the subsequent process; if no, it continues to the next step, proceeding to step B10: color mode conversion and step B11: result output. The terminal device 1 with document printing function can selectively perform color mode conversion on the modified image.The purpose of color mode conversion is to convert the modified image into a color mode suitable for the output device. The terminal device 1 with document printing function outputs the modified image RI through the image output unit 15. Output methods may include, but are not limited to, printing.

[0073] The following provides specific embodiments of the image processing method of the present invention.

[0074] Example 1: Remove the stamp portion.

[0075] Please see Figure 1 , Figure 4A and Figure 4B The user places the document bearing the stamp (ST) onto the scanning platform (not shown) of the terminal device 1 with document printing function. The user selects the scanning function through the user interface input unit 16 of the terminal device 1 with document printing function. The image reading unit 11 of the terminal device 1 with document printing function scans the document and stores the original scanned image (OI) in the temporary storage unit 17. The user inputs the image processing command "Remove stamped portion". The processing unit 12 of the terminal device 1 with document printing function transmits the original image (OI) and the image processing command to the cloud computing platform 2. Based on the processing command input by the user, the cloud computing platform 2 uses stamped portion recognition and removal technology to remove the stamped portion (ST) from the original image (OI) and repairs the area left after removal, generating a modified image (RI). The cloud computing platform 2 sends the processed modified image (RI) without the stamped portion (ST) back to the processing unit 12 of the terminal device 1 with document printing function. The user interface display 14 of the terminal device 1 with document printing function displays the modified image (RI) without the stamped portion (ST). After the user confirms that everything is correct, the image output unit 15 of the terminal device 1 with document printing function prints the modified image RI of the unmarked part ST to the user.

[0076] Example 2: Remove the handwritten part.

[0077] Please see Figure 1 , Figure 5A and Figure 5BThe user places a note containing handwritten characters (HW) onto the scanning platform (not shown) of the terminal device 1 with document printing function. The image reading unit 11 of the terminal device 1 with document printing function scans the note and stores the original scanned image (OI) in the temporary storage unit 17. The user inputs the image processing command "Remove handwritten characters" through the user interface input unit 16. The processing unit 12 of the terminal device 1 with document printing function transmits the original image (OI) and the image processing command to the cloud computing platform 2. Based on the processing command input by the user, the cloud computing platform 2 uses handwritten character recognition and removal technology to remove the handwritten characters (HW) from the original image (OI) and repairs the area left after removal, generating a modified image (RI). The cloud computing platform 2 sends the processed modified image (RI) without handwritten characters (HW) back to the processing unit 12 of the terminal device 1 with document printing function. The user interface display 14 of the terminal device 1 displays the modified image (RI) without handwritten characters (HW). After the user confirms that everything is correct, the image output unit 15 of the terminal device 1 with document printing function stores the modified image RI of the part HW without handwriting to the connected computer (not shown).

[0078] Example 3: Remove the background portion.

[0079] Please see Figure 1 , Figure 6A and Figure 6B The user places a photograph of a person with a background portion BC on the scanning platform (not shown) of the terminal device 1 with document printing function. The image reading unit 11 of the terminal device 1 with document printing function scans the photograph and stores the original image OI in the temporary storage unit 17. The user inputs the image processing command "Remove background portion" through the touch screen of the terminal device 1 with document printing function. The processing unit 12 of the terminal device 1 with document printing function transmits the original image OI and the image processing command to the cloud computing platform 2. According to the processing command input by the user, the cloud computing platform 2 uses background portion recognition and removal technology to remove the background portion BC from the original image and generates a modified image RI. The cloud computing platform 2 sends the processed modified image RI with the background portion BC removed back to the processing unit 12 of the terminal device 1 with document printing function. The user interface display 14 of the terminal device 12 displays the modified image RI with the background portion BC removed, and the user can choose to place it on another background portion or print it.

[0080] The following is a detailed description of the control panel CB of the terminal device 1 with document printing function of the present invention. Please refer to further reading. Figures 7A to 7C The control panel CB includes a user interface input unit 16 and a user interface display 14. The user interface input unit 16 includes a home button HB, a grayscale button WB, a color button CB, and a start button OB. Figure 7A The user interface display 14 displays a homepage M1, which includes at least a general mode icon M11 and a smart mode icon M12. When the user clicks the smart mode icon M12, as shown in the image... Figure 7B As shown, the user interface display 14 pops up a prompt window RW to remind the user that the terminal device 1 with document printing function is about to enter smart mode. The user clicks "OK" to enter smart mode. If the terminal device 1 with document printing function cannot read the account information, then... Figure 7C As shown, the user interface display 14 jumps to the login page LP for the user to enter their account and password information.

[0081] Please refer to further information. Figures 8A to 8F After the terminal device 1 with document printing function enters the smart mode, such as Figure 8A As shown, the user interface display 14 shows the operation page OP, which includes icons for setting dimensions, image density, and number of copies. When the user begins scanning the original image OI, as... Figure 8B As shown, the user interface display 14 shows the scanning screen SP. After the scan is complete, as... Figure 8C As shown, the user interface display 14 displays the original image OI and the toolbar TL. The original image OI includes at least the background portion BC, the stamp portion ST, or the handwritten handwriting portion HW. The toolbar TL includes a zoom-out button ZOB, a zoom-in button ZIB, an original scale button ORB, and a command button MB. The user can examine the original image OI using the zoom-in button ZIB, the original scale button ORB, and the zoom-out button ZOB on the toolbar TL. When the user presses the command button MB, as shown... Figure 8D As shown, the user interface display 14 shows a command list ML for the user to select from. The command list ML includes options such as removing handwritten parts, removing background parts, removing stamp parts, or inputting commands via voice (OPN). When the user selects to remove handwritten parts, the terminal device 1 with document printing function performs image processing, such as... Figure 8E As shown. Once the image processing is complete, as... Figure 8F As shown, the user interface display 14 will further display the modified image RI, and the user can use the zoom in button ZIB, the original zoom in button ORB, and the zoom out button ZOB on the toolbar TL to check the modified image RI again.

[0082] In summary, the advantages of the terminal device and image processing method with document printing function of the present invention are that the device is connected to a cloud computing platform, enabling complex image processing, and the modified image can be directly printed to the user through the device.

[0083] The above description is merely a preferred embodiment of the present invention and should not be construed as limiting the scope of the invention. Any simple equivalent variations and modifications made in accordance with the claims and description of the invention are still within the scope of this patent. Furthermore, no embodiment or claim of the present invention needs to achieve all the objectives, advantages, or features disclosed in the invention. In addition, the abstract and headings are merely for assisting in patent document searches and are not intended to limit the claims of the present invention. Moreover, the terms "first," "second," etc., mentioned in this specification or claims are only used to name elements or distinguish different embodiments or scopes, and are not used to limit the upper or lower limit of the number of elements.

Claims

1. A terminal device with document printing function, comprising: An image reading unit is used to acquire a raw image; A processing unit is configured to receive at least one image processing instruction and transmit the at least one image processing instruction and the original image to a cloud computing platform. The cloud computing platform has at least one image processing model, which modifies the original image according to the at least one image processing instruction and generates a modified image. The cloud computing platform then sends the modified image back to the processing unit. A user interface display for displaying the original image and the modified image; and An image output unit is used to print the modified image onto a carrier.

2. The terminal device with document printing function as described in claim 1, wherein, The original image includes at least: Background section; A stamped part; or The handwritten portion.

3. The terminal device with document printing function as described in claim 1, wherein, The at least one image processing instruction includes: Remove the background portion; Remove the stamped portion; or Remove the handwritten parts.

4. The terminal device with document printing function as described in claim 1 further includes a network connection unit, through which the terminal device with document printing function is connected to the cloud computing platform.

5. The terminal device with document printing function as described in claim 1 further includes a temporary storage unit for storing the at least one image processing instruction, the original image, and the modified image.

6. The terminal device with document printing function as described in claim 1, further comprising a user interface input unit for triggering the transmission of the at least one image processing instruction.

7. The terminal device with document printing function as described in claim 1 further includes a non-volatile random access storage unit for storing account information and password information, the account information and password information being used to log in to the cloud computing platform.

8. The terminal device with document printing function as described in claim 1, wherein, The image reading unit is a charge-coupled device sensor or a contact image sensor.

9. The terminal device with document printing function as described in claim 1, wherein, The processing unit is a digital signal processor, a central processing unit, or a graphics processor.

10. The terminal device with document printing function as described in claim 5, wherein, This temporary storage unit is a double data rate synchronous dynamic random access memory.

11. The terminal device with document printing function as described in claim 6, wherein, The user interface input unit can be a physical button or a virtual button.

12. The terminal device with document printing function as described in claim 1, wherein, The user interface display is a touch screen display.

13. The terminal device with document printing function as described in claim 1, wherein, The image output unit is a printing device.

14. An image processing method for a terminal device with document printing function, the terminal device with document printing function including an image reading unit, a processing unit, a user interface display, and an image output unit, the image processing method comprising the following steps: A raw image is acquired through the image reading unit; The processing unit receives at least one image processing instruction. The processing unit transmits the original image and the at least one image processing instruction to a cloud computing platform, wherein the cloud computing platform has at least one image processing model. The processing unit obtains a modified image returned by the cloud computing platform, wherein the modified image is generated by the image processing model modifying the original image according to the at least one image processing instruction; The original image and the modified image are displayed on the user interface screen; and The modified image is printed onto a carrier using the image output unit.

15. The image processing method as described in claim 14, wherein, After the terminal device with document printing function acquires the original image, the image processing method further executes the following steps: Store the original image; and Convert the format of the original image.

16. The image processing method as described in claim 14, wherein, After the terminal device with document printing function acquires the modified image, the image processing method further executes the following steps: The modified image is displayed.

17. The image processing method as described in claim 16, wherein, When the terminal device with document printing function displays the modified image, the image processing method further executes the following steps: Determine whether the at least one image processing instruction has been received. If so, return to the process of receiving the at least one image processing instruction.

18. The image processing method as described in claim 17, wherein, When the terminal device with document printing function determines whether it has received the at least one image processing instruction, if not, the further execution process includes: Convert the color mode of the modified image.

19. The image processing method as described in claim 14, wherein, The original image includes at least: Background section; A stamped part; or The handwritten portion.

20. The image processing method as described in claim 14, wherein, The at least one image processing instruction includes: Remove the background portion; Remove the stamped portion; or Remove the handwritten parts.

Images