A terminal device with dual-mode document printing function

Abstract

The invention provides a terminal device with a document printing function and an image processing method thereof. The terminal device with document printing function includes an image reading unit, a processing unit, a user interface display and an image output unit. The image reading unit acquires the original image, the processing unit receives the image processing instruction, and transmits the original image and the image processing instruction to the cloud computing platform. The cloud computing platform modifies the original image using the image processing model according to the image processing instruction, generates a modified image and transmits it back to the processing unit. The user interface output unit displays the original image and the modified image, and the image output unit prints the modified image on the carrier.

Description

[Technical Field]

[0001] This invention relates to a terminal device with dual-mode document printing function. [Previous Technology]

[0002] Existing applications of generative artificial intelligence (AI) technology are mainly concentrated on mobile internet terminals (phones) and desktop network terminals (personal computers), demonstrating the limitations of generative AI in application scenarios. Common office equipment, such as document printing devices like multifunction printers, photocopiers, and scanners, often rely solely on their own computing power when processing images, failing to fully utilize cloud or more powerful AI computing resources. Therefore, there is an urgent need for an improved terminal device with document printing capabilities and an image processing method. [Summary of the Invention]

[0003] One of the objectives of this invention is to provide an improved terminal device with dual-mode document printing function.

[0004] This invention provides a terminal device with dual-mode document printing function, including an image reading unit, a processing unit, a user interface display, and an image output unit. The image reading unit is used to acquire an original image; the processing unit is used to receive at least one image processing instruction and transmit the at least one image processing instruction and the original image to a cloud computing platform, wherein the cloud computing platform has at least one image processing model, the image processing model modifies the original image according to the image processing instruction and generates a modified image, and the cloud computing platform sends the modified image back to the processing unit; the user interface display is used to display the original image and the modified image; the image output unit is used to print the modified image on a carrier.

[0005] In addition, the original image includes at least a background portion, a stamp portion, or a handwritten handwriting portion.

[0006] In addition, at least one image processing instruction includes removing the background portion, removing the stamp portion, or removing the handwritten handwriting portion.

[0007] In addition, the terminal device with dual-mode document printing function further includes a network connection unit, through which the terminal device with dual-mode document printing function connects to a cloud computing platform.

[0008] In addition, the terminal device with dual-mode document printing function further includes a temporary storage unit for storing at least one image processing instruction, the original image and the modified image.

[0009] In addition, the terminal device with dual-mode document printing function further includes a user interface input unit for triggering the transmission of at least one image processing command.

[0010] In addition, the terminal device with dual-mode document printing function further includes a non-volatile random access memory unit for accessing account information and password information, which are used to log in to the cloud computing platform.

[0011] In addition, the image reading unit is a charge-coupled element sensor or a contact image sensor.

[0012] In addition, the processing unit is a digital signal processor, a central processing unit, or a graphics processor.

[0013] In addition, the temporary storage unit is a double data rate synchronous dynamic random access memory.

[0014] In addition, the user interface input unit is a physical button or a virtual button.

[0015] In addition, the user interface display is a touch display.

[0016] In addition, the image output unit is a printing device.

[0017] To make the above and other objects, features and advantages of the present invention more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings.

Implementation Method

[0018] Please refer to Figure 1. This embodiment provides a cloud-based collaborative image processing system S, including a terminal device 1 with dual-mode document printing function, a cloud computing platform 2, and a network 3 interconnecting the terminal device 1 with dual-mode document printing function and the cloud computing platform 2. The terminal device 1 with dual-mode document printing function is responsible for acquiring the original image OI, transmitting image data and processing instructions to the cloud computing platform 2, and receiving and outputting the modified image RI processed by the cloud computing platform 2.

[0019] Specifically, the terminal device 1 with dual-mode document printing function includes an image reading unit 11 , a processing unit 12 , a network connection unit 13 , a user interface display 14 , an image output unit 15 , a user interface input unit 16 , and a cache unit 17 . The image reading unit 11 has an image sensing element such as a Charge-coupled Device (CCD) sensor or a Contact Image Sensor (CIS) sensor to convert a physical document or object into a digital image signal, the image reading unit 11 may be, but is not limited to, e.g., a scanning device. The processing unit 12 is an computing processor, such as a Digital Signal Processor (DSP), a Central Processing Unit (CPU), or a Graphic Processing Unit (GPU), which functions in receiving at least one image processing command input from the user input unit 16 via the user interface, and transmitting the original image OI data and at least one image processing command to the cloud computing platform 2 over a network connection unit 13 , which further receives the modified image RI returned from the cloud computing platform 2 and controls the operation of the user interface display 14 and the image output unit 15 . The network connection unit 13 is used to access a terminal device 1 with a dual-mode document printing function to a network 3. The network connection unit 13 may be a wired network interface or a wireless network interface. The user interface display 14 is a user interface, e.g., a display or touch display to provide the function of previewing the image, the user interface display 14 displays the original image OI and the modified image RI. The image output unit 15 is an image output device, e.g., a printing device for printing an image on a carrier. The user interface input unit 16 is used for the user to operate a terminal device 1 with a dual-mode document printing function and to provide user input commands, the user interface input unit 16 may be, but is not limited to, for example: a virtual or physical keystroke or a microphone device. In addition, the terminal device 1 with dual-mode document printing functionality further comprises a storage unit 17, such as a Double Data Rate Synchronous Dynamic Random Access Memory (DDR Memory) to cache images 171 and instructions 172;

[0020] The main function of the cloud computing platform 2 is to receive raw image OI and processing instructions transmitted by a terminal device 1 with its own dual-mode document printing function, and to use at least one image processing model 21 to process the original image OI and generate a modified image RI. The image processing model 21 is a trained artificial intelligence model that performs various image processing tasks, such as: object recognition, image enhancement, image restoration, image style transformation, and task-specific processing such as: removal of stamped parts, handwritten handwriting parts, or background parts. After the processing is completed, the cloud computing platform 2 will modify the image RI and send it back to the terminal device 1 with dual-mode document printing capability over the network 3 .

[0021] Network 3 is a data transmission medium, which connects a terminal device 1 with a dual-mode document printing function and a cloud computing platform 2, which is responsible for the transmission of data and instructions between the two. Network 3 may be, but is not limited to, for example: an Internet or a LAN, the bandwidth and latency of which will affect the speed and efficiency of image processing.

[0022] See FIG. The mode selection flow starts at flow A1: Terminal device 1 with dual-mode document printing receives mode commands, and the user can issue commands via touch screen, physical keystrokes, voice input, etc. to instruct terminal device 1 with dual-mode document printing to enter normal mode or smart mode. After receiving the command, the terminal device 1 with dual-mode document printing function enters the mode selection flow into flow A2: determines whether it is an intelligent mode command. If the result is judged no, that is, the user selects the general mode, the process A3: the terminal device with dual-mode document printing function enters the general mode, and further into the process A31: the end after executing the traditional photocopying processing function. General mode is the basic function of a terminal device 1 with dual-mode document printing function, not connected to the cloud computing platform 2, and mainly provides traditional office affairs functions such as photocopying, scanning, and faxing. This mode is suitable for situations where the user only needs to perform basic document processing, or when the network environment is unstable. If the judgment result is yes, that is, the user selects smart mode, the terminal device 1 with dual-mode document printing function enters the smart mode processing flow. To ensure that the user has permission to use the smart function, the terminal device 1 with dual-mode document printing function will perform the account verification procedure, i.e. entering flow A4: The terminal device 1 with dual-mode document printing function attempts to read the cloud computing platform 2 frame data from the built-in non-volatile random access memory unit 18 . If the account data is successfully read, proceed to process A411: Log in to the cloud computing platform 2, and further perform process A412: Enter the smart mode and execute the process A413: perform the smart mode processing function.

[0023] If the account information cannot be read, the process proceeds to step A421: The user is prompted to enter the platform account password information via the user interface display 14. After the user enters the account information via the user interface input unit 16 (e.g., touch screen or physical keyboard), the process proceeds to step A422: The cloud computing platform 2 waits to receive the account information. Upon successful receipt, the process proceeds to step A423: The terminal device 1 with dual-mode document printing function stores the information in the non-volatile random access memory unit 18. This step not only facilitates the user's next login but also ensures data security, avoiding the inconvenience and potential risks caused by repeated input. After obtaining the account information, the terminal device 1 with dual-mode document printing function enters the login step to the cloud computing platform 2. The terminal device 1 with dual-mode document printing function transmits the account, password, and other information to the cloud computing platform 2 via the network connection unit 13 for identity verification. After successful verification, the cloud computing platform 2 sends back a login success message, and the terminal device 1 with dual-mode document printing function enters smart mode.

[0024] The image processing flow in smart mode of the terminal device 1 of the present invention having a dual-mode document printing function is described in detail below. See Figure 3 . The first step in the image processing flow in smart mode is step B1: Acquire the original image OI. At this stage, the terminal device 1 acquires the raw image OI through its built-in image reading unit 11 . Step B2: Save the original image OI, terminal device 1 with dual-mode file printing stores the acquired original image OI in its built-in storage unit 17, then proceed to the next stage, step B3: convert the format of the original image OI, the terminal device 1 with dual-mode document printing function can optionally perform format conversion of the original image OI Then proceed to step B4: Display the original image OI, the terminal device 1 with dual-mode document printing function causes the user interface display 14 to display the original image OI. Subsequently, proceeding to step B5: Receiving image processing commands, the user enters the image processing commands through the user interface input unit 16 of the terminal device 1 with dual-mode document printing function. Among other things, the content of the processing instruction may contain specific image processing needs, such as: removal of stamped parts, removal of handwritten handwriting parts, removal of background parts, image enhancement, or image style conversion. Then, proceed to step B6: the raw image OI and image processing instructions are uploaded to the cloud computing platform 2. At this stage, the processing unit 12 of the terminal device 1 with dual-mode document printing function transmits the raw image OI data and the image processing instructions entered by the user to the cloud computing platform 2 over the network connection unit 13 . The cloud computing platform 2 enters the image processing phase after receiving the raw image OI data and processing instructions from the terminal device 1 with the dual-mode document printing function. The cloud computing platform 2 processes the raw image OI using at least one image processing model 21 based on the processing instructions entered by the user. When the image is processed, step B7: Obtain the modified image of the cloud computing platform 2. At this stage, the cloud computing platform 2 sends the processed modified image RI back to the processing unit 12 of the terminal device 1 with dual-mode document printing function over the network 3 . Terminal device 1 with dual-mode document printing After receiving the modified image RI from the cloud computing platform 2 , it goes to step B8: Displaying the modified image RI, the user interface display 14 of the terminal device 1 with dual-mode document printing displays the modified image RI for user preview. Subsequently, proceed to step B9: Determine whether a new processing command has been received, and the terminal device with dual-mode document printing function 1 determines whether a new image processing command input by the user has been received.If yes, return to step B5, the instruction input stage, and repeat the subsequent process; if no, continue to the next step, proceeding to step B10: color mode conversion and step B11: result output. The terminal device 1 with dual-mode document printing capability can selectively perform color mode conversion on the modified image. The purpose of color mode conversion is to convert the modified image into a color mode suitable for the output device. The terminal device 1 with dual-mode document printing capability outputs the modified image RI through the image output unit 15. The output method may include, but is not limited to, printing.

[0025] The following provides specific embodiments of the image processing of the present invention.

[0026] Example 1: Remove the stamp portion.

[0027] Please refer to Figures 1, 4A, and 4B. The user places a document with the stamped portion ST on the scanning platform (not shown) of the terminal device 1 with dual-mode document printing function. The user selects the scanning function through the user interface input unit 16 of the terminal device 1 with dual-mode document printing function. The image reading unit 11 of the terminal device 1 with dual-mode document printing function scans the document and stores the scanned original image OI in the temporary storage unit 17. The user inputs the image processing command "Remove stamped portion". The processing unit 12 of the terminal device 1 with dual-mode document printing function transmits the original image OI and the image processing command to the cloud computing platform 2. According to the processing command input by the user, the cloud computing platform 2 uses stamped portion recognition and removal technology to remove the stamped portion ST from the OI of the original image and repairs the area left after removal, generating a modified image RI. The cloud computing platform 2 sends the processed modified image RI without the stamped portion ST back to the processing unit 12 of the terminal device 1 with dual-mode document printing function. The user interface display 14 of the terminal device 1 with dual-mode document printing function displays the modified image RI of the unstamped portion ST. After the user confirms that there are no errors, the image output unit 15 of the terminal device 1 with dual-mode document printing function prints the modified image RI of the unstamped portion ST to the user.

[0028] Example 2: Remove the handwritten part.

[0029] Please refer to Figures 1, 5A, and 5B. The user places a note with handwritten handwriting (HW) on the scanning platform (not shown) of the terminal device 1 with dual-mode document printing function. The image reading unit 11 of the terminal device 1 with dual-mode document printing function scans the note and stores the scanned original image (OI) in the temporary storage unit 17. The user inputs the image processing command "Remove handwritten handwriting" through the user interface input unit 16. The processing unit 12 of the terminal device 1 with dual-mode document printing function transmits the original image (OI) and the image processing command to the cloud computing platform 2. Based on the processing command input by the user, the cloud computing platform 2 uses handwritten handwriting recognition and removal technology to remove the handwritten handwriting (HW) from the original image (OI) and repairs the area left after removal, generating a modified image (RI). The cloud computing platform 2 sends the processed modified image (RI) without handwritten handwriting (HW) back to the processing unit 12 of the terminal device 1 with dual-mode document printing function. The user interface display 14 of the terminal device 1 displays a modified image RI of the portion HW without handwriting. After the user confirms that it is correct, the image output unit 15 of the terminal device 1 with dual-mode document printing function saves the modified image RI of the portion HW without handwriting to the connected computer (not shown).

[0030] Example 3: Remove the background portion.

[0031] Please refer to Figures 1, 6A, and 6B. The user places a photograph of a person with a background portion BC on the scanning platform (not shown) of the terminal device 1 with dual-mode document printing function. The image reading unit 11 of the terminal device 1 with dual-mode document printing function scans the photograph and stores the original image OI in the temporary storage unit 17. The user inputs the image processing command "Remove background portion" through the touch screen of the terminal device 1 with dual-mode document printing function. The processing unit 12 of the terminal device 1 with dual-mode document printing function transmits the original image OI and the image processing command to the cloud computing platform 2. According to the processing command input by the user, the cloud computing platform 2 uses background portion recognition and removal technology to remove the background portion BC from the original image and generates a modified image RI. The cloud computing platform 2 sends the processed modified image RI with the background portion BC removed back to the processing unit 12 of the terminal device 1 with dual-mode document printing function. The user interface display 14 of the terminal device 12 displays the modified image RI with the background portion BC removed, and the user can choose to place it on other background portions or print it.

[0032] The control panel CB of the terminal device 1 with dual-mode document printing function of the present invention will be described in detail below. Please refer further to Figures 7A to 7C. The control panel CB includes a user interface input unit 16 and a user interface display 14. The user interface input unit 16 includes a home button HB, a grayscale button WB, a color button CB, and a start button OB. The user interface display 14 in Figure 4A displays a home page M1, which includes at least a normal mode icon M11 and a smart mode icon M12. When the user clicks the smart mode icon M12, as shown in Figure 4B, the user interface display 14 displays a prompt window RW to remind the user that the terminal device 1 with dual-mode document printing function is about to enter smart mode. When the user clicks OK, the smart mode is entered. If the terminal device 1 with dual-mode document printing function cannot read the account information, as shown in Figure 4C, the user interface display 14 jumps to the login page LP for the user to enter account and password information.

[0033] Please refer further to Figures 8A to 8F. After the terminal device 1 with dual-mode document printing function enters the smart mode, as shown in Figure 5A, the user interface display 14 displays the operation page OP. The operation page OP includes setting icons such as size setting, image density, or number of copies. When the user starts scanning the original image OI, as shown in Figure 5B, the user interface display 14 displays the scanning screen SP. After the scan is completed, as shown in Figure 5C, the user interface display 14 displays the original image OI and the toolbar TL. The original image OI includes at least the background part BC, the stamp part ST, or the handwritten handwriting part HW. The toolbar TL includes the zoom-out button ZOB, the zoom-in button ZIB, the original scale button ORB, and the command button MB. The user can check the original image OI through the zoom-in button ZIB, the original scale button ORB, and the zoom-out button ZOB on the toolbar TL. When the user presses the command button MB, as shown in Figure 5D, the user interface display 14 shows the command list ML for the user to select. The command list ML includes options such as removing handwritten parts, removing background parts, removing stamp parts, or inputting commands via voice (OPN). When the user selects to remove handwritten parts, the terminal device 1 with dual-mode document printing function performs image processing, as shown in Figure 5E. After the image processing is completed, as shown in Figure 5F, the user interface display 14 further displays the modified image RI. The user can then use the zoom in button ZIB, the original zoom button ORB, and the zoom out button ZOB on the toolbar TL to check the modified image RI.

[0034] In summary, the advantages of the terminal device and image processing method with dual-mode document printing function of the present invention are that the device is connected to a cloud computing platform, enabling complex image processing, and the modified image can be directly printed to the user through the device.

[0035] However, the above description is merely a preferred embodiment of the present invention and should not be construed as limiting the scope of the invention. Any simple equivalent changes and modifications made in accordance with the claims and description of the present invention are still within the scope of the patent. Furthermore, any embodiment or claim of the present invention does not need to achieve all the objectives, advantages, or features disclosed in the present invention. In addition, the abstract and headings are merely for assisting in patent document searches and are not intended to limit the scope of the present invention. Furthermore, the terms "first," "second," etc., mentioned in this specification or claims are only used to name elements or distinguish different embodiments or scopes, and are not used to limit the upper or lower limit of the number of elements. [Simplified Explanation of the Diagram]

[0036] Figure 1 is a system architecture diagram of the image processing of the present invention. Figure 2 is a flowchart of the mode selection process of the terminal device with dual-mode document printing function of the present invention. Figure 3 is a flowchart of the intelligent mode image processing process of the terminal device with dual-mode document printing function of the present invention. Figures 4A to 6B are schematic diagrams of examples of intelligent mode image processing of the terminal device with dual-mode document printing function of the present invention. Figures 7A to 7C are schematic diagrams of the user interface display when the terminal device with dual-mode document printing function of the present invention selects a mode. Figures 8A to 8F are schematic diagrams of the user interface display when the terminal device with dual-mode document printing function of the present invention processes images in intelligent mode.

Claims

1. A terminal device with dual-mode document printing function, comprising: An image reading unit for scanning a document to obtain an original image of the document; an image output unit for printing the original image of the document or a modified image of the document onto a carrier; a user interface display for displaying a mode option, the original image, the modified image, or at least one image processing instruction, wherein the mode option includes a general mode and a smart mode, wherein in the general mode, the image output unit prints the original image of the document, and in the smart mode, the image output unit prints the modified image of the document; a network connection unit for connecting to a cloud computing platform via a network, the cloud computing platform having an image processing model; A processing unit, when the smart mode is selected, displays the original image and at least one image processing instruction on the user interface display. After receiving an image processing instruction input by a user, the processing unit transmits the image processing instruction and the original image to the cloud computing platform. The image processing model modifies the original image according to the image processing instruction and generates a modified image. The cloud computing platform sends the modified image back to the processing unit and displays the modified image on the user interface display. When the processing unit receives an image output instruction, it prints the modified image onto the carrier.

2. The terminal device with dual-mode document printing function as described in claim 1, wherein, The original image includes at least: a background portion; a stamp portion; or a handwritten portion.

3. A terminal device with dual-mode document printing function as described in claim 1, wherein, The at least one image processing instruction includes: removing the background portion; removing the stamp portion; or removing the handwritten handwriting portion.

4. A terminal device with dual-mode document printing function as described in claim 1, further comprising a temporary storage unit for storing the at least one image processing instruction, the original image, and the modified image.

5. The terminal device with dual-mode document printing function as described in claim 1, further comprising a user interface input unit for triggering the transmission of the at least one image processing command.

6. The terminal device with dual-mode document printing function as described in claim 1 further includes a non-volatile random access memory unit for storing account information and password information for logging into the cloud computing platform.

7. A terminal device with dual-mode document printing function as described in claim 1, wherein, The image reading unit is either a charge-coupled device (CCD) or a contact image sensor (CIS).

8. A terminal device with dual-mode document printing function as described in claim 1, wherein, The processing unit is a digital signal processor, a central processing unit, or a graphics processing unit.

9. A terminal device with dual-mode document printing function as described in claim 4, wherein, This temporary storage unit is a Double Data Rate Synchronous Dynamic Random Access Memory.

10. A terminal device with dual-mode document printing function as described in claim 5, wherein, The user interface input unit can be a physical button or a virtual button.

11. A terminal device with dual-mode document printing function as described in claim 1, wherein, The user interface display is a touch screen.

12. A terminal device with dual-mode document printing function as described in claim 1, wherein, The image output unit is a printing device.

Images