Image processing device, image processing system, storage medium and image processing method

By acquiring object image data and displaying images, and performing corresponding image processing, the problem of poor image quality in the prior art is solved, high-quality target image status output is achieved, and user operations are simplified.

CN111669478BActive Publication Date: 2024-11-15FUJIFILM BUSINESS INNOVATION CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201910832308.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-03-08
Filing Date
2019-09-04
Publication Date
2024-11-15
Estimated Expiration
2039-09-04

AI Technical Summary

Technical Problem

When the prior art reads the displayed image through the scanning device, the image quality of the processing results may be poor, and it is difficult to achieve the target image state represented by the displayed image.

Method used

By acquiring image data of the object image and a display image representing the target image state, corresponding image processing is performed, including operations such as enlarging, decreasing, rotating, configuring and image quality correction, to form an output image to achieve the target image state.

Benefits of technology

The image quality of image processing is improved, ensuring that the processing results are consistent with the original image data, reducing the user's operation burden, and improving the efficiency and effect of image processing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111669478B_ABST
    Figure CN111669478B_ABST
Patent Text Reader

Abstract

An image processing device, an image processing system, a storage medium, and an image processing method. The image processing device comprises: a unit for acquiring image data of a target image to be processed; a unit for acquiring a display image representing a state of the target image; and a unit for performing image processing corresponding to the state of the target image on the image data of the target image based on the acquired display image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to an image processing device, an image processing system, a storage medium and an image processing method. Background Art

[0002] Patent document 1 describes a scanning device having: a first mode for reading a normal object placed on a manuscript table; and a second mode for reading a self-luminous object placed on the manuscript table. The scanning device of patent document 1 detects light from the object placed on the manuscript table, and switches the reading mode to the first mode or the second mode according to the detection result.

[0003] Furthermore, Patent Document 2 describes an information terminal device that is based on a sheet-passing image reading device that reads at a fixed reading position while conveying a manuscript. In Patent Document 2, a display screen of the information terminal device can be arranged at the fixed reading position of the image reading device, the content of the display screen can be scrolled by the information terminal device, the content of the display screen can be read by the image reading device, and the content can be recorded on recording paper by the image forming device.

[0004] In addition, Patent Document 3 describes an image processing system in which an electronic book terminal and a copier are respectively provided with communication interfaces so as to be able to communicate with each other. The control unit of the copier notifies the electronic book terminal of a page display request after reading an image displayed on a display unit through a scanner. If the control unit of the electronic book terminal receives the notification of the page display request, it notifies the copier that the page display is completed after turning the page of the image displayed on the display unit.

[0005] Patent Document 1: Japanese Patent Application Publication No. 2014-116907

[0006] Patent Document 2: Japanese Patent Application Publication No. 2012-093903

[0007] Patent Document 3: Japanese Patent Application Publication No. 2006-254224

[0008] As described in Patent Documents 1 to 3, there is a conventionally known technique for reading a display image displayed on a display device or paper, for example, by a scanner, etc. For example, if it is desired to directly realize the image state of an object image represented by the display image, an image may be formed based on scan data obtained by reading the display image by a scanner, etc.

[0009] However, for example, the processing result obtained by image processing of scanned data of a display image representing an object image may have deteriorated image quality, etc. compared to the processing result obtained by image processing of image data of the object image (e.g., original image data used to form the display image). Summary of the invention

[0010] An object of the present invention is to realize a target image state represented by a display image by image processing on image data of a target image.

[0011] The invention described in Option 1 is an image processing device, characterized in that it comprises: a unit for acquiring image data of an object image that is the subject of image processing; a unit for acquiring a display image representing a target image state; and a unit for performing image processing corresponding to the target image state on the image data of the object image based on the acquired display image.

[0012] The invention described in Scheme 2 is characterized in that, in the image processing device described in Scheme 1, a display image representing a partial image that is a part of the object image is obtained, and image processing is performed to form an image corresponding to the partial image based on the image data of the object image.

[0013] The invention described in Scheme 3 is characterized in that, in the image processing device described in Scheme 2, a display image in which the partial image is enlarged and displayed is acquired, and an image corresponding to the partial image enlarged and displayed is formed based on the image data of the object image.

[0014] The invention described in claim 4 is characterized in that, in the image processing device described in claim 2 or 3, image processing is performed to form the partial image based on the image data of the target image and to enlarge or reduce the partial image.

[0015] The invention described in Scheme 5 is characterized in that, in an image processing device described in any one of Schemes 1 to 4, a display image representing at least a portion of the pages within the object image composed of a plurality of pages is obtained, and image processing is performed to form an image corresponding to the at least a portion of the pages based on the image data of the object image.

[0016] The invention described in Scheme 6 is characterized in that, in the image processing device described in Scheme 5, a display image representing N pages that are at least a part of the object image is obtained, and a collection image representing N images corresponding to the N pages on one page is formed based on the image data of the object image, wherein N is a natural number.

[0017] The invention described in claim 7 is characterized in that, in the image processing device described in claim 6, a plurality of data corresponding to the N pages are acquired, and the aggregate image is formed based on the image data of the target image.

[0018] The invention described in Scheme 8 is characterized in that, in an image processing device described in any one of Schemes 1 to 7, by obtaining information related to the configuration of the object image in the display image, an output image is formed by performing image processing on the image data of the object image in accordance with the configuration in the display image.

[0019] The invention described in Scheme 9 is characterized in that, in the image processing device described in Scheme 8, the object image formed based on the image data is arranged at a position in the output image corresponding to the position of the object image in the display image.

[0020] The invention described in Scheme 10 is characterized in that, in the image processing device described in Scheme 8 or 9, the object image formed based on the image data is rotated at a rotation angle of the object image in the display image, and the object image is arranged in the output image.

[0021] The invention described in Scheme 11 is characterized in that, in the image processing device described in any one of Schemes 1 to 10, by obtaining information related to the image quality of the object image in the display image, correction processing of the image quality in the display image is performed on the image data of the object image.

[0022] The invention described in Scheme 12 is characterized in that, in the image processing device described in Schemes 1 to 11, by obtaining instruction information of the image processing shown in the display image, the image processing specified by the instruction information is performed on the image data of the object image.

[0023] The invention described in Scheme 13 is characterized in that, in the image processing device described in Scheme 12, a display image containing marks corresponding to one or more retouching processes is obtained as the indication information, and the retouching process corresponding to the mark is determined, and the determined retouching process is performed on the output image obtained based on the image data of the object image.

[0024] The invention described in Scheme 14 is characterized in that, in the image processing device described in Scheme 12 or 13, information containing a specified watermark is obtained as a display image of the indication information, and image processing is performed on the image data of the object image to add the watermark specified by the indication information.

[0025] The invention described in Scheme 15 is an image processing system, which includes an information terminal device and an image processing device. The image processing system is characterized in that the information terminal device has a unit for displaying a display image representing a target image state, and the image processing device has: a unit for acquiring image data of an object image; a unit for acquiring the display image displayed on the information terminal device; and a unit for performing image processing corresponding to the target image state on the image data of the object image based on the acquired display image.

[0026] The invention described in Scheme 16 is a storage medium, characterized in that it stores a program for causing a computer to function as the following units: a unit for acquiring image data of an object image that is the subject of image processing; a unit for acquiring a display image representing a target image state; and a unit for performing image processing corresponding to the target image state on the image data of the object image based on the acquired display image.

[0027] The invention described in Scheme 17 is an image processing method, characterized in that it includes the following steps: a step of acquiring image data of an object image that is the object of image processing; a step of acquiring a display image representing a target image state; and a step of performing image processing corresponding to the target image state on the image data of the object image based on the acquired display image.

[0028] Effects of the Invention

[0029] According to the first aspect of the present invention, a target image state represented by a display image can be realized by image processing on image data of a target image.

[0030] According to the second aspect of the present invention, a partial image within a target image represented by a display image can be formed based on the image data of the target image.

[0031] According to the third aspect of the present invention, a partial image to be displayed enlarged within a target image can be formed based on the image data of the target image.

[0032] According to the fourth aspect of the present invention, an image capable of enlarging or reducing a partial image within a target image represented by a display image is formed based on the image data of the target image.

[0033] According to the fifth aspect of the present invention, an image corresponding to at least a part of the page in the target image represented by the display image can be formed based on the image data of the target image.

[0034] According to the sixth aspect of the present invention, a collection image corresponding to N pages in a target image represented by a display image can be formed based on the image data of the target image.

[0035] According to the seventh aspect of the present invention, even if the data corresponding to N pages in the target image is divided into a plurality of pieces, a collection image can be formed based on the image data of the target image.

[0036] According to the eighth aspect of the present invention, the target image can be arranged in the output image formed using the image data of the target image in the same manner as the arrangement indicated by the display image.

[0037] According to the ninth aspect of the present invention, the target image can be arranged at the position indicated by the display image in the output image formed using the image data of the target image.

[0038] According to the tenth aspect of the present invention, it is possible to arrange the target image rotated at the rotation angle indicated by the display image in the output image formed using the image data of the target image.

[0039] According to the eleventh aspect of the present invention, a target image corresponding to the image quality in a display image can be obtained based on the image data of the target image.

[0040] According to the twelfth aspect of the present invention, image processing on image data of a target image can be specified through a display image.

[0041] According to the thirteenth aspect of the present invention, it is possible to designate a trimming process for an output image obtained based on the image data of the target image by using a mark included in the display image.

[0042] According to the fourteenth aspect of the present invention, a watermark to be added to the image data of a target image can be specified through a display image.

[0043] According to a fifteenth aspect of the present invention, there is provided an image processing system for realizing a target image state represented by a display image displayed on an information terminal device by image processing on image data of a target image.

[0044] According to a sixteenth aspect of the present invention, there is provided a storage medium for realizing a target image state represented by a display image by image processing on image data of a target image.

[0045] According to a seventeenth aspect of the present invention, there is provided an image processing method for realizing a target image state represented by a display image by image processing on image data of a target image. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Embodiments of the present invention will be described in detail with reference to the following drawings.

[0047] Figure 1 is a diagram showing a specific example of an image processing system;

[0048] Figure 2 Is based on Figure 1 A diagram showing a specific example of image processing by an image processing system;

[0049] Figure 3 A diagram showing a basic specific example of image processing for a target image;

[0050] Figure 4 is a diagram showing a specific example of image processing for a partial image that is a part of a target image;

[0051] Figure 5 is a diagram showing a specific example of image processing for target images of a plurality of pages;

[0052] Figure 6 A diagram showing a specific example of image processing related to the arrangement of an object image;

[0053] Figure 7 is a diagram showing a specific example of image quality correction related to a target image;

[0054] Figure 8 is a diagram showing a specific example of image processing including trimming processing;

[0055] Fig. 9 It is a diagram showing a specific example of image processing for adding a watermark.

[0056] Explanation of symbols

[0057] 10 - image data acquisition unit, 20 - scanning processing unit, 30 - analysis processing unit, 40 - image processing unit, 100 - image processing device, 200 - information terminal device. DETAILED DESCRIPTION

[0058] Figure 1 FIG. 1 is a diagram showing an example of a specific embodiment of the present invention. Figure 1 FIG. 2 shows a specific example of an image processing system including an image processing device 100 and an information terminal device 200. Figure 1 In the specific example shown, the image processing device 100 and the information terminal device 200 are connected to each other via a communication line 300 using at least one of wireless communication and wired communication to exchange data (information). Figure 1 In the specific example shown, the information processing device 210 may exchange data with the image processing device 100 via the communication line 300 .

[0059] exist Figure 1 In the specific example shown, the image processing device 100 includes an image data acquisition unit 10, a scanning processing unit 20, an analysis processing unit 30, and an image processing unit 40. Figure 1 As illustrated in FIG. 1 , the image processing device 100 may include a data storage unit 12 and an image output unit 42 .

[0060] The image data acquisition unit 10 acquires image data of a target image to be processed. The image data acquisition unit 10 may acquire the image data of the target image from the information terminal device 200 or the information processing device 210 via the communication line 300. The image data acquired by the image data acquisition unit 10 may be stored in the data storage unit 12.

[0061] The scanning processing unit 20 acquires scan data of a display image representing a target image state related to the object image. The scanning processing unit 20 acquires scan data of the display image by, for example, optically reading the display image. The scanning processing unit 20 may optically read an image (including an image of only text or marks) shown on a manuscript such as paper by a scanner or a digital camera to acquire scan data of the image. Furthermore, the scanning processing unit 20 may optically read an image displayed on a self-luminous display device to acquire scan data of the image.

[0062] The analysis processing unit 30 determines the image processing corresponding to the target image state by analyzing the scan data. The analysis processing unit 30 analyzes the scan data acquired by the scan processing unit 20, for example. That is, the analysis processing unit 30 analyzes the scan data of the display image representing the target image state related to the object image. Thus, the analysis processing unit 30 determines the image processing corresponding to the target image state represented by the display image.

[0063] The image processing unit 40 performs image processing corresponding to the target image state on the image data of the target image. For example, the image processing unit 40 performs image processing determined by the analysis processing unit 30 on the image data of the target image acquired by the image data acquisition unit 10, that is, image processing corresponding to the target image state related to the target image.

[0064] The image obtained by the image processing by the image processing unit 40 can be output from the image output unit 42. For example, the image output unit 42 can print the image processed by the image processing unit 40 on a medium such as paper. In addition, the image output unit 42 can store the data of the image processed by the image processing unit 40 in the data storage unit 12 or transmit it to the outside of the image processing device 100.

[0065] Figure 1The image processing apparatus 100 illustrated in the figure can be realized by using, for example, one or more computers. The computer includes hardware resources such as a CPU and other computing devices, a memory or hardware and other storage devices, a communication device using a communication line such as the Internet, a device for reading and writing data from a storage medium such as an optical disk, a semiconductor memory, or a card memory, a display device such as a display, and an operation device for receiving user operations.

[0066] Furthermore, for example, the computer can read in Figure 1 The program (software) corresponding to the function of at least a part of the plurality of parts with symbols provided in the image processing device 100 shown in the figure is implemented by the computer through the cooperation of the hardware resources provided in the computer and the read software. Figure 1 The program may be provided to the computer (image processing device 100) via a communication line such as the Internet, or may be stored in a storage medium such as an optical disk, semiconductor memory, or card memory.

[0067] and, Figure 1 The image processing device 100 illustrated in the figure may be a composite device having a plurality of image output functions (at least some of the functions of printing function, scanning function, copying function, fax function, etc.). Figure 1 If the image processing device 100 is a composite device, it can be installed in a company or school and used by customers of the company or school, or it can be installed in a store such as a convenience store and used by many unspecified customers.

[0068] exist Figure 1 In the specific example shown, the information terminal device 200 and the information processing device 210 are composed of Figure 1 The user device used by the user of the image processing system shown in FIG. Specific examples of the information terminal device 200 include mobile terminal devices such as smartphones and tablet terminals. Specific examples of the information processing device 210 include devices such as personal computers.

[0069] Figure 1 The overall structure of the image processing system illustrated in FIG. Figure 1 A specific example of image processing implemented by the image processing system is described in detail. Figure 1 The structure (part) shown is used in the following description Figure 1 symbol.

[0070] Figure 2 Is based on Figure 1 A diagram (flow chart) showing a specific example of image processing by an image processing system. Figure 2, firstly, the user device selects the object image (S201). Figure 1 The user of the image processing system displays an image on the information terminal device 200 or the information processing device 210 and selects a target image to be subjected to image processing.

[0071] Next, the image data of the target image is sent (S202). For example, the user who selected the target image in S201 sends the image data of the selected target image from the information terminal device 200 or the information processing device 210 to the image processing device 100 via the communication line 300. The sent image data of the target image is received by the image data acquisition unit 10 of the image processing device 100 and stored in the data storage unit 12.

[0072] Furthermore, for example, if the user sends the image data of the target image at a location far from the image processing device 100, the user moves to the location where the image processing device 100 is installed (for example, a store such as a convenience store) after sending the image data. Alternatively, the user may send the image data of the target image from an information terminal device 200 such as a smartphone or a tablet terminal to the image processing device 100 at the location where the image processing device 100 is installed. The image data of the target image is sent to the image processing device 100 before the image processing is performed by the image processing device 100 that uses the image data as a target.

[0073] When the image data of the target image is transmitted, image processing is selected by the image processing apparatus 100 (S203). For example, the user who transmits the image data of the target image operates the operation panel of the image processing apparatus 100 to select a function of the image processing by the image processing apparatus 100.

[0074] Next, it is determined whether to use the scan setting ( S204 ). For example, a user who has selected the image processing function operates the operation panel of the image processing apparatus 100 and selects whether to use the scan setting described later.

[0075] When the scanning setting is used, the scanning process of the display image is first performed (S205). Thus, the scan data of the display image representing the state of the target image related to the object image is obtained. For example, the user displays the display image representing the state of the target image related to the object image on the display device of the information terminal device 200, and causes the scanning processing unit 20 of the image processing device 100 to read the display image displayed on the display device, thereby performing the scanning process.

[0076] The display image showing the target image state can be printed on a medium such as paper. When the display image is printed on paper, the user causes the scanning processing unit 20 of the image processing device 100 to read the display image shown on the paper, thereby performing scanning processing.

[0077] If scanning processing of the display image is performed to obtain scanning data of the display image, the scanning data is analyzed (S206). For example, the analysis processing unit 30 of the image processing device 100 analyzes the scanning data, thereby determining the image processing corresponding to the target image state. The analysis processing unit 30, for example, analyzes the scanning data obtained by the scanning processing unit 20. That is, the analysis processing unit 30 analyzes the scanning data of the display image representing the target image state related to the object image. Thus, the analysis processing unit 30 determines the image processing corresponding to the target image state.

[0078] Next, the image-processed image is displayed (S207), and it is confirmed whether there is any problem with the image-processed image (S208). For example, an image representing a finished image obtained by the image processing determined by the analysis processing unit 30 is displayed on a display device of the image processing apparatus 100. Then, the user confirms whether there is any problem with the displayed finished image, and if there is no problem, for example, operates the operation panel of the image processing apparatus 100 to instruct execution of the image processing.

[0079] Furthermore, if it is confirmed that the displayed image processing image has no problem, image processing is performed on the image data of the target image (S210). For example, the image processing unit 40 of the image processing device 100 performs the image processing determined by the analysis processing unit 30 on the image data of the target image acquired by the image data acquisition unit 10. Thus, image processing corresponding to the target image state related to the target image is performed on the image data of the target image. If the image processing in S210 is completed, Figure 2 The flowchart illustrated in FIG. 1 ends.

[0080] In S210, image processing is performed on the image data of the target image (e.g., original image data used in forming the display image) instead of the scanned data of the display image representing the target image. Therefore, the processing result of S210 obtained by the image processing on the image data of the target image is high quality in terms of image quality, etc., compared with the processing result obtained by the image processing on the scanned data of the display image representing the target image.

[0081] Furthermore, for example, if a user uses a familiar information terminal device 200 to form a display image representing a target image state related to an object image, the user's operational burden is reduced and operability is improved compared to the user operating an unfamiliar image processing device 100 to set the target image state.

[0082] In addition, when the scan setting is not used in S204, the image processing device 100 performs the setting (S209). For example, the user who determines that the scan setting is not used in S204 confirms that the image state of the target image displayed on the display device of the image processing device 100 is realized by operating the operation panel of the image processing device 100, etc., while confirming the image state of the target image displayed on the display device of the image processing device 100, and the parameters of the image processing by the image processing unit 40 of the image processing device 100 are set. In addition, even if there is a problem with the completed image in S208, the image processing device 100 performs the setting (S209).

[0083] If the image processing device 100 performs the setting in S209, the image processing of the image data of the target image is performed according to the setting content (S210). For example, the image processing unit 40 of the image processing device 100 performs the image processing on the image data of the target image acquired by the image data acquisition unit 10 according to the parameters set in S209.

[0084] And, in Figure 2 In the flowchart illustrated in , the processing of S207 and the processing of S208 can be omitted. For example, the scanning processing of the display image can be performed in S205 to obtain the scan data of the display image, and after the scanning data is analyzed in S206, the image processing of the image data of the target image is performed in S210. In addition, the scanning processing of the display image can be performed before the image data of the target image is sent, and the image data of the target image can be sent after the scanning processing of the display image.

[0085] And, in Figure 2 In the scanning process of S205 of the flowchart illustrated in FIG, the data of the display image displayed on the display device of the information terminal device 200 (for example, low-quality data equivalent to the scanned data) can be transmitted from the information terminal device 200 to the image processing device 100 through data communication. For example, if the information terminal device 200 and the image processing device 100 have a short-distance communication function such as NFC (Near Field Communication), the data of the display image can also be transmitted from the information terminal device 200 to the image processing device 100 through short-distance communication.

[0086] Next, Figure 1A specific example of image processing implemented in the image processing system is described. Figures 3 to 9 In the example, there is and in Figure 1 Several specific examples of image processing implemented in the image processing system. Figures 3 to 9 In each of the figures, there is illustrated a specific example of image data of an object image that is the subject of image processing, a specific example of a display image that represents a target image state related to the object image, and a specific example of an image processing result obtained by performing image processing corresponding to the target image state represented by the display image on the image data of the object image.

[0087] Figure 3 This is a diagram showing a basic specific example of image processing for a target image. Figure 3 3 shows a specific example of the image data 310 of the target image to be processed.

[0088] Figure 3 3 shows a specific example of a display image 320 directly representing the image content of the image data 310 as a target image state related to the object image.

[0089] Therefore, as the scan data of the display image representing the state of the target image related to the object image, for example, Figure 3 When the scanned data of the display image 320 illustrated in the example is obtained, as a result of image processing corresponding to the target image state represented by the display image 320 for the image data 310, the image content of the image data 310 can be directly represented. Figure 3 The image processing result 330 is illustrated in FIG.

[0090] Figure 4 A diagram showing a specific example of image processing for a partial image that is a part of a target image. Figure 4 4 shows a specific example of image data 410 of an object image to be processed. Figure 4 , specific examples of display images 421 , 422 , and 423 representing a partial image P that is a part of the target image are illustrated as target image states related to the target image.

[0091] In the display image 421, the partial image P as a part of the target image is displayed through the layout frame ( Figure 4 For example, when the Figure 4 When scanning data of the display image 421 illustrated in the figure is displayed, the image processing unit 40 of the image processing device 100 extracts (e.g., performs trimming processing) data corresponding to the partial image P within the layout frame from the image data 410 and performs image processing to form the partial image P.

[0092] Therefore, if Figure 4 As illustrated in FIG. 4 , based on the image data 410 and the display image 421 , for example, the image processing result 431 or the image processing result 432 can be obtained. Figure 4 In the specific example shown, the image processing result 431 is a processing result in which the size of the partial image P is maintained (for example, the relative size within the target image is maintained) and only the partial image P is shown. On the other hand, the image processing result 432 is a processing result in which the size of the partial image P is enlarged (for example, enlarged to be larger than the relative size within the target image) and only the partial image P is shown.

[0093] Furthermore, the display image 422 shows the partial image P as a part of the object image at the original size (for example, maintaining the relative size within the object image). Figure 4 When the scanned data of the display image 422 is shown in the example, the image processing unit 40 extracts the data corresponding to the partial image P from the image data 410 to form the partial image P. Thus, as shown in FIG. Figure 4 As illustrated in FIG. 4 , based on the image data 410 and the display image 422 , for example, the image processing result 431 or the image processing result 432 can be obtained.

[0094] Furthermore, the display image 423 enlarges the partial image P as a part of the target image (for example, enlarges it to a larger relative size than the target image). Figure 4 When the scan data of the display image 423 is shown in the example, the image processing unit 40 also performs image processing to extract data corresponding to the partial image P from the image data 410 to form the partial image P. Thus, as shown in FIG. Figure 4 As illustrated in FIG. 4 , based on the image data 410 and the display image 423 , for example, an image processing result 431 or an image processing result 432 may be obtained.

[0095] Figure 5 FIG. 1 is a diagram showing a specific example of image processing for a target image composed of a plurality of pages. Figure 5 Specific examples of image data 510 related to a target image composed of a plurality of pages are shown in FIG. Figure 5 4 , the image data 510 of the target image composed of a plurality of pages from page 1 to page 4 is illustrated.

[0096] and, Figure 5 Detailed examples of display images 521, 522, and 523 showing at least a part of pages in a target image composed of a plurality of pages are illustrated as target image states related to the target image.

[0097] The display image 521 is a specific example of a display image showing at least a part of pages in a target image composed of a plurality of pages. Figure 5 The display image 521 illustrated in FIG. 5 shows page 3 which is a part of the target image composed of pages 1 to 4. For example, when the Figure 5 When scanning data of the display image 521 illustrated in FIG. 5 is obtained, the image processing unit 40 of the image processing device 100 extracts data corresponding to page 3 from the image data 510 and performs image processing to form an image corresponding to page 3 .

[0098] Therefore, if Figure 5 As illustrated in FIG. 5 , an image processing result 531 representing an image corresponding to page 3 can be obtained based on the image data 510 and the display image 521 .

[0099] Furthermore, the display image 522 is a specific example of a display image showing N pages (N is a natural number) which are at least a part of the target image composed of a plurality of pages. Figure 5 The display image 522 illustrated in FIG. 5 shows two pages, Page 1 and Page 2 (page range 1 to 2), in the target image consisting of Pages 1 to 4.

[0100] For example, when you get Figure 5 When scanning data of the display image 522 illustrated in the example is obtained, the image processing unit 40 extracts data corresponding to page 1 and page 2 from the image data 510, and performs image processing to form images corresponding to page 1 and page 2. The image processing unit 40 can form a collection image in which N images corresponding to N pages (N is a natural number) are displayed on one page.

[0101] For example, Figure 5 As illustrated in FIG. 5 , an image processing result 532 in which the image of page 1 and the image of page 2 are displayed on one page can be obtained based on the image data 510 and the display image 522. In addition, a processing result in which the image of page 1 and the image of page 2 are displayed on different pages can also be obtained based on the image data 510 and the display image 522.

[0102] Furthermore, the display image 523 is a specific example of a display image showing N pages (N is a natural number) which are at least a part of the target image composed of a plurality of pages. Figure 5 The display image 523 illustrated in FIG. 5 is composed of two display images, namely, a display image representing page 3 and a display image representing page 4 in the target image composed of pages 1 to 4 .

[0103] The scanning processing unit 20 of the image processing device 100 may, for example, sequentially execute Figure 5The scanning process of the display image of page 3 of the display image 523 illustrated in the figure and the scanning process of the display image of page 4 are performed, and the scanning data related to the display image of page 3 and the scanning data related to the display image of page 4 are obtained in sequence.

[0104] Then, for example, when obtaining Figure 5 When scanning data corresponding to page 3 and scanning data corresponding to page 4 of the display image 523 illustrated in the example, the image processing unit 40 extracts data corresponding to page 3 and page 4 from the image data 510, and performs image processing to form images corresponding to page 3 and page 4. The image processing unit 40 can form a collection image in which N images corresponding to N pages (N is a natural number) are displayed on one page.

[0105] Thus, for example Figure 5 As illustrated in FIG. 5 , an image processing result 533 in which the image of page 3 and the image of page 4 are displayed on one page can be obtained based on the image data 510 and the display image 523. In addition, a processing result in which, for example, the image of page 3 and the image of page 4 are displayed on different pages can be obtained based on the image data 510 and the display image 523.

[0106] Figure 6 The figure is a specific example of image processing related to the configuration of the object image. The image processing device 100 can obtain scan data of a display image representing a target image state related to the object image, and analyze the scan data to obtain information related to the configuration of the object image in the display image, thereby performing image processing to configure the object image in an output image formed using the image data of the object image in accordance with the configuration in the display image.

[0107] Figure 6 , a specific example of image data 610 of an object image to be processed is shown in FIG. Figure 6 , specific examples of display images 621 and 622 indicating desired arrangements related to the target image are illustrated as target image states related to the target image.

[0108] The display image 621 is a specific example of a display image indicating the position at which the object image is arranged. The image processing unit 40 of the image processing device 100 may, for example, perform image processing to arrange the object image formed based on the image data at a position in the output image corresponding to the position of the object image in the display image. Figure 6 When the scan data of the display image 621 is shown in the example, the image processing unit 40 can arrange the object image formed based on the image data 610 at a position in the output image corresponding to the position of the object image in the display image 621, thereby obtaining, for example Figure 6The image processing result 631 is illustrated in FIG.

[0109] Furthermore, the display image 622 is a specific example of a display image in which the object image is rotated and arranged. The image processing unit 40 may, for example, perform image processing to rotate the object image formed based on the image data by the rotation angle of the object image in the display image and arrange the object image in the output image. Figure 6 The image processing unit 40 can rotate the object image formed according to the image data 610 at the rotation angle of the object image in the display image 622, and arrange the object image in the output image, thereby obtaining, for example, Figure 6 The image processing result 632 is illustrated in FIG.

[0110] By the way, in Figure 6 In the display image 622 illustrated in FIG. 1 , the object image is rotated 90 degrees to the left, so that the object image is arranged at the lower left side of the display image 622. Moreover, in the image processing result 632 obtained by imitating the arrangement in the display image 622, the object image is also rotated 90 degrees to the left, so that the object image is also arranged at the lower left side of the output image. Figure 6 In the specific example illustrated in FIG. 6 , the image processing unit 40 imitates the configuration in the display image 622 and obtains an image processing result 632 configured by adjusting both the rotation angle and the position of the target image in the output image formed using the image data 610 of the target image.

[0111] Figure 7 1 is a diagram showing a specific example of image quality correction related to an object image. The image processing device 100 can obtain scan data of a display image representing a target image state related to the object image, and analyze the scan data to obtain information related to the image quality of the object image in the display image, thereby performing image quality correction processing in the display image on the image data of the object image.

[0112] Figure 7 , a specific example of image data 710 of an object image to be processed is shown in FIG. Figure 7 , a specific example of a display image 720 showing a desired image quality related to the target image is illustrated as a target image state related to the target image.

[0113] For example, it can also be achieved by using Figure 1The user of the image processing system displays the target image on the display device of the information terminal device 200 and operates the operation device of the information terminal device 200, thereby forming a display image 720 in which the parameters related to the image quality such as brightness, luminance, and saturation of the target image are adjusted to a preferred state. In addition, the display image 720 may be an image printed on a medium such as paper.

[0114] And, for example, when you get Figure 7 When the scan data of the display image 720 illustrated in FIG. 1 is obtained, the image processing unit 40 of the image processing device 100 may perform correction processing on the image data 710 of the target image to achieve the image quality within the display image 720, thereby obtaining, for example, Figure 7 The image processing result 730 is shown in FIG. Figure 7 In the specific example illustrated in , an image processing result 730 that realizes the image quality represented by the display image 720 is obtained based on the image data 710.

[0115] Figure 8 The image processing apparatus 100 can obtain scan data of a display image representing a target image state related to a target image, analyze the scan data to obtain instruction information of the image processing represented by the display image, and thereby perform the image processing specified by the instruction information on the image data of the target image.

[0116] Figure 8 Detailed example of image data 810 of a target image to be subjected to image processing is shown in FIG. Figure 8 exemplified in FIG. 8 is image data 810 of a target image composed of a plurality of pages from page 1 to page 4. Figure 8 Specific examples of display images 821 , 822 , and 823 including marks corresponding to one or more trimming processes as instruction information for image processing are illustrated.

[0117] The display image 821 includes a stapling mark M1 as an example of finishing processing. The display image 821 shows two pages, page 1 and page 2 (page range 1 to 2), in the target image consisting of pages 1 to 4.

[0118] For example, when you get Figure 8, the image processing unit 40 of the image processing device 100 extracts data corresponding to page 1 and page 2 from the image data 810, and performs image processing to form images corresponding to page 1 and page 2. Furthermore, the analysis processing unit 30 of the image processing device 100 determines the binding process as the finishing process corresponding to the mark M1 by analyzing the scanned data of the display image 821. Furthermore, the image processing device 100 (for example, the image processing unit 40 or the image output unit 42) performs the binding process corresponding to the mark M1 represented by the display image 821.

[0119] Therefore, if Figure 8 As illustrated in FIG. 8 , an image processing result 831 may be obtained based on the image data 810 and the display image 821 , in which two processing results are bundled, for example, by binding the image of page 1 and the image of page 2 on different pages.

[0120] The display image 822 includes a hole mark M2 as an example of trimming processing. The display image 822 shows page 2 in the target image composed of pages 1 to 4.

[0121] For example, when you get Figure 8 When the image processing unit 40 extracts the data corresponding to the page 2 from the image data 810 to form an image corresponding to the page 2, the image processing unit 40 performs image processing. Furthermore, the analysis processing unit 30 determines the hole opening processing as the trimming processing corresponding to the mark M2 by analyzing the scanned data of the display image 822. Furthermore, for example, the image processing unit 40 or the image output unit 42 performs the hole opening processing corresponding to the mark M2 represented by the display image 822.

[0122] Therefore, if Figure 8 As illustrated in FIG. 8 , an image processing result 832 in which a hole opening process is performed in a page representing an image of page 2, for example, at a position corresponding to a mark M2 in the display image 822, can be obtained based on the image data 810 and the display image 822.

[0123] The displayed image 823 includes a mark M3 with a fold as an example of trimming processing. Furthermore, the displayed image 823 shows two pages, page 3 and page 4 (page range 3 to 4), in the target image consisting of pages 1 to 4.

[0124] For example, when you get Figure 8When the image processing unit 40 extracts the data corresponding to the pages 3 and 4 from the image data 810, and performs image processing to form images corresponding to the pages 3 and 4. Furthermore, the analysis processing unit 30 determines the additional folding process as the trimming process corresponding to the mark M3 by analyzing the scanned data of the display image 823. Furthermore, for example, the image processing unit 40 or the image output unit 42 performs the additional folding process corresponding to the mark M3 represented by the display image 823.

[0125] Therefore, if Figure 8 As illustrated in FIG. 8 , based on the image data 810 and the displayed image 823 , for example, an image processing result 833 in which a folding process is performed between the image of page 3 and the image of page 4 within one page representing the image of page 3 and the image of page 4 can be obtained.

[0126] In addition, Figure 8 In the figure, binding, perforating, and folding are illustrated as examples of finishing processes, but marks corresponding to finishing processes other than these examples (such as binding or offset discharge) can also be used to perform finishing processes corresponding to the marks.

[0127] Fig. 9 The image processing apparatus 100 can acquire scan data of a display image including information specifying a watermark as instruction information and analyze the scan data to perform image processing for adding a watermark specified by the instruction information to the image data of the target image.

[0128] Fig. 9 9 shows a specific example of image data 910 of a target image to be processed. Fig. 9 Specific examples of display images 921 and 922 including information designating a watermark as instruction information for image processing are illustrated in FIG.

[0129] The display image 921 includes instruction information that adds the text "DO NOT COPY" as a watermark to the front side of the image data 910. In addition, the target image (the image of the image data 910) may be displayed in the display image 921.

[0130] For example, when you get Fig. 9 When scanning data of the display image 921 illustrated in the example is obtained, the image processing unit 40 of the image processing device 100 performs image processing to add the text "No Copying" as a watermark on the front side of the object image formed based on the image data 910. Fig. 9 The image processing result 931 is illustrated in FIG.

[0131] Furthermore, the display image 922 includes instruction information that a text “No Copying” is added as a watermark to the back side of the image data 910. In addition, the target image (the image of the image data 910) may be displayed in the display image 922.

[0132] For example, when you get Fig. 9 When scanning data of the display image 922 shown in the example is obtained, the image processing unit 40 performs image processing to add the text "No Copying" as a watermark on the back of the object image formed based on the image data 910. Fig. 9 The image processing result 932 is illustrated in FIG.

[0133] An example of a specific embodiment of the present invention has been described above, but the above specific example is merely illustrative in all aspects and does not limit the scope of the present invention. The present invention includes various modifications within the scope of the present invention.

[0134] The above-mentioned embodiments of the present invention are provided for the purpose of illustration and description. In addition, the embodiments of the present invention do not fully and exhaustively include the present invention, and do not limit the present invention to the disclosed methods. Obviously, various modifications and changes are self-evident to those skilled in the art to which the present invention belongs. The present embodiment is selected and described in order to most easily understand the principles of the present invention and its application. Thus, other technicians in the art can understand the present invention through various variations optimized for specific uses assumed to be various embodiments. The scope of the present invention is defined by the above claims and their equivalents.

Claims

1. An image processing device, characterized in that: have: a unit for acquiring image data of a target image to be subjected to image processing; a unit for scanning a display image to acquire scan data, wherein the scan data of the display image represents a target image state related to the target image, and the target image state represents that the display image is a full image or a partial image of the target image, the display image is an image of N pages of at least a part of the target image, the display image is an image obtained by rotating the target image, or the display image is an image of a desired image quality related to the target image, wherein N is a natural number; as well as A unit for performing image processing corresponding to the target image state on the image data of the object image based on the scan data of the display image, wherein the image processing corresponding to the target image state includes: extracting all or part of the image of the object image corresponding to the display image, enlarging or reducing the part of the image extracted from the object image corresponding to the display image, forming a collection image in which N images corresponding to the images of the N pages are represented on one page based on the image data of the object image, configuring the object image formed based on the image data of the object image at a position in the output image corresponding to the position of the object image in the display image, or performing correction processing on the image data of the object image to achieve image quality in the display image.

2. The image processing device according to claim 1, characterized in that By obtaining instruction information of the image processing indicated in the display image, the image processing designated by the instruction information is performed on the image data of the target image.

3. The image processing device according to claim 2, characterized in that: A display image including marks corresponding to one or more retouching processes as the instruction information is acquired, the retouching process corresponding to the mark is determined, and the determined retouching process is executed on an output image obtained based on the image data of the target image.

4. The image processing device according to claim 2 or 3, characterized in that: Information including a designated watermark is acquired as a display image of the instruction information, and image processing for adding the watermark designated by the instruction information is performed on the image data of the target image.

5. An image processing system comprising an information terminal device and an image processing device, wherein the image processing system is characterized in that: The information terminal device has a unit for displaying a display image indicating a state of an object image. The image processing device comprises: a unit for acquiring image data of an image of an object; a unit for acquiring scan data by scanning the display image, wherein the scan data of the display image represents a target image state related to the target image, and the target image state represents that the display image is a full image or a partial image of the target image, the display image is an image of N pages of at least a part of the target image, the display image is an image in which the target image is rotated, or the display image is an image of a desired image quality related to the target image, wherein N is a natural number; and A unit for performing image processing corresponding to the target image state on the image data of the object image according to the scan data of the display image, wherein the image processing corresponding to the target image state comprises: Extracting the entire image or a portion of the object image corresponding to the display image, enlarging or reducing the portion of the image extracted from the object image corresponding to the display image, forming a collection image in which N images corresponding to the images of the N pages are represented on one page based on the image data of the object image, arranging the object image formed based on the image data of the object image at a position in the output image corresponding to the position of the object image in the display image, or performing correction processing on the image data of the object image to achieve image quality in the display image.

6. A storage medium, characterized in that: A program for causing the computer to function as the following means is stored: a unit for acquiring image data of a target image to be subjected to image processing; a unit for scanning a display image to acquire scan data, wherein the scan data of the display image represents a target image state related to the target image, and the target image state represents that the display image is a full image or a partial image of the target image, the display image is an image of N pages of at least a part of the target image, the display image is an image obtained by rotating the target image, or the display image is an image of a desired image quality related to the target image, wherein N is a natural number; as well as A unit for performing image processing corresponding to the target image state on the image data of the object image based on the scan data of the display image, wherein the image processing corresponding to the target image state includes: extracting all or part of the image of the object image corresponding to the display image, enlarging or reducing the part of the image extracted from the object image corresponding to the display image, forming a collection image in which N images corresponding to the images of the N pages are represented on one page based on the image data of the object image, configuring the object image formed based on the image data of the object image at a position in the output image corresponding to the position of the object image in the display image, or performing correction processing on the image data of the object image to achieve image quality in the display image.

7. An image processing method, characterized in that: The steps include: A step of acquiring image data of a target image to be subjected to image processing; A step of scanning a display image to obtain scan data, wherein the scan data of the display image represents a target image state related to the target image, and the target image state represents that the display image is a full image or a partial image of the target image, the display image is an image of N pages of at least a part of the target image, the display image is an image obtained by rotating the target image, or the display image is an image of a desired image quality related to the target image, wherein N is a natural number; as well as Based on the scanned data of the displayed image, a step of performing image processing corresponding to the target image state on the image data of the object image, wherein the image processing corresponding to the target image state includes: extracting all or part of the image of the object image corresponding to the displayed image, enlarging or reducing the part of the image extracted from the object image corresponding to the displayed image, forming a collection image in which N images corresponding to the images of the N pages are represented on one page based on the image data of the object image, configuring the object image formed based on the image data of the object image at a position in the output image corresponding to the position of the object image in the displayed image, or performing correction processing on the image data of the object image to achieve image quality in the displayed image.

8. A computer program product, characterized in that Includes programs that cause a computer to function as: a unit for acquiring image data of a target image to be subjected to image processing; a unit for scanning a display image to acquire scan data, wherein the scan data of the display image represents a target image state related to the target image, and the target image state represents that the display image is a full image or a partial image of the target image, the display image is an image of N pages of at least a part of the target image, the display image is an image obtained by rotating the target image, or the display image is an image of a desired image quality related to the target image, wherein N is a natural number; as well as A unit for performing image processing corresponding to the target image state on the image data of the object image based on the scan data of the display image, wherein the image processing corresponding to the target image state includes: extracting all or part of the image of the object image corresponding to the display image, enlarging or reducing the part of the image extracted from the object image corresponding to the display image, forming a collection image in which N images corresponding to the images of the N pages are represented on one page based on the image data of the object image, configuring the object image formed based on the image data of the object image at a position in the output image corresponding to the position of the object image in the display image, or performing correction processing on the image data of the object image to achieve image quality in the display image.