Image printing system and program, and image manufacturing method.

JP7635519B2Active Publication Date: 2025-02-26DAI NIPPON PRINTING CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2020139654
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-08-20
Publication Date
2025-02-26
Estimated Expiration
2040-08-20

AI Technical Summary

Benefits of technology

【0014】 本実施の形態によれば、元の立体被写体に近い立体感を備えた平面画像を印刷することが可能な画像印刷システムおよびプログラム並びに画像の製造方法を提供することができる。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007635519000001
    Figure 0007635519000001
  • Figure 0007635519000002
    Figure 0007635519000002
  • Figure 0007635519000003
    Figure 0007635519000003
Patent Text Reader

Abstract

To provide an image printing system and a program capable of printing a plane image with a stereoscopic effect close to an original stereoscopic subject, and a manufacturing method of images.SOLUTION: Image printing system 10, 11 includes a light source that irradiates a subject with light, a photographing unit that acquires reflected light reflected by the subject as an input image, an editing unit 140 that corrects the input image acquired by the photographing unit and generates a correction image which is a plane image, and a printing unit 160 that prints the correction image. For the correction image, a first input image including first shading information as shading information and a second input image including second shading information different from the first shading information are synthesized.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an apparatus and method for editing an image of a three-dimensional subject captured by a scanner to create and print a two-dimensional image with a three-dimensional effect. [Background technology]

[0002] In recent years, there is an increasing need to print flat images that realistically reproduce the wood grain pattern of wallpaper or the fine unevenness seen on the surface of Japanese paper, and distribute them as flyers, pamphlets, etc. that attract customers. For example, Patent Document 1 proposes a multi-angle scanner that is configured to adjust the posture of the reading head so that the optical axis of the reading optical system of the reading head can be adjusted to a desired corresponding angle with respect to the subject's placement platform. It is described that this makes it possible to appropriately change the corresponding angle of the optical axis of the reading optical system with respect to the scanned surface of the subject, obtain the optimal reading direction with respect to the uneven parts of the subject, and output realistic image data that accurately captures the subtle expressions of the subject.

[0003] Patent Document 2 describes a stereoscopic scanner that can capture an image of a stereoscopic subject without causing color saturation or the like in the shadows that occur in the high saturation or brightness parts of the stereoscopic subject. In this stereoscopic scanner, the brightness on the median side, which occupies most of the image, is almost the same as the brightness at a specified exposure amount, resulting in an image that gives a natural impression overall. This is said to be able to prevent the shadows on the high brightness side from disappearing due to color saturation as much as possible. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2009-182995 A [Patent Document 2] JP 2014-11505 A Summary of the Invention [Problem to be solved by the invention]

[0005] Even when an image is obtained as described above, there are cases in which a sufficient three-dimensional effect cannot be obtained. The present disclosure has been made in consideration of such circumstances, and an object of the present disclosure is to provide an image printing system and program, as well as an image manufacturing method, capable of printing a two-dimensional image having a three-dimensional effect close to that of the original three-dimensional subject. [Means for solving the problem]

[0006] The image printing system according to the present embodiment is an image printing system that prints a flat image including shading information corresponding to a subject, and includes a light source that irradiates light onto the subject, a photographing unit that acquires the light reflected by the subject as an input image, an editing unit that corrects the input image acquired by the photographing unit to create a corrected image, which is a flat image, and a printing unit that prints the corrected image, and is characterized in that the corrected image is a combination of a first input image including first shading information as shading information, and a second input image including second shading information different from the first shading information.

[0007] In another embodiment of the image printing system, the first input image and the second input image may be acquired by the photographing unit under conditions in which the light irradiation conditions of the light source on the subject or the photographing conditions of the photographing unit are different from each other.

[0008] In the image printing system according to another embodiment of the present invention, the photographing condition may be a state in which the photographing units are inclined at a predetermined angle with respect to a normal direction of a main surface of the subject so as to be line-symmetrical with each other.

[0009] In the image printing system according to another embodiment of the present invention, the corrected image may be an image corrected by setting the radius of an unsharp mask to 1.0 pixel or less.

[0010] In addition, in an image printing system according to another embodiment of the present invention, the subject may be composed of a first object and a second object having different materials or colors overlapping each other, and a portion of the second object may be visible through an opening of the first object.

[0011] In the image printing system according to another embodiment of the present invention, the corrected image may form a development of a three-dimensional object.

[0012] Moreover, an image manufacturing method according to the present embodiment is an image manufacturing method for printing a planar image including shading information corresponding to a subject, and includes the steps of: irradiating the subject with light from a light source; acquiring the light reflected by the subject as an input image by an imaging unit; correcting the input image acquired by the imaging unit to create a corrected image, which is a planar image; and printing the corrected image, wherein the corrected image is a combination of a first input image including first shading information as shading information, and a second input image including second shading information different from the first shading information.

[0013] Furthermore, the program according to this embodiment is a program for causing a computer to produce an image for printing a planar image including shading information corresponding to a subject, and includes a function for irradiating light from a light source onto the subject, a function for acquiring the light reflected by the subject as an input image by an imaging unit, an editing function for correcting the input image acquired by the imaging unit to create a corrected image which is a planar image, and a printing function for printing the corrected image, wherein the corrected image is a combination of a first input image including first shading information as shading information and a second input image including second shading information different from the first shading information. Effect of the Invention

[0014] According to the present embodiment, it is possible to provide an image printing system, a program, and an image manufacturing method capable of printing a two-dimensional image having a three-dimensional effect close to that of the original three-dimensional subject. [Brief description of the drawings]

[0015] [Figure 1] FIG. 1 is a system configuration diagram of an image printing system according to first and second embodiments. [Diagram 2] FIG. 2 is a diagram illustrating the structure of a scanner in the image printing system according to the first embodiment. [Diagram 3] 4 is a flow chart showing an acquisition flow of an input image of the image printing system of the present disclosure. [Figure 4] 4 is a flow chart showing a formation flow of a two-dimensional image including shadow information of the image printing system of the present disclosure. [Diagram 5] FIG. 13 is a diagram illustrating the synthesis of an input image including shadow information. [Figure 6] FIG. 11 is a diagram illustrating image correction. [Figure 7] FIG. 11 is a diagram illustrating the structure of a scanner in an image printing system according to a second embodiment. [Figure 8] 1A and 1B are diagrams illustrating changes in an input image due to illumination conditions of a light source. [Figure 9] 1A and 1B are diagrams illustrating changes in an input image due to illumination conditions of a light source. [Figure 10] 13A and 13B are diagrams illustrating an output image for a subject on which different articles are formed in an overlapping manner. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] Hereinafter, an example of an image printing system, a program, and an image manufacturing method of the present disclosure will be described with reference to the drawings, etc. However, the image printing system and the like of the present disclosure are not limited to the embodiments and examples described below.

[0017] The figures shown below are schematic. Therefore, the size and shape of each part are appropriately exaggerated to facilitate understanding. In addition, hatching showing the cross section of a member is appropriately omitted in each figure. The numerical values ​​such as dimensions of each member and the material names described in this specification are examples of embodiments, and are not limited thereto, and can be appropriately selected and used. In this specification, terms that specify shapes and geometric conditions, such as parallel, orthogonal, and vertical, are intended to include substantially the same state in addition to their strict meanings.

[0018] 1. First embodiment A first embodiment of an image printing system of the present disclosure will be described. As shown in Fig. 1, the image printing system 10 according to the first embodiment mainly comprises a scanner 110, a printer 190, and an information processing device 160, which are communicably connected via a network 200. The network 200 may be a dedicated line, a wired or wireless LAN, a mobile phone line, the Internet, or the like. The configuration of each part of the image printing system 10 will be described below.

[0019] (a) Image printing system configuration (i) Scanner The scanner 110 has a function of irradiating a subject with light and detecting the intensity of the reflected light one-dimensionally or two-dimensionally. The result is converted into a digital value to obtain an input image, which is a planar image corresponding to the subject. Fig. 2(a) is a schematic perspective view for explaining the structure of the scanner 111 of the first embodiment, and Fig. 2(b) is a side view of the scanner 111 of Fig. 2(a) as viewed from the +Y axis direction.

[0020] Here, for convenience of explaining the scanner 111, an XYZ coordinate system is provided. In the scanner 111, an X-axis is provided along the relative movement direction of the line scanner 221 and the mounting table 241, and the side from the line scanner 221 before shooting toward the mounting table 241 is the +X direction side, and the opposite side is the -X direction side. Also, a Y-axis is provided in the width direction of the line scanner 221 perpendicular to the X-axis and the vertical direction, and the side toward the right when looking at the line scanner 221 from the mounting table 241 before shooting is the +Y direction side, and the opposite side is the -Y direction side. Also, a Z-axis is provided in the vertical direction, and the upper side is the +Z direction side, and the lower side is the -Z direction side.

[0021] As shown in Fig. 2(a) and Fig. 2(b), the scanner 111 in the image printing system 10 of the first embodiment includes a light source 120 consisting of an exterior light 121 and an interior light 122, and a line scanner 221 arranged between the light sources 120. The scanner 111 further includes a mounting base 241 for mounting the subject 310, a support base 231 for supporting the mounting base 241, and a housing 211 for surrounding the light sources 120 and the support base 231. In this embodiment, the light source 120 and the line scanner 221 are integrally fixed to a frame (not shown), and when photographing the subject 310, the light source 120 and the line scanner 221 can move in parallel along the X-axis from a position A shown in Fig. 2(b). Then, the light source 120 and the line scanner 221 can move in parallel to a position B directly above the subject 310, and further to a position C past the end of the subject 310.

[0022] The minimum components of scanner 111 are light source 120 and line scanner 221, and it is sufficient that the light source 120 and line scanner 221 simultaneously move in parallel relative to subject 310. In other words, mounting base 241, support base 231, and housing 211 are not necessary as long as these requirements are met.

[0023] The line scanner 221 is an example of the imaging unit 220, and is a line CCD in which CCD elements are arranged along the Y-axis direction. The line scanner 221 converts the intensity of the received reflected light from the subject into digital data of 256 gradations of brightness values ​​in three colors, RGB, for each CCD element along the Y-axis direction and outputs the digital data to the outside. In addition, by translating the line scanner 221 together with the light source 120 at a constant speed along the X-axis, it is possible to output to the outside the intensity data of the reflected light of each part arranged in a matrix corresponding to the entire surface of the subject 310. One square or rectangular section, which is the smallest unit of each part, or the area or length of one side of this section is called one pixel.

[0024] Here, the line scanner 221 can change its inclination with respect to the subject 310 when viewed along the Y-axis direction, as shown in Figures 2(c), (d), and (e), which are enlarged views of the vicinity of the line scanner 221 in Figure 2(b). First, irradiation light Lin11 is incident on the subject 310 from a light source 120 such as a white fluorescent lamp or a white LED light. At this time, when the head of the line scanner 221 is not inclined with respect to the vertical direction perpendicular to the main surface of the mounting table 241 as shown in Figure 3(c), the CCD element of the line scanner 221 can capture reflected light Lout11 in the +Z direction.

[0025] On the other hand, as shown in Fig. 3(d), when the head of the line scanner 221 is tilted at an angle θ1 counterclockwise with respect to the vertical direction, the CCD element of the line scanner 221 can capture Lout12, which is a component tilted at the angle θ1, of the reflected light from the illumination light Lin11 that hits the subject 310. Similarly, as shown in Fig. 3(e), when the head of the line scanner 221 is tilted at an angle θ2 clockwise with respect to the vertical direction, the CCD element of the line scanner 221 can capture Lout13, which is a component tilted at the angle θ2, of the reflected light from the illumination light Lin11.

[0026] In this way, the head of the line scanner 221 can be installed at an angle to the vertical direction, so that the CCD element of the line scanner 221 can capture the light reflected from the subject 310 in an oblique direction. This makes it possible to capture an input image of the subject 310 with the shadow of the three-dimensional subject 310 emphasized, which is effective in obtaining an image with a three-dimensional feel. In this embodiment, the input image of the subject 310 is obtained by translating the line scanner 221 together with the light source 120 at a constant speed along the X-axis. However, the line scanner 221 and the light source 120 may be fixed, and instead the subject 310 side may translate at a constant speed along the X-axis together with the mounting table 241.

[0027] Scanner 111 also has a pair of interior lights 122 as light sources 120 at two locations, the +X direction side and the -X direction side, closer to line scanner 221 when viewed along the X axis. Also, scanner 111 has a pair of exterior lights 121 as light sources 120 at two locations, the +X direction side and the -X direction side, farther from line scanner 221 than interior lights 122. Interior lights 122 and exterior lights 121 are arranged to extend in parallel to line scanner 221 along the Y axis.

[0028] In order to reliably capture the shadows of the three-dimensional subject 310 with the line scanner 221, it is effective to install the head of the line scanner 221 tilted relative to the vertical direction as described above, but it is also effective to change the illumination conditions of a total of four points, namely a pair of interior lights 122 and a pair of exterior lights 121.

[0029] The illumination condition is a selection condition for determining which of the four light sources 120 should be turned on and which should be turned off. The number of adjustable lights of the light source 120 is not limited to four, and the light source 120 may be configured with only a pair of interior or exterior lights, or additional lights may be added. It is preferable that the lights of the light source 120 are arranged in approximately symmetrical positions with the line scanner 221 in between. By changing the illumination condition, it is possible to obtain input images in which the positions at which the shadows of the subject 310 are formed are opposite to each other, and images that emphasize the three-dimensional effect can be synthesized.

[0030] An example of the scanner 111 having the above-mentioned functions is MEGAMACH manufactured by Newly Corporation.

[0031] (ii) Information processing device 1, the information processing device 160 is a personal computer, and includes a control unit 130, a display unit 180, an operation unit 170, a storage unit 150, an editing unit 140, and the like. However, the information processing device 160 may be a personal computer or a smartphone, and the functions of the control unit 130, the storage unit 150, the editing unit 140, and the like described above may be provided on the server side. In this case, the information processing device 160 as a client terminal may be configured to execute the functions of the operation unit 170 and the display unit 180 through application software provided by the server.

[0032] The control unit 130 is illustratively configured with a CPU and an MPU, and performs various controls such as issuing instructions to the scanner 111 to acquire an input image, issuing printing instructions to the printer 190, issuing instructions to store an image edited by the editing unit 140 in the storage unit 150, reading out stored images and data, and other controls such as power supply control. The functions of the control unit 130 may be realized as hardware, or may be realized by executing a program such as an application program.

[0033] The storage unit 150 has a function of storing various data for inputting and outputting image information, setting data, etc., mainly to and from the control unit 130 and the editing unit 140. The storage unit 150 is composed of a ROM, a RAM, and a non-volatile rewritable memory (NVM) such as a flash memory. The ROM stores the BIOS and OS, which are start-up programs for the CPU and the like of the control unit 130, and the RAM is used as a temporary working memory for the CPU and the like. The NVM is used to store image information such as input images and corrected images, various application programs and parameters, and variable information for holding data in various data tables and databases.

[0034] The operation unit 170 is illustratively an input device such as a keyboard, a mouse, a touch pen, a touch panel, etc. With this, the operation unit 170 can instruct the scanner 111 to acquire an input image, display the input image on the display unit 180, edit the image in the editing unit 140, and instruct the printer 190 to print. The operation unit 170 also functions as an input interface to set and change scanning conditions such as the moving speed of the scanner 111 and irradiation conditions of the light source 120.

[0035] The display unit 180 is a display that displays the input image and the corrected image output via the control unit 130 and the editing unit 140, various setting screens, and the like.

[0036] The editing unit 140 has a function of performing image processing such as image synthesis, contour emphasis, contrast adjustment, and saturation adjustment on the input image and the edited image. The editing unit 140 performs these processes based on instructions from the operation unit 170, and displays the results on the display unit 180 via the control unit 130 or stores them in the storage unit 150. The functions of the editing unit 140 may be shared by a CPU or MPU that realizes the functions of the control unit 130 described above, or the editing unit 140 may have a separate engine dedicated to image processing. The functions of the editing unit 140 may be realized as hardware, or may be realized by executing a program such as an application program.

[0037] (iii) Printer The printer 190 is a printing unit in the image printing system 10, and is illustratively an electrostatic printing machine such as an inkjet printer or a laser beam printer, an offset printing machine, a gravure printing machine, etc. The printer 190 is preferably a high-resolution printer capable of reproducing the resolution of the corrected image created by the image printing system 10.

[0038] (b) Operation of the image printing system Next, the operation of the image printing system 10 of the first embodiment will be described mainly with reference to FIGS.

[0039] (i) Acquire input image First, various conditions of the scanner 110 are set. A three-dimensional object 310 is placed on the mounting table 241, the arrangement of the line scanner 221 and the light source 120 is provisionally determined, and an input image corresponding to the object 310 is acquired with various settings set to default values. That is, the line scanner 221 and the light source 120 are translated along the X direction to capture an image corresponding to the object 310. Then, while checking the result on the display unit 180, various conditions for acquiring an optimal input image for the object 310 are set again.

[0040] For example, it is necessary to adjust the exposure amount of the line scanner 221 to an appropriate value so that luminance saturation does not occur in some pixels of the input image. If luminance gradation saturation occurs in a high-luminance part or a low-luminance part of the input image, the contrast of that part of the subject 310 becomes unclear, and the shading information indicated by the shading may become unclear or may even be lost. The shading information refers to the shadow that indicates the three-dimensional element of the subject 310 in the input image, that is, information indicating that it is a shading.

[0041] As a particularly important setting, it is necessary to set the illumination conditions of the light source 120 or the imaging conditions such as the mounting angle of the line scanner 221 to the frame so that the input image of the subject 310 has appropriate shading information (step S601). This is because the input image having appropriate shading information contributes to the final composite image having an effective three-dimensional effect. The illumination conditions and imaging conditions at this time are collectively referred to as the first condition.

[0042] Next, under the above-mentioned first condition, the line scanner 221 is caused to scan, an image corresponding to the subject 310 is captured, and this is acquired as an input image (step S602). The input image is set as a first input image. Specifically, the first input image is stored in the storage unit 150 by an instruction from the control unit 130.

[0043] Next, the illumination conditions and the photographing conditions of the subject 310 are reset to second conditions different from the above-mentioned first conditions (steps S603 and S605). Then, an input image for the subject 310 is acquired again under these conditions (step S602). Here, the second conditions do not simply have to be different from the first conditions. That is, when the input image acquired under the second conditions is used as the second input image, the second input image needs to have different shading information from the first input image. As a result, the first input image and the second input image have different shading information from each other, and therefore, when the shading information of the first input image and the second input image are synthesized, an image having an effective three-dimensional effect that cannot be obtained by normal photographing is obtained.

[0044] As described above, the input image acquisition operation is completed by acquiring two input images having at least two illumination conditions and shooting conditions with different shading information. However, three or more input images may be acquired (step S604). In this case, the operations of steps S605 and S602 described above can be repeated. Note that, although it is preferable that the shading information in all of these three or more input images is different from one another, it is sufficient that the shading information in at least two input images is different from one another.

[0045] (ii) Formation of a flat image including shading information In order to form a planar image including shading information, various image processing such as image synthesis, contour emphasis, contrast adjustment, and saturation adjustment is performed on two or more input images acquired by the scanner 111 using the functions of the editing unit 140. Specifically, an operator uses the display unit 180 and the operation unit 170 as an interface to interactively perform the necessary editing work, i.e., image processing work. Note that in this embodiment, these editing operations are performed using Adobe's Photoshop (registered trademark), which is an existing application program, as a function of the editing unit 140. However, other application programs may be used for editing, and those functions may be realized by hardware.

[0046] First, the scanner 111 performs a process of compositing two or more input images acquired by the scanner 111 in whole or in part so as to include each of the shading information (step S611). For example, compositing a second input image with a first input image means cutting out a part of the second input image into an area of ​​a predetermined shape and replacing it with an area of ​​the same shape as the above-mentioned predetermined shape at any location of the first input image. This can be performed using a layer mask function on Photoshop (registered trademark). Here, when replacing a part of an area excluding the shading information of one input image with a part of an area of ​​another input image of the same shape, it is possible to bring out the three-dimensional effect of the composite image by including the shading information in the part of the other input image. FIG. 5 is a diagram for explaining the composition of images including shading information.

[0047] FIG. 5(a) is a diagram showing an input image 400 corresponding to a subject 310 in which the circular design portion on the left and the triangular design portion on the right protrude in the +Z direction from the background, i.e., in a convex state. In this figure, the design portions are not shaded, and there is no three-dimensional feeling at all. On the other hand, FIG. 5(b) is a diagram showing an input image 401 corresponding to the subject 310 when the light source 120 is placed on the -Y direction side of the subject 310. In this figure, a shadow 510 is formed on the design portions on the +Y direction side opposite the light source 120, giving a three-dimensional feeling.

[0048] FIG. 5(c) is a diagram showing an input image 402 corresponding to the subject 310 when the light source 120 is arranged on the +Y direction side of the subject 310, opposite to FIG. 5(b). In this figure, a shadow 520 is formed on the design part on the -Y direction side opposite to the light source 120, giving a three-dimensional effect. The illumination condition for the subject 310 in FIG. 5(b) is set as a first condition, and the illumination condition for the subject 310 in FIG. 5(c) is set as a second condition. In this case, the arrangement position of the light source 120 in the first condition and the arrangement position of the light source 120 in the second condition are opposite to each other with the subject 310 in between. In other words, the arrangement positions of the light source 120 in both conditions are symmetrical with respect to the XZ plane passing through the subject 310 as viewed from the subject 310.

[0049] The input images 401 and 402 acquired under such conditions are composited so as to include each other's shading information. That is, while leaving the shading information of the input image 401 including the shading information formed by the shading 510, a partial area including the shading information formed by the shading 520 of the input image 402 is replaced with a partial area of ​​the same shape of the input image 401. As a result, as shown in Fig. 5(d), a composite corrected image 420 having shading information formed by the shading 530 on both the -Y direction side and the +Y direction side of the design part, that is, a planar image including shading information, is obtained. Furthermore, it can be outputted to a printer as an output image 440 after undergoing other corrections.

[0050] As described above, as a method for forming shadows in an input image, it is effective to adjust not only the arrangement of the light source 120 but also the inclination of the line scanner 221. For example, as the shooting conditions, a third condition and a fourth condition are determined in which the line scanner 221 is fixed in a state inclined by a predetermined angle along the scanning direction with respect to the normal direction of the main surface of the subject 310 so as to be linearly symmetrical with each other. This also makes it possible to obtain an input image in which the shadows generated on the subject 310 are emphasized in mutually opposite directions, as in the above-mentioned first and second conditions.

[0051] As shown in Fig. 5(d), by forming a corrected image to which shading information is added symmetrically in multiple directions, particularly in the vertical or horizontal directions with respect to linear axes such as the X-axis and Y-axis, a two-dimensional image containing shading information in which the three-dimensional effect of the subject 310 is more emphasized than an image having shading information only in one direction can be obtained. In addition, by combining shading information in oblique directions, the three-dimensional effect can be further emphasized. However, depending on the state of the subject, combining too much shading information may reduce the reality, so the degree of combination must be appropriately adjusted according to the properties of the subject.

[0052] Next, edge enhancement, contrast adjustment, saturation adjustment, etc. are performed (step S612). Edge enhancement is a process for enhancing the edges of each part of the subject 310 in the input image. A part in an image where the difference in luminance between adjacent pixels is equal to or greater than a predetermined value is regarded as an edge, and the luminance difference in a certain area part on the outside and inside of the edge is expanded. In Photoshop (registered trademark), this process is performed by setting a parameter for the radius of the unsharp mask used in the edge enhancement process.

[0053] Here, the image correction for obtaining a flat image including shading information will be described with reference to FIG. 6, and the editing process of these images will be described. FIG. 6(a) is an original input image 408. The level correction function of Photoshop (registered trademark) is used to correct the levels of the highlight and shadow parts of the input image 408. Similarly, the hue and saturation can be appropriately adjusted while displaying the image. The image thus corrected for contrast, saturation, etc. is the corrected image 421 shown in FIG. 6(b). FIG. 6(c) shows a histogram of the luminance distribution, which is the input level in FIG. 6(b), and FIG. 6(d) shows the output level with the contrast range expanded from level 0 to 255.

[0054] In order to obtain a planar image including shading information, it is particularly preferable to further perform edge enhancement on the corrected image 421 of FIG. 6(b) using an unsharp mask set to 1.0 pixel or less, as shown in FIG. 6(c). By setting within this range, edge enhancement can be performed while reproducing as faithfully as possible the shadows caused by the minute unevenness of the subject 310. FIG. 6(c) is a diagram showing a corrected image 422 in which edge enhancement has been performed using an unsharp mask with a radius of 0.5 pixel. In this way, the input image 408 of FIG. 6(a) can be finished into the corrected image 422 as a planar image including shading information with adjusted edge, unevenness, and color tone through edge enhancement, contrast adjustment, saturation adjustment, etc. Note that other corrections may be added as appropriate.

[0055] This allows the printer 190 to print a corrected image that has been obtained by combining all or part of two or more input images and performing various corrections such as contour emphasis (step S613). Printing by the printer 190 is performed when the editing unit 140 or the control unit 130 transmits a print instruction signal to the printer 190 based on an input from the operation unit 170.

[0056] As described above, the image printing system 10 of the first embodiment includes a scanner 111 including a light source 120 that irradiates light onto a three-dimensional object 310, and a line scanner 221 that is an image capturing unit 220 that captures light reflected by the object 310 as an input image. The image printing system 10 further includes an editing unit 140 that corrects the input image captured by the line scanner 221 to create a corrected image that is a two-dimensional image that includes shading information, and a printer 190 that prints the corrected image. The corrected image is a composite of a first input image that includes first shading information as shading information, and a second input image that includes second shading information different from the first shading information. This makes it possible to print a two-dimensional image that includes shading information in which the three-dimensional effect of the object 310 is more emphasized than when a single input image that simply has shading information in only one direction is printed.

[0057] Therefore, it is possible to print a flat image with a three-dimensional effect close to that of the original three-dimensional subject, and it is possible to express a three-dimensional effect close to that of a three-dimensional sample even though it is a flat image. This improves the advertising effect of flyers, pamphlets, etc. Furthermore, as a final output product, it is now possible to mass-produce three-dimensional products that have been difficult to mass-produce, even though they have been able to be produced in prototypes or small lots, with a nearly identical appearance.

[0058] 2. Second embodiment Next, a second embodiment of the image printing system of the present disclosure will be described. The image printing system 11 according to the second embodiment has a similar system configuration to the image printing system 10 according to the first embodiment, as shown in Fig. 1. The only difference between the two systems is the configuration of the scanner 110, so this point will be mainly described.

[0059] (a) Scanner configuration Fig. 7(a) is a schematic perspective view illustrating the structure of scanner 112 according to the second embodiment, and Fig. 7(b) is a side view of scanner 112 in Fig. 7(a) as viewed from the +Y axis direction. For convenience of explanation, an XYZ coordinate system similar to that set for scanner 111 is also set for scanner 112.

[0060] As shown in Fig. 7(a) and Fig. 7(b), the scanner 112 in the image printing system 11 of the second embodiment includes a light source 120 consisting of an exterior light 123 and an interior light 124 arranged in a rectangle, and a single-lens reflex camera 222 arranged between the light sources 120. The scanner 112 further includes a mounting base 242 for mounting the subject 310, a support base 232 for supporting the mounting base 242, and a housing 212 surrounding them. In this embodiment, the light source 120 and the single-lens reflex camera 222 are fixed integrally to a frame (not shown), and the light source 120, the single-lens reflex camera 222, and the mounting base 242 do not move even when the subject 310 is photographed. This point differs from the scanner 111 of the first embodiment.

[0061] The minimum components of the scanner 112 are the light source 120 and the single-lens reflex camera 222, and the mounting base 242, the support base 232, and the housing 212 are not required.

[0062] The single-lens reflex camera 222 is an example of the photographing unit 220, and is a two-dimensional CCD in which CCD elements are arranged in a matrix on the XY plane. Therefore, in this embodiment, the photographing unit 220 does not need to scan in one direction to acquire an input image. Even in this case, the single-lens reflex camera 222 can convert the intensity of the reflected light received from the subject into digital data of 256 gradations of brightness values ​​of the three colors, RGB, for each CCD element arranged along the XY plane and output the digital data to the outside.

[0063] The mounting angle of the single-lens reflex camera 222 cannot be changed in the scanner 112, and only the illumination condition of which light of the light source 120 is selectively turned on can be changed arbitrarily. That is, by selecting an illumination pattern of a total of eight lights, consisting of outdoor lights 123 and indoor lights 124, each of which has four lights arranged in a rectangle, it is possible to obtain a plurality of input images with different shading information. As shown in FIG. 7(b), the incident angle of the light from the light source 120 to the subject 310 when viewed along the Y-axis direction is different between the outdoor light 123 and the indoor light 124. The illumination light Lin21 of the outdoor light 123 is incident from a point at a lower height than that of the indoor light 124, and therefore tends to relatively emphasize the shadow of the subject 310.

[0064] In this way, the scanner 112 can mainly change only the illumination conditions, and by selecting which of the eight exterior lights 123 and interior lights 124 of the light source 120 to turn on and which to turn off, it is possible to obtain multiple input images containing different shading information.

[0065] For example, Figures 8 and 9 show comparative display of the lighting conditions of the light source 120 and the input image acquired under those conditions in the scanner 112. Figure 8(a) shows only the arrangement of the light source 120 as seen from the +Z direction in Figure 7(a), and shows that a total of two lights are on: one hatched outdoor light 123 on the -X direction side and one hatched indoor light 124 on the -X direction side. As a result, as shown in Figure 8(b), an input image 403 obtained by photographing embossed paper with an uneven surface as a subject has shadow information on the +X direction side.

[0066] On the other hand, Fig. 8(c) shows that a total of four lights are on: one on the -X direction side and one on the -Y direction side of outdoor light 123, and one on the -X direction side and one on the -Y direction side of indoor light 124. As a result, as shown in Fig. 8(d), input image 404 obtained for embossed paper has shadow information on the +X direction side and the +Y direction side.

[0067] 9(b) and 9(d) are input images of Japanese paper, and FIG. 9(a) shows that a total of two lights are on: one on the -X direction side of outdoor light 123 and one on the -X direction side of indoor light 124. As a result, as shown in FIG. 9(b), input image 405 obtained for Japanese paper has shadow information on the +X direction side, but the shadows are not as emphasized as in the above-mentioned embossed paper.

[0068] FIG. 9(c) shows that a total of four lights are on, including one outdoor light 123 on the -X side and one indoor light 124 on the -Y side. FIG. 9(e) shows that a total of eight outdoor lights 123 and indoor lights 124 are on. As a result, input image 406 in FIG. 9(d) corresponding to the condition in FIG. 9(c) has shading information on the +X and +Y sides. Input image 407 in FIG. 9(f) corresponding to the condition in FIG. 9(e) is effective in that it has few shadings but makes the lines of the Japanese paper stand out clearly. In this way, shading needs to be devised depending on the material of the subject and the content to be emphasized.

[0069] An example of the scanner 112 having the above-mentioned functions is the Surf3D manufactured by Metis. (b) Operation of the image printing system The operation and function of the image printing system 11 of the second embodiment are similar to those of the image printing system 10 of the first embodiment described above, and therefore a description thereof will be omitted.

[0070] 3. Target subject The subject to which the image printing system of the present disclosure is applied is preferably a three-dimensional object to the extent that the input image acquired by the scanner 110 contains shading information consisting of some kind of shading. This is because the input image and corrected image need to have shading information in order to impart a three-dimensional effect to a printed two-dimensional image. However, if the depth difference from the outermost surface, i.e., the amount of recession, is too large, it becomes difficult to input and edit the image, so it is preferable that the depth of the unevenness of the subject from the outermost surface is approximately 50 mm or less.

[0071] Here, a three-dimensional object is not necessarily defined only by the degree of physical depth from the outermost surface of the subject, but also includes objects such as an envelope, part of whose outside is covered with a transparent film and whose contents are placed deeper inside. In other words, even if there is little unevenness between the envelope surface and the transparent film surface, if the surface of the contents seen through the transparent film is significantly recessed relative to the envelope surface, the entire object can be considered a three-dimensional subject.

[0072] The subject to which the image printing system of the present disclosure is applied may be a single material such as embossed paper or Japanese paper as exemplified in FIG. 8 or FIG. 9, or a printed object. However, it may also be a combination of an envelope with a transparent or semi-transparent film as described above and a content part of which can be seen through the film. In other words, it is preferable for the subject to be configured such that a first object and a second object having different materials or colors are overlapped, and a part of the second object can be seen through the opening of the first object. This is because such a subject requires a higher load to actually create a three-dimensional sample such as a flyer or pamphlet than a normal subject, and it is more effective to make it into a flat image containing shading information that can express a three-dimensional effect close to that of a three-dimensional sample.

[0073] FIG. 10 shows three types of output images as examples of output images obtained by acquiring such an object as an input image using the image printing system of the present disclosure, editing the input image, and printing the output image. However, it goes without saying that the object suitable for application of the image printing system of the present disclosure is not limited to those corresponding to these output images. FIG. 10(a) is a diagram showing an output image 450 printed for an object of mail in which the contents can be partially seen. The output image 450 includes an envelope corresponding portion 451 corresponding to the outer envelope, a transparent window corresponding portion 452 corresponding to the transparent window in the center with a substantially rectangular transparent film attached thereto, and a contents corresponding portion 453 corresponding to the contents that can be seen through the transparent window.

[0074] In such a subject, it is necessary to extract the shadow caused by the difference in depth between the envelope and the contents as the shadow information formed in the envelope corresponding portion 451 and the contents corresponding portion 453. For this reason, it is more important to appropriately select the light irradiation conditions of the scanner 111 and the shooting conditions of the shooting unit 220. The multiple input images obtained in this manner can be printed as a flat image containing three-dimensional shadow information by image editing as described above. Note that the transparent film in this case does not need to be completely transparent, and may be cloudy glassine paper or a colored transparent film.

[0075] FIG. 10(b) is a diagram showing an output image assembly 460 in which a printed output image is assembled as a development view to approximate an actual box, for a subject that is a box of a three-dimensional object in which the contents can be partially seen. The output image assembly 460 includes a box-corresponding portion 461 corresponding to the outer box, a transparent window-corresponding portion 462 corresponding to a transparent window in the center with a substantially rectangular transparent film attached, and a contents-corresponding portion 463 corresponding to the contents that can be seen through the transparent window. In this way, instead of treating the output image only as a two-dimensional image, it is also possible to assemble the output image as a three-dimensional object as a development view. This makes it possible to further emphasize the three-dimensional effect of the overlapping portion of the first object and the second object having different materials or colors, which is a two-dimensional image portion containing shading information.

[0076] 10(c) is a diagram showing an output image 470 printed on a subject in which the front and back paper materials have different materials or colors and are partially overlapping. A cutout pattern is formed in a portion of the front paper material, and the back paper material can be seen through the cutout portion. The output image 470 includes a front-side paper material corresponding portion 471 corresponding to the front paper material, a back-side paper material corresponding portion 472 corresponding to the back paper material, and a cutout corresponding portion 473 corresponding to the portion where the cutout is formed.

[0077] 10(a), it is necessary to extract the shadow caused by the difference in depth between the box and the contents, or the shadow caused by the difference in depth between the paper material on the front side and the paper material on the back side as the shadow information of the input image for the output images 460 and 470. This makes it possible to edit and print a development of a flat image including shadow information with a three-dimensional feel, or a flat image including shadow information.

[0078] The control processing and other processing of the information processing device according to each embodiment of the present disclosure described above can also be achieved by the information processing device reading and executing the program code constituting the software for realizing each function of the embodiment. Therefore, the program code itself and the storage medium on which the program code is recorded also constitute the present disclosure. Examples of the storage medium on which the program code is recorded include, but are not limited to, a hard disk, a USB memory, an SD (registered trademark) card, a CD-ROM, a CD-R, and an IC card. [Explanation of symbols]

[0079] 10, 11 Image printing system 110, 111, 112 Scanner 120 light source 121, 123 Outdoor lights 122, 124 interior light 130 Control section 140 Editorial Department 150 Storage section 160 Information processing equipment 170 Operation section 180 Display section 190 Printers 200 Network 211, 212 Case 220 Photography Department 221 Line Scanner 222 SLR camera 231, 232 Support stand 241, 242 Mounting table 310 Subject 400, 401, 402, 403, 404, 405, 406, 407, 408 Input image 420, 421, 422 Corrected images 440, 450, 460, 470 Output Image 451 Envelope-compatible section 452 Transparent window corresponding part 453 Contents Corresponding Part 453a Text section 460 Output Image Assembly 461 Box Corresponding Part 462 Transparent window corresponding part 463 Contents Corresponding Part 471 Front side paper compatible part 472 Back side paper material corresponding part 473 Cutout Corresponding Part 510, 520, 530 shading

Claims

1. An image printing system for printing a two-dimensional image including shading information corresponding to a three-dimensional subject, comprising: a light source that irradiates the three-dimensional subject with light; an image capturing unit that captures light reflected by the three-dimensional object as an input image including shading information; an editing unit that corrects the input image acquired by the photographing unit to create a corrected image that is a planar image with a three-dimensional effect; a printing unit that prints the corrected image. an image printing system, characterized in that the corrected image is synthesized from a first input image including first shading information as shading information and a second input image including second shading information different from the first shading information, by replacing a first partial area of ​​the first input image excluding the shading information with a partial area of ​​the second input image having the same shape as the first partial area, into a flat image including shading information with a three-dimensional feel.

2. 2. The image printing system according to claim 1, wherein the first input image and the second input image are acquired by the photographing unit under different illumination conditions of the light source for the three-dimensional subject or different photographing conditions of the photographing unit.

3. 3. The image printing system according to claim 2, wherein the photographing condition is a state in which the photographing units are inclined at a predetermined angle to be line-symmetrical with respect to a normal direction of a main surface of the three-dimensional subject.

4. 4. The image printing system according to claim 1, wherein the corrected image is corrected by setting a radius of an unsharp mask to 1.0 pixel or less.

5. The three-dimensional subject is configured by overlapping a first object and a second object having different materials or colors, The image printing system of claim 1 , wherein a portion of the second article is visible through an opening in the first article.

6. A method for manufacturing an image for printing a two-dimensional image including shading information corresponding to a three-dimensional subject, comprising the steps of: irradiating the three-dimensional object with light from a light source; acquiring, by an imaging unit, light reflected by the three-dimensional object as an input image including shadow information; an editing process for correcting the input image acquired by the photographing unit to create a corrected image which is a planar image having a three-dimensional effect; and printing the corrected image. a first input image including first shading information as shading information, and a second input image including second shading information different from the first shading information, the first input image including first shading information and second shading information different from the first shading information being replaced with a partial area of ​​the second input image having the same shape as the first partial area, to synthesize the corrected image into a planar image including shading information with a three-dimensional effect.

7. A program for causing a computer to realize the production of an image by printing a two-dimensional image including shading information corresponding to a three-dimensional subject, comprising: A function of irradiating the three-dimensional subject with light from a light source; a function of acquiring light reflected by the three-dimensional object as an input image including shading information by an imaging unit; an editing function for correcting the input image acquired by the photographing unit to create a corrected image which is a planar image having a three-dimensional effect; a printing function for printing the corrected image, the correction image is synthesized from a first input image including first shading information as shading information and a second input image including second shading information different from the first shading information, by replacing a first partial area of ​​the first input image excluding the shading information with a partial area of ​​the second input image having the same shape as the first partial area, into a planar image including shading information with a three-dimensional feel.

Citation Information

Patent Citations

  • Multi-angle scanner

    JP2009182995A

  • Image processing apparatus and image processing method, print manufacturing apparatus and print manufacturing method, image processing program, and printed material

    JP2014011505A

  • Windowed envelope

    JP2014162507A

  • Image reading device

    JP2020120230A

  • JPP6708862B