Information processing device, image forming system, information processing method, and program

The information processing device optimizes image division by considering image and medium information to avoid unwanted boundaries, ensuring high image quality during multi-region printing.

JP7844943B2Active Publication Date: 2026-04-14RICOH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
RICOH CO LTD
Filing Date
2022-03-09
Publication Date
2026-04-14

AI Technical Summary

Technical Problem

Conventional image division methods for images larger than the maximum image forming range of an apparatus can result in undesirable divisions, affecting image quality by creating noticeable boundaries, especially around important image elements like human faces.

Method used

An information processing device that communicates with an image forming apparatus to receive position and medium information, and sets image division positions based on this data to avoid boundaries on specific images, using evaluation metrics to determine optimal division points.

Benefits of technology

Ensures high image quality by avoiding unwanted boundaries during multi-region image formation, even when the image exceeds the maximum forming range of the apparatus.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007844943000001
    Figure 0007844943000001
  • Figure 0007844943000002
    Figure 0007844943000002
  • Figure 0007844943000003
    Figure 0007844943000003
Patent Text Reader

Abstract

To solve a problem in which in a conventional technique, when performing image formation by dividing an image having an image formation range larger than the maximum image formation range of an image forming apparatus into a plurality of areas, dividing the image without considering the details of the image may divide the image at a position where the image is not intended to be divided, which consequently affects image quality.SOLUTION: An information processing apparatus 3 receives position information on an image forming apparatus 5 and medium information transmitted by the image forming apparatus (step S13). The information processing apparatus receives input of image division information for dividing an image larger than the maximum image formation range in which the image forming apparatus 5 can perform image formation into a plurality of areas (step S22), and sets image division position information that is set based on the position information on the image forming apparatus 5, the medium information, and the image division information, and is for dividing the image into a plurality of areas so that the boundaries of the plurality of areas after the division are not present on a specific image (step S23).SELECTED DRAWING: Figure 19
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an image forming system, an information processing method, and a program.

Background Art

[0002] There is known a technique of dividing an image having a printing range exceeding the printing range that can be printed at one time, and printing it on a printing medium such as paper using a printing method such as an inkjet method.

[0003] As one of them, when performing printing across a plurality of sheets, there is known a technique of reducing density unevenness at a boundary portion by changing the printing width in the sub-scanning direction in consideration of the position of an object (see, for example, Patent Document 1).

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the conventional technology, when dividing an image having an image forming range larger than the maximum image forming range of an image forming apparatus into a plurality of regions for image formation, the image may be divided at a position where it is not desired to be divided by dividing without considering the content of the image. As a result, there has been a problem that the image quality is affected.

Means for Solving the Problems

[0005] To solve the above-mentioned problems, the invention according to claim 1 provides an information processing device that can communicate with an image forming apparatus that forms an image on an image forming medium, comprising: receiving means for receiving position information indicating the position of the image forming apparatus and medium information relating to the image forming medium transmitted by the image forming apparatus; receiving means for receiving input of image division information for dividing an image larger than the maximum image forming range that the image forming apparatus can form into a plurality of regions; and setting means for setting image division position information which is set based on the position information, the medium information and the image division information, and for dividing the plurality of regions into a plurality of regions where the boundaries of the divided regions do not exist on a particular image. [Effects of the Invention]

[0006] As described above, the present invention has the effect of ensuring image quality even when an image having an image forming range larger than the maximum image forming range of an image forming apparatus is divided into multiple regions for image forming. [Brief explanation of the drawing]

[0007] [Figure 1] (a) is a conceptual diagram showing an example of dividing an image without considering specific images contained within it. (b) is a conceptual diagram showing an example of dividing an image while considering specific images contained within it. [Figure 2] This is a conceptual diagram showing an example of an evaluation value defined for each pixel in an image, and an example of a division position. [Figure 3] (a) is a conceptual diagram showing an example of an image containing faces of people and text of different sizes. (b) is a conceptual diagram showing an example of calculating evaluation values ​​for each pixel from an image containing faces of people and text of different sizes. [Figure 4] (a) is a conceptual diagram showing an example of an image containing faces of people and text of different sizes. (b) is a conceptual diagram showing an example of changing evaluation values ​​according to the size of a specific image. [Figure 5](a) is a diagram showing an example of the change in density of the original image. (b) is a diagram showing an example of the relationship between the change in density and the horizontal position. (c) is a conceptual diagram showing an example of the distribution of evaluation values ​​corresponding to the original image. [Figure 6] This is a conceptual diagram illustrating an example of a method for combining multiple segmented evaluation indices after calculation. [Figure 7] This is a conceptual diagram illustrating an example of complementary relationships in gradient processing. [Figure 8] This is a conceptual diagram illustrating an example of a method for combining multiple segmented evaluation indices after calculation. [Figure 9] This figure shows an example of the external appearance of an image forming apparatus. [Figure 10] (a) is a diagram showing an example of an image forming mechanism using an inkjet method. (b) is a diagram showing an example of the arrangement of a head module in an inkjet method. [Figure 11] This figure shows an example of the overall configuration of an image forming system. [Figure 12] This figure shows an example of the hardware configuration of an information processing device. [Figure 13] This figure shows an example of the hardware configuration of an image forming apparatus. [Figure 14] This figure shows an example of the functional configuration of an image forming system. [Figure 15] This is a conceptual diagram showing an example of an image formation information management table. [Figure 16] This is a conceptual diagram showing an example of an evaluation value management table. [Figure 17] This is a conceptual diagram showing an example of a division position information management table. [Figure 18] This is a sequence diagram showing an example of the process for acquiring location and media information. [Figure 19] This is a sequence diagram showing an example of a process that includes setting the division position and image formation. [Figure 20] This is an example of a display screen for an information processing device that accepts input for image size and evaluation value. [Figure 21]This is an example of a display screen when accepting a designation of a non-divisible area in an information processing apparatus. [Figure 22] This is an example of a display screen when accepting an input of the maximum number of divisions in an information processing apparatus. [Figure 23] This is a flowchart showing an example of a division position setting process. [Figure 24] This is a flowchart showing another example of a division position setting process.

Embodiment for Carrying Out the Invention

[0008] Hereinafter, embodiments for carrying out the invention will be described with reference to the drawings. In the description of the drawings, the same reference numerals are assigned to the same elements, and the description of overlapping parts will be omitted.

[0009] 〔Embodiment〕 <Image Division> In this embodiment, consider as an example a case where an image forming apparatus that prints an image by an inkjet method prints an image larger than the maximum image forming range that the apparatus can form on an image forming medium. In such a case, the image to be printed is divided into a plurality of regions, printing is executed for each of the divided regions, and this is repeated to print the entire image. Therefore, first, a method for dividing the image formed on the image forming medium will be described. FIG. 1(a) is a conceptual diagram showing an example of a case where an image is divided without considering a specific image included in the image. When such division is performed, a boundary of the divided region exists from the ear to the mouth of the face of a person, which is an example of a specific image. As a result, streaks due to the boundary are likely to be conspicuous in a relatively uniform region with little change in density such as the cheek (a region with little density change from the surroundings). Furthermore, since a person's face, characters, etc. tend to attract people's attention as objects, streaks due to the boundary are likely to be recognized.

[0010] Therefore, the method of dividing an image while avoiding a human face or the like is shown in Fig. 1(b). Fig. 1(b) is a conceptual diagram showing an example of the case where an image is divided in consideration of a specific image included in the image. In such a case, since the division of the image is such that the position of the human face is avoided as a boundary based on the image information, it can be expected that the streaks will be relatively less conspicuous.

[0011] In this embodiment, the "image forming medium" includes planar media composed of paper, wood, metal, and plastic, the outer wall surfaces of structures, the road surfaces of roads, the floor surfaces of buildings, and the like.

[0012] In this embodiment, the "image" refers to those including patterns, characters, and images in general. Also, in this embodiment, the "resolution" includes the degree of the amount of paint sprayed in an image forming method such as spraying for coating, painting, etc. Furthermore, in this embodiment, "image formation" includes printing on an image forming medium by an inkjet method or the like. For the sake of convenience in explanation, the term "printing" may be used hereinafter in this embodiment.

[0013] Also in this embodiment, the specific image includes a portrait (face), an animal, a font, a pattern, etc. formed (printed) on the image forming medium.

[0014] Also in this embodiment, the "structure" refers to a structure that is above the line of sight, that is, a structure for which an elevation angle occurs. Structures include, for example, buildings (as an example, a building), warehouses, houses, columnar and plate-shaped buildings, natural rocks, quay walls, and other structures in general. Also, the structure has at least one or more surfaces, and the surfaces may be flat or may be curved surfaces having a predetermined curvature. Examples of structures having a predetermined curvature include the loading platform of a truck, the fuselage of an aircraft, and the like.

[0015] <Determination of the Image Division Position> Next, we will explain how to determine the division position of the image. In this embodiment, we will explain a method for determining the division position of the image, which takes image data showing the image to be formed (printed), a division evaluation index described later, and evaluation value calculation data described later as inputs, and outputs the division position of the image.

[0016] <<Segmented Evaluation Indicators>> A segmentation evaluation index is a method of calculating a numerical value (hereinafter referred to as the "evaluation value") for each pixel of an image that is the subject of image formation, such as printing, indicating the degree to which that pixel should not be selected as a boundary value. One example of a segmentation evaluation index is one that specifies the type of object detected in the image (such as a person's face) and the evaluation value for each object.

[0017] <<Data for calculating evaluation value>> The data used for calculating the evaluation value is the data necessary to calculate the evaluation value based on the division evaluation index described above. For example, when calculating the evaluation value based on image data, it is not necessary to specify this data separately. On the other hand, when calculating the evaluation value based on the smoothness of the image, it is necessary to input the smoothness of the image separately as data for calculating the evaluation value. This corresponds to the data used for calculating the evaluation value. The above is one example of how to calculate the evaluation value for each pixel. Next, we consider a method in which a threshold value that is acceptable for boundary values ​​is determined, and pixels with values ​​smaller than that threshold are allowed to be boundary values.

[0018] Figure 2 is a conceptual diagram showing an example of an evaluation value defined for each pixel of an image and an example of a division position. In Figure 2, if the threshold is set to 80, divisions (1) and (3) are allowed, but division (2) is not. On the other hand, if the threshold is set to 40, only division (3) is allowed. In other words, the condition for allowing image division is that the evaluation value is smaller than the set threshold for that region. The specific method for determining the division position will be explained in detail in the image division position setting process.

[0019] <Object types and evaluation values> Next, we will explain the types of objects and their evaluation values. Figure 3(a) is a conceptual diagram showing an example of an image containing human faces of different sizes and text. In Figure 3(a), a fixed evaluation value is assigned to each object, but it is also possible to assign formulas to calculate evaluation values ​​for each location within each object. Figure 3(b) is a conceptual diagram showing an example of calculating evaluation values ​​for each pixel from an image containing human faces of different sizes and text. In Figure 3(b), an evaluation value of 90 is assigned to the human faces, and an evaluation value of 50 is assigned to the text. Furthermore, an evaluation value of 0 is assigned to the other parts, and the boundaries of the divided regions are determined based on these evaluation values.

[0020] Figure 4(a) is a conceptual diagram showing an example of an image containing faces of people and text of different sizes. Figure 4(a) is similar to the case of Figure 3(a). On the other hand, Figure 4(b) is a conceptual diagram showing an example of changing the evaluation value according to the size of a particular image. In Figure 4(b), for example, the evaluation value may also be changed according to the size (e.g., diameter) of a person's face, as shown below. • If the size is 100 or less, then 10 • If the size is 100 or more, then 90 Furthermore, if the object is text or similar, the evaluation value may be set to 50. In this way, even for objects of the same type, varying the evaluation value based on their size makes it possible to more flexibly set the division area for the desired image.

[0021] <Image density changes as a segmentation evaluation index> Figure 5(a) shows an example of density change in the original image. Figure 5(a) shows an example of considering density change in the image as a division evaluation index. Figure 5(b) shows an example of the relationship between density change and lateral position. As shown in Figure 5(b), in this case, the density change is calculated for the lateral direction of the image, corresponding to the original image in Figure 5(a). Figure 5(c) is a conceptual diagram showing an example of the distribution of evaluation values ​​corresponding to the original image. As shown in Figure 5(c), the evaluation value is high in areas with low density change. In this case, the density change is calculated only for the lateral direction of the image, but there are several ways to calculate the change. For example, methods such as forward difference, backward difference, and central difference can be considered. Note that, as shown in Figure 5(b), the density change graph can also be interpreted as smoothness. In other words, in areas where the surface of the image-forming medium is rough (areas with high density change), even if streaks occur, they are difficult for the human eye to perceive.

[0022] <Overlay of each evaluation value> Figure 6 is a conceptual diagram illustrating an example of a method for combining results after calculation using multiple segmented evaluation indices. As shown in Figure 6, when using multiple evaluation indices as segmented evaluation indices, consider the case where two indices are used: one that avoids faces and another that avoids areas of high smoothness in the image-forming medium. In this case, first, evaluation values ​​are calculated for each segmented evaluation indice, and the overall evaluation value is defined by adding these values ​​together. While Figure 6 simply adds the evaluation values ​​together, the values ​​may be normalized so that the maximum evaluation value remains constant. Furthermore, weighting may be applied when adding the evaluation values ​​together. By weighting the evaluation values, priority may be given to the evaluation values. For example, 1. Do not divide the image on a person's face (areas where the density is constant or changes in density are minimal). 2. If the smoothness of the image-forming medium is higher than a predetermined threshold, the image will not be divided. In cases like these, one possible approach is to increase the weight of 1. and add them together.

[0023] Furthermore, if there is only one evaluation metric for splitting, splitting is not performed in the region where the evaluation value would be maximized. However, as shown in Figure 6, multiple evaluation values ​​are weighted and added together (combined), and in this case, the summed evaluation value will not generally reach its maximum value. This is because, for example, two evaluation metrics are often independent of each other. Therefore, this problem can be solved by specifying a region that is never selected regardless of the evaluation value. One way to implement this is to allow specifying a value such as +inf (positive infinity) as the evaluation value, thereby specifying that the region will not be split regardless of the values ​​of other evaluation metrics.

[0024] Furthermore, a mode may be implemented that prohibits the use of a boundary regardless of the values ​​of other indicators. In this way, it is possible to define a region that is not always designated as a boundary, regardless of the weighting.

[0025] <Interpolation in gradient processing> Next, we will explain interpolation processing in gradient processing. Figure 7 is a conceptual diagram showing an example of an interpolation relationship in gradient processing. Gradient processing is one image processing method used to make the boundaries between different printing modes less visible. This gradient processing involves overlapping the images of the boundary areas that occur at the boundary between different printing modes by a certain distance, so that the images in both printing modes become complementary. Specifically, the further away from the boundary between printing modes, the greater the amount of ink to print (for example, the amount of ink ejected during printing). The interpolation relationship means that areas printed with one image are not printed with the other image. This is expected to have the effect of making the boundary lines that occur at the boundary less noticeable.

[0026] <Gradient processing on the boundaries of divided regions> Figure 8 is a conceptual diagram showing an example of a method for combining images after calculation using multiple division evaluation indices. As shown in Figure 8, when dividing an image into multiple division regions, consider a method of division where adjacent division regions have a common area (common region) at their boundaries. In this case, for example, the thick lines in Figure 8 are assumed to be included in any of the division regions that are adjacent to each other. Specifically, region A and region B each include region A' and region B' as common areas. Each dot (each pixel) in region A'B' is determined on a dot-by-dot basis, either when printing region A' or when printing region B'. Various methods can be considered for this determination, including the method of applying a gradient as described above. This is expected to reduce the impact on the image even when misalignment of the landing position of image-forming agents such as ink occurs. Note that Figure 8 shows the case where there is a common area between two regions, but the same applies when there are two or more common areas. By adopting such a method, it becomes possible to suppress the occurrence of image defects by having division regions have a common area and applying processing such as a gradient to it.

[0027] <Exterior view of the image forming apparatus> Next, the appearance of the image forming apparatus will be described. Figure 9 shows an example of the appearance of an image forming apparatus. In the example shown in Figure 9, the image forming apparatus 5 is an apparatus used when printing on the ground G (road surface) as an example of an image forming medium M (hereinafter sometimes simply referred to as the image forming medium). In this case, the image forming apparatus 5 is towed by a vehicle, trolley, or other mobile body and moves on the ground G (road surface). Alternatively, the image forming apparatus 5 itself may be equipped with a mobile body and be self-propelled. Furthermore, the image forming apparatus 5 is equipped with a position detection camera C to determine the current position of the apparatus. With this configuration, the image forming apparatus 5 has the function of obtaining position information of the image forming apparatus 5 by photographing the ground G with the position detection camera C and detecting where the current position of the apparatus corresponds to the image to be printed. Note that although the ground G (road surface) is shown as an example of an image forming medium in Figure 9, for example, the wall surface of a building or other structure may be used as the image forming medium.

[0028] <Image forming mechanism of an image forming apparatus> Next, the image forming mechanism of the image forming apparatus will be described. Figure 10(a) shows an example of an inkjet-based image forming mechanism. In Figure 10(a), the head (recording head or print head) provided in the image forming apparatus 5 is configured to move on the image forming medium M in the main scanning direction (X direction) and the sub-scanning direction (Y direction). As a result, the image forming apparatus 5 ejects dot-shaped ink or paint, which serves as an image forming agent, from multiple nozzles provided in the head (recording head or print head) toward the image forming medium M. At this time, the image forming apparatus 5 can form an image in one go up to the maximum image forming range that can be formed. Furthermore, if the image to be formed on the image forming medium M is larger than the maximum image forming range, the image forming apparatus 5 divides the image forming range below the maximum image forming range into separate regions and forms an image for each of these divided regions. By repeating this image formation for each divided region, the image forming apparatus 5 can print images that exceed the maximum image forming range that can be formed as a single image on the image forming medium M.

[0029] Figure 10(b) shows an example of the arrangement of a head module in an inkjet system. As shown in Figure 10(b), the printing unit 560 includes inkjet heads 581C, 581K, 581M, 581Y, a head holder, and a head gap adjustment unit.

[0030] The inkjet heads 581C, 581K, 581M, and 581Y eject cyan (C), black (K), magenta (M), and yellow (Y) inks, respectively. The inkjet heads 581C, 581K, 581M, and 581Y are arranged in parallel in the left-right direction above the transport unit. By overlapping the ink of each color onto the same pixel from the inkjet heads 581C, 581K, 581M, and 581Y, various colors can be formed. The inkjet heads 581C, 581K, 581M, and 581Y are line-type inkjet heads and each has six head modules 580.

[0031] The head module 580 has multiple nozzles and ejects ink from the nozzles. The multiple nozzles of the head module 580 are arranged in the front-to-back direction (main scanning direction) perpendicular to the transport direction (sub-scanning direction) of the printing medium 552 at a predetermined nozzle pitch. In each inkjet head 581C, 581K, 581M, 581Y, the six head modules 570 are arranged in a staggered pattern along the front-to-back direction. That is, the six head modules 570 are arranged along the front-to-back direction and are positioned with alternating left-to-right shifts. The head module 580 can change the number of ink droplets (drop count) ejected from one nozzle to one pixel, and performs printing that expresses density by the number of drops. For the sake of explanation in this embodiment, the head module 580 and the inkjet heads 581C, 581K, 581M, 581Y are collectively referred to as the recording head unit 516, which will be described later.

[0032] In the image formation process described above, the image forming apparatus 5 may use, as the image forming agent, an ink with a viscosity of a predetermined value or higher, or a powder toner (a mixture of powder toner and adhesive) that adheres to the outer wall, etc., in order to prevent the ink or other material dispensed onto the outer wall, etc., from dripping down. This makes it possible to eliminate the influence of the image forming agent on image quality during image formation.

[0033] [Overall configuration of the image forming system] Figure 11 shows an example of the overall configuration of an image forming system. As shown in Figure 11, the image forming system 1 includes an information processing device 3 and an image forming apparatus 5. In the image forming system 1, the information processing device 3 and the image forming apparatus 5 are connected to each other via a communication network 100.

[0034] The communication network 100 is a communication network where an unspecified number of communications take place, and is constructed using the Internet, an intranet, a LAN (Local Area Network), etc. The communication network 100 may include not only wired communication but also wireless communication networks such as 4G (4th Generation), 5G (5th Generation), WiMAX (Worldwide Interoperability for Microwave Access), and LTE (Long Term Evolution). The information processing device 3 and the image forming apparatus 5 may be connected to each other via a dedicated local area network, etc., or they may be connected to each other within the communication network 100 via a firewall.

[0035] <Information Processing Device> The information processing device 3 is implemented by one or more information processing devices (computer systems) equipped with a general-purpose server OS or the like. Furthermore, the information processing device 3 stores a communication application for communicating with the image forming apparatus 5 in its storage means.

[0036] The information processing device 3 may be constructed using a single computer, such as a commonly used PC (Personal Computer) or a portable notebook PC, or it may be constructed using multiple computers, each part (function or means) such as storage, that are arbitrarily allocated. Furthermore, all or part of the functions of the information processing device 3 may be a server computer located in a cloud environment or a server computer located in an on-premise environment. The information processing device 3 may also utilize a communication device or communication terminal capable of running software such as browser software.

[0037] Furthermore, the information processing device 3 may also notify (send) data (information) to the image forming apparatus 5 via push notification (transmission). In this case, the information processing device 3 can, for example, use FCM (Firebase Cloud Messaging), which is an example of a push notification server, to send push notifications.

[0038] <Image forming apparatus> The image forming apparatus 5 is implemented with a configuration comprising one or more information processing mechanisms equipped with a general server OS, etc., and an image forming mechanism that forms a predetermined image using an image forming agent such as ink or powder toner. This image forming mechanism has the function of printing a desired image by ejecting ink of a predetermined color onto an image forming medium such as the ground (road surface) using an inkjet method. However, the image is not limited to surfaces that are approximately parallel to the ground, such as the ground (road surface), but can also be printed on surfaces that are approximately perpendicular to the ground, such as the outer wall surface of a structure. Furthermore, the image forming apparatus 5 stores communication applications in its storage means for communicating with other devices, such as the information processing device 3, and communication terminals. The image forming apparatus 5 may also have a communication function that enables the operation of software such as browser software.

[0039] As described above, when setting image division position information to divide an image into multiple regions, if there is a boundary for division, such as a person's face, even if a predetermined process (e.g., gradient processing) is applied to that boundary, there remains a possibility that the image quality will be affected. Therefore, in this embodiment, image division position information for dividing the image formation target into multiple regions is set based on at least one of the image information relating to the image formation target and the print media information relating to the print medium. This provides an image forming system that makes it possible to ensure image quality even when an image formation target having an image formation range larger than the maximum image formation range of the image forming apparatus is divided into multiple regions for image formation.

[0040] [Hardware configuration] Next, the hardware configuration of the device or terminal constituting the image forming system according to the embodiment will be described using Figures 12 and 13. Note that the hardware configuration of the terminal or device shown in Figures 10 and 11 may have components added or removed as needed.

[0041] <Hardware configuration of the information processing system> Figure 12 shows an example of the hardware configuration of an information processing device. As shown in Figure 12, the information processing device 3 is built, for example, by a computer and includes a CPU 301, ROM 302, RAM 303, EEPROM 304, HD 305, HDD controller 306, display 307, near-field communication I / F 308, CMOS sensor 309, and image sensor I / F 310. The information processing device 3 further includes a network I / F 311, keyboard 312, pointing device 313, media I / F 315, external device connection I / F 316, sound input / output I / F 317, microphone 318, speaker 319, and bus line 320.

[0042] Of these, the CPU 301 controls the operation of the entire information processing device 3. The ROM 302 stores programs and the like used to drive the CPU 301. The RAM 303 is used as the work area for the CPU 301. The EEPROM 304 reads or writes various data such as applications according to the control of the CPU 301. The HD 305 stores various data such as programs. The HDD controller 306 controls the reading or writing of various data to the HD 305 according to the control of the CPU 301. Here, the information processing device 3 may have a hardware configuration equipped with an SSD (Solid State Drive) instead of the HD 305 and HDD controller 306. The display 307 displays various information such as cursors, menus, windows, characters, or images. In this embodiment, the display 307 functions as an example of a display means. The Near Field Communication I / F 308 is a communication circuit for data communication with communication devices or communication terminals equipped with wireless communication interfaces such as NFC (Near Field Communication), Bluetooth (registered trademark; hereinafter omitted), and Wi-Fi (registered trademark; hereinafter omitted). The CMOS sensor 309 is a type of built-in imaging means that captures an image of a subject according to the control of the CPU 301 to obtain image data or video data. Note that the imaging means may be an imaging means composed of a CCD (Charge Coupled Device) sensor or the like, instead of a CMOS sensor. The image sensor I / F 310 is a circuit that controls the driving of the CMOS sensor 309.

[0043] Network I / F 311 is an interface for data communication using the communication network 100. Keyboard 312 is a type of input means equipped with multiple keys for inputting characters, numbers, various instructions, etc. In this embodiment, instead of or in addition to the keyboard 312, a touch panel may be provided for operating the information processing device 3 by pressing, clicking, or tapping predetermined buttons, icons, etc., arranged on the display 307. Pointing device 313 is a type of input means for selecting and executing various instructions, selecting processing targets, moving the cursor, etc. Media I / F 315 controls the reading or writing (storage) of data to or from the recording medium 314, such as flash memory. External device connection I / F 316 is an interface for connecting various external devices. In this case, the external device is, for example, a USB (Universal Serial Bus) memory. Audio input / output I / F 317 is a circuit that processes the input and output of audio signals between the microphone 318 and the speaker 319 according to the control of the CPU 301. Microphone 318 is a built-in circuit that converts sound into electrical signals, acquiring voice and sound waves emitted from external speakers, etc., and obtaining information using electrical signals. Speaker 319 is a built-in circuit that converts electrical signals into physical vibrations to produce sound such as music and voice. Bus line 320 is an address bus, data bus, etc., for electrically connecting various components such as CPU 301.

[0044] <Hardware configuration of the image forming apparatus> Figure 13 shows an example of the hardware configuration of an image forming apparatus. As shown in Figure 13, the image forming apparatus 5 is constructed, for example, by a computer and an image forming mechanism, and includes a CPU 501, ROM 502, RAM 503, EEPROM 504, HD 505, HDD (Hard Disk Drive) controller 506, position detection sensor 508, CMOS sensor 509, and image sensor I / F 510. The image forming apparatus 5 further includes a network I / F 511, a short-range communication I / F 512, an external device connection I / F 513, a drive roller 514, a recording head drive circuit 515, a recording head unit 516, and a chassis 517.

[0045] Of these, the CPU 501 controls the operation of the entire image forming apparatus 5. The ROM 502 stores programs and the like used to drive the CPU 501. The RAM 503 is used as the work area for the CPU 501. The EEPROM 504 reads or writes various data such as applications according to the control of the CPU 501. The HD 505 stores various data such as programs. The HDD controller 506 controls the reading or writing of various data to the HD 505 according to the control of the CPU 501. Here, the image forming apparatus 5 may have a hardware configuration equipped with an SSD (Solid State Drive) instead of the HD 505 and HDD controller 506. The position detection sensor 508 detects the position information of the image forming apparatus 5 using a sensor mechanism equipped with a commonly known distance measuring sensor, gravity sensor, etc. The CMOS sensor 509 is a type of built-in imaging means that captures an image forming medium (subject) such as a road surface according to the control of the CPU 501 and obtains surface data of the image forming medium. The imaging means may be composed of a CCD (Charge Coupled Device) sensor or the like, instead of a CMOS sensor. The image sensor I / F 510 is a circuit that controls the driving of the CMOS sensor 509.

[0046] Network I / F 511 is an interface for data communication using the communication network 100. Near-field communication I / F 512 is a communication circuit for data communication with communication devices or communication terminals equipped with wireless communication interfaces such as NFC (Near Field Communication), Bluetooth (registered trademark; hereinafter omitted), and Wi-Fi (registered trademark; hereinafter omitted). External device connection I / F 513 is an interface for connecting various external devices. In this case, the external device is, for example, a USB (Universal Serial Bus) memory. Drive roller 514 is a drive unit for moving the image forming mechanism itself or the recording head unit 516 provided in the image forming apparatus 5. Recording head drive circuit 515 is a drive unit for driving the recording head unit 516 for ejecting image forming agents such as ink and powder toner. Chassis 517 is a structure attached to the main body of the image forming apparatus 5, equipped with drive wheels (tires) for moving the image forming apparatus 5 on the image forming medium. In this embodiment, the chassis 517 is an example of a means of movement. Bus line 520 is an address bus, data bus, etc., used to electrically connect various components such as the CPU 701.

[0047] The above program may be distributed as an installable or executable file, recorded on a computer-readable storage medium, or distributed via download over a network. Examples of storage media include CD-R (Compact Disc Recordable), DVD (Digital Versatile Disk), Blu-ray Disc (Blu-ray is a registered trademark; hereinafter omitted), SD card, USB memory, etc. Furthermore, the storage media can be provided domestically or internationally as a program product. For example, the information processing device 3 realizes the information processing method according to the present invention when the program according to the present invention is executed.

[0048] [Functional configuration of the image forming system] Next, the functional configuration of this embodiment will be described using Figures 14 to 17. Figure 14 is a diagram showing an example of the functional configuration of the image forming system. Note that Figure 14 shows the devices shown in Figure 11 that are related to the processing or operation described later.

[0049] <Functional Configuration of Information Processing Devices> First, the functional configuration of the information processing device 3 will be explained using Figure 14. As shown in Figure 14, the information processing device 3 has a transmitting / receiving unit 31, a receiving unit 32, an acquisition unit 33, a display control unit 34, a judgment unit 35, a calculation / combination unit 36, a setting unit 37, a registration management unit 38, and a storage / reading unit 39. Each of these functional units is a function or means realized by one of the hardware resources shown in Figure 12 operating according to instructions from the CPU 301 that follow a program for the information processing device 3, which is expanded from at least one of the ROM 302, EEPROM 304, and HD 305 into the RAM 303. The information processing device 3 also has a storage unit 3000 constructed from at least one of the ROM 302, EEPROM 304, and HD 305 shown in Figure 12. Furthermore, the storage unit 3000 stores a communication program (communication application) for communicating with the image forming apparatus 5 via the communication network 100, a browser application, an image forming application for setting and managing image division information, etc.

[0050] <<Information Processing Device Functional Configurations>> Next, the functional configurations of the information processing device 3 will be described in detail. The transmitting / receiving unit 31 of the information processing device 3 shown in Figure 14 is mainly realized by the processing of the CPU 301 with respect to the network I / F 311 and the short-range communication I / F 308, and transmits and receives various data (or information) with the image forming apparatus 5 via the communication network 100. The transmitting / receiving unit 31 also transmits the set image division position information and an image file showing the image to the image forming apparatus 5. In this embodiment, the transmitting / receiving unit 31 functions as an example of at least one of the transmitting means and the receiving means.

[0051] The reception unit 32 is primarily realized by the CPU 301 processing signals generated by various operations received by the keyboard 312 and the pointing device 313. The reception unit 32 also receives input of image division information for dividing an image larger than the maximum image forming range that the image forming apparatus 5 can form into multiple regions. At this time, the image division information includes the size of a specific image, an evaluation value, non-divided region information indicating non-divided regions, the number of divisions, and the division positions, which will be described later. The reception unit 32 also receives input of image division information such that each of the multiple regions is less than or equal to the maximum image forming range. Note that the reception unit 32 may use input means such as a touch panel instead of the keyboard 312 and the pointing device 313. In this embodiment, the reception unit 32 functions as an example of a reception means.

[0052] The acquisition unit 33 is mainly implemented by the processing of the CPU 301 and acquires the surface smoothness, etc., of an image forming medium that has been image formed (printed) in advance by the image forming apparatus 5. In this embodiment, the acquisition unit 33 functions as an example of an acquisition means.

[0053] The display control unit 34 is primarily implemented by the processing performed by the CPU 301 on the display 307 and controls the display of various screens and information (data) in the information processing device 3. The display control unit 34 also displays a display screen generated using HTML (Hyper Text Markup Language), etc., on the display 307 of the information processing device 3 (hereinafter simply referred to as the display 307), for example, by using a browser. The display control unit 34 also displays a setting screen for setting the image size and evaluation value, a screen for specifying the non-divided area, and a screen for setting the maximum number of divisions, respectively, on the display 307. The display control unit 34 may also display various screens not only on the information processing device 3 but also on a predetermined display portion of the image forming apparatus 5. In this embodiment, the display control unit 34 functions as an example of a display control means.

[0054] The decision unit 35 is mainly implemented by the processing of the CPU 301 and performs various decisions in the information processing device 3. In this embodiment, the decision unit 35 functions as an example of a decision means.

[0055] The calculation and synthesis unit 36 ​​is mainly implemented by the processing of the CPU 301 and calculates the coordinate values ​​of each of the multiple divided regions in the printing of the divided image performed by the image forming apparatus 5. The calculation and synthesis unit 36 ​​also calculates the coordinate values ​​of the start and end points of a specific image, such as a person's face. Furthermore, when multiple evaluation indicators are used, the calculation and synthesis unit 36 ​​calculates an evaluation value for each divided evaluation indicator and defines an overall evaluation value by adding up these evaluation values. In this embodiment, each evaluation value is simply added up, but the values ​​may be normalized so that the maximum value of the evaluation value is constant. Weighting may also be applied when adding up each evaluation value. In this embodiment, the calculation and synthesis unit 36 ​​functions as an example of a calculation means.

[0056] The setting unit 37 is primarily implemented by the processing of the CPU 301 and sets the division positions of the image to be printed based on the input data and the input image division information. The setting unit 37 also sets image division position information for dividing the image into multiple regions where the boundaries of the multiple regions after division do not exist on a specific image, based on position information, media information related to the image forming medium, and image division information. The setting unit 37 also sets the number of divisions and division positions that constitute the image division position information. Furthermore, the setting unit 37 sets the number of divisions and division positions based on image division information including a relative evaluation value for preventing boundaries from existing on a specific image, the type and size of a specific image, and the number of divisions and division positions for dividing the image into multiple regions. In addition, the setting unit 37 sets the number of divisions and division positions of the division regions according to the type of image forming medium and surface smoothness included in the media information of the image forming medium. Furthermore, the setting unit 37 sets the number of divisions and division positions of the division regions according to the type of image forming medium and surface smoothness for each image forming medium, including planar media composed of paper, wood, metal, and plastic, the outer wall surface of a structure, and the road surface. The setting unit 37 further sets a region having a predetermined width for applying a gradient process to the boundaries of each of the multiple regions. In this embodiment, the setting unit 37 functions as an example of a setting means.

[0057] The registration management unit 38 is primarily implemented by the CPU 301 and registers the image forming medium information transmitted by the image forming apparatus 5 into corresponding items managed in the image forming information management table (image forming information management DB 3001), which will be described later. In this embodiment, the registration management unit 38 functions as an example of a registration means.

[0058] The memory read / recovery unit 39 is mainly implemented by the CPU 301 processing at least one of the ROM 302, EEPROM 304, and HD 305, and stores various data (or information) in the memory unit 3000 and reads various data (or information) from the memory unit 3000. In this embodiment, the memory read / recovery unit 39 functions as an example of a memory read / recovery means.

[0059] ●Image Formation Information Management Table● Figure 15 is a conceptual diagram showing an example of an image formation information management table. Note that the structure of the data table described below is just one example and is not limited to this. The storage unit 3000 of the information processing device 3 has an image formation information management DB 3001 constructed using the image formation information management table shown in Figure 15. In the image formation information management table, location information, type of image forming medium, type of image forming medium, and state of image forming medium are stored and managed in association with each image formation identification information.

[0060] Of these, the image formation identification information is, for example, a sequential number assigned when performing image formation, and is given as "PI0001", "PI0002", etc. The position information indicates the current position of the image forming apparatus 5, and is given as GPS (Global Positioning System) information values ​​including latitude information indicated by North latitude and longitude information indicated by East longitude, for example. The type of image forming medium is given as information such as road surface (concrete), floor (flooring), wall surface (tile), etc. The state of the image forming medium is given as surface smoothness, for example, rough, smooth, presence or absence of steps, etc.

[0061] In this embodiment, the image formation information management table (image formation information management DB3001) functions as an example of an image formation information management means.

[0062] ●Evaluation Value Management Table● Figure 16 is a conceptual diagram showing an example of an evaluation value management table. Note that the structure of the data table described below is just one example and is not limited to this. The storage unit 3000 of the information processing device 3 has an evaluation value management DB 3002 constructed using the evaluation value management table shown in Figure 16. In the evaluation value management table, for each specific image identification information, the specific image type (undivided area), the size of the specific image, and the evaluation value (or input value) are associated and stored and managed.

[0063] Of these, the specific image identification information is information for identifying a specific image, such as a person's face, included in the image to be printed, and is given as "I0001", "I0002", etc. The specific image type is given as a specific image included in the image to be printed, such as a person's face, text, or an animal's head. The size of the specific image is the size of the specific image [mm] as described above, but may also be given as a ratio to the size of the image to be printed. The evaluation value is a relative value given to determine the area of ​​the image to be printed that should not be divided (undivided area), and is given as an arbitrary number between 0 and 100, for example. In this embodiment, a larger evaluation value indicates a higher degree of the area that should not be divided (undivided area), but a smaller evaluation value may also indicate a higher degree of the area that should not be divided (undivided area). This evaluation value may be set by input by a user, such as an administrator, on the UI (User Interface) of the information processing device described later.

[0064] In this embodiment, the evaluation value management table (evaluation value management DB3002) functions as an example of an evaluation value management means.

[0065] ●Division Position Information Management Table● Figure 17 is a conceptual diagram showing an example of a division position information management table. Note that the structure of the data table described below is just one example and is not limited to this. The storage unit 3000 of the information processing device 3 has a division position information management DB 3003 constructed using the division position information management table shown in Figure 16. In the division position information management table, for each specific image identification information, the specific image coordinate value (start point), specific image coordinate value (end point), maximum number of divisions, image formation identification information, and image file name are stored and managed in association.

[0066] Of these, the specific image coordinate value (start point) and specific image coordinate value (end point) represent the coordinate values ​​of the start and end points of a specific image included in the image to be printed, and are given, for example, in an XY coordinate system. The specific image coordinate value (start point) and specific image coordinate value (end point) may be given only as coordinates of a specific image, without setting four points of a rectangle as a divided area as shown in Figure 1, and the other areas may be divided by calculating the area within the maximum image forming range. The maximum number of divisions is the number that determines the maximum number of divided areas containing a specific image, and may be set by input by a user such as an administrator. The image file name indicates the file name of the image to be transmitted to the image forming apparatus 5.

[0067] In this embodiment, the segmentation location information management table (segmentation location information management DB3003) functions as an example of segmentation location information management means.

[0068] <Functional configuration of an image forming apparatus> Returning to Figure 14, the functional configuration of the image forming apparatus 5 will be described. As shown in Figure 14, the image forming apparatus 5 includes a transmitting / receiving unit 51, a detection unit 52, an acquisition unit 53, a display control unit 54, a calculation / setting unit 55, a synthesis unit 56, an image forming unit 500, and a storage / reading unit 59. The image forming unit 500 further includes a drive control unit 57 and an ejection control unit 58. Each of these functional units is a function or means realized by one of the hardware resources shown in Figure 13 operating according to instructions from the CPU 501 that follow a program for the image forming apparatus 5, which is expanded from at least one of the ROM 502, EEPROM 504, and HD 505 into the RAM 503. The image forming apparatus 5 also has a storage unit 5000 constructed from at least one of the ROM 502, EEPROM 504, and HD 505 shown in Figure 13. The storage unit 5000 stores a communication program (communication application) and a browser application for communicating with the information processing device 3 via the communication network 100. The memory unit 5000 also stores a printing application that controls the image forming apparatus 5 in order to print an image.

[0069] <<Functional Configuration of Image Forming Apparatus>> Next, the functional configurations of the image forming apparatus 5 will be described in detail. The transmitting / receiving unit 51 of the image forming apparatus 5 shown in Figure 14 is mainly realized by the processing of the CPU 501 for the network I / F 511 and the short-range communication I / F 512, and transmits and receives various data (or information) with the information processing device 3 via the communication network 100. The transmitting / receiving unit 51 also transmits position information indicating the position of the image forming apparatus 5 and media information related to the image forming medium to the information processing device 3. The transmitting / receiving unit 51 also receives image division position information and image files indicating images set by the information processing device 3. In this embodiment, the transmitting / receiving unit 51 functions as an example of at least one of the transmitting means and the receiving means.

[0070] The detection unit 52 is mainly realized by the CPU 501 processing the detection signal detected by the position detection sensor 508, and for example, it detects position information indicating the current position of the image forming apparatus 5. In this embodiment, the detection unit 52 functions as an example of a detection means.

[0071] The acquisition unit 53 is mainly implemented by the CPU 501 processing the position detection sensor 508 and the CMOS 509 and image sensor I / F 510, and acquires, for example, position information indicating the current position of the image forming apparatus 5 detected by the detection unit 52. The acquisition unit 53 further acquires media information of the image forming medium from image data showing an image or video of the image forming medium captured by the CMOS 509 and image sensor I / F 510. In this embodiment, the acquisition unit 53 functions as an example of an acquisition means.

[0072] The display control unit 54 is primarily implemented by the processing performed by the CPU 501 on the display 507, and controls the display of various screens and information (data) in the image forming apparatus 5. The display control unit 54 also displays a display screen generated using HTML (Hyper Text Markup Language), etc., on the display 507 of the image forming apparatus 5 (hereinafter simply referred to as the display 507), for example, by using a browser. In this embodiment, the display control unit 54 functions as an example of a display control means.

[0073] The calculation and setting unit 55 is mainly implemented by the processing of the CPU 501, and calculates the image formation conditions when printing is performed by the image forming apparatus 5 based on the image division position information included in the image formation condition information transmitted by the information processing device 3, and sets them in the storage unit 5000. In this embodiment, the calculation and setting unit 55 functions as an example of at least one of the calculation means and the setting means.

[0074] The synthesis unit 56 is mainly implemented by the processing of the CPU 501, and when the image formation process described later is executed, it synthesizes multiple divided images into a single image based on, for example, the image division position information and image file transmitted by the information processing device 3. In this embodiment, the synthesis unit 56 functions as an example of a setting means.

[0075] The image forming unit 500 is mainly realized by the processing of the drive roller 514, the recording head drive circuit 515, the recording head unit 516, and the chassis 517 by the CPU 501. When performing image forming using an inkjet method, for example, the image forming unit 500 controls various processes in the drive roller 514, the recording head drive circuit 515, and the recording head unit 516 to form an image on the ground, exterior wall surface, etc. In this case, the drive control unit 57 in the image forming unit 500 controls the drive roller 514 to drive the recording head unit 516 of the image forming apparatus 5 to a predetermined coordinate position of the image. The ejection control unit 58 then controls the recording head drive circuit 515 and the recording head unit 516. The image forming unit 500 also forms an image on the image forming medium based on the image division position information and the image file that indicates the image transmitted by the information processing device 3. Furthermore, the image forming unit 500 forms an image on the image forming medium based on image division position information and image forming position information indicating the position of the image forming apparatus 5 obtained as the image forming apparatus 5 body moves by the chassis 517. The image forming unit 500 further forms an image on the image forming medium with an image forming agent having at least one color. In this embodiment, the image forming unit 500 functions as an example of an image forming means.

[0076] The memory read / recovery unit 59 is mainly implemented by the CPU 501 processing at least one of the ROM 502, EEPROM 504, and HD 505, and stores various data (or information) in the memory unit 5000 and reads various data (or information) from the memory unit 5000. In this embodiment, the memory read / recovery unit 59 functions as an example of a memory read / recovery means.

[0077] [Processing or operation of the embodiment] Next, Figures 18 to 24 will be used to explain each process or operation in the image forming system according to this embodiment. In this embodiment, it is assumed that in each communication between the information processing device 3 and the image forming apparatus 5 described later, the login authentication process, session establishment process, etc., according to the predetermined procedure have been successfully completed and the two devices are in a state where they can communicate with each other.

[0078] <Acquisition and registration of image forming media information> Figure 18 is a sequence diagram showing an example of the process for acquiring location information and media information. First, the acquisition unit 53 of the image forming apparatus 5 acquires its own location information (step S11). Specifically, the acquisition unit 53 acquires its own location information in cooperation with the detection unit 52 and the transmitting / receiving unit 51 from a location detection sensor 508, a network I / F 511, and a short-range communication I / F 512, etc. At this time, the acquisition unit 53 may also acquire its own location information from a GPS device or the like that can communicate with the image forming apparatus 5. The acquisition unit 53 may further move the image forming apparatus 5 using a chassis 517 provided on the image forming apparatus 5 to capture a predetermined marker on the image forming medium, and acquire the relative location information of its own device from the image data of the captured image. The acquisition unit 53 may further acquire image forming medium information when a user of the image forming apparatus 5 inputs a predetermined value using the display 507. The acquisition unit 53 may further acquire image forming medium information via the short-range communication I / F 512 using a communication terminal or the like that stores the image forming medium information.

[0079] Next, the acquisition unit 53 acquires image forming medium information (step S12). Specifically, the acquisition unit 53 acquires media information of the image forming medium from the image or video of the image forming medium captured by the CMOS 509 and the image sensor I / F 510. At this time, the type of image forming medium and the state of the image forming medium (surface smoothness) as media information of the image forming medium may be acquired by the following method. For example, the acquisition unit 53 acquires image data of the captured image or video of the image forming medium and compares it with data such as a media library stored in a predetermined area of ​​the storage unit 5000 of the image forming apparatus 5. After that, the acquisition unit 53 may estimate the similarity of the data such as the media library to the image data and the surface smoothness. Alternatively, the acquisition unit 53 may cooperate with the transmitting / receiving unit 51 to receive media information related to the image forming medium from the information processing device 3 in advance and read out that information.

[0080] Next, the transmitting / receiving unit 51 transmits an image formation information registration request to the information processing device 3 (step S13). As a result, the transmitting / receiving unit 31 of the information processing device 3 receives the image formation information registration request transmitted by the image forming apparatus 5. At this time, the image formation information registration request includes the location information of the image forming apparatus 5 and the image forming medium information.

[0081] Next, the registration management unit 38 of the information processing device 3 registers the image forming information received in step S13 (step S14). Specifically, the registration management unit 38 registers the received image forming medium information, including the position information of the image forming apparatus 5, the type of image forming medium, and the state of the image forming medium (surface smoothness), into the corresponding items managed in the image forming information management DB 3001 (see Figure 15).

[0082] Next, the transmitting / receiving unit 31 transmits an image formation information registration response to the image formation information registration request received in step S13 to the image forming apparatus 5, thereby ending the series of sequence processing (step S15). As a result, the transmitting / receiving unit 51 of the image forming apparatus 5 receives the image formation information registration response transmitted by the information processing device 3.

[0083] In the image forming system according to this embodiment, for example, when the processes of steps S13 and S15 described above are executed, other devices may exist between the information processing device 3 and the image forming apparatus 5. In other words, the information (data) transmitted and received between the information processing device 3 and the image forming apparatus 5 may be transmitted and received via other devices at some point. The above configuration can also be applied even when other processing steps (for example, steps S24 and S28 described later) exist between the information processing device 3 and the image forming apparatus 5.

[0084] <Setting the division position> Next, the process for setting the division position will be described. Figure 19 is a sequence diagram showing an example of a process including the division position setting process and the image formation process. First, the display control unit 34 of the information processing device 3 displays the non-divided area specified image (step S21). Specifically, the display control unit 34 displays various division setting screens on the display 307. In this embodiment, the various division setting screens displayed are the specific image information setting screen, the non-divided area setting screen, and the maximum number of divisions setting screen, which will be described later.

[0085] ●Screen display example● Figure 20 shows an example of a display screen when receiving input for image size and evaluation value in an information processing device. As shown in Figure 20, the display control unit 34 displays the specific image information setting screen 3111 on the display 307 of the information processing device 3. The specific image information setting screen 3111 displays the specific image type, the size of the specific image, and the evaluation value associated with the specific image (specific image). At this time, the specific image type may be one that the information processing device 3 has previously extracted as a specific image from the image data contained in the image to be printed, or it may be entered by the user on the specific image information setting screen 3111. In addition, the size of the specific image and the evaluation value are each provided with input sections into which the user can enter arbitrary values. As a result, the values ​​entered by the user are set by the setting unit 37. After entering arbitrary values, the user can confirm and set the entered values ​​by operating the confirm button 3511.

[0086] ●Screen display example● Figure 21 shows an example of a display screen when an information processing device accepts the specification of an undivided area. As shown in Figure 21, the display control unit 34 displays the undivided area setting screen 3121 on the display 307 of the information processing device 3. The undivided area setting screen 3121 displays a message indicating the area to be specified that should not be divided in the image to be printed, along with a finger icon 3521 and a confirmation button 3522. At this time, the user can operate the finger icon 3521 to draw a dotted line around any area on the image. The acquisition unit 33 then acquires the trajectory or coordinates of the finger icon 3521 on the undivided area setting screen 3121, allowing the display control unit 34 to follow that trajectory and draw a dotted line trajectory as shown in Figure 21. At this time, the maximum image forming range that the image forming apparatus 5 can form an image at once is shown, so the user will specify an area smaller than this range on the undivided area setting screen 3121. The user can then specify the area that should not be divided by operating the confirmation button 3522. Alternatively, instead of using the finger icon 3521, users could be allowed to define arbitrary areas by directly moving their fingers or other objects on the image. Providing such a UI would allow developers and other users to avoid boundaries that they cannot predict beforehand, by specifying the boundaries afterward. Furthermore, providing such a UI would allow for handling cases where there are multiple ways to select areas that should not be boundaries.

[0087] ●Screen display example● Figure 22 shows an example of a display screen when an information processing device accepts input for the maximum number of divisions. As shown in Figure 22, the display control unit 34 displays the maximum number of divisions setting screen 3131 on the display 307 of the information processing device 3. The maximum number of divisions setting screen 3131 displays a maximum number of divisions input unit 3132 for entering the maximum number of divisions and a confirmation button 3531. At this time, the user can set the maximum number of divisions by entering a desired number in the maximum number of divisions input unit 3132 and operating the confirmation button 3531. However, if each division area divided by the number entered in the maximum number of divisions input unit 3132 exceeds the maximum image formation range, the setting will not be made even if the confirmation button 3531 is operated, and the user may be prompted to enter the maximum number of divisions again with a predetermined message. By providing a UI for specifying the maximum number of divisions in this way, it becomes possible for the user to decide on a balance between productivity and print quality, given that increasing the number of divisions allows for specifying boundaries in more appropriate positions, but productivity deteriorates.

[0088] Returning to Figure 19, the reception unit 32 receives input from the administrator for various division settings (step S22). Specifically, the reception unit 32 receives input of image division information for dividing an image larger than the maximum image forming range that the image forming apparatus 5 can form into multiple regions. At this time, the reception unit 32 receives input as image division information, including a relative evaluation value to prevent boundaries from existing on a specific image, the type and size of a specific image, and the number of divisions and division positions for dividing the image into multiple regions.

[0089] Next, the setting unit 37 sets the division positions (step S23). Specifically, the setting unit 37 sets image division position information, which is information set based on position information, media information, and image division information, in order to divide the image into multiple regions where the boundaries of the multiple regions after division do not exist on a particular image.

[0090] <<Details of the process for setting the split position>> Here, we will explain in detail the process of setting the division position in step S23 described above. Figure 23 is a flowchart showing an example of the process of setting the division position. First, the acquisition unit 33 acquires input data (step S23-1-1). Specifically, the acquisition unit 33 inputs various data as input data, including image data indicating the image to be printed, evaluation indicators, and data for calculating evaluation values. At this time, the acquisition unit 33 works in cooperation with the storage and reading unit 39 to read the corresponding input data from the image formation information management DB 3001 (see Figure 15), the evaluation value management DB 3002 (see Figure 16), and the division position information management DB 3003 (see Figure 17). The evaluation value calculation data may be data designed in advance by an image designer or the like, or it may be data entered by a user via a predetermined setting screen.

[0091] Next, the calculation and synthesis unit 36 ​​calculates an evaluation value for each pixel based on the evaluation index (step S23-1-2). Specifically, for each pixel in the image, the calculation and synthesis unit 36 ​​calculates a numerical value representing the degree to which it is undesirable for that pixel to be selected as a boundary value (evaluation value). In this embodiment, this is expressed as a numerical value from 0 to 100, with a larger value indicating a greater undesirability of that pixel as a boundary value. At this time, the calculation and synthesis unit 36 ​​may also add information related to the type of image forming medium and the state of the image forming medium (surface smoothness), which are managed in the image forming information management DB 3001 (see Figure 15), from the input data acquired in step S23-1, as parameters for calculating the evaluation value.

[0092] Next, the setting unit 37 sets the evaluation threshold to an initial value (step S23-1-3). The evaluation threshold set at this time may be arbitrarily set by an administrator or the like.

[0093] Next, the setting unit 37 divides the region so that the boundary line does not pass through areas above a threshold (step S23-1-4). Specifically, the predetermined input values ​​from the user received by the reception unit 32 in the process of step S22 described above are set as setting values ​​so that the boundary line does not pass through areas above a threshold, and are set to the coordinate values ​​of the start and end points of specific image coordinate values ​​managed in the division position information management DB 3003 (see Figure 17). As a result, for example, a rectangular region enclosed by the start and end points of specific image coordinate values ​​can be set as a region on a specific image where the boundary line of the divided region does not pass through.

[0094] Next, the determination unit 35 determines whether each divided region is less than or equal to the printable area (maximum image forming area) (step S23-1-5). If each divided region is less than or equal to the printable area (maximum image forming area) (step S23-1-5: YES), the setting unit 37 sets the output data to be sent to the image forming apparatus 5 and exits this flow (step S23-1-10). Specifically, the determination unit 35 repeats the loop while raising the threshold value of the evaluation value until the area of ​​each divided region is less than or equal to the maximum printable area, and outputs the data in the next step when the condition is met.

[0095] On the other hand, if each of the divided regions is larger than the printable area (maximum image formation range) (step S23-1-5: NO), the setting unit 37 works with the calculation and synthesis unit 36 ​​to update the threshold value of the evaluation value (step S23-1-6), then returns to the process in step S23-1-4, and repeats this process until it is determined in step S23-1-5 that each of the divided regions is less than or equal to the printable area (maximum image formation range). When updating the threshold value of the evaluation value at this time, for example, the threshold value may be increased or decreased depending on the difference between each of the divided regions and the printable area.

[0096] <<Details on other settings for the split position>> Here, we will explain the details of other setting processes for the division position. Figure 24 is a flowchart of another example of the setting process for the division position. Note that the process in Figure 24 is the same as the process from step S23-1-1 to step S23-1-6 shown in Figure 23 above, so the explanation is omitted.

[0097] In the example shown in Figure 23, after the decision process in step S23-2-6 (step S23-1-6), the output data was set and the flow was exited. In contrast, in the example shown in Figure 24, if each divided area is a printable area, the decision unit 35 further determines whether the number of divisions is less than or equal to the maximum number of divisions (step S23-2-9). Specifically, the decision unit 35 determines whether the number of divisions performed in step S22 above is less than or equal to the maximum number of divisions entered in the maximum number of divisions setting screen 3131 shown in Figure 22. At this time, the decision unit 35 works in cooperation with the storage read unit 39 to search the division position information management DB 3003 (see Figure 17) using specific image identification information as a search key and read the corresponding maximum number of divisions. After that, the decision unit 35 determines the relationship between the read maximum number of divisions and the number of divisions that were actually performed.

[0098] If the number of divisions is less than or equal to the maximum number of divisions (step S23-2-9: YES), the setting unit 37 sets the output data to be sent to the image forming apparatus 5 and exits this flow (step S23-2-10).

[0099] On the other hand, if the number of divisions is not less than or equal to the maximum number of divisions (step S23-2-9: NO), the setting unit 37 works with the calculation and synthesis unit 36 ​​to update the threshold value of the evaluation value (step S23-2-6), then returns to the process in step S23-2-4, and repeats the process from step S23-2-5 onwards.

[0100] In Figure 24, the addition of the process in step S23-2-9 described above is expected to prevent the printable area from becoming too small.

[0101] Returning to Figure 19, the transmitting / receiving unit 31 transmits image forming condition information to the image forming apparatus 5 (step S24). As a result, the transmitting / receiving unit 51 of the image forming apparatus 5 receives the image forming condition information transmitted by the information processing device 3. At this time, the image forming condition information includes image division position information for dividing the image into multiple regions, and an image file showing the printed image. At this time, the image forming condition information may also include image forming position information.

[0102] Next, the calculation and setting unit 55 of the image forming apparatus 5 sets the image forming condition information (step S25). Specifically, the calculation and setting unit 55 sets the image division position information and image file received in step S24 into a predetermined area of ​​the storage unit 5000.

[0103] Next, the acquisition unit 53 acquires the location information of its own device (step S26). Specifically, the acquisition unit 53 acquires location information indicating the current position of the image forming apparatus 5 detected by the detection unit 52. Although the image forming apparatus 5 also acquires its own location information in step S11 described above, the location information acquisition process here is a process to reset the actual image data output position. If the image forming apparatus 5 has not moved from the location where it was located in step S11, the process in step S26 may be omitted.

[0104] Next, the image forming unit 500, including the synthesis unit 56, performs image forming processing (step S27). Specifically, the drive control unit 57 included in the image forming unit 500 drives the recording head unit 516 of the image forming apparatus 5, which is located on the ground G (road surface) as shown in Figure 9, to a predetermined printing start position by controlling the drive roller 514. After that, the drive control unit 57 controls the recording head drive circuit 515 and the recording head unit 516 to start printing the image data to be printed from a desired position. At this time, the image forming unit 500 prints the divided image data, which is divided into multiple divided regions, onto the image forming medium based on the image forming position information received in step S24. Then, the image forming unit 500, in cooperation with the synthesis unit 56, synthesizes the divided image data, which is divided into multiple divided regions, in accordance with the movement of the image forming apparatus 5, and prints all the image data to be printed onto the ground G (road surface).

[0105] Next, when image formation is complete, the transmitting / receiving unit 51 transmits an image formation response to the information processing device 3 (step S28). As a result, the transmitting / receiving unit 31 of the information processing device 3 receives the image formation response transmitted by the image forming device 5. At this time, the image formation response includes a status flag indicating that image formation is complete, or a predetermined message. Note that the processing in step S28 may be omitted in the processing between the information processing device 3 and the image forming device 5.

[0106] Through the above sequence, the information processing device 3 can print the desired image onto an image-forming medium such as the ground G (road surface) according to the image formation condition information set based on the desired image division information entered by the administrator (user). This makes it possible to ensure image quality even when dividing an image with an image formation range larger than the maximum image formation range of the image forming device 5 into multiple regions for image formation.

[0107] [Main effects of the embodiment] As described above, according to this embodiment, the transmitting / receiving unit 31 of the information processing device 3 receives location information and media information of the image forming apparatus 5 transmitted by the image forming apparatus 5 (step S13). The receiving unit 32 then receives input of image division information for dividing an image larger than the maximum image forming range that the image forming apparatus 5 can form into multiple regions (step S22). The setting unit 37 sets image division position information based on the location information, media information, and image division information of the image forming apparatus 5, for dividing the image into multiple regions where the boundaries of the divided regions do not exist on a particular image (step S23). This has the effect of ensuring image quality even when dividing an image having an image forming range larger than the maximum image forming range of the image forming apparatus 5 into multiple regions for image formation.

[0108] Furthermore, according to this embodiment, the reception unit 32 of the information processing device 3 receives input information related to the size and evaluation value of a specific image, the non-divided area, and the maximum number of divisions from the user on various setting screens displayed on the display 307 (step S22). This provides the effect of allowing the user to freely divide the image into division areas of a size and boundary desired by the user, in addition to the effects described above.

[0109] [Supplement to the Embodiment] Each of the functions of the embodiments described above can be realized by one or more processing circuits. Hereinafter, "processing circuit" as used herein includes devices programmed to execute each function by software, such as processors implemented by electronic circuits. Such devices include, for example, processors, ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), FPGAs (field programmable gate arrays), SOCs (System on a chip), GPUs (Graphics Processing Units), and conventional circuit modules designed to execute the functions described above.

[0110] Furthermore, in the embodiments described above, machine learning, artificial intelligence (AI), deep learning, etc., may be used for the control that recognizes a specific image contained in the printed image, and for the control that prevents boundaries from being included on a specific image when dividing the image into multiple divided regions. In this way, the results learned through processing using machine learning, artificial intelligence (AI), deep learning, etc., may be reflected in the division position setting process.

[0111] While an information processing apparatus, an image forming system, an information processing method, and a program according to one embodiment of the present invention have been described so far, the present invention is not limited to the embodiments described above. It can be modified to the extent that a person skilled in the art can conceive of adding, changing, or deleting other embodiments, and any embodiment that achieves the functions and effects of the present invention is included within the scope of the present invention. [Explanation of symbols]

[0112] 1. Image forming system 3. Information Processing Device 5 Image forming apparatus 31 Transmitting and Receiving Unit (Example of transmitting means, example of receiving means) 34 Display Control Unit (An example of display control means) 36 Calculation Unit (Example of Calculation Means) 37 Setting section (an example of setting means) 307 Display (an example of a display means) 3101 Image Segmentation Information Settings Screen 3102 Ruler for area selection (an example of an area selection section) 3103 Region selection scale (an example of multiple region selection scales) 3104 Region selection scale (an example of multiple region selection scales) 3111 Productivity Confirmation Screen 3511 Accept button (Example of an acceptance section) 3512 Reset button (Example of acceptance section) 55 Setting section (an example of setting means) 58 Light emission control unit (an example of display control means) 500 Image forming unit (an example of an image forming means) 517 Chassis (an example of a means of transportation) [Prior art documents] [Patent Documents]

[0113] [Patent Document 1] Japanese Patent Publication No. 2019-127008

Claims

1. An information processing device capable of communicating with an image forming apparatus that forms an image on an image forming medium, A receiving means for receiving position information indicating the position of the image forming apparatus and media information relating to the image forming medium, transmitted by the image forming apparatus. The image forming apparatus includes a receiving means for receiving input of image division information to divide an image larger than the maximum image forming range that can be formed into multiple regions, Information set based on the position information and the media information and the image division information, setting means for setting image division position information to divide the image into multiple regions where the boundaries of the multiple regions after division do not exist on a specific image, Having, An information processing device characterized by the following:

2. The aforementioned receiving means is The system accepts input of image segmentation information such that each of the plurality of regions is less than or equal to the maximum image forming range. The information processing apparatus according to feature 1.

3. The setting means is, The number of divisions and division positions that constitute the aforementioned image division position information are set. The information processing apparatus according to claim 1 or 2.

4. The setting means is, Based on the image division information, which includes a relative evaluation value for preventing the boundary from existing on the specific image, the type and size of the specific image, and the number of divisions and division positions for dividing the image into the plurality of regions, the number of divisions and division positions are set. The information processing apparatus according to feature 3.

5. The media information includes the type of image forming medium and the surface smoothness, The setting means is, The number of divisions and the division positions are set according to the type and surface smoothness. The information processing apparatus according to feature 3.

6. The image-forming medium includes a planar medium composed of paper, wood, metal, and plastic, the outer wall surface of a structure, and the road surface of a road. The setting means is, The number of divisions and division positions are set according to the type and surface smoothness of each image forming medium. The information processing apparatus according to feature 5.

7. The setting means is, A region having a predetermined width is set for applying a gradient effect to the boundary of each of the aforementioned multiple regions. The information processing apparatus according to feature 6.

8. An information processing apparatus according to any one of claims 1 to 7, further, The system has a transmission means for transmitting the set image division position information and an image file showing the image to the image forming apparatus. An information processing device characterized by the following:

9. An image forming system comprising an image forming apparatus for forming an image on an image forming medium, and an information processing apparatus capable of communicating with the image forming apparatus, The aforementioned information processing device is A receiving means for receiving position information indicating the position of the image forming apparatus and media information relating to the image forming medium, transmitted by the image forming apparatus. The image forming apparatus includes a receiving means for receiving input of image division information to divide an image larger than the maximum image forming range that can be formed into multiple regions, Information set based on the position information and the media information and the image division information, setting means for setting image division position information to divide the image into multiple regions where the boundaries of the multiple regions after division do not exist on a specific image, A transmission means for transmitting the set image division position information and an image file showing the image to the image forming apparatus, It has, The image forming apparatus is Image forming means that forms an image relating to the image file on the image forming medium based on the image division position information and the image file representing the image transmitted by the information processing device. Having, An image forming system characterized by the following features.

10. The image forming apparatus further, The image forming apparatus has a moving means for moving the main body of the image forming apparatus in order to form the image on the image forming medium, The image forming means is Based on the image division position information and the image forming position information indicating the position of the image forming apparatus obtained as the image forming apparatus body is moved by the moving means, the image is formed on the image forming medium. The image forming system according to feature 9.

11. The image forming means is The image is formed on the image forming medium using an image forming agent having at least one or more colors. The image forming system according to claim 9 or 10, characterized in that it is the same as described in claim 9 or 10.

12. An information processing method performed by an information processing device that can communicate with an image forming apparatus that forms an image on an image forming medium, A receiving step of receiving location information indicating the position of the image forming apparatus and media information relating to the image forming medium transmitted by the image forming apparatus, The image forming apparatus receives input of image division information for dividing an image larger than the maximum image forming range that can form an image into multiple regions, A setting step of setting image division position information, which is set based on the position information, the media information and the image division information, and which is used to divide the image into multiple regions whose boundaries after division do not exist on a particular image, Execute the process that includes An information processing method characterized by the following:

13. An information processing device that can communicate with an image forming apparatus that forms an image on an image forming medium, A receiving step of receiving location information indicating the position of the image forming apparatus and media information relating to the image forming medium transmitted by the image forming apparatus, The image forming apparatus receives input of image division information for dividing an image larger than the maximum image forming range that can form an image into multiple regions, A setting step of setting image division position information, which is set based on the position information, the media information and the image division information, and which is used to divide the image into multiple regions whose boundaries after division do not exist on a particular image, A program that performs a process that includes this.

Citation Information

Patent Citations

  • Image processor

    JP2006121371A

  • Road printer

    JP2013068046A

  • Information processing device and control method thereof and program

    JP2017182488A

  • Image forming apparatus and image processing method

    JP2018037849A

  • Image processor and computer program

    JP2019127008A