Image synthesis method and program

Abstract

[Problem] To further reduce, even if image data is corrupted, the impact of the corruption on the image, and minimize the inconvenience to a user in continuing image editing. [Solution] The disclosed technology provides an image synthesis method in which a computer synthesizes an image in which images represented by objects respectively defined in a plurality of layers are superimposed, said image synthesis method comprising: creating raster data from a first layer where an object of a first format other than raster format is defined; detecting whether or not the first layer is corrupted; and if it is detected that the first layer is corrupted, or if an instruction has been received from a user, replacing at least a portion of the first layer with an object created on the basis of the raster data, or with a layer generated on the basis of the created object.

Description

Image synthesis method and program

[0001] The present invention relates to an image synthesis method and a program.

[0002] Software exists to assist in the creation of illustrations and other images.

[0003] Software for creating illustrations and images has a feature called "layers." Layers are like layers that are convenient when drawing or editing, and using them can make the image creation process more efficient.

[0004] Layers allow you to work (create, display, edit) on illustrations and images by dividing them into multiple layers. For example, you can place the background on one layer and the character on another. This allows you to easily make fine adjustments, as changing the background will not affect the character.

[0005] Layers have functions such as "hide" and "show." This allows you to show or hide only specific layers. For example, you can show only the character layer and focus on editing only that part. This makes it easier to adjust the details while keeping an eye on the overall balance.

[0006] You can also combine images of multiple objects by stacking layers. For example, you can create a more three-dimensional illustration by drawing a character on a background layer and then adding a shadow on top of it. Because each layer is independent, you can easily make changes and adjustments later, making your work more efficient.

[0007] Additionally, some drawing software allows you to apply different formats to each layer, such as raster, vector, 3D, etc. Using drawing software that can handle layers makes it easier and more intuitive to create and edit illustrations and images that consist of different types of objects.

[0008] Prior art has been disclosed regarding the layer function of drawing software with a layer structure when creating images. When drawing an illustration, the line drawings and fill colors, characters and backgrounds that make up the illustration can be drawn on separate layers, allowing each to be edited individually. It has been disclosed that handling the components of an illustration in a layer structure allows for efficient subsequent revisions, such as hiding unnecessary sketches, repainting while leaving the line drawings intact, or changing the position of characters relative to the background. (See, for example, Non-Patent Document 1.)

[0009] In addition to drawing software, there are other prior art technologies that have user interfaces with layered structures. For example, there is a technology that provides an in-vehicle device that can prevent unauthorized display in a virtualized environment where multiple operating systems each display on a display. The technology includes a display output unit that combines multiple hierarchical layers and outputs the combined data to a display. The display output unit combines the multiple layers to be combined so that relatively higher layers are displayed with priority over relatively lower layers. The masking unit pre-draws masking content (CM) to cover a display with a malfunction on a layer higher in the hierarchy than the layers assigned to the multiple operating systems. When a malfunction is detected by a monitoring unit, the monitor sets the display output unit to include the layer with the masking content in the composite target, thereby masking a display area where unauthorized display may occur with the masking content (see, for example, Patent Document 1).

[0010] While the above-mentioned technology makes it possible to handle complex image data, if the data itself is corrupted, the displayed image may become corrupted. Moreover, because the image data is complex, restoring the corrupted data can require a great deal of effort.

[0011] https: / / help.clip-studio.com / en-us / manual_en / 180_layers / What_are_layers__63_.htm#XREF_39244__What_are_layers (Accessed July 26, 2024)

[0012] Japanese Patent Application Laid-Open No. 2020-187631

[0013] The disclosed technology aims to further reduce the impact of damage to an image, even if image data is damaged.

[0014] The disclosed technology provides an image synthesis method in which a computer synthesizes an image in which images represented by objects defined on each of a plurality of layers are superimposed, the image synthesis method including: creating raster data from a first layer in which an object of a first format other than a raster format is defined; detecting whether the first layer is corrupted; and, if it is detected that the first layer is corrupted or if an instruction is received from a user, replacing at least a portion of the first layer with an object created based on the raster data or a layer generated based on the created object.

[0015] The disclosed technology can reduce the impact of corrupted image data on the image, and also minimize inconvenience to the user when continuing to edit the image, since the layer structure of the image is similar to the original layer structure.

[0016] FIG. 1A is a diagram showing an example of a user interface (UI) for manipulating a layer structure. FIG. 1B is an example of displaying an image in which layers are overlaid. FIG. 2A is a diagram showing an example in which only layers 108a and 118a are set to be displayed. FIG. 2B is a diagram showing an example in which a 3D object, a cup 108b, is displayed on a canvas. FIG. 3A is a diagram showing an example in which data for one layer is corrupted. FIG. 3B is a diagram showing an image in which data for one layer is corrupted. FIG. 4A is a diagram showing a setting to display only the corrupted layer and the background color. FIG. 4B is a diagram showing an example image of the corrupted layer. FIG. 5A is a diagram showing a state in which a new layer is generated based on raster data saved before the layer was corrupted. FIG. 5B is a diagram showing an example in which a layer generated based on the saved raster data is displayed on the canvas in place of the image of the corrupted layer. FIG. 6A is a diagram showing an example in which a setting is set to display only a layer generated based on a raster object and the background color. FIG. 6B is a diagram showing an example in which an image of the generated layer is displayed. FIG. 7A is a diagram showing an example in which a vector object is created from saved raster data and a new layer is generated. FIG. 7B is a diagram showing an image of the newly created vector object. FIG. 8A is a diagram showing an example in which a 3D object is created from saved raster data and a new layer is generated. FIG. 8B is a diagram showing an image of the newly created 3D object. FIG. 9 is a flowchart showing processing of the disclosed technique. FIG. 10 is a flowchart showing processing in response to layer corruption. FIG. 11 is a flowchart showing processing for creating raster data from a first layer in which an object of a first format other than raster format is defined. FIG. 12 is a flowchart showing processing for creating an object based on the created raster data and generating a substitute layer. FIG. 13 is a flowchart showing processing for substituting at least a portion of a first layer based on a user instruction.Fig. 14 is a flowchart showing a process for creating raster data from a layer in which an object of a first format other than a raster format is defined. Fig. 15 is a flowchart showing a process for replacing at least a part of a first layer with an object or a layer. Fig. 16 is a hardware configuration diagram of the disclosed technology. Fig. 17 is a functional block diagram of the disclosed technology.

[0017] The disclosed technology will be described below with reference to the drawings.

[0018] Fig. 1A is a diagram showing an example of a user interface (UI) for manipulating a layer structure, and Fig. 1B is an example of a display of an image in which layers are superimposed.

[0019] In FIG. 1A, the layer list 100 can handle multiple layers 102a to 118a. Column 120 is a display indicator field for setting whether to show or hide a layer. Clicking on each display indicator field in column 120 toggles the display or hide of an eye icon. A layer with an eye icon displayed is displayed on the canvas. A layer without an eye icon displayed is not displayed on the canvas. Column 125 in FIG. 1A will be described in FIG. 2A. In FIG. 1A, column 130 is the name of the layer. The user can give each layer a name of their choice to make it easier to identify them.

[0020] In Fig. 1B, the images of each layer are composited and displayed on a canvas 150. When eye icons are displayed on all layers in the layer list 100 in Fig. 1A, the images of all layers are superimposed and displayed in Fig. 1B. When an image of an upper layer overlaps an image below it in the layer list 100, the image of the lower layer is displayed so that the opaque portion of the image of the upper layer hides the image of the lower layer.

[0021] Each layer defines a different type of object. Object formats include a "raster format" that defines a bitmap image object, a "vector format" that defines a vector image object, a "3D format" that defines an object such as a three-dimensional shape, a "frame border format" that defines a frame border object, a "text format" that defines a text object, a "tone format" that defines a screen tone, a "paper format" that defines a background color, and an "external reference format" that defines an external reference object that references a file in which the object is saved. 3D format objects may further include texture, lighting, and virtual camera information. Text format objects may further include font information and text frame information. The shape of the text frame may be a rectangle, circle, ellipse, speech bubble, or the like. A frame border 102b in a frame border format is defined on layer 102a. A round line image 104b in a raster format is defined on layer 104a. A wavy line 106b in a vector format is defined on layer 106a. A 3D model 108b of a cup in 3D format is defined in layer 108a. A frame border 110b in a frame frame format is defined in layer 110a. A text and speech bubble 112b in a text format are defined in layer 112a. A character 114b in 3D format is defined in layer 114a. A screen tone 116b in a tone format is defined in layer 116a. A paper 118b in a paper format is defined in layer 118a.

[0022] Each layer may have multiple objects defined. Areas of a layer with no objects may be transparent. Transparent portions of a layer allow the layer below to be displayed. Transparency may also be set for layers. A semi-transparent layer displays the image of that layer, combining it with the image of the layer below. Figure 2A shows an example in which only layers 108a and 118a are set to be displayed. A pen icon in column 108d indicates that the layer is being edited.

[0023] FIG. 2B shows an example in which a 3D object, a cup 108b, is displayed on a canvas with a white background color based on the display settings of FIG. 2A . Because the cup 108b being edited is a 3D object, a command sequence 108y for editing the 3D model and handles 108x for moving, rotating, and scaling the cup 108b in three-dimensional space are displayed. By operating the command sequence 108y and the handles 108x, a user can freely edit and transform a 3D object by moving, rotating, scaling, or transforming the object in three-dimensional space, or by applying a texture to the object's surface. FIG. 3A shows an example in which data on one layer is corrupted. FIG. 3B shows an image in which data on one layer is corrupted.

[0024] 3A, the word "(broken)" has been added after the original name of the layer 108a1 to indicate that the data of the layer 108a1 has been corrupted. Depending on the state of corruption of the layer data, data related to the objects defined in the layer may be in an abnormal state. In this case, the image of the layer itself may not be able to be displayed.

[0025] In such cases, the system can detect that the layer data is corrupted by checking whether various data are in an abnormal state, so it is desirable to inform the user that the layer data is corrupted by displaying (broken) or similar so that the corrupted layer can be identified.

[0026] Even if the data for the objects defined on a layer does not indicate an abnormality, the layer may still be corrupted. In such cases, a "broken" message will not be displayed, but the layer image itself will be unintended. In this case, the user will be aware of the corrupted layer data. As shown in FIG. 3B, the light source data for layer 108a1, which defines 3D objects, is corrupted, resulting in cup 108b1 appearing as a black cup silhouette. FIG. 4A illustrates a setting that displays only the corrupted layer 108a1 and background color and sets the corrupted layer 108a1 as being edited (a pen icon is displayed in column 108d). FIG. 4B illustrates an example image of the corrupted layer 108a1 (cup 108b1). In FIG. 4A, to display only layer 108a1 and the background color, eye icons are displayed only in column 108c and column 118d for display instructions for layer 108a1 and paper layer 118a.

[0027] FIG. 4B shows a black cup 108b1. Because the light source settings for the 3D object have been lost, the cup 108b1 is not illuminated. Since the object can be identified as a 3D object, a command sequence 108y for editing the 3D model and a handle 108x for moving, rotating, and scaling the cup 108b in three-dimensional space are displayed. FIG. 5A shows a state in which a new layer has been generated based on raster data saved before the layer was corrupted. FIG. 5B shows an example in which the corrupted layer 108a1 is replaced with a new layer 508a generated based on the raster data and displayed on the canvas. More specifically, a raster object is created based on the raster data, and a new layer 508a in which the object is defined is generated. In this figure, the resolution of the raster data is reduced to make the difference easier to understand. It is desirable to set the resolution of the raster data to be the same as or higher than the resolution of the canvas. Alternatively, raster data with multiple different resolutions may be created. The raster data with multiple different resolutions may be mipmap image data.

[0028] In FIG. 5A, no eye icon is displayed in field 108c1, which indicates the display of layer 108a1, but an eye icon is displayed in field 508c, which indicates the display of newly generated layer 508a, in which a raster-format object is defined, indicating that the layer should be displayed.

[0029] The generation and display instruction of layer 508a may be performed automatically when the system detects corruption of layer 108a1, or may be performed in response to a user instruction. In particular, if the system cannot detect an abnormality in the layer data, the user may specify the layer displaying the abnormal image, and the system may generate a new layer that can display the raster data stored in that layer based on the user instruction.

[0030] Alternatively, a raster object can be created based on the raster data and the object defined in the broken layer can be replaced with the newly created object. In this case, the original layer is maintained and a new layer is not created. In the layer list, the name of the layer "3D_cup" changes to "3D_cup (rastered)" and "3D_cup (broken)" does not appear. Alternatively, if multiple objects are defined in the broken layer, a new layer can be created based only on the pre-saved raster data corresponding to a specific object. FIG. 6A shows an example of a layer 508a with a created raster object defined, with the setting to display only the background color (the eye icon is displayed in field 118c). Furthermore, the created layer 508a is being edited. FIG. 6B shows an example of an image 508b of the created layer 508a with a raster object defined, and the background color of the layer 118a. 6A, an eye icon is displayed in the display instruction column 508c and column 118c so that only the layer 508a on which the generated raster object 508b is defined and the background color are displayed. Furthermore, a pen icon is displayed in column 508d to indicate that the generated layer 508a is being edited.

[0031] In Figure 6B, a raster object created based on previously saved raster data of a cup is displayed on the canvas. Because the cup is a raster object, commands for editing the 3D object are not displayed. Also, because the raster data has a lower resolution, it can be seen that the cup image 508b is rougher than the 3D object image.

[0032] In this way, by saving pre-created raster data for layers with non-raster object formats, even if the layer data is corrupted, the saved raster data can be used to replace the corrupted layer or the corrupted object within the layer, thereby restoring the image. Raster data for layers with non-raster object formats may be created at predetermined time intervals and stored in a storage unit in association with data identifying the layer. The resolution of the created raster data may also be specified in advance. Figure 7A illustrates an example in which a vector object is created from saved raster data and a new layer is generated. Figure 7B illustrates a newly created vector object. In Figure 7A, eye icons are displayed only in display instruction columns 708c and 118c so that only the newly created layer 708a with the vector object defined and the background color are displayed. Furthermore, a pen icon is displayed in column 708d, indicating that the created layer is being edited.

[0033] 7B, a cup image 708b is displayed, which is a vector object created based on raster data. Because cup image 708b is a vector image, it appears to have more detail than cup 508b, which is a raster object. However, because cup 708b is a vector image, commands for editing 3D objects are not displayed.

[0034] If the corrupted layer is a layer with a vector object defined, you can restore the original object by creating a vector object from the saved raster data. However, the resulting object may not be identical to the original. FIG. 8A shows an example of creating a 3D object from saved raster data and generating a new layer. FIG. 8B shows an image of the newly created 3D object. In FIG. 8A, eye icons are displayed only in display instruction columns 808c and 118c so that only the newly created layer 808a with the 3D object defined and the background color are displayed. Furthermore, a pen icon is displayed in column 808d, indicating that the created layer 808a is being edited.

[0035] 8B, a cup 808b, which is a 3D object created based on raster data, is displayed. Because the cup 808b is a 3D object, it can be seen that the image is more detailed than the cup image 508b, which is a raster object. Furthermore, because the cup 808b is a 3D object, a group of commands 808y and handles 808x for editing the 3D object are displayed.

[0036] In this way, by creating a 3D object from the saved raster data, it is possible to easily move, rotate, scale, and deform the cup 808b. Figure 9 is a flowchart showing the processing of the disclosed technique. Each step is described below.

[0037] [Step S902] The resolution of the raster data is determined based on an instruction from the operator. The process proceeds to step S904.

[0038] [Step S904] Raster data is created from a first layer in which an object in a first format other than raster format is defined. Processing proceeds to step S906. [Step S906] Information linking the raster data to the first layer is generated. Processing proceeds to step S908. [Step S908] The layer, raster data, and linking information are saved to a storage medium.

[0039] Through the above processing, data of a layer in which an object in a format other than raster format is defined and the raster data of that layer are linked and saved to a storage medium. The saved raster data can be used if the layer is damaged. FIG. 10 is a flowchart showing the processing executed in response to layer damage. Each step is explained below. [Step S1002] The layer, raster data, and linking information are read from the storage medium. Processing proceeds to step S1004.

[0040] [Step S1004] It is checked whether the first layer is damaged. If this check is affirmative (Yes), the process proceeds to step S1006. If this check is negative (No), the process ends.

[0041] [Step S1006] At least a portion of the first layer is replaced with an object created based on raster data, or a layer generated based on the created object. The replacement may be performed based on an operator's operation or automatically by the system. FIG. 11 is a flowchart showing the process of creating raster data from a layer in which an object of a first format other than a raster format is defined. This flowchart provides more detailed information about step S904. Each step is described below.

[0042] [Step S1102] This step indicates that this is a subroutine of step S904, which creates raster data from a first layer defined in a first format other than the raster format. [Step S1104] Raster data is created at a predetermined frequency. [Step S1106] This step returns the process.

[0043] The predetermined frequency may be specified by the user, or a default value may be set in advance. Alternatively, raster data may be created and saved when the entire data is saved. Creating raster data at a predetermined frequency allows for flexible response to unexpected data corruption. FIG. 12 is a flowchart showing a process for replacing at least a portion of the first layer based on the created raster data. This flowchart provides more detailed information about step S1006. Each step will be described below.

[0044] [Step S1202] This step indicates that this is a subroutine of step S1006, which replaces at least a part of the first layer with an object created based on raster data or a layer generated based on the created object. [Step S1204] One or more substitute layers are generated based on an object created based on raster data. [Step S1206] This step returns the process.

[0045] An object in vector format, 3D format, or the like is created from the created raster data. If the format of the object defined in the corrupted layer is known, an object in that format may be generated. If the format of the object defined in the corrupted layer is unknown, the object format may be estimated using AI. Alternatively, if the format of the corrupted layer is unknown, it may be specified to convert it into an object in a specific format, such as a vector format. Figure 13 is a flowchart showing the process of replacing an object based on the created raster data. This flowchart is a more detailed flowchart of step S1006. Each step is described below.

[0046] [Step S1302] This step indicates that this is a subroutine of step S1006, in which at least a part of the first layer is replaced with an object created based on raster data, or a layer generated based on the created object.

[0047] [Step S1304] Based on a user instruction, at least a portion of the first layer is replaced with either a substitute layer in which a raster-format object is defined or a substitute layer in which a first-format object is defined, or both. The substitute layer to be replaced may be determined based on an operator's instruction. [Step S1306] This is a step for returning the process. FIG. 14 is a flowchart showing the process of creating raster data from a layer in which a non-raster-format object is defined. This flowchart is a more detailed flowchart of step S904. Each step is described below.

[0048] [Step S1402] This step indicates that this is a subroutine of step S904 for creating raster data from the first layer in which an object in a first format other than the raster format is defined.

[0049] [Step S1404] If multiple objects are defined on the first layer, raster data corresponding to each of the multiple objects is created based on each of the multiple objects. [Step S1406] This is the step to return the process.

[0050] By creating raster data corresponding to each of the multiple objects based on each of the multiple objects, detailed processing can be performed, such as replacing only the damaged object using only the raster data corresponding to the damaged object. Figure 15 is a flowchart showing the process of replacing an object based on the created raster data. This flowchart is a more detailed flowchart of step S1006. Each step will be described below.

[0051] [Step S1502] This step indicates that this is a subroutine of step S1006, in which at least a part of the first layer is replaced with an object created based on raster data, or a layer generated based on the created object.

[0052] [Step S1504] It is checked whether the first format is unknown. If this check is affirmative (Yes), the process proceeds to step S1506. If this check is negative (No), the process returns. [Step S1506] The first format is estimated from the raster data. This estimation can be achieved using AI. [Step S1508] This is a step for returning the process. In yet another embodiment, multiple objects of different formats may be defined on a single layer. In this case, a single raster data set may be created from all objects defined on that layer. Alternatively, raster data may be created for each object format. Alternatively, a single object may be divided into multiple parts, and raster data for each part may be created.

[0053] FIG. 16 is a hardware configuration diagram of the disclosed technology.

[0054] The hardware configuration of the disclosed technology includes a CPU 3001, a ROM 3002 in which the program and data of this embodiment can be stored, a RAM 3003, a network interface 3005, an input interface 3006, a display interface 3007, and an external memory interface 3008. These pieces of hardware are connected to each other by a bus 3004.

[0055] The network interface 3005 is connected to a network 3015. The network 3015 may be a wired LAN, a wireless LAN, the Internet, a telephone network, or the like. The input interface 3006 is connected to an input unit 3016. The display interface 3007 is connected to a display unit 3017. The display unit 3017 may be realized by a plurality of display devices. The external memory interface 3008 is connected to a storage medium 3018. The storage medium 3018 may be a RAM, a ROM, a CD-ROM, a DVD-ROM, a hard disk, a memory card, a USB memory, or the like.

[0056] The order of steps in the methods or programs of the illustrated embodiments may be changed as long as there is no contradiction. Furthermore, one illustrated step may be executed multiple times at different times as long as there is no contradiction. Furthermore, multiple steps may be executed simultaneously as long as there is no contradiction. Furthermore, not all steps are essential, and some steps may not exist or may not be executed as long as there is no contradiction.

[0057] The same applies to the elements of the methods defined in the claims. That is, the order of the elements can be changed as long as there is no contradiction. Furthermore, multiple elements can be implemented simultaneously as long as there is no contradiction. The implementation of these elements also falls within the technical scope defined in the claims.

[0058] Each procedure may be executed by an operating system or hardware. The program may be distributed in a state stored in a non-transitory medium.

[0059] The program and method for realizing the above-described embodiments may be executed by a computer having the hardware configuration shown in FIG. 16. That is, the program of the embodiment may be implemented as a method executed by a computer. The program may be stored in a storage medium 3018, a ROM 3002, or a RAM 3003. Each embodiment may be implemented as a hardware device on which the program is installed. FIG. 17 is a functional block diagram of the disclosed technology. A raster data creation unit 1702 creates raster data from layers in a non-raster format.

[0060] A layer data, raster data, and linked data storage unit 1704 stores layers other than those in raster format, the created raster data, and data linking these to each other in a storage medium 1706 .

[0061] A layer data and raster data associated with the layer acquisition unit 1708 acquires the layer data and raster data associated with the layer from the storage medium 1706 .

[0062] The corruption detection unit 1710 detects corruption of data in a layer. Note that there are cases where corruption is not detected. If corruption is not detected, the corrupted layer may be identified based on instructions from an operator.

[0063] The format estimation AI 1712 estimates the format of the object defined in the corrupted layer. Note that even if a layer is corrupted, data defining the format of the object defined in the layer may still exist.

[0064] The object restorer 1714 restores an object corresponding to the estimated format of the object defined in the corrupted layer using the created raster data. Note that AI may be used for this process. The substitute layer B generator 1716 including the created object generates a substitute layer from the restored object. Note that the restored object or layer may not be completely identical to the original object or layer. The substitute layer A generator 1718 including the created raster data creates a substitute layer A including the created raster data. Whether the substitute layer A or the substitute layer B replaces the corrupted layer may be determined based on an operator's instructions.

[0065] 3001 CPU 3002 ROM 3003 RAM 3004 Bus 3005 Network interface 3006 Input interface 3007 Display interface 3008 External memory interface 3015 Network 3016 Input unit 3017 Display unit 3018 Storage medium

Claims

1. An image synthesis method in which a computer synthesizes an image in which images represented by objects defined on each of a plurality of layers are superimposed, the image synthesis method comprising: creating raster data from a first layer in which an object of a first format other than a raster format is defined; detecting whether the first layer is corrupted; and, if it is detected that the first layer is corrupted or if an instruction is received from a user, replacing at least a portion of the first layer with an object created based on the raster data or a layer generated based on the created object.

2. The image synthesis method according to claim 1, wherein the creating step includes creating the raster data at a predetermined frequency.

3. The image synthesis method according to claim 1, further comprising: generating information linking the raster data to the first layer; and storing the raster data and the linking information in a storage medium.

4. The image synthesis method according to claim 1, further comprising: receiving a user instruction relating to a resolution of the raster data; and determining a resolution of the raster data based on the instruction.

5. The image compositing method of claim 1, wherein the substituting includes: generating one or more substitute layers based on objects created based on the raster data when it is detected that the first layer is corrupted or when an instruction is received from a user; and substituting the substitute layers for at least a portion of the first layer.

6. The image synthesis method according to claim 5, wherein at least one of the substitute layers is a substitute layer A in which a raster-format object is defined.

7. The image synthesis method according to claim 6, wherein at least one of the substitute layers is a substitute layer B in which the object of the first format is defined.

8. The image synthesis method according to claim 6, wherein at least one of the substitute layers is a substitute layer C in which an object in a format different from both the raster format and the first format is defined.

9. The image compositing method of claim 7, wherein the substituting includes: receiving a user instruction; and substituting at least a portion of the first layer with either or both of the substitute layer A and the substitute layer B based on the instruction.

10. The image synthesis method of claim 8, wherein the substituting includes: receiving a user instruction; and, based on the instruction, substituting at least a portion of the first layer with either or both of the substitute layer A and the substitute layer C.

11. The image synthesis method according to claim 1, wherein the creating step includes: when a plurality of objects are defined on the first layer, creating raster data corresponding to each of the plurality of objects based on each of the plurality of objects.

12. The image synthesis method according to claim 1, wherein the first format is any one of a format in which vector information is defined, a format in which a 3D object is defined, a format in which a manga frame border is defined, a format including text, a format in which a tone is defined, and a format in which a file in which an object is saved is referenced.

13. The image synthesis method of claim 7, wherein said substituting comprises: if said first format is unknown, estimating said first format from said raster data.

14. A program for causing a computer to execute the method according to any one of claims 1 to 13.

Images