Image synthesis method and program

By storing pre-created raster data in the image layer and replacing or creating an alternative layer when a corruption is detected, the recovery problem after image data is damaged is solved, reducing the inconvenience of continuing editing.

JP7628267B1Active Publication Date: 2025-02-10CELSYS CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2024122454
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-07-29
Publication Date
2025-02-10
Estimated Expiration
2044-07-29

AI Technical Summary

Technical Problem

The prior art When image data is corrupted, image data is easily affected and difficult to recover.

Method used

Recover the image by storing pre-created raster data in each layer and replacing or creating an alternative layer with the raster data when it is detected that the layer data is corrupted.

Benefits of technology

Reduces the impact when image data is corrupted and simplifies the inconvenience of continuing to edit images.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007628267000001_ABST
    Figure 0007628267000001_ABST
Patent Text Reader

Abstract

To provide an image synthesis method and program that, even if image data is corrupted, further reduces the effect on an image caused by the corruption and minimizes inconvenience when a user continues editing an image. [Solution] An image synthesis method in which a computer synthesizes an image by superimposing images represented by objects defined in each of a plurality of layers, the method including creating and storing raster data defined in a raster format from a first layer defined in a format other than raster format, reading the layer, the raster data, and linking information from a storage medium, detecting whether the first layer is corrupted, and if it is detected that the first layer is corrupted, replacing at least a portion of the first layer with an object created based on the raster data or a layer generated based on the created object.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an image synthesis method and a program. [Background technology]

[0002] Software exists to assist in the creation of illustrations and other images.

[0003] Software for creating illustrations and images has a feature called "layers." Layers are like "layers" that are convenient when drawing or editing, and using them can make image creation more efficient.

[0004] Layers allow you to work (create, display, edit) on illustrations and images by dividing them into multiple layers. For example, you can put the background on one layer and the character on another layer. This makes it easy to make fine adjustments because changing the background does not affect the character.

[0005] Layers have functions such as "hide" and "show". This allows you to show or hide only specific layers. For example, you can show only the character layer and focus on editing only that part. This makes it easier to adjust the details while keeping an eye on the overall balance.

[0006] You can also combine images of multiple objects by stacking layers. For example, you can create a more three-dimensional illustration by drawing a character on top of a background layer and then adding a shadow on top of it. In this way, since each layer is independent, it is easy to change or adjust it later, making your work more efficient.

[0007] In addition, some drawing software allows you to apply different formats to each layer, such as raster, vector, 3D, etc. Using drawing software that can handle such layers makes it easier and more intuitive to create and edit illustrations and images that are composed of different types of objects.

[0008] There is prior art disclosure regarding the layer function in drawing software with a layer structure when creating images. When drawing an illustration, the line drawing and paint colors, characters and background that make up the illustration can be drawn on separate layers, allowing each to be edited separately. It has been disclosed that by handling the components of an illustration in a layer structure, such as hiding unnecessary sketches, repainting while leaving the line drawing intact, or changing the position of a character relative to the background, subsequent revision work can be carried out efficiently. (For example, see Non-Patent Document 1)

[0009] Besides the drawing software, there is a conventional technology having a user interface with a layer structure. For example, there is a technology that provides a vehicle device that can prevent unauthorized display in a virtualized environment in which multiple operating systems each perform display on a display. The display output unit is provided with a display output unit that composites multiple layers in a hierarchical structure and outputs the composite data to a display unit, and the display output unit composites multiple layers to be composited so that a relatively higher layer is displayed with priority over a relatively lower layer. The masking unit pre-draws a masking content (CM) for covering a display in which a defect has occurred on a layer that is higher in the hierarchy than the layers assigned to the multiple operating systems, and when a defect is detected by a monitoring unit, a setting is made to include the layer on which the masking content is drawn in the composite data of the display output unit, thereby masking a display area in which unauthorized display may occur with the masking content (for example, see Patent Document 1).

[0010] Although the above-mentioned technology can handle complex image data, if the data itself is corrupted, the displayed image may be corrupted. Moreover, because the image data is complex, it may take a lot of effort to restore the corrupted data. [Prior art documents] [Non-patent literature]

[0011] [Non-Patent Document 1] https: / / help.clip-studio.com / en-us / manual_en / 180_layers / What_are_layers__63_.htm#XREF_39244__What_are_layers(Accessed: July 26, 2024) [Patent documents]

[0012] [Patent Document 1] JP 2020-187631 A Summary of the Invention [Problem to be solved by the invention]

[0013] The disclosed technology aims to further reduce the effect of corruption on an image, even if image data is corrupted. [Means for solving the problem]

[0014] The disclosed technology provides an image synthesis method in which a computer synthesizes an image that is a superimposed image represented by objects defined in each of a plurality of layers, the image synthesis method including: creating raster data from a first layer in which an object in a first format other than a raster format is defined; detecting whether the first layer is corrupted; and, if it is detected that the first layer is corrupted, replacing at least a portion of the first layer with an object created based on the raster data or a layer generated based on the created object. Effect of the Invention

[0015] With the disclosed technology, even if image data is corrupted, the effect of the corruption on the image can be further reduced. Furthermore, since the layer configuration of the image is similar to the original layer configuration, the inconvenience to the user when continuing image editing can be minimized. [Brief description of the drawings]

[0016] [Figure 1] Fig. 1A is a diagram showing an example of a user interface (UI) for manipulating a layer structure, and Fig. 1B is an example of a display of an image in which layers are superimposed. [Diagram 2] Fig. 2A is a diagram showing an example in which only layers 108a and 118a are set to be displayed, and Fig. 2B is a diagram showing an example in which a cup 108b, which is a 3D object, is displayed on the canvas. [Diagram 3] Fig. 3A is a diagram showing an example when data of one layer is corrupted, and Fig. 3B is a diagram showing an image when data of one layer is corrupted. [Figure 4] Figure 4A shows a setting to show only the corrupted layer and background color, and Figure 4B shows an example image of the corrupted layer. [Diagram 5]Fig. 5A shows a state where a new layer is generated based on the raster data saved before the layer was corrupted, while Fig. 5B shows an example where a layer generated based on the saved raster data is substituted for the corrupted layer image and displayed on the canvas. [Figure 6] Fig. 6A is a diagram showing an example in which a setting is made to display only a layer generated based on a raster object and a background color, and Fig. 6B is a diagram showing an example in which an image of the generated layer is displayed. [Figure 7] Fig. 7A is a diagram showing an example of creating a vector-format object from saved raster data and generating a new layer, while Fig. 7B is a diagram showing an image of the newly created vector-format object. [Figure 8] Fig. 8A is a diagram showing an example of creating a 3D object from saved raster data and generating a new layer, and Fig. 8B is a diagram showing an image of the newly created 3D object. [Figure 9] FIG. 9 is a flowchart showing the processing of the disclosed technique. [Figure 10] FIG. 10 is a flow chart showing processing in response to layer corruption. [Figure 11] FIG. 11 is a flowchart showing a process for creating raster data from a first layer in which an object in a first format other than the raster format is defined. [Figure 12] FIG. 12 is a flow chart showing the process of creating an object based on the created raster data and generating a substitute layer. [Figure 13] FIG. 13 is a flowchart showing a process of replacing at least a part of the first layer based on a user instruction. [Figure 14] FIG. 14 is a flowchart showing a process for creating raster data from a layer in which an object in a first format other than the raster format is defined. [Figure 15]FIG. 15 is a flowchart showing a process for replacing at least a portion of a first layer with an object or a layer. [Figure 16] FIG. 16 is a hardware configuration diagram of the disclosed technology. [Figure 17] FIG. 17 is a functional block diagram of the disclosed technology. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] The disclosed technology will be described below with reference to the drawings.

[0018] Fig. 1A is a diagram showing an example of a user interface (UI) for manipulating a layer structure, and Fig. 1B is an example of a display of an image in which layers are superimposed.

[0019] In FIG. 1A, layer list 100 can handle multiple layers 102a to 118a. Column 120 is a display instruction field for setting whether a layer is visible or hidden. Clicking on each display instruction field in column 120 toggles the visibility of the eye icon. A layer with an eye icon displayed is displayed on the canvas. A layer without an eye icon displayed is not displayed on the canvas. Column 125 of FIG. 1A is illustrated in FIG. 2A. 1A, column 130 is the name of the layer. The user can give each layer a name of their choice to make it easier to identify them.

[0020] In Fig. 1B, the images of each layer are composited and displayed on the canvas 150. When eye icons are displayed on all layers in the layer list 100 in Fig. 1A, the images of all layers are superimposed and displayed in Fig. 1B. When an image of an upper layer and an image below that layer overlap in the layer list 100, the image of the lower layer is displayed so that the opaque part of the image of the upper layer hides the image of the lower layer.

[0021] Each layer has a different object format defined. Object formats include "raster format" which defines bitmap image objects, "vector format" which defines vector image objects, "3D format" which defines objects such as three-dimensional shapes, "frame frame format" which defines frame border objects, "text format" which defines text objects, "tone format" which defines screen tones, "paper format" which defines background colors, and "external reference format" which defines external reference objects which reference the files in which the objects are saved. 3D objects may also include texture, lighting, and virtual camera information. The text object may further include font information and text frame information. The shape of the text frame may be a rectangle, a circle, an ellipse, a speech bubble, or the like. A frame border 102b in the form of a frame frame is defined in the layer 102a. A raster-format circular line image 104b is defined in the layer 104a. A wavy line 106b in vector format is defined in the layer 106a. In layer 108a, a 3D model 108b of a cup is defined in 3D format. A frame border 110b in the form of a frame frame is defined in the layer 110a. Layer 112a defines text in text format and speech bubbles 112b. A 3D character 114b is defined in layer 114a. In the layer 116a, a screen tone 116b in a tone format is defined. In layer 118a, a paper 118b of a paper format is defined.

[0022] Furthermore, each layer may have multiple objects defined. Areas of a layer that have no objects may be transparent. Transparent parts of a layer allow the layer below to be displayed. Furthermore, transparency may be set for layers. For layers that are set to semi-transparent, the image of that layer becomes semi-transparent, and an image composited with the image of the layer below is displayed. 2A shows an example where only layers 108a and 118a are set to be displayed, and a pen icon in field 108d indicates that the layer is being edited.

[0023] 2B is a diagram showing an example in which a 3D object, cup 108b, is displayed on the canvas with the background color set to white by the display settings of FIG. 2A. Since cup 108b being edited is a 3D object, command sequence 108y for editing the 3D model and handles 108x for moving, rotating, and enlarging / reducing cup 108b in three-dimensional space are displayed. A 3D object can be freely edited and deformed by a user operating command sequence 108y and handles 108x to move, rotate, enlarge, and reduce the object in three-dimensional space, to deform the object, and to attach a texture to the surface of the object. FIG. 3A is a diagram showing an example where data in one layer is corrupted. FIG. 3B shows an image when one layer of data is corrupted.

[0024] In Fig. 3A, the word (broken) is added after the original name of the layer 108a1 to indicate that the data of the layer 108a1 is broken. Depending on the state of the broken data of the layer, data related to the objects defined in the layer may be in an unusual state. In this case, the image of the layer itself may not be displayed.

[0025] In such cases, the system can detect that the layer data is corrupted by checking whether various data are in an abnormal state, and it is desirable to inform the user that the layer data is corrupted by displaying (broken) or similar so that the corrupted layer can be identified to indicate this to the user.

[0026] Even if the data related to the objects defined in a layer does not indicate any abnormality, the layer may be corrupted. In such a case, the layer image itself may be an unintended image, although no display such as (broken) will be shown. In this case, the user himself will be aware of the corruption of the layer data. As shown in FIG. 3B, the light source data in layer 108a1, in which 3D objects are defined, has been corrupted, and so cup 108b1 appears as an image of a black silhouette of a cup. FIG. 4A is a diagram showing a setting in which only the damaged layer 108a1 and the background color are displayed and the damaged layer 108a1 is set as being edited (a pen icon is displayed in the field 108d). FIG. 4B shows an example of an image of a damaged layer 108a1 (cup 108b1). In FIG. 4A, in order to display only the layer 108a1 and the background color, eye icons are displayed only in the display instruction columns 108c and 118c of this layer 108a1 and the paper layer 118a.

[0027] In Fig. 4B, a black cup 108b1 is displayed. It can be seen that the light source setting for the 3D object has been lost, so the cup 108b1 is not illuminated by any illumination light. Since it can be identified as a 3D object, a command sequence 108y for editing the 3D model and a handle 108x for moving, rotating, and scaling the cup 108b in three-dimensional space are displayed. FIG. 5A shows a state in which a new layer has been generated based on the raster data that was saved before the layer was corrupted. 5B is a diagram showing an example in which the damaged layer 108a1 is replaced with a new layer 508a generated based on raster data and displayed on the canvas. More specifically, a raster-format object is created based on the raster data, and a new layer 508a in which the object is defined is generated. In this figure, the resolution of the raster data is lowered to make the difference easier to understand. It is preferable to set the resolution of the raster data to be the same as or higher than the resolution of the canvas. Alternatively, raster data with multiple different resolutions may be created. The raster data with multiple different resolutions may be image data in a mipmap format.

[0028] In FIG. 5A, no eye icon is displayed in field 108c1, which indicates the display of layer 108a1, but an eye icon is displayed in field 508c, which indicates the display of newly generated layer 508a, in which a raster-format object is defined, and the display is instructed.

[0029] The generation and display instruction of this layer 508a may be performed automatically when the system detects damage to layer 108a1, or may be performed by a user instruction. In particular, when the system cannot detect an abnormality in the data of a layer, the user may specify the layer in which the abnormal image is displayed, and the system may generate a new layer that can display the raster data stored in that layer, based on the user's instruction.

[0030] Alternatively, you can create a raster object based on the raster data and replace the object defined in the broken layer with the newly created object. In this case, the original layer will be kept and no new layer will be created. In the layers list, the layer "3D_cup" will be renamed to "3D_cup (rastered)" and "3D_cup (broken)" will not appear. Alternatively, if the corrupted layer has multiple objects defined, a new layer may be generated based only on the pre-stored raster data corresponding to the particular object. 6A shows an example of a layer 508a in which a raster object is defined and a setting to display only the background color (a setting to display an eye icon in field 118c). Furthermore, the layer 508a is being edited. FIG. 6B is a diagram showing an example in which the generated image 508b of the layer 508a in which the raster object is defined and the background color of the layer 118a are displayed. 6A, an eye icon is displayed in the display instruction column 508c and column 118c so as to display only the layer 508a in which the generated raster object 508b is defined and the background color. Furthermore, a pen icon is displayed in column 508d to indicate that the generated layer 508a is being edited.

[0031] In Fig. 6B, a raster object based on previously saved raster data of a cup is displayed on the canvas. Because the cup is a raster object, no commands for editing the 3D object are displayed. Also, because the resolution of the raster data is low, it can be seen that the image 508b of the cup is rougher than the image of the 3D object.

[0032] In this way, by storing raster data created in advance for layers in which objects in a format other than the raster format are defined, even if the data of the layer is damaged, the stored raster data can be used to replace the damaged layer or the damaged object in the layer based on the raster data, thereby recovering the image. Note that raster data for layers in which objects in a format other than the raster format are defined may be created at predetermined time intervals, and stored in the storage unit in association with data identifying the layer. Also, the resolution of the created raster data may be specified in advance. FIG. 7A is a diagram showing an example in which a vector-format object is created from saved raster data and a new layer is generated. FIG. 7B shows the newly created vector object. In Fig. 7A, eye icons are displayed only in the display instruction columns 708c and 118c so that only the newly created layer 708a with the vector-format object defined and the background color are displayed. In addition, a pen icon is displayed in column 708d to indicate that the created layer is being edited.

[0033] 7B, a cup image 708b is displayed, which is a vector object created based on raster data. Because the cup image 708b is in vector format, it can be seen that the image is more detailed than the cup 508b, which is a raster object. However, because the cup 708b is in vector format, no commands are displayed for editing 3D objects.

[0034] If the damaged layer is a layer with a vector object defined in it, you can recover the same object by creating a vector object from the saved raster data, but you will not get an exact replica of the original. FIG. 8A is a diagram showing an example in which a 3D object is created from saved raster data and a new layer is generated. FIG. 8B shows an image of the newly created object in 3D format. In Fig. 8A, eye icons are displayed only in the display instruction field 808c and field 118c so that only the newly generated layer 808a in which a 3D object is defined and the background color are displayed. Furthermore, a pen icon is displayed in field 808d to indicate that the generated layer 808a is being edited.

[0035] 8B shows a cup 808b, which is a 3D object created based on raster data. Because the cup 808b is a 3D object, it can be seen that the image is finer than the cup image 508b, which is a raster object. Moreover, because the cup 808b is a 3D object, a group of commands 808y and handles 808x for editing the 3D object are displayed.

[0036] In this way, by creating a 3D object from the saved raster data, the cup 808b can be easily moved, rotated, enlarged, reduced, and transformed. 9 is a flowchart showing the process of the disclosed technique. Each step will be described below.

[0037] [Step S902] The resolution of the raster data is determined based on an instruction from the operator. Then the process proceeds to step S904.

[0038] [Step S904] Raster data is created from the first layer in which an object in a first format other than raster format is defined. The process proceeds to step S906. [Step S906] Generate information linking the raster data to the first layer. Then proceed to step S908. [Step S908] The layer, raster data, and linking information are stored in a storage medium.

[0039] By the above processing, data of a layer in which an object in a format other than a raster format is defined and the raster data of the layer are linked and saved in a storage medium. The saved raster data can be used if the layer is damaged. Figure 10 is a flow chart showing the steps taken in response to a layer being corrupted. Each step is explained below. [Step S1002] The layer, raster data, and linking information are read from the storage medium. The process proceeds to step S1004.

[0040] [Step S1004] It is checked whether the first layer is damaged. If the check is affirmative (Yes), the process proceeds to step S1006. If the check is negative (No), the process ends.

[0041] [Step S1006] At least a part of the first layer is replaced with an object created based on raster data, or a layer generated based on the created object. Note that the replacement may be performed based on an operator's operation, or may be performed automatically by the system. FIG. 11 is a flowchart showing a process for creating raster data from a layer in which an object in a first format other than a raster format is defined. This flowchart is a more detailed flowchart of step S904. Each step will be described below.

[0042] [Step S1102] This step indicates that this is a subroutine of step S904 for creating raster data from a first layer defined in a first format other than the raster format. [Step S1104] Raster data is created at a predetermined frequency. [Step S1106] This is a step for returning the process.

[0043] The predetermined frequency may be specified by the user, or a default value may be set in advance. Alternatively, the raster data may be created and saved when the entire data is saved. By creating the raster data at a predetermined frequency, it is possible to flexibly respond to unexpected data corruption. FIG. 12 is a flowchart showing a process for replacing at least a portion of the first layer based on the created raster data. This flowchart is a more detailed flowchart of step S1006. Each step will be described below.

[0044] [Step S1202] This step indicates that this is a subroutine of step S1006 in which at least a part of the first layer is replaced with an object created based on raster data, or with a layer generated based on the created object. [Step S1204] One or more substitute layers are generated based on the object created based on the raster data. [Step S1206] This is the step to return the process.

[0045] From the created raster data, objects in vector format, 3D format, etc. can be created. If the format of the object defined in the damaged layer is known, an object in that format can be generated. If the format of the object defined in the damaged layer is unknown, the object format can be estimated using AI. Alternatively, if the format of the damaged layer is unknown, it can be specified to convert it into an object in a specific format, such as a vector format. FIG. 13 is a flowchart showing a process for substituting an object based on the created raster data. This flowchart is a more detailed flowchart of step S1006. Each step will be described below.

[0046] [Step S1302] This step indicates that this is a subroutine of step S1006 in which at least a part of the first layer is replaced with an object created based on raster data, or with a layer generated based on the created object.

[0047] [Step S1304] Based on a user instruction, at least a portion of the first layer is replaced with either or both of an alternative layer in which raster-format objects are defined and an alternative layer in which first-format objects are defined. The choice of which substitute layer to use may be based on an instruction from an operator. [Step S1306] This is the step to return the process. FIG. 14 is a flowchart showing the process of creating raster data from a layer in which an object in a format other than the raster format is defined. This flowchart is a more detailed flowchart of step S904. Each step will be described below.

[0048] [Step S1402] This step indicates that this is a subroutine of step S904 for creating raster data from a first layer in which an object in a first format other than a raster format is defined.

[0049] [Step S1404] When multiple objects are defined in the first layer, raster data corresponding to each of the multiple objects is created based on each of the multiple objects. [Step S1406] This is a step for returning the process.

[0050] By creating raster data corresponding to each of the plurality of objects based on each of the plurality of objects, detailed processing such as substituting only the damaged object using only the raster data corresponding to the damaged object can be performed. FIG. 15 is a flowchart showing a process for substituting an object based on the created raster data. This flowchart is a more detailed flowchart of step S1006. Each step will be described below.

[0051] [Step S1502] This step indicates that this is a subroutine of step S1006 in which at least a part of the first layer is replaced with an object created based on raster data, or with a layer generated based on the created object.

[0052] [Step S1504] It is checked whether the first format is unknown. If the check is affirmative (Yes), the process proceeds to step S1506. If the check is negative (No), the process returns. [Step S1506] The first format is estimated from the raster data. This estimation can be realized by using AI. [Step S1508] This is the step to return the process. In yet another embodiment, a layer may have a plurality of objects of different formats defined thereon. In this case, a single raster data may be created from all the objects defined in the layer. Alternatively, raster data may be created for each object format. Also, one object may be divided into multiple parts and raster data may be created for each part.

[0053] FIG. 16 is a hardware configuration diagram of the disclosed technology.

[0054] The hardware configuration of the disclosed technology includes a CPU 3001, a ROM 3002 in which the program and data of the present embodiment can be stored, a RAM 3003, a network interface 3005, an input interface 3006, a display interface 3007, and an external memory interface 3008. These pieces of hardware are connected to each other by a bus 3004.

[0055] The network interface 3005 is connected to a network 3015. The network 3015 may be a wired LAN, a wireless LAN, the Internet, a telephone network, or the like. The input interface 3006 is connected to an input unit 3016. The display interface 3007 is connected to a display unit 3017. The display unit 3017 may be realized by a plurality of display devices. The external memory interface 3008 is connected to a storage medium 3018. The storage medium 3018 may be a RAM, a ROM, a CD-ROM, a DVD-ROM, a hard disk, a memory card, a USB memory, or the like.

[0056] The steps of the method or program of the illustrated embodiment may be rearranged as long as there is no contradiction. Furthermore, one illustrated step may be executed multiple times at different times as long as there is no contradiction. Furthermore, multiple steps may be executed simultaneously as long as there is no contradiction. Furthermore, not all steps are essential, and some steps may not exist or may not be executed as long as there is no contradiction.

[0057] The above points also apply to the constituent elements of the method defined in the claims. That is, the order of the constituent elements can be changed as long as there is no contradiction. Also, multiple constituent elements can be implemented simultaneously as long as there is no contradiction. The implementation of these constituent elements also falls within the technical scope defined in the claims.

[0058] Moreover, each procedure may be executed by an operating system or hardware. Also, the program may be distributed in a state stored in a non-transitory medium.

[0059] The program and method for realizing the above-described embodiment may be executed by a computer having the hardware configuration shown in Fig. 16. That is, the program of the embodiment may be implemented as a method for causing a computer to execute the program. The program may be stored in the storage medium 3018, the ROM 3002, or the RAM 3003. Each embodiment may be implemented as a hardware device having a program installed thereon. FIG. 17 is a functional block diagram of the disclosed technology. A raster data creation unit 1702 creates raster data from layers other than those in the raster format.

[0060] A layer data, raster data, and linked data storage unit 1704 stores layers other than those in raster format, the created raster data, and data linking these in a storage medium 1706.

[0061] A layer data and raster data associated with the layer acquisition unit 1708 acquires the layer data and the raster data associated with the layer from the storage medium 1706 .

[0062] The corruption detector 1710 detects corruption of data in a layer. Note that corruption may not be detected. If corruption is not detected, the corrupted layer may be identified based on an operator's instructions.

[0063] The format estimation AI 1712 estimates the format of an object defined in a corrupted layer. Note that even if a layer is corrupted, data defining the format of an object defined in the layer may exist.

[0064] The object restorer 1714 uses the created raster data to recover objects that correspond to the estimated form of the object defined in the corrupted layer. Note that AI may be used for this process. The substitute layer B generator 1716 containing the created object generates a substitute layer from the restored object. Note that the restored object or layer may not be completely identical to the original object or layer. A substitute layer A generating unit 1718 including the created raster data creates a substitute layer A including the created raster data. Whether the damaged layer is replaced by replacement layer A or replacement layer B may be determined based on an instruction from an operator. [Explanation of symbols]

[0065] 3001 CPU 3002 ROM 3003 RAM 3004 Bus 3005 Network Interface 3006 Input Interface 3007 Display Interface 3008 External Memory Interface 3015 Network 3016 Input section 3017 Display section 3018 Storage medium

Claims

1. 1. An image synthesis method in which a computer synthesizes an image obtained by superimposing images represented by objects defined in each of a plurality of layers, the method comprising the steps of: creating raster data from a first layer having objects defined thereon in a first format other than a raster format; detecting whether the first layer is corrupted; if it is detected that the first layer is corrupted or if an instruction from a user is received, replacing at least a part of the first layer with an object created based on the raster data or a layer generated based on the created object; The image synthesis method includes the steps of:

2. The creating step comprises: generating the raster data at a predetermined frequency; The image synthesis method according to claim 1 , comprising:

3. generating information linking the raster data to the first layer; storing the raster data and the linking information in a storage medium; The image synthesis method of claim 1 , further comprising:

4. receiving a user indication of a resolution of the raster data; determining a resolution of the raster data based on the instruction; and The image synthesis method of claim 1 , further comprising:

5. The replacing step comprises: generating one or more substitute layers based on objects created based on the raster data when the first layer is detected to be corrupted or when a user instruction is received; replacing at least a portion of the first layer with the replacement layer; The image synthesis method according to claim 1 , comprising:

6. At least one of the substitute layers is a substitute layer A in which a raster-format object is defined; The image synthesis method according to claim 5 .

7. At least one of the substitution layers is a substitution layer B in which the first type of object is defined; The image synthesis method according to claim 6.

8. At least one of the alternative layers is an alternative layer C in which an object of a format different from both the raster format and the first format is defined. The image synthesis method according to claim 6.

9. The replacing step comprises: Receiving a user instruction; replacing at least a portion of the first layer with either or both of the substitute layer A and the substitute layer B based on the instruction; The image synthesis method according to claim 7, comprising:

10. The replacing step comprises: Receiving a user instruction; replacing at least a portion of the first layer with either or both of the substitute layer A and the substitute layer C based on the instruction; The image synthesis method according to claim 8 , comprising:

11. The creating step comprises: creating raster data corresponding to each of the plurality of objects based on each of the plurality of objects when a plurality of objects are defined in the first layer; The image synthesis method according to claim 1 , comprising:

12. The first format is any one of a format in which vector information is defined, a format in which a 3D object is defined, a format in which a manga frame is defined, a format in which text is included, a format in which a tone is defined, and a format in which a file in which an object is saved is referenced. The image synthesis method according to claim 1 .

13. The replacing step comprises: if the first format is unknown, estimating the first format from the raster data; The image synthesis method according to claim 7, comprising:

14. A program for causing a computer to execute the method according to any one of claims 1 to 13.

Citation Information

Patent Citations

  • Apparatus and method for image editing of structural image

    JP1996235373A

  • Image processor, image processing method, and image processing program

    JP2008015619A

  • Animation edition system, animation edition program and recording medium with the same program recorded

    JP2010092138A

  • System for vehicle

    JP2020187631A