Image processing device, image processing method, and program

Abstract

To facilitate the selection of a particular element from an image including elements that may be positioned overlapping other elements. [Solution] From an input image containing multiple visual elements, stacked elements that can be placed overlapping other elements and that can be virtually placed closer to or further back than other elements are extracted, and an image that visually distinguishes the specific stacked element from the other elements is added to the position of the specific stacked element.

Description

[Technical Field]

[0001] The present invention relates to a technique for processing an image that includes multiple visual elements, and more particularly to a technique for processing an image that includes elements that may be positioned overlapping other elements. [Background technology]

[0002] Digital adoption refers to bridging the gap between the application being introduced and the business processes, enabling users to master the application. The tools used to achieve this digital adoption are called digital adoption tools. Digital adoption tools, for example, add visual effects (such as annotations like messages or navigation buttons) to image elements on web pages to assist or alert users.

[0003] There are also tools for setting such visual effects. These tools display an image to which a visual effect is to be added (hereinafter referred to as a "target image"), and add an image such as a red frame (hereinafter referred to as a "guide image") to identify the element to be selected. The user selects the element to which the visual effect is to be added from the elements identified by the guide image, and adds the visual effect to the selected element (see, for example, Patent Document 1 and Non-Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6557184 [Non-patent literature]

[0005] [Non-Patent Document 1] “BizFront / SmartUI for Digital Adoption”, [online], NTT Technocross Corporation, [Retrieved January 24, 2024], Internet <https: / / www.ntt-tx.co.jp / products / bizfront / sui / ad / LP05 / bizfrontsmartui_lp05.html?utm_source=google&utm_medium=cpc&utm_campaign=bizfront_shimei&gclid=EAIaIQobChMI_pHp-66JgwMVTtUWBR1UtgxMEAAYASAAEgLkw_D_BwE#problem> Summary of the Invention [Problem to be solved by the invention]

[0006] On the other hand, there are expressions that display another element over an already displayed element, prompting the user to enter or confirm something. If a guide image is added to the target image displayed in this way, the guide image will overlap, making it difficult for the user to select a specific element. This problem is not limited to setting up a digital adaptation tool, but is common when selecting a specific element from an image that includes elements that may be placed over other elements.

[0007] In view of the above, the present invention provides a technique that makes it easy to select a specific element from an image that includes elements that may be positioned overlapping other elements. [Means for solving the problem]

[0008] From an input image including a plurality of visual elements, stacked elements that can be arranged overlapping with other elements and can be virtually arranged closer to or further back than the other elements are extracted, and an image for visually distinguishing the specific stacked element from the other elements is added to the position of the specific stacked element. [Effects of the Invention]

[0009] This makes it easier to select a particular element from an image that includes elements that may be positioned over other elements. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram illustrating the configuration of an image editing system according to an embodiment. [Figure 2] FIG. 2 is a block diagram illustrating the functional configuration of the image processing apparatus according to the embodiment. [Figure 3] FIG. 3 is a flow diagram illustrating the image processing of the embodiment. [Figure 4] FIG. 4 is a flow diagram illustrating the process of extracting stacking context elements in FIG. [Figure 5] FIG. 5 is a flow diagram illustrating the process of collecting stacked elements in FIG. [Figure 6] FIG. 6 is a conceptual diagram illustrating the configuration of an image including stacked elements. [Figure 7] FIG. 7 is a diagram illustrating a tree structure (hierarchical structure) of an image including stacked elements. [Figure 8] FIG. 8 is a diagram illustrating an image including stacked elements. [Figure 9] FIG. 9 is a diagram illustrating an example in which a guide image (frame) is added to each element of an image including stacked elements. [Figure 10] FIG. 10 is a diagram illustrating an example of an image including stacked elements in which an image (frame) is added to the position of a specific stacked element to visually distinguish the specific stacked element from other elements. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. [First embodiment] First, the first embodiment will be described. <Configuration> 1, the image editing system 1 of this embodiment includes an image providing device 10, an image processing device 11, a display device 12, and an input device 13. The image providing device 10 and the image processing device 11 are configured to be able to communicate with each other via a network 100. The image processing device 11 is connected to the display device 12 and the input device 13 so as to be able to communicate with each other.

[0012] 2, the image processing device 11 has a communication unit 111, a storage unit 112, a stack element extraction unit 113, an image addition unit 114, an element editing unit 115, an output unit 116, an input unit 117, and a memory 118. The output unit 116 is communicably connected to the display device 12, and the input unit 117 is communicably connected to the input device 13. Data obtained by each unit of the image processing device 11 is stored in the memory 118 one by one, and is read out and used as needed.

[0013] The display device 12 is a device for presenting an image. The display device 12 is, for example, a display, a touch screen, a projector, smart glasses, VR goggles, or the like.

[0014] The input device 13 is a device that accepts input of information, and is, for example, a mouse, a keyboard, a touch screen, a touch panel, or the like.

[0015] <Pretreatment> An image providing device 10 (FIG. 1) transmits information A representing an input image including multiple visual elements to an image processing device 11 via a network 100. The information A representing the input image is received by a communication unit 111 of the image processing device 11 (FIG. 2) and stored in a storage unit 112. The input image in this embodiment is an image to which some visual effect (e.g., annotations such as messages in a digital adaptation tool, navigation displays such as buttons, etc.) is to be added. Examples of input images include user interface images of web pages and applications. Visual elements included in the input image include, for example, text information, image information, video information, etc. At least some of the elements included in the input image may be arranged overlapping other elements and may be virtually arranged in front of or behind other elements. Such elements are referred to as stacked elements. All of the elements included in the input may be stacked elements, or only some of the elements included in the input image may be stacked elements. Stacked elements are, for example, stacking context elements in which the overlapping of elements is represented by a stacking context. Stacking context is a concept related to the method of drawing elements included in an image (for example, an image on a web browser), and is a technology that realizes the overlapping and placement of elements in the virtual depth direction or front direction on an image (for example, on a web page). For example, if element α1 and element α2 are placed overlapping each other, and element α1 is virtually placed in front of element α2 (i.e., element α2 is virtually placed behind element α1), the area X where element α1 and element α2 overlap is 12 The area X1 of element α1 is mainly displayed. For example, the area X 12 Only the area X1 of element α1 is displayed in the 12 The area X2 of element α2 may not be displayed, and the area X 12A region X1 of a translucent element α1 may be displayed in the image, and a region X2 of element α2 may be displayed through the region X1. Stacked elements have, for example, an attribute that represents a position in a virtual depth direction or a virtual front direction. For example, stacked elements have a z-index as property information of CSS (Cascading Style Sheets) (e.g., a style sheet of an element on a web page). For example, elements that are not stacked elements do not have an attribute that represents a position in a virtual depth direction or a virtual front direction, or even if they do, the attribute has a value of zero. For example, for child elements of the same parent element, the smaller the z-index value, the further back the element is virtually placed, and the larger the z-index value, the further forward the element is virtually placed. Information A representing the input image is, for example, code such as HTML (Hyper Text Markup Language) or CSS.

[0016] 6 conceptually illustrates the configuration of an input image 1000. The input image 1000 illustrated in FIG. 6 includes multiple elements 1100, 1110, 1111, 1112, 1120, 1200, 1210, 1211, 1212, 1220, 1221, 1300, 1310, 1311, 1312, 1400, 1410, and 1420. Of these elements, elements 1111, 1210, 1211, 1212, 1300, 1310, 1311, and 1312 are stacked elements and are virtually positioned in front of the other elements 1100, 1200, 1300, and 1400. For example, the z-index of element 1300 is 1, the z-index of element 1310 is 100, and the z-index of element 1210 is 5. In this example, the elements 1300, 1310, and 1210 are virtually placed in front of the elements 1100, 1200, 1300, and 1400, and can be placed overlapping the elements 1100, 1200, 1300, and 1400.

[0017] FIG. 7 illustrates an example of a tree structure (hierarchical structure) of elements in the input image 1000 of FIG. 6. The input image 1000 of FIG. 6 includes elements 1100, 1200, 1300, and 1400, which are parent elements. The element 1300 is a stacked element (e.g., a stacking context element), but the elements 1100, 1200, and 1400 are not stacked elements. The element 1100 includes elements 1110 and 1120, which are child elements that are not stacked elements. The element 1110 includes element 1111, which is a child element that is a stacked element, and element 1112, which is a child element that is not a stacked element. Note that a child element refers to an element that constitutes a parent element. The child element β2 of the parent element β1 is at least a part of the parent element β1. The child elements of a parent element that is a stacked element are always stacked elements. Element 1200 has element 1210, a child element that is a stacked element, and element 1220, a child element that is not a stacked element. Elements 1211 and 1212, which are child elements of element 1200, which is a stacked element, are also stacked elements. Child element 1221 of element 1220 is not a stacked element. Since element 1300 is a stacked element, element 1310, which is a child element of element 1300, is also a stacked element. Similarly, elements 1311 and 1312, which are child elements of element 1310, are also stacked elements. Element 1400 has elements 1410 and 1420, which are child elements that are not stacked elements. In other words, the elements surrounded by dotted lines in FIG. 7 are stacked elements, and are arranged overlapping with other elements, and may be virtually arranged in front of or behind other elements.

[0018] <Image processing> FIG. 3 illustrates an example of image processing according to this embodiment. As described above, if an element corresponding to a stacked element (e.g., a stacking context element) can be identified, it is possible to extract elements that are arranged overlapping with other elements and that may virtually be arranged in front of or behind other elements. To this end, first, the stacked element extraction unit 113 of the image processing device 11 (FIG. 2) reads information A representing an input image from the storage unit 112 and extracts stacked elements (elements that may be arranged overlapping with other elements and that may virtually be arranged in front of or behind other elements) from the input image (an input image including multiple visual elements). The stacked element extraction unit 113 may extract stacked elements that may virtually be arranged in front of or behind other elements, or may extract only stacked elements that may virtually be arranged in front of other elements, or may extract only stacked elements that may virtually be arranged behind other elements. The stacked element extraction unit 113 may extract only stacked elements that are virtually arranged closer or further back than other elements, or may extract only stacked elements that are virtually arranged closer to or further back than other elements. A specific example of step S113 will be described later. The stacked element extraction unit 113 in this example generates and outputs information A' representing an input image to which information for identifying the stacked elements has been added. The information A' is sent to the image addition unit 114 (step S113).

[0019] Information A' is input to the image adding unit 114. The image adding unit 114 generates and outputs information A" representing an added image in which image a for visually distinguishing a specific stack element included in the input image represented by information A' from other elements is added to the position of the specific stack element. Image a may be, for example, a frame along the edge of the specific stack element, a frame surrounding the specific stack element, a semi-transparent image displayed overlaid on the specific stack element, or a hatched image displayed overlaid on the specific stack element. Such image a represents, for example, the position, shape, area, and size of the specific stack element. Image a may, for example, represent the area of ​​the specific stack element and obscure the areas of other elements arranged overlapping the specific stack element. This makes it possible to more clearly visually distinguish the specific stack element from other elements even when the specific stack element is semi-transparent and other elements are displayed through the specific stack element. The specific stack element to which image a is added may be all stack elements included in the input image, or a single stack element included in the input image. The image adding unit 114 may add image a to all the stacked elements or may add image a only to specific stacked elements. For example, when a plurality of stacked elements are arranged overlapping each other, the image adding unit 114 may add image a to the position of a specific stacked element that is virtually arranged at the forefront among the multiple stacked elements that are arranged overlapping each other. For example, when a plurality of stacked elements are arranged overlapping each other, the image adding unit 114 may add image a only to the position of the specific stacked element that is virtually arranged at the forefront. On the other hand, in this embodiment, image a is not added to elements other than the specific stacked elements. That is, the image adding unit 114 in this embodiment classifies the elements of the input image represented by information A' into specific stacked elements and other elements, and adds image a only to the specific stacked elements. In other words, the image adding unit 114 in this embodiment filters the elements of the input image represented by information A' and adds image a only to the specific stacked elements. The information A'' is sent to the element editing unit 115 (step S114).

[0020] Information A" is input to the element editing unit 115. The element editing unit 115 sends information B for presenting the added image represented by information A" to the output unit 116, and the output unit 116 sends information B for presenting the added image to the display device 12. The display device 12 presents the added image represented by information B to the user. For example, the display device 12 may display the added image or may project the added image. The user inputs editing information C to the input device 13 while looking at the presented added image. The editing information C includes information representing a specific stack element selected as an editing target. The user can easily select a specific stack element to be edited, for example, by referring to image a added to the specific stack element (for example, a frame added to the specific stack element). The stack element is selected by, for example, clicking or tapping. Furthermore, the editing information C may represent the editing content of the selected specific stack element. The editing content may be, for example, adding annotation text such as a message to a specific stack element or its surroundings, adding a navigation display such as a button, adding a visual effect such as adding an input tab (for example, setting a digital adaptation tool), inputting data into an input field, selecting data from a selection field, modifying, replacing, or deleting a stack element, etc. The element editing unit 115 may accept editing of the specific selected stack element and not accept editing of elements other than the specific stack element. For example, only the specific selected stack element may be editable. This prevents accidental editing of other elements that overlap with or are located nearby the specific stack element. The editing information C is sent to the input unit 117 of the image processing device 11 (FIG. 2) and then to the element editing unit 115. The element editing unit 115 selects the specific stack element represented by the editing information C. When the editing information C represents editing content for the selected specific stack element, the element editing unit 115 edits the specific stack element represented by the editing information C according to the editing content represented by the editing information C. The element editing unit 115 sends information B for presenting the updated added image to the output unit 116, and the output unit 116 sends information B for presenting the added image to the display device 12. The display device 12 presents the added image represented by information B to the user.In this way, updating of the added image and presentation of the added image can be repeated (step S115).

[0021] <Specific example of step S113> A specific example of step S113 (FIG. 3) described above will be shown using FIG. 4. The stack element extraction unit 113 of the image processing device 11 (FIG. 2) reads information A representing an input image from the storage unit 112 and generates a list (hereinafter, "stack element list") of stack elements (e.g., stacking context elements) acquired from the input image (step S1131). A specific example of this process will be described later. Next, the stack element extraction unit 113 executes the following processes from step S1132a to step S1132c for all elements of the input image (step S1132). Hereinafter, the elements targeted for the processes from step S1132a to step S1132c will be referred to as "elements to be processed." First, in step S1132a, the stack element extraction unit 113 determines whether the stack element list includes the element to be processed (step S1132a). If the element to be processed is included in the stack element list, the process proceeds to step S1132b. On the other hand, if the element to be processed is not included in the stack element list, the process proceeds to step S1132c. In step S1132b, the stack element extraction unit 113 sets a flag, which is one of the property information of the element to be processed, to True, and proceeds to step S1132c. The initial value of the flag is set to False (step S1132b). In step S1132c, the stack element extraction unit 113 collects property information (flag, position, size, etc.) of the element to be processed and stores it in the memory 118, and excludes the element to be processed from the search targets. The property information of the element to be processed stored in the memory 118 is used, for example, to identify the stack element in the processes of steps S114 and S115 described above, or to identify the position of image a to be added to the specific stack element (step S1132c). When the search for all elements is completed, the process of step S113 ends.

[0022] <Specific example of step S1131> The stacked element extraction unit 113 of the image processing device 11 (FIG. 2) reads information A representing an input image from the storage unit 112, and executes the following processes from step S1131a to step S1131c for all elements of the input image. First, in step S1131a, the stacked element extraction unit 113 determines whether the element to be processed is currently displayed (step S1131a). If the element to be processed is currently displayed, the process proceeds to step S1131b. On the other hand, if the element to be processed is not currently displayed, the process executes step S1131a for another element as the element to be processed. If the search for all elements is complete, the process of step S1131 ends. In step S1131b, the stacked element extraction unit 113 determines whether the element to be processed satisfies the conditions for a stacked element. For example, if the stacked element is a stacking context element, the stacked element extraction unit 113 determines that the element to be processed satisfies the conditions for a stacked element if the CSS parameters of the element to be processed satisfy any of the following, and determines that the element does not satisfy the conditions for a stacked element if none of the following are satisfied: Elements whose position value is absolute or relative and whose z-index value is other than auto -Elements with a position value of fixed or sticky -Elements that are children of a flex container and have a z-index value other than auto -Elements that are children of a grid container and have a z-index value other than auto These conditions indicate that elements may be arranged overlapping in the depth direction or the front direction on the web page (step S1131b). Here, if the stack element extraction unit 113 determines that the element to be processed satisfies the conditions of the stack element, it adds the element to be processed to the stack element list and excludes it from search targets. Child elements of the stack element are also stack elements. Therefore, child elements of the element to be processed (stack element) are also added to the stack element list and excluded from search targets. That is, the stack element extraction unit 113 determines whether the parameters of the element to be processed satisfy the conditions of the stack element, and extracts elements determined to satisfy the conditions of the stack element and child elements of the elements determined to satisfy the conditions of the stack element as the stack elements. This makes it possible to omit the process of determining child elements that are obviously stack elements. On the other hand, if the stack element extraction unit 113 determines that the element to be processed does not satisfy the conditions of the stack element, it excludes the element to be processed from search targets without adding it to the stack element list (step S1131c). When all elements have been searched, the process of step S1131 ends.

[0023] <Features of this form> As described above, in this embodiment, from an input image containing multiple visual elements, stacked elements that may be placed overlapping other elements and that may be virtually placed in front of or behind the other elements are extracted, and an image for visually distinguishing the specific stacked element from the other elements is added to the position of the specific stacked element. This makes it easy to select a specific element from an image containing elements that may be placed overlapping other elements. For example, consider the input image 1000 illustrated in FIG. 8. In the input image 1000, an element 1210 is virtually displayed in front of an element 1200. A user selects element 1210 to perform editing. Here, as illustrated in FIG. 9, if a shape (a frame in this example) 1500 is added to all elements in the input image 1000, the guide shapes of the multiple elements will overlap, making it difficult to visually identify the element 1210 to be edited and its child elements. 10 , when graphic 1500 is added only to element 1200, which is a specific stacked element, and its child elements, element 1200 and its child elements are distinguished from other elements, making it easier to visually identify element 1210, the element to be edited, and its child elements. As a result, even if element 1200 and its child elements overlap with other elements, it becomes easier to select element 1200 and its child elements. In particular, when an image that represents the area of ​​a specific stacked element and obscures the areas of other elements that are arranged overlapping the specific stacked element is added to the specific element, it becomes even easier to select the specific element.

[0024] When multiple stacked elements are arranged overlapping each other, an image may be added to the position of a specific stacked element that is virtually arranged at the forefront among the multiple stacked elements that are arranged overlapping each other, thereby making it easy to select the specific stacked element that is arranged at the forefront even when multiple stacked elements are arranged overlapping each other.

[0025] The element editing unit 115 may accept edits related to a selected specific stack element, but may not accept edits related to elements other than the specific stack element, thereby preventing other elements that overlap with or are located nearby the specific stack element from being edited by mistake.

[0026] Furthermore, the stacked elements of an input image can be extracted simply by analyzing the elements of the input image. Therefore, even if the input image is provided by a third party (for example, a web page provided by a third party), the stacked elements can be extracted and an image for visually distinguishing a specific stacked element from other elements can be added to the position of the specific stacked element.

[0027] [Second embodiment] When multiple stacked elements are arranged on top of each other, the user may select a specific stacked element, and image a may be added to the selected specific stacked element. The following description will focus on differences from the first embodiment, and the same reference numbers will be used to simplify the description of matters already described.

[0028] <Configuration> 1, the image editing system 2 of this embodiment includes an image providing device 10, an image processing device 21, a display device 12, and an input device 13. The image providing device 10 and the image processing device 21 are configured to be able to communicate with each other via a network 100. The image processing device 21 is connected to be able to communicate with the display device 12 and the input device 13. As illustrated in FIG. 2, the image processing device 21 includes a communication unit 111, a storage unit 112, a stacked element extraction unit 113, an image addition unit 214, an element editing unit 115, an output unit 116, an input unit 117, and a memory 118.

[0029] <Pretreatment> Except that the image processing device 11 is replaced with the image processing device 21, the pre-processing is the same as that in the first embodiment.

[0030] <Image processing> The image processing of this embodiment differs from the image processing of the first embodiment only in that the image processing device 11 is replaced with the image processing device 21, the image addition unit 114 is replaced with the image addition unit 214, and the processing of step S114 is replaced with the processing of the following step S214. The rest is as described in the first embodiment.

[0031] In step S214 (FIG. 3), information A′ representing an input image to which information for identifying a stacked element is added is input to the image adding unit 214 of the image processing device 21 (FIG. 2). In addition, the user can input selection information D for selecting a specific stacked element to which image a is added using the input device 13 (FIG. 1). Such selection is necessary, for example, when multiple stacked elements are arranged overlapping each other. The selection information D may be, for example, information for selecting the stacked element that is virtually arranged at the forefront as the specific stacked element among the multiple stacked elements that are arranged overlapping each other, information for selecting the stacked element that is virtually arranged at the back as the specific stacked element, or information for selecting a stacked element that is arranged at another position as the specific stacked element. The image adding unit 114 generates and outputs information A″ representing an added image in which image a is added to the position of the specific stacked element selected by the selection information D. For example, the image adding unit 114 generates and outputs information A″ representing an added image in which image a is added only to the position of the specific stacked element selected by the selection information D. Information A'' is sent to element editing unit 115 (step S214).

[0032] <Features of this form> In this embodiment, the same effect as in the first embodiment can be obtained. In particular, the image adding unit 214 in this embodiment accepts the selection of a specific stack element from among a plurality of stack elements arranged overlapping each other, and adds image a to the position of the selected specific stack element. This allows image a to be added to the position of a stack element desired by the user from among a plurality of stack elements arranged overlapping each other. As a result, it becomes easy for the user to select a specific element desired from an image including elements that may be arranged overlapping with other elements.

[0033] [Hardware configuration] The functions performed by the components described herein may be implemented in circuitry or processing circuitry, including general-purpose processors, application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), a CPU (a Central Processing Unit), conventional circuits, and / or combinations thereof, programmed to perform the described functions. A processor includes transistors and other circuits and is considered to be circuitry or processing circuitry. A processor may also be a programmed processor that executes programs stored in memory.

[0034] In this specification, a circuitry, unit, or means is hardware that is programmed to realize or performs the described functions, which may be any hardware disclosed herein or any hardware known to be programmed to realize or perform the described functions.

[0035] If the hardware is a processor considered to be a type of circuitry, the circuitry, means, or unit is a combination of the hardware and software used to configure the hardware and / or processor.

[0036] For example, the image processing devices 11 and 21 in each embodiment are devices configured by a general-purpose or dedicated computer having a processor (hardware processor) such as a central processing unit (CPU) and memories such as random-access memory (RAM) and read-only memory (ROM) executing a predetermined program. That is, the image processing devices 11 and 21 in each embodiment have, for example, processing circuitry configured to implement each of the components. This computer may have one processor and memory, or multiple processors and memories. This program may be installed on the computer or may be pre-recorded in a ROM or the like. Furthermore, some or all of the processing units may be configured using electronic circuits that independently realize processing functions, rather than electronic circuits that realize functional configurations by loading programs, such as a CPU. Furthermore, the electronic circuits constituting one device may include multiple CPUs.

[0037] The program describing this processing can be recorded on a computer-readable recording medium. Examples of computer-readable recording media are non-transitory recording media. Examples of such recording media include magnetic recording devices, optical disks, magneto-optical recording media, and semiconductor memories.

[0038] The program may be distributed, for example, by selling, transferring, lending, etc. a portable recording medium such as a DVD or CD-ROM on which the program is recorded. Furthermore, the program may be stored in a storage device of a server computer, and then transferred from the server computer to another computer via a network, thereby distributing the program.

[0039] A computer that executes such a program may first temporarily store the program recorded on a portable recording medium or transferred from a server computer in its own storage device. Then, when executing a process, the computer reads the program stored on its own recording medium and executes the process in accordance with the read program. Alternatively, the computer may read the program directly from a portable recording medium and execute the process in accordance with the program. Furthermore, the computer may execute the process in accordance with the program each time a program is transferred from a server computer to the computer. The server computer may not transfer the program to the computer, but may instead execute the process through a so-called ASP (Application Service Provider) service, which realizes the processing function by issuing an execution instruction and obtaining the results. Furthermore, the server computer may execute the process on a terminal using a so-called SaaS (Software as a Service) service, which allows users to use part of the server computer along with the program. In this embodiment, the program includes information used for computer processing that is equivalent to a program (such as data that is not a direct instruction to the computer but has properties that define computer processing).

[0040] Furthermore, in this embodiment, the device is configured by executing a predetermined program on a computer, but at least a part of the processing contents may be realized by hardware.

[0041] [Other modifications, etc.] The present invention is not limited to the above-described embodiment. For example, in the above-described embodiment, information A representing an input image is transmitted from the image providing device 10 to the image processing device 11, 21 via the network 100. However, information A representing an input image may be provided to the image processing device 11, 21 without passing through the network 100. Furthermore, in the above-described embodiment, an example is shown in which the image adding unit 114 adds image a only to a specific stack element. However, the image adding unit 114 may add image a to a specific stack element and some other elements. Even in such a case, if the specific stack element can be clearly distinguished from the other elements, the specific stack element can be easily selected.

[0042] Furthermore, the various processes described above may not only be executed in chronological order as described, but may also be executed in parallel or individually depending on the processing capacity of the device executing the processes or as necessary. Needless to say, other modifications are possible within the scope of the present invention.

[0043] [Note] The features of this embodiment are listed below. [Appendix 1] a stacked element extraction unit that extracts, from an input image including a plurality of visual elements, stacked elements that may be arranged overlapping with other elements and that may be virtually arranged in front of or behind the other elements; an image adding unit that adds an image to the position of the specific stacked element to visually distinguish the specific stacked element from other elements; An image processing device having: [Appendix 2] 10. The image processing device of claim 1, The image adding unit adds the image to the position of the specific stacked element that is virtually arranged nearest to the front among the plurality of stacked elements that are arranged overlapping each other. [Appendix 3] 3. The image processing device of claim 1 or 2, an image processing device having an element editing unit that accepts editing related to the specific stack element and does not accept editing related to elements other than the specific stack element; [Appendix 4] 4. The image processing device of claim 1, The image adding unit adds an image for visually distinguishing the specific stack element from other elements only at the position of the specific stack element. [Appendix 5] 5. The image processing device of claim 1, The stacked element extraction unit extracts only the stacked elements that can be virtually placed in front of the other elements. [Appendix 6] 6. The image processing device of any one of claims 1 to 5, The stacked element extraction unit extracts only the stacked elements that are virtually arranged in front of the other elements. [Appendix 7] 7. The image processing device of any one of claims 1 to 6, The stack element extraction unit determines whether or not parameters of an element satisfy conditions for the stack element, and extracts, as the stack elements, elements determined to satisfy the conditions for the stack element and child elements of the elements determined to satisfy the conditions for the stack element. [Appendix 8] 8. The image processing device of any one of claims 1 to 7, The image adding unit receives a selection of the specific stacked element from among a plurality of stacked elements arranged on top of each other, and adds the image to the position of the selected specific stacked element. [Appendix 9] 9. The image processing device of any one of appendixes 1 to 8, An image processing device, wherein the image represents an area of ​​the specific stacked element and obscures areas of other elements that are arranged overlapping the specific stacked element. [Explanation of symbols]

[0044] 11,21 Image processing device 113 Layer element extraction section 114,214 Image Addition Section 115 Elements Editorial Department

Claims

1. a stacked element extraction unit that analyzes elements of an input image including a plurality of visual elements and extracts all stacked elements that may be arranged overlapping with other elements and have characteristics that may be virtually arranged in front of or behind other elements; an image adding unit that adds an image to a position of the specific stack element selected from all the stack elements to visually distinguish the specific stack element from other elements; An image processing device having:

2. a stacked element extraction unit that extracts, from an input image including a plurality of visual elements, all stacked elements that are elements that may be arranged overlapping with other elements and have characteristics that may be virtually arranged in front of or behind other elements; an image adding unit that adds an image to a position of the specific stack element selected from all the stack elements to visually distinguish the specific stack element from other elements; and The laminate element extraction unit determines whether parameters of the elements satisfy conditions for the laminate elements, and extracts elements having parameters that satisfy the conditions for the laminate elements as the laminate elements.

3. A stacked element extraction unit that extracts, from an input image including a plurality of visual elements, stacked elements that may be arranged overlapping with other elements and that may be virtually arranged in front of or behind the other elements; an image adding unit that adds an image to the position of the specific stacked element to visually distinguish the specific stacked element from other elements; and The stack element extraction unit determines whether the parameters of the element satisfy the conditions of the stack element, extracts an element having parameters that satisfy the conditions of the stack element as the stack element, and if it determines that the parameters of the element satisfy the conditions of the stack element, extracts the element and the child elements having parameters that satisfy the conditions of the stack element as the stack element without determining the parameters of the child elements that make up the element having parameters that satisfy the conditions of the stack element.

4. An image processing method for an image processing device, comprising: a stacked element extraction step of analyzing elements of an input image including a plurality of visual elements to extract stacked elements, which are elements that may be arranged overlapping with other elements and have characteristics that may be virtually arranged in front of or behind other elements; an image adding step of adding an image to a position of the specific stack element selected from all the stack elements to visually distinguish the specific stack element from other elements; An image processing method comprising:

5. An image processing method for an image processing device, comprising: a stacked element extraction step of extracting, from an input image including a plurality of visual elements, stacked elements, which are elements that may be arranged overlapping with other elements and have characteristics that may be virtually arranged in front of or behind other elements; an image adding step of adding an image to a position of the specific stack element selected from all the stack elements to visually distinguish the specific stack element from other elements; and The image processing method includes determining whether parameters of the elements satisfy conditions for the laminate elements, and extracting elements having parameters that satisfy the conditions for the laminate elements as the laminate elements.

6. A stacked element extraction step of extracting, from an input image including a plurality of visual elements, stacked elements that may be arranged overlapping with other elements and that may be virtually arranged in front of or behind the other elements; an image adding step of adding an image to the position of the specific stacked element to visually distinguish the specific stacked element from other elements; and The stack element extraction step determines whether the parameters of the element satisfy the conditions of the stack element, extracts an element having parameters that satisfy the conditions of the stack element as the stack element, and if it is determined that the parameters of the element satisfy the conditions of the stack element, extracts the element and the child elements having parameters that satisfy the conditions of the stack element as the stack element without determining the parameters of the child elements that make up the element having parameters that satisfy the conditions of the stack element.

7. A program for causing a computer to function as the image processing device according to any one of claims 1 to 3.

Images