Data management device, data management method, and program

Abstract

The present invention provides a data management device in which an acquisition means acquires first data including a first image. An extracting means extracts at least one image component from the first image. A screen generation means generates a display screen containing a display content capable of comparing the at least one image component extracted from the first image and at least one image component extracted in advance from a second image included in second data different from the first data.

Description

Data management device, data management method, and recording medium

[0001] The present disclosure relates to techniques that can be used to manage data.

[0002] Techniques relating to data management have been proposed.

[0003] Specifically, for example, Patent Literature 1 discloses a technology for acquiring item information as names of items present around a user and managing feature quantities corresponding to the acquired item information. Patent Literature 1 also discloses a technology for recognizing items in an image by using the managed feature quantities as references.

[0004] Japanese Patent Application Laid-Open No. 2015-191265

[0005] However, the technology disclosed in Patent Document 1 has the problem that, for example, an item may not be correctly recognized due to an inability to manage features corresponding to the details of the appearance of the item.

[0006] One object of the present disclosure is to provide a data management device that can appropriately manage data related to an item even if the details of the item's appearance are changed.

[0007] In one aspect of the present disclosure, a data management device includes an acquisition means for acquiring first data including a first image, an extraction means for extracting at least one image component from the first image, and a screen generation means for generating a display screen including display content that allows comparison between the at least one image component extracted from the first image and at least one image component previously extracted from a second image included in second data different from the first data.

[0008] In another aspect of the present disclosure, a data management method includes acquiring first data including a first image, extracting at least one image component from the first image, and generating a display screen including display content that allows comparison of the at least one image component extracted from the first image with at least one image component previously extracted from a second image included in second data different from the first data.

[0009] In yet another aspect of the present disclosure, a recording medium records a program that causes a computer to execute a process of acquiring first data including a first image, extracting at least one image component from the first image, and generating a display screen including display content that allows comparison of the at least one image component extracted from the first image with at least one image component previously extracted from a second image included in second data different from the first data.

[0010] According to the present disclosure, even if the details of the appearance of an item are changed, data related to the item can be managed appropriately.

[0011] 1 is a diagram showing an example of a hardware configuration of a data management device according to the present disclosure. FIG. 2 is a block diagram showing an example of a functional configuration of a data management device according to the present disclosure. FIG. 3 is a diagram for explaining data included in component data of master data. FIG. 4 is a diagram for explaining data included in component data of candidate data. FIG. 5 is a diagram showing an example of a package included in a master image. FIG. 6 is a diagram showing an example of image components obtained by region dividing a master image. FIG. 7 is a diagram showing an example of a package included in a candidate image. FIG. 8 is a diagram showing an example of image components obtained by region dividing a candidate image. FIG. 9 is a diagram showing an example of a display screen generated by a data management device according to the present disclosure. FIG. 10 is a diagram showing an example of display content included in the display screen. FIG. 11 is a diagram showing another example of display content included in the display screen. FIG. 12 is a diagram showing another example of display content included in the display screen. FIG. 13 is a diagram showing another example of display content included in the display screen. FIG. 14 is a diagram showing another example of display content included in the display screen.

[0012] Hereinafter, preferred embodiments of the present disclosure will be described with reference to the drawings.

[0013] First Embodiment [Hardware Configuration] Fig. 1 is a diagram illustrating an example of the hardware configuration of a data management device according to the present disclosure. As shown in Fig. 1, the data management device 100 includes an interface (IF) 111, a processor 112, a memory 113, a recording medium 114, a database (DB) 115, a display device 116, and an input device 117.

[0014] The IF 111 inputs and outputs data to and from an external device. For example, data transmitted from a server device or the like is input to the data management device 100 through the IF 111.

[0015] The processor 112 is a computer such as a CPU (Central Processing Unit), and executes a pre-prepared program to control the entire data management device 100. Specifically, the processor 112 performs, for example, processing related to the generation of a display screen, which will be described later.

[0016] The memory 113 is configured by a ROM (Read Only Memory), a RAM (Random Access Memory), etc. The memory 113 is also used as a working memory while the processor 112 is executing various processes.

[0017] The recording medium 114 is a non-volatile, non-transitory recording medium such as a disk-shaped recording medium or semiconductor memory, and is configured to be detachable from the data management device 100. The recording medium 114 records various programs executed by the processor 112. When the data management device 100 executes various processes, the programs recorded on the recording medium 114 are loaded into the memory 113 and executed by the processor 112.

[0018] The DB 115 stores, for example, data input via the IF 111 and processing results obtained by processing by the processor 112 .

[0019] The display device 116 is configured by, for example, a liquid crystal monitor, etc. Furthermore, the display device 116 displays a display screen, etc., as described below, as necessary.

[0020] The input device 117 includes at least one of a keyboard, a mouse, a touch panel, etc. The input device 117 is used to operate a GUI (Graphical User Interface) on a display screen, etc. The input device 117 can output instruction signals corresponding to user operations performed on the GUI, etc.

[0021] [Functional Configuration] Fig. 2 is a block diagram showing an example of the functional configuration of a data management device according to the present disclosure. As shown in Fig. 2, the data management device 100 includes a data storage unit 21, a data acquisition unit 22, a display screen generation unit 23, and a management unit 24.

[0022] The data storage unit 21 functions as a database. The data storage unit 21 also stores master data MD and candidate data CD. The master data MD corresponds to data registered in the data storage unit 21 before the candidate data CD is acquired. The master data MD includes a master image MG, and component element data MED and identification data MSD corresponding to the master image MG. The candidate data CD includes a candidate image CG, and component element data CED and identification data CSD corresponding to the candidate image CG.

[0023] The master image MG corresponds to an image including a package PKX of a product SH such as food, and is registered by the user operating a GUI button, which will be described later.

[0024] The component element data MED includes data relating to at least one image component element MEG extracted from the master image MG (package PKX).

[0025] The image component MEG may include, for example, text, one-dimensional codes, two-dimensional codes, logos, patterns, illustrations, and photographs. The text may include, for example, the product name, content volume, catchphrase, and ingredients list. The text may also include characters extracted from illustrations and logos. The catchphrases may include words related to product promotion, such as "limited time only," "limited edition," "anniversary," "new release," and "increased quantity." The image component MEG may be extracted by performing a process related to region division, such as semantic segmentation, on the master image MG.

[0026] The component element data MED includes, for example, position data MEP, color data MEC, shape data MES, and composition data MEK as data associated with the image component element MEG, as shown in Fig. 3. Fig. 3 is a diagram for explaining the data included in the component element data of the master data.

[0027] The position data MEP corresponds to data representing the position of the image component MGE in the master image MG. The color data MEC corresponds to data representing the foreground color, background color, and character color of the image component MGE. The shape data MES corresponds to data representing the shape and pattern of the image component MGE. The composition data MEK corresponds to data representing the composition of the image component MGE. It is desirable that the composition data MEK include data indicating, for example, the number and orientation of objects in the image component MGE. In other words, the color data MEC, shape data MES, and composition data MEK include data representing multiple internal elements in one image component MEG extracted from the master image MG.

[0028] According to this embodiment, it is desirable that each piece of data included in the component element data MED is stored in the data storage unit 21 before the data acquisition unit 22 acquires the candidate data CD.

[0029] The identification data MSD includes data that can be used to identify the product SH having the package PKX of the master image MG, such as a JAN (Japan Article Number) code, etc. The identification data MSD also includes, for example, data indicating the registration date and time of the master image MG and data indicating the file name of the master image MG.

[0030] The candidate image CG corresponds to, for example, an image of the same product as the product SH of the master image MG, but including a package PKY that is different from the package PKX of the master image MG. The candidate image CG also corresponds to an image acquired as a candidate for a new master image MG by processing by the data acquisition unit 22, which will be described later.

[0031] The component element data CED includes data relating to at least one image component element CEG extracted from the candidate image CG (package PKY).

[0032] The image component CEG can include, for example, text, one-dimensional codes, two-dimensional codes, logos, patterns, illustrations, photographs, etc. Furthermore, the image component CEG can be extracted by performing processing related to region division, such as semantic segmentation, on the candidate image CG.

[0033] The component element data CED includes, for example, position data CEP, color data CEC, shape data CES, and composition data CEK as data associated with the image component element CEG, as shown in Fig. 4. Fig. 4 is a diagram for explaining the data included in the component element data of the candidate data.

[0034] The position data CEP corresponds to data representing the position of the image component CEG in the candidate image CG. The color data CEC corresponds to data representing the foreground color, background color, and character color of the image component CEG. The shape data CES corresponds to data representing the shape and pattern of the image component CEG. The composition data CEK corresponds to data representing the composition of the image component CEG. It is desirable that the composition data CEK include data indicating, for example, the number and orientation of objects in the image component CEG. In other words, the color data CEC, shape data CES, and composition data CEK include data representing multiple internal elements in one image component CEG extracted from the candidate image CG.

[0035] The identification data CSD includes data that can be used to identify the product SH having the package PKY of the candidate image CG, such as a JAN code, etc. The identification data CSD also includes, for example, data indicating the acquisition date and time of the candidate image CG and data indicating the file name of the candidate image CG.

[0036] The data acquisition unit 22 functions as an acquisition means and an extraction means. The data acquisition unit 22 searches the Internet or the like using the master image MG or the identification data MSD included in the master data MD read from the data storage unit 21 to acquire search results SR including images and identification data of products identical to the product SH. The data acquisition unit 22 also applies a narrowing-down process to each image included in the search results SR to extract at least one candidate image CG from the search results SR. As part of the narrowing-down process, the data acquisition unit 22 can, for example, extract a predetermined number of images in descending order of similarity to the master image MG. As part of the narrowing-down process, the data acquisition unit 22 can, for example, extract a predetermined number of images in descending order of update date and time. As part of the narrowing-down process, the data acquisition unit 22 can, for example, extract images associated with the same JAN code as the identification data MSD. Furthermore, the data acquisition unit 22 acquires image components CEG and each piece of data associated with the image components CEG, for example, by performing processing related to region segmentation on candidate images CG extracted from the search results SR. The data acquisition unit 22 also acquires identification data corresponding to the candidate images CG extracted from the search results SR as identification data CSD. The data acquisition unit 22 also stores candidate data CD including the candidate images CG, the image components CEG, each piece of data associated with the image components CEG, and the identification data CSD in the data storage unit 21. Furthermore, when the data acquisition unit 22 extracts multiple candidate images CG from the search results SR, it stores multiple pieces of candidate data CD corresponding to each of the multiple candidate images CG in the data storage unit 21.

[0037] According to the processing described above, the data acquisition unit 22 can acquire candidate data CD including a candidate image CG. Furthermore, according to the processing described above, the data acquisition unit 22 can extract at least one image component CEG from the candidate image CG. Note that, hereinafter, unless otherwise specified, a case will be described in which one candidate image CG is extracted from the search results SR and one piece of candidate data CD including that one candidate image CG is stored in the data storage unit 21.

[0038] The display screen generation unit 23 functions as a screen generation means. Furthermore, the display screen generation unit 23 performs processing related to the generation of a display screen, etc., in response to input of an instruction signal from an external device. Specifically, for example, when an instruction signal HSS corresponding to an instruction to start comparing a master image MG with a candidate image CG is input, the display screen generation unit 23 generates a display screen HG using the master data MD and candidate data CD read from the data storage unit 21, and outputs the generated display screen HG to the display device 116. Furthermore, for example, when an instruction signal HMS corresponding to an instruction to change the display content of the display image HG is input, the display screen generation unit 23 performs processing to change the display content of the display screen HG in response to the instruction signal HMS. The instruction signals HSS and HMS may be, for example, signals output from the input device 117 in response to a user operation on a GUI or the like. Specific examples of the display screen HG generated by the display screen generation unit 23 will be described later.

[0039] In response to an instruction signal input from outside, the management unit 24 performs processing related to the operation of data stored in the data storage unit 21. Specifically, for example, when an instruction signal DMS corresponding to an instruction related to the operation of data stored in the data storage unit 21 is input, the management unit 24 generates a management signal CTS for changing at least one of the master data MD and the candidate data CD in response to the instruction signal DMS, and outputs the generated management signal CTS to the data storage unit 21. Note that the instruction signal DMS may be, for example, a signal output from the input device 117 in response to a user operation on a GUI or the like.

[0040] [Specific Example] Next, a specific example according to this embodiment will be described.

[0041] The data storage unit 21 stores a master image MGA including a food package PK1, as shown in FIG. 5 . FIG. 5 illustrates an example in which the package PK1 occupies the entire area of ​​the master image MGA. The data storage unit 21 also stores component element data MEDA including image components MEG1 to MEG10 obtained by dividing the master image MGA into regions, as shown in FIG. 6 . The data storage unit 21 also associates position data MEPA, color data MECA, shape data MESA, and composition data MEKA with each image component in the component element data MEDA. That is, the color data MECA, shape data MESA, and composition data MEKA correspond to data representing multiple internal elements in one image component MEG extracted from the master image MGA. The data storage unit 21 also stores identification data MSDA corresponding to the master image MGA. That is, in this specific example, master data MDA including a master image MGA, component data MEDA, and identification data MSDA is stored in the data storage unit 21. Fig. 5 is a diagram showing an example of a package included in the master image. Fig. 6 is a diagram showing an example of image components obtained by region segmenting the master image.

[0042] The data storage unit 21 stores a candidate image CGA including a food package PK2, as shown in FIG. 7 . FIG. 7 shows an example in which the package PK2 occupies the entire area of ​​the candidate image CGA. The data storage unit 21 also stores component element data CEDA, as shown in FIG. 8 , including image components CEG1 to CEG10 obtained by region-dividing the candidate image CGA. The data storage unit 21 also associates position data CEPA, color data CECA, shape data CESA, and composition data CEKA with each image component in the component element data CEDA. That is, the color data CECA, shape data CESA, and composition data CEKA correspond to data representing multiple internal elements in one image component CEG extracted from the candidate image CGA. The data storage unit 21 also stores identification data CSDA corresponding to the master image CGA. That is, in this specific example, candidate data CDA including a candidate image CGA, component element data CEDA, and identification data CSDA is stored in the data storage unit 21. Fig. 7 is a diagram showing an example of a package included in a candidate image. Fig. 8 is a diagram showing an example of image components obtained by region segmenting the candidate image.

[0043] According to this specific example, one image component may be obtained as a rectangular region cut out to surround the one image component, or as a region cut out along the outermost contour of the one image component. Also, according to this specific example, processing using inpainting may be performed as the process for obtaining one image component. Furthermore, this specific example will be described assuming that the image components MEG1 to MEG10 and CEG1 to CEG10 are rectangular regions.

[0044] When the instruction signal HSS is input, the display screen generation unit 23 uses the master data MDA and candidate data CDA read from the data storage unit 21 to generate a display screen HGA as shown in FIG. 9 and outputs the generated display screen HGA to the display device 116. Note that, for convenience of illustration, the images and internal elements of the image components shown in FIGS. 5 to 8 are omitted in FIG. 9. Also, for convenience of illustration, the reference numerals corresponding to the image components shown in FIGS. 5 to 8 are omitted in FIG. 9. FIG. 9 is a diagram illustrating an example of a display screen generated by a data management device according to the present disclosure.

[0045] The display screen HGA has screen areas MA1 and MA2 in which information contained in the master data MDA is displayed, screen areas CA1 and CA2 in which information contained in the candidate data CDA is displayed, and a screen area GA in which a GUI is displayed. The display screen HGA may also be referred to as a basic screen, an initial screen, or a simplified display screen.

[0046] The screen area MA1 displays the master image MGA and image information MGJ related to the master image MGA. The image information MGJ includes, for example, a character string indicating the year and month the master image MGA was registered and a character string indicating the file name of the master image MGA. In other words, the display screen generation unit 23 can generate the image information MGJ to be displayed in the screen area MA1 based on the data included in the identification data MSD. Note that, according to this specific example, the display screen generation unit 23 may place a thumbnail of the master image MGA in the screen area MA1 instead of the master image MGA.

[0047] In the screen area MA2, an image element group GMEG including the image elements MEG1 to MEG10 extracted from the master image MGA is displayed. According to this specific example, the display screen generation unit 23 can set the arrangement positions of the image elements MEG1 to MEG10 in the screen area MA2 based on the position data MEPA associated with the image elements MEG1 to MEG10, for example, so that the positional relationships in the master image MGA are maintained.

[0048] The screen area CA1 displays a candidate image CGA and image information CGJ related to the candidate image CGA. The image information CGJ includes, for example, a character string indicating the year and month in which the candidate image CGA was acquired and a character string indicating the file name of the candidate image CGA. In other words, the display screen generation unit 23 can generate the image information CGJ to be displayed in the screen area CA1 based on the data included in the identification data CSD. Note that, according to this specific example, the display screen generation unit 23 may arrange a thumbnail of the candidate image CGA in the screen area CA1 instead of the candidate image CGA.

[0049] In the screen area CA2, an image component group GCEG including the image components CEG1 to CEG10 extracted from the candidate image CGA is displayed. According to this specific example, the display screen generation unit 23 can set the arrangement positions of the image components CEG1 to CEG10 in the screen area CA2 based on, for example, the position data CEPA associated with the image components CEG1 to CEG10 so that the positional relationships in the candidate image CGA are maintained.

[0050] According to the processing described above, the display screen generation unit 23 can generate a display screen having a screen area CA2 in which multiple image components extracted from the candidate image CGA are arranged so that their positional relationships in the candidate image CGA are maintained, and a screen area MA2 in which multiple image components extracted from the master image MGA are arranged so that their positional relationships in the master image MGA are maintained.

[0051] A plurality of GUI buttons are displayed in the screen area GA. Specifically, a component details button BUA, a layout comparison button BUB, a reset button BUC, an add registration button BUP, an update registration button BUQ, and a no registration required button BUR are displayed as the plurality of GUI buttons in the screen area GA.

[0052] When one of the component detail button BUA, layout comparison button BUB, and reset button BUC is pressed, an instruction signal HMS corresponding to that button is output to the display screen generation unit 23, and the display content of the display screen is changed in accordance with the instruction signal HMS. Also, when one of the add registration button BUP, update registration button BUQ, and no registration required button BUR is pressed, an instruction signal DMS corresponding to that button is output to the management unit 24, and at least one of the master data MDA and the candidate data CDA is changed in accordance with the instruction signal DMS.

[0053] Here, specific examples relating to the functions of each GUI button displayed in the screen area GA will be described. In this specific example, we will explain how the display contents of the screen areas MA2 and CA2 are changed in response to the operation of the Component Details button BUA, the Layout Comparison button BUB, and the Reset button BUC. We will also explain how the data in the data storage unit 21 is changed in response to the operation of the Add Registration button BUP, the Update Registration button BUQ, and the No Registration Required button BUR. In this specific example, unless otherwise specified, the display contents of the screen areas MA1 and CA1 are maintained as they are in the display image HGA. In this specific example, we will explain the initial state in which the image components MEG1 to MEG10 and the image components CEG1 to CEG10 are displayed in the screen areas MA2 and CA2 in the positional relationship shown in FIG. 10 . In this specific example, for the sake of convenience and illustration, we will explain some of the image components shown in FIG. 10 , while omitting explanations of other elements as appropriate. FIG. 10 is a diagram showing an example of display content included in the display screen.

[0054] The component details button BUA has the function of being able to instruct, when pressed by the user, to switch the display content of screen areas MA2 and CA2 to display content relating to a detailed comparison between image components MEG1 to MEG10 and image components CEG1 to CEG10.

[0055] For example, when the component details button BUA is pressed in the initial state, the display screen generation unit 23 performs processing to change the display content shown in Fig. 10 to the display content shown in Fig. 11. A specific example of such processing will be described below. Fig. 11 is a diagram showing another example of the display content included in the display screen.

[0056] When the component details button BUA is pressed in the initial state, the display screen generating unit 23 sets a screen area MCA3 by integrating the screen areas MA2 and CA2.

[0057] The display screen generation unit 23 calculates the similarity between one image component MEGX among the image components MEG1 to MEG10 and each of the image components CEG1 to CEG10. The display screen generation unit 23 also determines whether the largest similarity MSV among the similarities calculated as described above is equal to or greater than a predetermined value TH. The display screen generation unit 23 may calculate, as the similarity, a value representing the similarity of the entire image components. Specifically, the display screen generation unit 23 may calculate, as the similarity, the sum of, for example, the color similarity ISV corresponding to the color data MECA and CECA, the shape similarity SSV corresponding to the shape data MESA and CESA, and the composition similarity KSV corresponding to the composition data MEKA and CEKA.

[0058] When the display screen generation unit 23 obtains a determination result that one similarity MSV is equal to or greater than a predetermined value TH, it identifies one image component CEGX corresponding to the one similarity MSV from among the image components CEG1 to CEG10. Then, the display screen generation unit 23 arranges one image component MEGX and one image component CEGX at positions adjacent to each other in the screen region MCA3. According to this processing, the display screen generation unit 23 can identify, for example, a pair of image components MEG1 and CEG1 as a combination of image components that are relatively highly similar to the image components MEG1 to MEG10 and the image components CEG1 to CEG10. According to the above-described processing, the display screen generation unit 23 can arrange the image components MEG1 and CEG1 at positions adjacent to each other in the screen region MCA3 (see FIG. 11 ).

[0059] When the display screen generation unit 23 determines that the similarity MSV is less than a predetermined value TH, it generates visual information VMJ indicating that no element similar to the image component MEGX is included among the image components CEG1 to CEG10. The display screen generation unit 23 then arranges the image component MEGX and the visual information VMJ adjacent to each other in the screen area MCA3. According to this processing, the display screen generation unit 23 can arrange, for example, the image component MEG10 and the visual information VMJ adjacent to each other in the screen area MCA3 (see FIG. 11 ). The visual information VMJ may include, for example, a character string such as "none" or a symbol such as "x."

[0060] If there is an image component CEGY that was not identified as an image component CEGX by the above-described process, the display screen generation unit 23 generates visual information VCJ indicating that no element similar to the image component CEGY was included among the image components MEG1 to MEG10. The display screen generation unit 23 then arranges the image component CEGY and the visual information VCJ in positions adjacent to each other in the screen area MCA3. According to this process, the display screen generation unit 23 can arrange, for example, the image component CEG10 and the visual information VCJ in positions adjacent to each other in the screen area MCA3 (see FIG. 11 ). The visual information VCJ may include, for example, a character string such as "none" or a symbol such as "x."

[0061] According to this example, the display screen generation unit 23 is not limited to arranging each image component at the position shown in Fig. 11. Specifically, the display screen generation unit 23 may arrange the image component MEG10 corresponding to the visual information VMJ and the image component CEG10 corresponding to the visual information VCJ close to each other, for example, as shown in Fig. 12. Fig. 12 is a diagram showing another example of the display content included on the display screen.

[0062] For example, when the component details button BUA is pressed in the display state of Fig. 11, the display screen generation unit 23 performs processing to change the display content shown in Fig. 11 to the display content shown in Fig. 13. A specific example of such processing will be described below. Fig. 13 is a diagram showing another example of the display content included in the display screen.

[0063] The display screen generation unit 23 calculates a similarity ISVX representing the color similarity between one image component MEGX and one image component CEGX based on the color data MECA and CECA. The display screen generation unit 23 also calculates a similarity SSVX representing the shape similarity between one image component MEGX and one image component CEGX based on the shape data MESA and CESA. The display screen generation unit 23 also calculates a similarity KSVX representing the composition similarity between one image component MEGX and one image component CEGX based on the composition data MEKA and CEKA. The display screen generation unit 23 also identifies the smallest similarity MSVX among the similarities ISVX, SSVX, and KSVX, and generates a tag TGX including a character corresponding to the identified similarity MSVX. Specifically, for example, when ISVX = MSVX, the display screen generation unit 23 generates a tag TGI containing the word "color" as the tag TGX. Furthermore, for example, when SSVX = MSVX, the display screen generation unit 23 generates a tag TGS containing the word "shape" as the tag TGX. Furthermore, for example, when KSVX = MSVX, the display screen generation unit 23 generates a tag TGK containing the word "composition" as the tag TGX. Then, the display screen generation unit 23 places the tag TGX in a position adjacent to one image component MEGX and one image component CEGX in the screen area MCA3. According to this processing, the display screen generation unit 23 can place the tag TGI in a position adjacent to the image components MEG1 and CEG1 in the screen area MCA3, for example (see FIG. 13 ). Furthermore, according to the above-described processing, the display screen generation unit 23 can place the tag TGS at a position adjacent to the image components MEG4 and CEG4 in the screen area MCA3 (see FIG. 13). Furthermore, according to the above-described processing, the display screen generation unit 23 can place the tag TGK at a position adjacent to the image components MEG9 and CEG9 in the screen area MCA3 (see FIG. 13).

[0064] According to this example, one-dimensional codes that match in color, shape, and composition are extracted as image components MEG8 and CEG8. Therefore, according to this example, tags TGX corresponding to image components MEG8 and CEG8 are not displayed (see FIG. 13 ). In other words, when ISVX = SSVX = KSVX, the display screen generation unit 23 does not perform processing related to the generation and placement of tags TGX. Furthermore, according to this example, the display screen generation unit 23 may generate tags TGX that include, for example, a numerical value representing one similarity MSVX. Furthermore, according to this example, the display screen generation unit 23 may generate tags TGX that include a phrase indicating a difference corresponding to one similarity MSVX, such as the color of image component MEG1 and the color of CEG1.

[0065] For example, when the component details button BUA is pressed in the display state of Fig. 13, the display screen generation unit 23 performs processing to change the display content shown in Fig. 13 to the display content shown in Fig. 14. A specific example of such processing will be described below. Fig. 14 is a diagram showing another example of the display content included in the display screen.

[0066] The display screen generation unit 23 generates a bidirectional arrow YJX having a display mode corresponding to one similarity MSVX. Specifically, the display screen generation unit 23 generates an arrow YJX having a different color or shape corresponding to one similarity MSVX, for example. The display screen generation unit 23 then places the arrow YJX between one image component MEGX and one image component CEGX. By performing this processing, the display screen generation unit 23 can place the arrow YJX between the image components MEG1 and CEG1 in the screen area MCA3, for example (see FIG. 14 ).

[0067] According to this example, one-dimensional codes matching in color, shape, and composition are extracted as image components MEG8 and CEG8. Therefore, according to this example, the arrow YJX corresponding to image components MEG8 and CEG8 is not displayed (see FIG. 14). According to this example, the arrow YJX is also not displayed for image component MEG10 corresponding to visual information VMJ and image component CEG10 corresponding to visual information VCJ (see FIG. 14). In other words, the display screen generation unit 23 does not perform processing related to the generation and placement of the arrow YJX for image components where ISVX = SSVX = KSVX. Furthermore, the display screen generation unit 23 does not perform processing related to the generation and placement of the arrow YJX for image components corresponding to either visual information VMJ or VCJ. According to this example, the display screen generation unit 23 may display, instead of the arrow YJX, characters indicating a numerical value of a single similarity MSVX, such as "high," "medium," or "low."

[0068] For example, when the component details button BUA is pressed in the display state of FIG. 14, the display screen generating unit 23 performs processing to change the display content shown in FIG. 14 to the display content shown in FIG.

[0069] According to the processing described above, the component details button BUA has a function capable of issuing an instruction to switch the display content relating to the comparison between the image components MEG1 to MEG10 and the image components CEG1 to CEG10 in the order of FIG. 11 → FIG. 13 → FIG. 14 → FIG. 11 .... Furthermore, according to the processing described above, in response to pressing of the component details button BUA, the display screen generation unit 23 can change the display content relating to the detailed comparison between the image components MEG1 to MEG10 and the image components CEG1 to CEG10 in the order of FIG. 11 → FIG. 13 → FIG. 14 → FIG. 11 .... Note that, according to this specific example, instead of the component details button BUA, it is sufficient if at least one GUI button capable of switching the display content shown in FIG. 10 to any of the display contents of FIGS. 11 to 14 is disposed in the screen area GA. Furthermore, according to this specific example, when the display content is changed from the initial state by pressing the layout comparison button BUB, it is desirable that the display screen generation unit 23 not change the display content by pressing the component details button BUA.

[0070] The layout comparison button BUB has the function of being able to instruct, when pressed by the user, to switch the display content of the screen areas MA2 and CA2 to display content relating to a comparison between the layout positions of each image component included in the master image MGA and the layout positions of each image component included in the candidate image CGA.

[0071] For example, when the layout comparison button BUB is pressed in the initial state, the display screen generation unit 23 performs processing to change the display content shown in Fig. 10 to the display content shown in Fig. 15. A specific example of such processing will be described below. Fig. 15 is a diagram showing another example of the display content included in the display screen.

[0072] The display screen generation unit 23 identifies image components MEGZ and CEGZ that are arranged at different positions in the master image MGA and the candidate image CGA based on the position data MEPA associated with the image components MEG1 to MEG10 and the position data CEPA associated with the image components CEG1 to CEG10. Furthermore, the display screen generation unit 23 generates a bidirectional arrow YJZ and a tag TGZ including the word "arrangement" as visual information indicating that the arrangement positions of the image components MEGZ and CEGZ within the image are different. The display screen generation unit 23 then arranges the arrow YJZ between the image components MEGZ and CEGZ and arranges the tag TGZ at a position tangent to the arrow YJZ. According to this processing, the display screen generation unit 23 can, for example, arrange the arrow YJZ between the image component MEG8 in the screen area MA2 and the image component CEG8 in the screen area CA2 (see FIG. 15 ). Furthermore, according to the above-described process, the display screen generating unit 23 can place the tag TGZ above the arrows YJZ, for example (see FIG. 15).

[0073] According to this specific example, logo marks located at the same positions in the master image MGA and the candidate image CGA are extracted as the image components MEG1 and CEG1. Therefore, according to this specific example, the arrows YJZ corresponding to the image components MEG1 and CEG1 are not displayed (see FIG. 15). According to this specific example, the arrows YJZ are also not displayed for the image component MEG10 corresponding to the visual information VMJ and the image component CEG10 corresponding to the visual information VCJ (see FIG. 14). In other words, the display screen generation unit 23 does not perform processing related to the generation and placement of the arrows YJZ for image components located at the same positions in the master image MGA and the candidate image CGA. Furthermore, the display screen generation unit 23 does not perform processing related to the generation and placement of the arrows YJZ for image components present in either the master image MGA or the candidate image CGA.

[0074] According to this specific example, the display screen generation unit 23 may generate, as the arrows YJZ, arrows having different colors or shapes according to one similarity MSVX, for example. Also, according to this specific example, the display screen generation unit 23 may generate, as the tag TGZ, a tag including, for example, a numerical value representing one similarity MSVX. Also, according to this specific example, when the display content has been changed from the initial state by pressing the layout comparison button BUB, it is desirable that the display screen generation unit 23 not change the display content by pressing the component details button BUA.

[0075] The reset button BUC has a function of being able to issue an instruction to return the current display state on the display screen to the initial state in response to a user's depression.

[0076] For example, when the reset button BUC is pressed in any one of the display states of Figures 11, 13, 14 and 15, the display screen generation unit 23 performs processing to return the one display state to the display state of Figure 10.

[0077] According to the above-described process, the display screen generation unit 23 can generate a display screen including display content that allows comparison between at least one image component extracted from a candidate image CGA included in the candidate data CDA and at least one image component previously extracted from a master image MGA included in master data MDA different from the candidate data CDA. According to the above-described process, the display screen generation unit 23 can identify at least one pair corresponding to a combination of image components that are relatively similar between multiple image components extracted from the candidate image CGA and multiple image components extracted from the master image MGA, and generate a display screen in which the two image components included in the identified pair are positioned adjacent to each other. According to the above-described process, the display screen generation unit 23 can generate visual information indicating image components that are not identified as part of the pair. According to the above-described process, the display screen generation unit 23 can generate visual information corresponding to an internal element that is least similar among multiple internal elements in each of the two image components. Furthermore, the multiple internal elements can include at least one of color, shape, and composition.

[0078] The additional registration button BUP has a function that, when pressed by the user, can instruct the candidate image CGA displayed on the display screen HGA to be separately registered as another master image derived from the master image MGA displayed on the display screen HGA.

[0079] When the additional registration button BUP is pressed, the management unit 24 rewrites the candidate data CDA corresponding to the candidate image CGA displayed on the display screen HGA as master data MDB different from the master data MDA. According to this process, the management unit 24 can separately register the candidate image CGA displayed on the display screen HGA as a master image MGB different from the master image MGA in the data storage unit 21. That is, according to the above-described process, the management unit 24 can register at least one candidate image in the data storage unit 21 as a master image different from an existing master image. According to the above-described process, the management unit 24 can also obtain the date and time when the additional registration button BUP was pressed as the registration date and time of the master image MGB.

[0080] The update registration button BUQ has a function that, when pressed by the user, can instruct the candidate image CGA displayed on the display screen HGA to be registered as a new master image to replace the master image MGA displayed on the display screen HGA.

[0081] When the update registration button BUQ is pressed, the management unit 24 rewrites the candidate data CDA corresponding to the candidate image CGA displayed on the display screen HGA as new master data MDN replacing the master data MDA, and then deletes the master data MDA. According to this process, the management unit 24 can separately register the candidate image CGA displayed on the display screen HGA as a new master image MGN replacing the master image MGA in the data storage unit 21. Furthermore, according to the above-described process, the management unit 24 can obtain the date and time when the update registration button BUQ was pressed as the registration date and time of the master image MGN.

[0082] The registration unnecessary button BUR has a function of being able to instruct the user to delete the candidate image CGA displayed on the display screen HGA in response to pressing the button.

[0083] When the registration unnecessary button BUR is pressed, the management unit 24 deletes the candidate data CDA corresponding to the candidate image CGA displayed on the display screen HGA.

[0084] According to the processing described above, the display screen generation unit 23 can generate a display screen having a GUI button that can give an instruction to separately register the candidate data CDA in the data storage unit 21, while maintaining the master data MDA that was registered in the data storage unit 21 before the acquisition of the candidate data CDA. Furthermore, the display screen generation unit 23 can generate a display screen that has a GUI button that can give an instruction to register the candidate data CDA in the data storage unit 21 instead of the master data MDA that was registered in the data storage unit 21 before the acquisition of the candidate data CDA.

[0085] According to this specific example, a display screen having display content that allows a user to compare each image component extracted from the master image MGA with each image component extracted from the candidate image CGA can be presented to the user. Furthermore, according to this specific example, a display screen having display content that allows a user to confirm details of differences between each image component extracted from the master image MGA and each image component extracted from the candidate image CGA can be presented to the user. Furthermore, according to this specific example, the user can determine whether to register the candidate image CGA as a master image MGB or MGN by checking the display content on the display screen.

[0086] According to this specific example, for example, when a plurality of master data are stored in the data storage unit 21, the display screen generation unit 23 may arrange in the screen area GA a GUI button having a function of sequentially displaying a master image and image components included in one of the plurality of master data. Also, according to this specific example, for example, when a plurality of candidate data are stored in the data storage unit 21, the display screen generation unit 23 may arrange in the screen area GA a GUI button having a function of sequentially displaying a candidate image and image components included in one of the plurality of candidate data.

[0087] [Processing Flow] Next, a description will be given of the flow of processing performed in the data management device 100. Fig. 16 is a flowchart showing an example of processing performed in the data management device according to the present disclosure.

[0088] First, the data management device 100 acquires candidate images that can be used as candidates for a new master image by searching the Internet or the like using data included in the master data read from the data storage unit 21 (step S11). The data management device 100 also stores candidate data including the candidate images acquired in step S11 in the data storage unit 21.

[0089] Next, the data management device 100 uses the master data and candidate data stored in the data storage unit 21 to generate a display image having display content that allows comparison between each image component extracted from the master image and each image component extracted from the candidate image, and displays the generated display image on the display device 116 (step S12).

[0090] Next, the data management device 100 determines whether an instruction to change the display content of the display image has been given, for example, by detecting the pressing of a GUI button included in the display image displayed in step S12 (step S13).

[0091] If an instruction to change the display content has not been given (step S13: NO), the data management device 100 performs the process of step S15. If an instruction to change the display content has been given (step S13: YES), the data management device 100 changes the current display content in response to the instruction (step S14), and then performs the process of step S15.

[0092] The data management device 100 determines whether an instruction has been given to operate the data stored in the data storage unit 21, for example, by detecting the pressing of a GUI button included in the display image generated in step S12 (step S15).

[0093] If an instruction related to data manipulation has not been given (step S15: NO), the data management device 100 performs the process of step S13 again. If an instruction related to data manipulation has been given (step S15: YES), the data management device 100 changes the data in the data storage unit 21 in accordance with the instruction (step S16), and then ends the series of processes.

[0094] As described above, according to this embodiment, it is possible to display a display image that allows each image component included in a master image to be compared with each image component included in a candidate image from various perspectives. Furthermore, according to this embodiment, by referring to the display image, a user can determine, for example, whether to add data to treat a candidate image as a master image. Furthermore, according to this embodiment, by referring to the display image, a user can determine, for example, whether to update data to treat a candidate image as a new master image. Therefore, according to this embodiment, even if the details of the appearance of an item are changed, data related to the item can be appropriately managed.

[0095] Second Embodiment FIG. 17 is a block diagram showing another example of the functional configuration of a data management device according to the present disclosure.

[0096] The data management device 500 according to this embodiment has the same hardware configuration as the data management device 100. The data management device 500 also has an acquisition unit 501, an extraction unit 502, and a screen generation unit 503.

[0097] The acquiring means 501 can be realized, for example, by using the function of the data acquiring unit 22 of the first embodiment. The extracting means 502 can be realized, for example, by using the function of the data acquiring unit 22 of the first embodiment. The screen generating means 503 can be realized, for example, by using the function of the display screen generating unit 23 of the first embodiment.

[0098] FIG. 18 is a flowchart showing another example of processing performed in the data management device according to the present disclosure.

[0099] The acquiring unit 501 acquires first data including a first image (step S51).

[0100] The extracting means 502 extracts at least one image component from the first image (step S52).

[0101] The screen generation means 503 generates a display screen including display content that allows comparison between at least one image component extracted from the first image and at least one image component previously extracted from a second image included in second data different from the first data (step S53).

[0102] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.

[0103] (Supplementary Note 1) A data management device comprising: an acquisition means for acquiring first data including a first image; an extraction means for extracting at least one image component from the first image; and a screen generation means for generating a display screen including display content that allows comparison between the at least one image component extracted from the first image and at least one image component previously extracted from a second image included in second data different from the first data.

[0104] (Appendix 2) The screen generation means of the data management device of Appendix 1 generates a screen having, as the display screen, a first screen area in which a plurality of image components extracted from the first image are arranged so as to maintain their positional relationship in the first image, and a second screen area in which a plurality of image components extracted from the second image are arranged so as to maintain their positional relationship in the second image.

[0105] (Appendix 3) The screen generation means is a data management device of Appendix 1, which identifies at least one pair corresponding to a combination of image components that are relatively similar between a plurality of image components extracted from the first image and a plurality of image components extracted from the second image, and generates the display screen in which the two image components included in the identified pair are positioned adjacent to each other.

[0106] (Supplementary Note 4) The data management device according to Supplementary Note 3, wherein the screen generating means generates visual information showing the image components that have not been identified as a pair.

[0107] (Supplementary Note 5) The data management device according to Supplementary Note 3, wherein the screen generation means generates visual information corresponding to one internal element that has the lowest similarity among a plurality of internal elements in each of the two image components.

[0108] (Supplementary Note 6) The data management device of Supplementary Note 5, wherein the plurality of internal elements include at least one of color, shape, and composition.

[0109] (Supplementary Note 7) The data management device of Supplementary Note 1, wherein the screen generation means generates, as the display screen, a screen having a GUI button that can instruct the user to separately register the first data in the database while maintaining the second data that was registered in the database before the first data was acquired.

[0110] (Appendix 8) The data management device of Appendix 1, wherein the screen generation means generates, as the display screen, a screen having a GUI button capable of instructing to register the first data in the database instead of the second data registered in the database before the acquisition of the first data.

[0111] (Supplementary Note 9) A data management method comprising: acquiring first data including a first image; extracting at least one image component from the first image; and generating a display screen including display content that allows a comparison between the at least one image component extracted from the first image and at least one image component previously extracted from a second image included in second data different from the first data.

[0112] (Supplementary Note 10) A recording medium having recorded thereon a program that causes a computer to execute a process of acquiring first data including a first image, extracting at least one image component from the first image, and generating a display screen including display content that allows comparison between the at least one image component extracted from the first image and at least one image component previously extracted from a second image included in second data different from the first data.

[0113] Although the present disclosure has been described above with reference to embodiments and examples, the present disclosure is not limited to the above embodiments and examples. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0114] 21 Data storage unit 22 Data acquisition unit 23 Display screen generation unit 24 Management unit 100 Data management device

Claims

1. An acquisition means for acquiring first data including a first image, Extraction means for extracting at least one image component from the first image, A screen generation means that generates a display screen including display content that allows comparison of at least one image component extracted from the first image and at least one image component previously extracted from a second image contained in second data different from the first data, A data management device having the following features.

2. The data management device according to claim 1, wherein the screen generation means generates a screen having, as the display screen, a first screen area in which a plurality of image components extracted from the first image are arranged such that their positional relationships in the first image are maintained, and a second screen area in which a plurality of image components extracted from the second image are arranged such that their positional relationships in the second image are maintained.

3. The data management device according to claim 1, wherein the screen generation means identifies at least one pair of image elements that are relatively similar among a plurality of image elements extracted from the first image and a plurality of image elements extracted from the second image, and generates the display screen in which the two image elements included in the identified pair are arranged in adjacent positions.

4. The data management device according to claim 3, wherein the screen generation means generates visual information indicating image components that were not identified as a pair.

5. The data management device according to claim 3, wherein the screen generation means generates visual information corresponding to the one internal element with the lowest similarity among a plurality of internal elements in each of the two image components.

6. The data management device according to claim 5, wherein the plurality of internal elements include at least one of color, shape, and composition.

7. The data management device according to claim 1, wherein the screen generation means generates a screen as the display screen having GUI buttons that allow instructions to separately register the first data in the database while maintaining the second data which was registered in the database before the acquisition of the first data.

8. The data management device according to claim 1, wherein the screen generation means generates a screen as the display screen having GUI buttons that can give instructions to register the first data in the database in place of the second data which was registered in the database before the acquisition of the first data.

9. A computer, First data including the first image is obtained, Extract at least one image component from the first image, A data management method for generating a display screen that includes display content that allows comparison between at least one image component extracted from the first image and at least one image component previously extracted from a second image contained in second data different from the first data.

10. First data including the first image is obtained, Extract at least one image component from the first image, A program that causes a computer to perform a process to generate a display screen that includes display content that allows comparison between at least one image component extracted from the first image and at least one image component previously extracted from a second image contained in second data different from the first data.