Method, system, and computer program for comparing common features of products and providing comparison results
The product comparison method addresses inefficiencies in keyword-based searches by using content-based image retrieval to recognize and label common product attributes, improving search accuracy and efficiency.
Patent Information
- Application Number
- JP2021048337
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-03-24
- Filing Date
- 2021-03-23
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2041-03-23
AI Technical Summary
Existing product search methods, particularly those relying on keyword-based image searches, are inefficient when users lack product knowledge, leading to inaccurate keyword entry and cumbersome search processes.
A product comparison method using content-based image retrieval techniques that recognize multiple products from images, compare attributes using metadata, and overlay comparison results directly on the images.
Facilitates efficient comparison of product attributes by recognizing and labeling common features across multiple products, enhancing user understanding and accuracy in product selection.
Smart Images

Figure 0007586581000002 
Figure 0007586581000003 
Figure 0007586581000004
Abstract
Description
[Technical field]
[0001] The following description relates to techniques for comparing products. [Background technology]
[0002] A common method for searching for products is to classify attributes based on product information entered in text and display them to the user. This method, in keyword-based image search technology, causes a lot of inconvenience in product searches because if the user does not have sufficient knowledge about the product, he or she must directly check all the products in each category and it is difficult to enter keywords accurately.
[0003] As a new approach to this problem, a content-based image retrieval technique may be used, which performs searches based on the feature vectors of an image.
[0004] As an example of image-based product search technology, Patent Document 1 (registered on October 7, 2019) discloses a technology for identifying items depicted in an image and searching for data for the items. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Korean Patent No. 10-2032038 Summary of the Invention [Problem to be solved by the invention]
[0006] The purpose is to compare data of the same attributes of two or more products recognized from images and display the comparison results by labeling them on the relevant images.
[0007] The purpose is to provide a UI for comparing common features between two or more products recognized from images, and to display the comparison results of the features selected in the UI on top of the corresponding images. [Means for solving the problem]
[0008] A product comparison method executed by a computer device, the computer device including at least one processor configured to execute computer-readable instructions contained in a memory, the product comparison method including the steps of: recognizing, by the at least one processor, two or more compared products from at least one image; displaying, by the at least one processor, at least one attribute comparable between the compared products in a user interface (UI); and providing, by the at least one processor, a comparison result for data of an attribute selected in the UI.
[0009] According to one aspect, the displaying step may include identifying attributes that allow common classification between the compared products using metadata of the compared products.
[0010] According to another aspect, the displaying step may include querying metadata of the compared products from a product database including metadata of each product, and identifying attributes that allow for common classification between the compared products using the query metadata.
[0011] According to another aspect, the displaying step may include querying metadata from product details obtained by a real-time search for the compared products, and identifying attributes that can be commonly classified between the compared products using the retrieved metadata.
[0012] According to another aspect, the displaying step may further include checking field values of each attribute that allows common classification between the compared products.
[0013] According to another aspect, the providing step may include overlaying a label on the image according to the comparison result.
[0014] According to another aspect, the displaying step may include displaying display elements of the label in a differentiated manner depending on at least one field value of the compared products for the selected attribute.
[0015] According to another aspect, the providing step may include providing a comparison result between the compared products in a graphical format using at least one field value of the compared products for the selected attribute.
[0016] According to another aspect, the recognizing step may include providing, for each object recognized from the image, product information matching the corresponding object, and, if a user confirms the product information, identifying the corresponding product as the comparison product.
[0017] According to yet another aspect, the product comparison method may further include comparing text extracted from the images by an optical character reader (OCR) between the products to be compared by the at least one processor to provide a comparison result.
[0018] There is also provided a computer program recorded on a non-transitory computer-readable recording medium for causing the computer device to execute the product comparison method.
[0019] A computer device is provided, the computer device including at least one processor implemented to execute computer-readable instructions contained in a memory, the at least one processor including a product recognition unit configured to recognize two or more comparison target products from at least one image, an attribute providing unit configured to provide at least one attribute comparable between the comparison target products in a UI, and a label display unit configured to display a label on the image based on a comparison result against data of an attribute selected in the UI. [Brief description of the drawings]
[0020] [Figure 1] FIG. 1 illustrates an example of a network environment in accordance with an embodiment of the present invention. [Diagram 2] 2 is a block diagram illustrating the internal configuration of an electronic device and a server according to an embodiment of the present invention. FIG. [Diagram 3] FIG. 2 illustrates example components that may be included in a processor of an electronic device in accordance with an embodiment of the present invention. [Figure 4] 4 is a flowchart illustrating an example of a method that can be performed by an electronic device in accordance with an embodiment of the present invention. [Diagram 5] 10 is an exemplary diagram illustrating a process of inputting an image of a comparison product in accordance with an embodiment of the present invention; [Figure 6] FIG. 11 is an exemplary diagram for explaining a process of identifying a comparison target product in an embodiment of the present invention. [Figure 7] FIG. 11 is an exemplary diagram for explaining a process of identifying a comparison target product in an embodiment of the present invention. [Figure 8] 11 is an exemplary diagram illustrating a process of displaying field information comparable between comparison target products according to an embodiment of the present invention; FIG. [Figure 9] 1 is an exemplary diagram illustrating a process of providing a comparison result between compared products in accordance with an embodiment of the present invention; [Figure 10]1 is an exemplary diagram illustrating a process of providing a comparison result between compared products in accordance with an embodiment of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0021] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
[0022] An embodiment of the present invention relates to a technique for comparing products with the same attributes contained in images.
[0023] Embodiments including those specifically disclosed herein can compare data of the same attribute between two or more products recognized from an image and label the comparison results on the relevant image.
[0024] Fig. 1 is a diagram showing an example of a network environment in one embodiment of the present invention. The network environment in Fig. 1 shows an example including a plurality of electronic devices 110, 120, 130, 140, a plurality of servers 150, 160, and a network 170. Fig. 1 is merely an example for explaining the invention, and the number of electronic devices and the number of servers are not limited to those shown in Fig. 1.
[0025] The electronic devices 110, 120, 130, and 140 may be fixed terminals or mobile terminals realized by computer devices. Examples of the electronic devices 110, 120, 130, and 140 include smartphones, mobile phones, navigation systems, personal computers (PCs), notebook PCs, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), tablets, game consoles, wearable devices, Internet of Things (IoT) devices, virtual reality (VR) devices, and augmented reality (AR) devices. As an example, FIG. 1 shows a smartphone as an example of the electronic device 110, but in the embodiment of the present invention, the electronic device 110 may mean one of various physical computer devices that can communicate with other electronic devices 120, 130, and 140 and / or servers 150 and 160 via a network 170 using a substantially wireless or wired communication method.
[0026] The communication method is not limited, and may include not only a communication method using a communication network (such as a mobile communication network, a wired Internet, a wireless Internet, a broadcast network, a satellite network, etc.) that the network 170 can include, but also short-range wireless communication between devices. For example, the network 170 may include any one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, etc. Furthermore, the network 170 may include any one or more of a network topology including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network, etc.
[0027] Each of the servers 150 and 160 may be realized by one or more computer devices that communicate with the multiple electronic devices 110, 120, 130, and 140 via the network 170 to provide instructions, codes, files, contents, services, and the like. For example, the server 150 may be a system that provides a first service to the multiple electronic devices 110, 120, 130, and 140 connected via the network 170, and the server 160 may be a system that provides a second service to the multiple electronic devices 110, 120, 130, and 140 connected via the network 170. As a more specific example, the server 150 may provide a service (such as a product comparison service, for example) targeted by an application, which is a computer program installed and executed in the multiple electronic devices 110, 120, 130, and 140, as a first service to the multiple electronic devices 110, 120, 130, and 140. As another example, the server 160 may provide, as a second service, a service of distributing files for installing and executing the above-mentioned application to the multiple electronic devices 110, 120, 130, and 140.
[0028] Fig. 2 is a block diagram for explaining the internal configuration of an electronic device and a server in an embodiment of the present invention. In Fig. 2, the internal configuration of electronic device 110 and the internal configuration of server 150 are explained as examples of electronic devices. In addition, other electronic devices 120, 130, 140 and server 160 may have the same or similar internal configuration as electronic device 110 or server 150 described above.
[0029] The electronic device 110 and the server 150 may include memories 211 and 221, processors 212 and 222, communication modules 213 and 223, and input / output interfaces 214 and 224. The memories 211 and 221 may be non-transitory computer-readable recording media and may include persistent mass storage devices such as random access memory (RAM), read only memory (ROM), disk drives, solid state drives (SSD), flash memories, and the like. Here, persistent mass storage devices such as ROM, SSD, flash memories, and disk drives may be included in the electronic device 110 and the server 150 as persistent storage devices separate from the memories 211 and 221. In addition, the memories 211 and 221 may store an operating system and at least one program code (for example, a browser installed and executed in the electronic device 110, or a code for an application installed in the electronic device 110 to provide a specific service, etc.). Such software components may be loaded from a computer-readable recording medium separate from the memories 211 and 221. Such another computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, a memory card, etc. In another embodiment, the software components may be loaded into the memory 211, 221 through a communication module 213, 223 that is not a computer-readable recording medium. For example, at least one program may be loaded into the memory 211, 221 based on a computer program (for example, the above-mentioned application) that is installed by a file provided via the network 170 by a developer or a file distribution system that distributes an installation file of the application (for example, the above-mentioned server 160).
[0030] The processors 212, 222 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the processors 212, 222 by the memory 211, 221 or the communication modules 213, 223. For example, the processors 212, 222 may be configured to execute instructions received according to program code stored in a storage device such as the memory 211, 221.
[0031] The communication modules 213 and 223 may provide a function for the electronic device 110 and the server 150 to communicate with each other via the network 170, or may provide a function for the electronic device 110 and / or the server 150 to communicate with other electronic devices (for example, the electronic device 120) or other servers (for example, the server 160). For example, a request generated by the processor 212 of the electronic device 110 according to a program code recorded in a recording device such as the memory 211 may be transmitted to the server 150 via the network 170 under the control of the communication module 213. Conversely, a control signal, an instruction, a content, a file, etc. provided under the control of the processor 222 of the server 150 may be received by the electronic device 110 through the communication module 213 of the electronic device 110 via the communication module 223 and the network 170. For example, control signals, instructions, content, files, etc. from the server 150 received through the communication module 213 may be transmitted to the processor 212 or memory 211, and the content, files, etc. may be recorded on a recording medium (the above-mentioned permanent recording device) that the electronic device 110 may further include.
[0032] The input / output interface 214 may be a means for interfacing with the input / output device 215. For example, the input device may include a device such as a keyboard, a mouse, a microphone, or a camera, and the output device may include a device such as a display, a speaker, or a haptic feedback device. As another example, the input / output interface 214 may be a means for interfacing with a device in which functions for input and output are integrated into one, such as a touch screen. The input / output device 215 may be configured as one device together with the electronic device 110. Also, the input / output interface 224 of the server 150 may be a means for interfacing with a device for input or output (not shown) that may be connected to the server 150 or included in the server 150. As a more specific example, when the processor 212 of the electronic device 110 processes the instructions of the computer program loaded in the memory 211, a service screen or content configured using data provided by the server 150 or the electronic device 120 may be displayed on a display through the input / output interface 214.
[0033] Also, in other embodiments, the electronic device 110 and the server 150 may include more components than those in FIG. 2. However, it is not necessary to clearly show most of the conventional technical components in the figure. For example, the electronic device 110 may be realized to include at least some of the above-mentioned input / output devices 215, and may further include other components such as a transceiver, a GPS (Global Positioning System) module, a camera, various sensors, a database, etc. As a more specific example, if the electronic device 110 is a smartphone, various components such as an acceleration sensor, a gyro sensor, a camera module, various physical buttons, a button using a touch panel, an input / output port, a vibrator for vibration, etc., which are generally included in a smartphone, may be realized to be further included in the electronic device 110.
[0034] Specific embodiments of a method and system for comparing common features of products and providing a comparison result are described below.
[0035] FIG. 3 is a block diagram illustrating an example of components that may be included in a processor of an electronic device in one embodiment of the present invention, and FIG. 4 is a flowchart illustrating an example of a method that may be performed by an electronic device in one embodiment of the present invention.
[0036] A product comparison system implemented by a computer may be configured in the electronic device 110 according to the present embodiment. For example, the product comparison system may be implemented in the form of an independently operating program, or may be configured in the form of an in-app of a specific application and may be implemented to be operable on the specific application, and in some cases, may be linked with the server 150 to provide a product comparison service.
[0037] Based on instructions provided by an application installed on the electronic device 110, the product comparison system implemented in the electronic device 110 may perform the product comparison method illustrated in FIG.
[0038] The electronic device 110 may execute the product comparison method according to Fig. 4. To this end, the processor 212 of the electronic device 110 may include, as components, a product recognition unit 310, an attribute providing unit 320, and a label display unit 330, as shown in Fig. 3. Depending on the embodiment, the components of the processor 212 may be selectively included or excluded from the processor 212. Also, depending on the embodiment, the components of the processor 212 may be separated or combined to express the functions of the processor 212.
[0039] Such processor 212 and components of processor 212 may control electronic device 110 to execute steps 410 to 430 included in the product comparison method of Fig. 4. For example, processor 212 and components of processor 212 may be realized to execute instructions from operating system code and at least one program code included in memory 211.
[0040] Here, the components of the processor 212 may represent different functions of the processor 212 that are executed by the processor 212 according to instructions provided by a program code recorded in the electronic device 110 (for example, instructions provided by an application executed on the electronic device 110). For example, the product recognition unit 310 may be used as a functional representation of the processor 212 that controls the electronic device 110 according to the above-mentioned instructions so that the electronic device 110 recognizes a product from an image.
[0041] The processor 212 may read necessary instructions from the memory 211 loaded with instructions related to the control of the electronic device 110. In this case, the read instructions may include instructions for controlling the processor 212 to execute steps 410 to 430 described below.
[0042] 4, in step 410, the product recognition unit 310 may recognize two or more products from at least one input image. An image including a comparison target product may be input to the product recognition unit 310 by an application including an AI-based camera function. For example, an image may be input to the product recognition unit 310 by a camera capture function of the application, or an image may be retrieved from an image storage area associated with the electronic device 110 (for example, a local storage such as the memory 211, or a storage area on the Internet that can be linked to the electronic device 110).
[0043] As one example, an image including two or more products to be compared in one frame may be input to the product recognition unit 310. As another example, product images corresponding to each product may be input one by one in stages to the product recognition unit 310. For example, when the "product comparison mode" is selected, the product recognition unit 310 may provide an interface for photographing or recalling from a storage area the products to be compared one by one. Each recognized product may be displayed in a separate area. When an image input or recalled from a storage area includes two or more products, each product may be displayed separately.
[0044] In the present embodiment, the comparison target product may refer to an object having a common feature that allows product comparison as an object of an attribute for providing an image comparison analysis. For example, the comparison target product may include cosmetics, wine, sneakers, mobile phones, home appliances, etc., but these are merely examples and may include all common classification objects that can be compared with each other. Even if the detailed categories of the comparison target products are different, all products that can be labeled according to other criteria such as usage can be applied.
[0045] The product recognition unit 310 may analyze the input image based on an object detection technique using deep learning, and may identify a product to be compared using the analysis result. For example, the product recognition unit 310 may provide product information matching each object recognized in the input image by utilizing a product database (for example, the memory 221) constructed in advance to provide a product comparison service in cooperation with the server 150. The product recognition unit 310 may transmit a product information request including the input image to the server 150, and the server 150 may provide product information matching the object recognized in the input image in response to the product information request. The product recognition unit 310 may display product information matching the corresponding object for each object recognized in the input image, and may identify a product to be compared based on a user input for the product information. For example, when an image is input by a user, product information matching the object recognized in the image may be displayed, and the user may be asked to confirm whether the items being compared are correct. When the user confirms the product information, the corresponding product may be identified as the product to be compared.
[0046] In step 420, the attribute providing unit 320 may provide field information of the same attribute that can be compared between the products recognized in step 410 in a UI (hereinafter, referred to as an "attribute selection UI"). When two or more compared products are identified, the attribute providing unit 320 may confirm at least one common attribute that can unite the compared products, and then provide a UI that allows a user to select from the confirmed attribute.
[0047] The attribute providing unit 320 may inquire about metadata of each of the products to be compared. The metadata may mean data describing various attributes of the products, and may include product specifications such as category, product classification item, use, capacity, ingredients, country of manufacture, manufacturer, distributor, date of manufacture, and expiration date, as well as product features such as efficacy and performance, product evaluation data, and various tags. The attribute that allows common classification between the products to be compared may mean a standard for bundling the products to be compared with a common attribute based on the metadata. The attribute providing unit 320 may check whether there is a metadata field with the same attribute between the products to be compared. For example, when the products to be compared are cosmetics, if there is a common attribute field indicating wateriness and a common attribute field indicating whitening performance as a result of comparing the metadata of each product, the wateriness and whitening performance may be used as attributes that allow common classification. In addition, the attribute providing unit 320 may check whether there is a corresponding field value in the metadata field, whether the metadata field has a comparable value, and the like. As an example, if a database including the generated metadata is constructed in advance, the attribute providing unit 320 may inquire about the metadata of the compared products using the corresponding database. For example, the metadata of each product may be included in a product DB. As another example, the attribute providing unit 320 may inquire about the metadata from detailed information on at least one product included in the search results of the compared products by performing a real-time search for product information identified as the compared products. For example, the attribute providing unit 320 may extract the product details displayed at the top of the search results for the compared products and inquire about the metadata of the compared products. In order to be able to check the metadata fields even from various types of ungenerated product details, a mapping table for various detailed expressions may be defined in advance, and the attribute providing unit 320 may inquire about the metadata value of the compared products from the product details acquired by the real-time search while using the mapping table.
[0048] The attribute providing unit 320 may extract field information of the same attribute between the products to be compared, and may confirm a numerical value indicating a corresponding field value for each piece of field information. In this case, the attribute providing unit 320 may bundle individual field information that can be compared between the products to be compared as a common concept, and provide each of them in a UI. As an example, the attribute providing unit 320 may extract field information with the largest field depth or a certain number of field information in descending order of depth from among metadata fields of the same attribute between the products to be compared, and may confirm a field value (e.g., a numerical value) for each piece of extracted field information. As another example, the depth of a field to be compared may be adjusted according to a user request. By adjusting the level of comparison in this manner, a more detailed or abstract comparison between products can be made.
[0049] In step 430, when a specific field is selected in the attribute selection UI, the label display unit 330 may compare data of the selected field information and display a label according to the comparison result on the input image. The label display unit 330 may compare data of the same attribute between the products to be compared and overlay the comparison result on the input image. In this case, the products on the input image may be labeled and displayed according to the comparison result. Display elements such as the size and color of the label according to the comparison result may be applied so as to be differentiated according to the numerical value indicating the field value.
[0050] As another example, the label display unit 330 may provide the comparison results between the compared products in a graph format, and may display the comparison results by creating a graph of numerical values indicating the field values of each compared product.
[0051] In the above description, metadata fields of the same attribute are compared between the products to be compared, but the present invention is not limited thereto, and any common feature that can be compared between the products can be used. For example, the processor 212 may use a character recognition result by an optical character reader (OCR). In other words, the processor 212 may use an OCR to extract text from an input image for each of the products to be compared, and then display a label based on the comparison result obtained by comparing the numerical values included in the extracted text. In addition to the metadata of the products to be compared, it is also possible to compare label information of the products themselves that can be recognized by OCR. Furthermore, it is also possible to combine and use the metadata of the products to be compared with the OCR recognition results, and to use all information included in the product details as product comparison data.
[0052] In addition, when a specific attribute is predefined in the metadata field or OCR character recognition result of the comparison target product, for example, when an attribute predefined by the user exists, the processor 212 may highlight and display the product containing the corresponding attribute. For example, when a harmful substance, allergenic ingredient, or non-preferred ingredient is pre-specified by the user, an individual label or marker may be displayed for the products containing the corresponding ingredient among the comparison target products. In addition, when text indicating a harmful substance, allergenic ingredient, or non-preferred ingredient that the user is trying to identify is extracted by OCR character recognition of the product, the corresponding text may be displayed together with the comparison result with other products.
[0053] The server 150 may pre-construct a database for metadata fields based on the generated metadata. The processor 222 of the server 150 may receive input for product classification and field information via the input / output interface 224 and record the product classification and field information in the database. Additionally or alternatively, the processor 222 of the server 150 may analyze the data collected via the network 170 to determine the field names and field depths for each product classification and record them in the database as shown in Table 1.
[0054] [Table 1]
[0055] A database for pre-constructed metadata fields may also be used to collect and generate metadata. For example, if perfume A and perfume B are recognized by the product recognition unit 310, the attribute providing unit 320 may extract "target gender" and "type of fragrance" with a field depth of "1" as field information by referring to the database of Table 1. In this case, if the "target gender" and "type of fragrance" of the two perfumes are the same, the attribute providing unit 320 may extract "base note" and "top note" with a "field depth" of "2" as field information, and may determine field values corresponding to perfume A and perfume B using the metadata of perfume A and perfume B. In this case, a label may be determined according to the association with the determined field value, and the determined label may be displayed on the input image by the label display unit 330.
[0056] 5 to 10 are diagrams showing examples of user interface screens for explaining the process of providing a product comparison service in one embodiment of the present invention.
[0057] 5 to 10 show a product comparison service screen 500, which may be a screen displayed on the display of the electronic device 110. In FIG.
[0058] 5, an image 501 may be input to the processor 212 using a camera capture function or may be retrieved from an image storage area associated with the electronic device 110, and displayed on a product comparison service screen 500. In this case, an image including two or more products to be compared in one frame may be input to the processor 212, or an individual image of each product to be compared may be input.
[0059] For example, if a user takes an image of two cleaning products in one frame to compare the two cleaning products, the captured image may be input to the processor 212 as an image 501 for product comparison.
[0060] For each object recognized in the image 501, the processor 212 may display product information that matches the corresponding object and identify comparison products according to user input for the product information.
[0061] 6 and 7, the processor 212 may provide a user confirmation screen 610, 710 including product information matching the object for each object recognized in the image 501. When one product is recognized in the image 501 as a "I" product of the A brand and the other is recognized as a "RO" product of the B brand, the user confirmation screen 610, 710 including the corresponding product information may be provided so that the user can confirm that the recognized product is the product to be compared. When the user inputs a confirmation for the product recognized in the user confirmation screen 610, 710, the processor 212 may identify the corresponding product as the product to be compared.
[0062] In some embodiments, the process of providing the user confirmation screen 610, 710 for the product information recognized in the image 501 may be omitted. For example, if the product recognition accuracy is equal to or higher than a certain level, the process of providing the user confirmation screen 610, 710 may be omitted.
[0063] The processor 212 may inquire into the metadata of each of the products to be compared, and check whether there is a metadata field with the same attribute between the products to be compared, and whether the corresponding field has a comparable value. At this time, the processor 212 may extract field information of the same attribute that can be compared between the products to be compared. For example, from the metadata of the "I" product and the "Ro" product, attributes having common characteristics such as wateriness (or moisturizing information), content of harmful substances (or harmfulness), and overall rating may be extracted. The processor 212 may check the field value of the corresponding attribute for each attribute that is the same between the products to be compared. For example, to compare the "I" product and the "Ro" product, the processor 212 may check the field value of the same attribute between the products, such as wateriness (-5 points for the "I" product, -3 points for the "Ro" product), content of harmful substances (-2 types for the "I" product, -1 type for the "Ro" product), and overall rating (-10 points for the "I" product, -5 points for the "Ro" product).
[0064] 8, the processor 212 may provide an attribute selection UI 820 by using field information of the same attribute that can be compared between the products to be compared. In other words, the processor 212 may bundle individual field values indicating common characteristics as a common concept and provide it as the attribute selection UI 820. If the "I" product and the "RO" product have common field information of wateriness (or moisturizing information), content of harmful substances (or harmfulness), and overall rating in the metadata, the processor 212 may provide an attribute selection UI 820 by using the corresponding field information.
[0065] 9, when a field of a particular attribute is selected in the attribute selection UI 820, the processor 212 may compare the selected field values and display a label 930 based on the comparison result on the image. When the "fewer harmful substances" UI is selected in the attribute selection UI 820, the processor 212 may compare field values related to "harmful substances" among the metadata attributes of the "I" product and the "Ro" product, and display a label 930 on the product with the fewer harmful substances. Alternatively, instead of the label 930 based on the comparison result, ranking information may be provided for each of the compared products. For example, the products may be displayed in order of lowest field value related to "harmful substances".
[0066] As another example, the processor 212 may provide the comparison result between the compared products in a graph format instead of the label according to the comparison result 930. Referring to Fig. 10, when the "Less harmful substances" UI is selected in the attribute selection UI 820, the processor 212 may provide the comparison result in which the field values related to "harmful substances" among the metadata attributes of the "I" product and the "Ro" product are represented in a graph 1040.
[0067] Therefore, this embodiment can display common attributes that can be compared between two or more products to be compared, and label and display the results of comparing the field values of attributes selected by the user.
[0068] In this manner, according to an embodiment of the present invention, data of the same attribute between two or more products recognized from an image can be compared, and the comparison result can be displayed by labeling on the corresponding image. Furthermore, according to an embodiment of the present invention, common features for comparing two or more products recognized from an image can be provided in a UI, and a comparison result of the feature selected in the UI can be provided.
[0069] The above-mentioned devices may be realized by hardware components, software components, and / or a combination of hardware and software components. For example, the devices and components described in the embodiments may be realized using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications that run on the OS. The processing device may also respond to the execution of the software to access, record, manipulate, process, and generate data. For convenience of understanding, a single processing device may be described as being used, but one skilled in the art will understand that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, the processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.
[0070] The software may include computer programs, codes, instructions, or a combination of one or more of these, and may configure a processing device to operate as desired or instruct the processing device, either independently or collectively. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device to be interpreted by the processing device or to provide instructions or data to the processing device. The software may be distributed and stored or executed in a distributed manner on computer systems connected by a network. The software and data may be stored on one or more computer-readable storage media.
[0071] The method according to the embodiment may be realized in the form of program instructions executable by various computer means and recorded on a computer-readable medium. Here, the medium may be one that continuously records a computer-executable program or one that temporarily records the program for execution or download. The medium may be one of various recording or storage means in the form of a single or multiple hardware devices combined, and may not be limited to a medium directly connected to a certain computer system, but may be one that is distributed over a network. Examples of the medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and ROMs, RAMs, flash memories, etc., configured to record program instructions. Other examples of the medium include recording media or storage media managed by application stores that distribute applications, or sites, servers, etc. that supply or distribute various other software.
[0072] Although the embodiments have been described based on the limited embodiments and drawings as above, those skilled in the art will be able to make various modifications and variations from the above description. For example, the described techniques may be performed in an order different from that described, and / or the components of the described systems, structures, devices, circuits, etc. may be combined or combined in a manner different from that described, or may be counterbalanced or replaced by other components or equivalents, and still achieve suitable results.
[0073] Therefore, different embodiments are within the scope of the appended claims provided they are equivalent to the claims. [Explanation of symbols]
[0074] 212: Processor 310: Product recognition department 320: Attribute provider 330: Label section
Claims
1. 1. A computer device implemented product comparison method, comprising: The computing device includes at least one processor configured to execute computer-readable instructions contained in a memory; The product comparison method includes: Recognizing, by the at least one processor, two or more comparison products from the at least one image; displaying, by the at least one processor, at least one attribute comparable between the compared products in a user interface (UI); and providing, by the at least one processor, a comparison result for data of an attribute selected in the UI; Including, how to compare products.
2. The displaying step includes: Identifying attributes that can be commonly classified between the products to be compared using metadata of the products to be compared. The product comparison method of claim 1 , comprising:
3. The displaying step includes: querying metadata of the products to be compared from a product database containing metadata of each product; and Identifying attributes that can be commonly classified between the products to be compared using the requested metadata. The product comparison method of claim 1 , comprising:
4. The displaying step includes: querying metadata from product details obtained by a real-time search for the comparison product; and Identifying attributes that can be commonly classified between the products to be compared using the requested metadata. The product comparison method of claim 1 , comprising:
5. The displaying step includes: checking field values of each of the attributes that can be classified in common between the products to be compared; The product comparison method of claim 2 further comprising:
6. The providing step comprises: and overlaying a label on the image according to the comparison result. The product comparison method according to any one of claims 1 to 5, comprising:
7. The steps of the process include: Differentiating display elements of the label according to at least one field value of the compared products for the selected attribute. The product comparison method according to claim 6 ,
8. The providing step comprises: providing a comparison result between the compared products in a graphical format using at least one field value of the compared products for the selected attribute; The product comparison method according to any one of claims 1 to 5, comprising:
9. The step of recognizing includes: providing, for each object recognized from the image, product information that matches the corresponding object; and and if a confirmation is input from the user regarding the product information, identifying the corresponding product as the product to be compared. The product comparison method according to any one of claims 1 to 8, comprising:
10. The product comparison method includes: comparing, by the at least one processor, text extracted from the images by optical character reader (OCR) between the products to be compared and providing a comparison result. The product comparison method according to any one of claims 1 to 9, further comprising:
11. A computer program product that causes a computer device to carry out the product comparison method according to any one of claims 1 to 10.
12. 1. A computing device comprising: At least one processor configured to execute computer readable instructions contained in the memory. Including, The at least one processor a product recognition unit for recognizing two or more products to be compared from at least one image; an attribute providing unit that provides at least one attribute that can be compared between the products to be compared on a UI; and a label display unit for displaying a label on the image according to a comparison result with the attribute data selected in the UI; A computer device comprising:
13. The attribute providing unit, Using metadata of the compared products to identify attributes that can be commonly classified between the compared products.
13. The computer device of claim 12.
14. The attribute providing unit, Querying the metadata of the products to be compared from a product database containing metadata of each product; Using the queried metadata, identify attributes that can be commonly classified between the compared products.
13. The computer device of claim 12.
15. The attribute providing unit, Inquiring metadata from product details acquired through a real-time search for the comparison product; Using the queried metadata, identify attributes that can be commonly classified between the compared products.
13. The computer device of claim 12.
16. The attribute providing unit, Checking field values for each of the attributes that allow for common classification between the products to be compared 14. The computer device of claim 13.
17. The label section includes: Differentiating display elements of the label according to at least one field value of the compared products for the selected attribute. A computer device according to any one of claims 13 to 16, characterized in that
18. The at least one processor providing a comparison result between the compared products in a graphical format using at least one field value of the compared products for the selected attribute; A computer device according to any one of claims 13 to 16, characterized in that
19. The product recognition unit includes: For each object recognized from the image, providing product information that matches the corresponding object; When a user inputs a confirmation for the product information, the corresponding product is identified as the product to be compared. A computer device according to any one of claims 12 to 18, characterized in that
20. The at least one processor Comparing the text extracted from the image by OCR between the compared products and providing a comparison result. A computer device according to any one of claims 12 to 19, characterized in that
Citation Information
Patent Citations
Shopping support device and program, and commodity sales data processor
JP2011103045A
Receipt processing device and receipt processing method
JP2016206969A
Information processing device, information processing method and information processing program
JP2019028904A
Liquor information management system and management method
JP2020021215A
Recognize items depicted in images
KR102032038B1
