Cosmetic product search system

Abstract

To provide a cosmetic product search system for searching for cosmetic products based on color codes, capable of searching for cosmetic products across brands. [Solution] The cosmetic product search system 100 comprises terminal devices 101a to 101c, a connection device 102, a storage device 103, and a processor device 104. Based on search color information input from each terminal device 101a to 101c, the processor device 104 searches the storage device 103 for records in which product color information of a color that perceptually matches or is similar to the color indicated by the search color information is registered, and transmits at least the product brand name information, product name information, and detailed product information recorded in one or more records obtained as the search result to the terminal devices 101a to 101c via the connection device 102, making it possible to notify the user.

Description

[Technical field]

[0001] The present invention relates to a cosmetic product search system that searches for cosmetic products based on color codes. [Background technology]

[0002] Previously, official cosmetic brand websites only offered color search systems that were specific to that brand. Summary of the Invention [Problem to be solved by the invention]

[0003] Therefore, in the past, it was not possible to perform a color search unless the brand was limited.

[0004] Therefore, the object of the present invention is to make it possible to search for cosmetic products across brands. [Means for solving the problem]

[0005] The cosmetic product search system of the present invention is configured to include, integrally or in communication with each other, a terminal device equipped with an input / output device that provides an input interface through which a user can input search color information; a connection device capable of communicating with the terminal device; a storage device including a storage medium having data fields for registering at least product color information, product brand name information, product name information, and product detail information, and physically configuring a plurality of records consisting of the plurality of data fields; and a processor device that searches the storage device for records in which product color information of a color that perceptually matches or is similar to the color indicated by the search color information is registered based on the search color information input from the terminal device via the connection device, and transmits at least the product brand name information, product name information, and product detail information recorded in the record obtained as the search result to the terminal device via the connection device so that they can be displayed. Effect of the Invention

[0006] According to the present invention, it is possible to search for cosmetic products across brands, and it is possible to specify search color information by directly inputting a color code or visually selecting a color using a color picker, thereby making it possible to search for cosmetic products with a color that matches or is similar to the specified color. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an embodiment of a cosmetic product search device (system). [Diagram 2] 13A and 13B are diagrams illustrating an example of an input interface and a display of a search result. [Diagram 3] FIG. 13 is a diagram showing an example of the configuration of a cosmetic product search device according to another embodiment. [Figure 4] FIG. 13 is a diagram showing an example of the configuration of a cosmetic product search device according to still another embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will now be described in detail with reference to the accompanying drawings, in which: FIG 1 is a diagram showing an example of the configuration of a cosmetic product search device (system) 100;

[0009] Terminal devices 101a, 101b, 101c, 101d, and 101e (hereinafter, these may be collectively referred to as "terminal devices 101" without a subscript) have a structure equipped with an input / output device that provides an input interface that allows a user to input search color information. Note that the number of terminal devices 101 is not limited to five as shown in FIG. 1, and a larger number of terminal devices may be connected.

[0010] Terminal device 101a is a configuration example in which terminal device 101 is a smartphone, and terminal device 101b is a configuration example in which terminal device 101 is a tablet terminal. Both smartphone 101a and tablet terminal 101b are equipped with a structure having at least a touch panel display 110 that can be operated by a user's finger or the like and can display information, and a microphone 111 as input / output devices.

[0011] Moreover, the terminal device 101c is a configuration example in which the terminal device 101 is a personal computer. The personal computer 101c has a structure including at least a liquid crystal or organic EL display 112, a keyboard 113, and a pointing device 114 as input / output devices.

[0012] 2(a) and (b) are diagrams showing examples of the input interface 200 and search results 210 displayed on the touch panel display 110 of the smartphone 101a or tablet terminal 101b in FIG. 1, or on the LCD or organic EL display 112 of the personal computer 101c, respectively. The input interface 200 is displayed on the touch panel display 110 (in the case of the smartphone 101a or tablet terminal 101b in FIG. 1) or the LCD or organic EL display 112 (in the case of the personal computer 101c in FIG. 1), and a color code input text box 201 is displayed, which allows the user to directly input search color information, for example, a search RGB code (which may also be a search HEX (hexadecimal) code; the same applies below), by typing input using a soft keyboard (not shown) displayed on the screen (in the case of the smartphone 101a or tablet terminal 101b, etc.) or keyboard 113 (in the case of the personal computer 101c, etc.), or by voice input into the microphone 111 (in the case of the smartphone 101a, etc.).

[0013] The input interface 200 is displayed on the touch panel display 110 (in the case of the smartphone 101a or tablet terminal 101b in FIG. 1) or the liquid crystal or organic EL display 112 (in the case of the personal computer 101c), and displays a color picker 202a that allows the user to tap a desired color on a color palette with a finger or the like (in the case of the smartphone 101a or tablet terminal 101b) or click a desired color with the pointing device 114 (in the case of the personal computer 101c) to specify search color information, for example, a search RGB code. A selected color sample 202b is displayed, for example, to the left of the color picker 202a. Due to limitations on the drawing, the color picker 202a and the selected color sample 202b are displayed in monochrome in FIG. 2, but are displayed in color on the actual screen display.

[0014] Furthermore, as the input interface 200, the user is allowed to upload any image by tapping on the touch panel display 110 (in the case of the smartphone 101a or tablet terminal 101b in FIG. 1) or by using the keyboard 113 or pointing device 114 (in the case of the personal computer 101c in FIG. 1), and as a result, an image upload button 203 is displayed in which the user is allowed to tap a desired color with a finger or the like (in the case of the smartphone 101a or tablet terminal 101b) or click a desired color with the pointing device 114 (in the case of the personal computer 101c) on the image displayed on the touch panel display 110 (in the case of the smartphone 101a or tablet terminal 101b) or the liquid crystal or organic EL display 112 (in the case of the personal computer 101c), thereby specifying search color information, such as a search RGB code.

[0015] Then, as the input / output interface 200, a search button 204 is displayed which the user can press to transmit the search color information specified by the user as described above, for example a search RGB code, to the processor device 104 in Figure 1 to execute a search.

[0016] FIG. 2(b) is a diagram showing an example of search results 210 transmitted from the processor device 104 in FIG. 1 and displayed on the touch panel display 110 (in the case of the smartphone 101a or the tablet terminal 101b) or the LCD or organic EL display 112 (in the case of the personal computer 101c) as a result of a user pressing the above-mentioned search button 204. 2(b), at least product brand name information (brand name), product name information (product name), and detailed product information such as product color name, product image / photo, #category, #color code, and other product descriptions (not shown) are displayed as search results 210. In addition, link information (link buttons) to multiple product websites where product details are posted are displayed as detailed product information.

[0017] In this embodiment, product information that matches (is identical or similar to) the search color information specified by the user is not limited to one brand, but can display search results across multiple brands.

[0018] Returning to the explanation of Fig. 1, the terminal device 101d is a configuration example in which the terminal device 101 is a smart speaker. The smart speaker 101d has a structure having at least a microphone 115 and a speaker 116 as input / output devices.

[0019] As an input interface, the smart speaker 101d allows the user to speak a color code or color name into the microphone 115, and then inputs and specifies search color information, such as a search RGB code, through voice recognition and transmits it to the processor device 104.

[0020] The smart speaker 101d then uses voice synthesis to pronounce the search results transmitted from the processor device 104 and notify the user of them.

[0021] The terminal device 101e is a configuration example in which the terminal device 101 is smart glasses. The smart glasses 101e have a structure including at least a small camera 117 and a small liquid crystal or organic EL display 118 as input / output devices.

[0022] As an input interface, the smart glasses 101e allow the user to face the direction of any image using a small camera 117 placed near the eyeglass lenses to capture the image, and then specify a desired color as the color of the image, and specify search color information, such as a search RGB code, through image color recognition.

[0023] Then, the smart glasses display the search results transmitted from the processor device 104 on a small LCD or organic EL display 118 arranged near the lenses of the smart glasses. The display form may be the form shown in FIG. 2(b) described above or a simplified form thereof.

[0024] Next, in Fig. 1, the connection device 102 has a structure capable of communicating with the terminal devices 101. When the terminal devices 101 are connected via the Internet 106 as shown in Fig. 1, for example, the connection device 102 is a network interface circuit, and interfaces communication by TCP / IP (Transfer Control Protocol / Internet Protocol) between the terminal devices 101 and a processor device 104 described later. On the other hand, when the terminal devices 101 are connected to the processor device 104 by an internal bus 105 as described later in Fig. 3, the connection device 102 is a bus control circuit.

[0025] Next, as shown in FIG. 1, the storage device 103 has a structure including a storage medium that has data fields for registering at least product color information relating to cosmetic products, such as product RGB code and product color space code, product brand name information, product name information, and product detail information, and that physically configures a plurality of records, each of which is made up of a plurality of data fields.

[0026] The storage device 103 may, for example, be in the form of a solid-state drive (SSD) device or a hard disk drive.

[0027] Furthermore, the storage device 103 has a structure for physically storing, for example, combinations of at least the product brand name information, the product name information, and the product detail information in a plurality of data fields of a plurality of records in a relational database.

[0028] In contrast to the relational database structure of the storage device 103 described above, the processor device 104 described later has a structure for performing searches and obtaining search results by executing search command codes in, for example, Structured Query Language (SQL) provided by a database management system program.

[0029] 1, the processor device 104, using a processing structure shown as 104a, searches the storage device 103 for records in which product color information of a color that perceptually matches or is similar to the color indicated by the search color information input from each terminal device 101 via the connection device 102. The processor device 104 then has a structure that transmits at least the product brand name information, product name information, and detailed product information recorded in one or more records obtained as the search results to the terminal device 101 via the connection device 102, and enables the user to be notified in the format shown in FIG. 2(b) as described above.

[0030] In this embodiment, the above-described respective terminal devices 101, connection device 102, storage device 103, and processor device 104 are configured to have a structure that is in an integrated shape or in a combination capable of communicating with each other.

[0031] Here, the search color information input from each terminal device 101 and the product color information stored in the storage device 103 may be a search RGB code and a product RGB code, which are coordinates in the RGB space generally widely adopted on websites and the like.

[0032] In this embodiment, it is characterized in that not only the color match but also the similarity between the search color information and the product color information can be determined. In this case, by using a color space based on human perception instead of the RGB space, it becomes possible to more accurately evaluate the visual similarity.

[0033] In this case, as shown in FIG. 1, the storage device 103 may be configured to have a data field of a product color space code in addition to the data field of the above-described product RGB code as part of the product color information in each record. This product color space code is obtained by converting the product RGB code registered in the record into coordinates in a color space based on perception.

[0034] As the above-described color space, for example, a CIE LAB color space, an HSV color space, or the like can be adopted. For example, the CIE LAB color space is a space constructed based on human color perception, and L * (brightness), a * (from green to red), b * (from blue to yellow) represent colors with three components.

[0035] The conversion from the RGB code (search RGB code or product RGB code) in the RGB color space to the color space code (search color space code or product color space code) in the CIE LAB color space can be executed by the following series of operations.

[0036] <Normalization of RGB values> By the calculations shown in the following equations (1), (2), and (3), each RGB value (range 0 to 255) of the RGB code is normalized and converted into the range of 0 to 1. Now, assume that normalized RGB values ​​(R', G', B') can be obtained from unnormalized RGB values ​​(R, G, B).

[0037] R′=R / 255 (1) G′=G / 255 (2) B′=B / 255 (3)

[0038] <Conversion to linear RGB> The RGB values ​​(R′, G′, B′) normalized by the calculations shown in (1), (2), and (3) are converted into linear RGB values ​​(R lin ,G lin ,B lin ) is calculated.

[0039] R lin =R′ / 12.92 (When R′≦0.04045) (4) R lin =((R′+0.055) / 1.055) 2.4 (When R′>0.04045) (5) G lin =G′ / 12.92 (When G′≦0.04045) (6) G lin =((G′+0.055) / 1.055) 2.4 (When G′>0.04045) (7) B lin =B′ / 12.92 (When B′≦0.04045) (8) B lin =((B′+0.055) / 1.055) 2.4 (When B′>0.04045) (9)

[0040] <Conversion of linear RGB values to XYZ color space values> Using the linear RGB values (R lin , G lin , B lin ) calculated by each operation shown in equations (4) to (9) above, calculate the XYZ color space values (X, Y, Z) by each operation shown in the following equations (10), (11), and (12).

[0041] X = 0.4124564 × R lin + 0.3575761 × G lin + 0.1804375 × B lin ) ···(10) Y = 0.2126729 × R lin + × 0.7151522 × G lin + 0.0721750 × B lin ) ···(11) Z = 0.0193339 × R lin + 0.1191920 × × G lin + 0.9503041 × B lin ) ···(12)

[0042] <Conversion of XYZ color space values to CIE LAB color space values> First, normalize the XYZ color space values (X, Y, Z) calculated by the operations of equations (10) to (12) by each operation shown in the following equations (13), (14), and (15) using the reference white point (usually D65: X n = 95.047, Y n = 100.000, Z n = 108.883). Let the normalized XYZ values be (X′, Y′, Z′).

[0043] X′ = X / X n ···(13) Y′ = Y / Y n ···(14) Z′ = Z / Z n ···(15)

[0044] Next, the normalized XYZ values ​​(X', Y', Z') are converted to CIE LAB color space values ​​by the conversion function f(t) defined by the following equations (16) and (17).

[0045] f(t)=t 1 / 3 (When t>0.008856) (16) f(t)=7.787t+16 / 116 (When t≦0.008856) (17)

[0046] Using the function f(t) defined by the calculations shown in (16) and (17), the CIE LAB color space value (L * ,a * ,b * ) is calculated.

[0047] L * = 116 × f(Y′) – 16 (18) a * =500×{f(X′)-f(Y′)} ···(19) b * =200×{f(Y′)-f(Z′)} ···(20)

[0048] As shown as a processing structure 104b in FIG. 1, the processor unit 104 has a structure for further executing a process of converting a product RGB code registered in each record of the storage device 103 into a product color space code in, for example, the CIE LAB color space, which is a color space based on perception, by executing a series of calculations shown in the above equations (1) to (20) for that record, and pre-registering the product color space code in the data field of that record.

[0049] On the other hand, the processor device 104 converts the search RGB code input from each terminal device 101 into a search color space code in the CIE LAB color space, which is a color space based on the above perception, by executing a series of calculations shown in equations (1) to (20).

[0050] The processor unit 104 has a structure for searching the records based on the distance calculation between the search color space code and each product color space code registered in each record of the storage unit 103. Now, the search color space code is (L * in ,a * in ,b * in ), and the product color space code for each record is (L * i ,a * i ,b * i ) (1≦i≦N, N is a natural number (see 103 in FIG. 1)), the processor device 104 calculates the distance D i Perform the calculation (1≦i≦N).

[0051] D i ={(L * in ,-L * i ) 2 +(a * in -a * i ) 2 +(b * in -b * i ) 2} 1 / 2 ···(twenty one)

[0052] Then, the processor device 104 calculates the distance D for all record IDs=i (1≦i≦N) by the calculation shown in the above formula (21). iOf the records (1≦i≦N), records whose distance value is equal to or smaller than a certain threshold value are extracted as records whose colors match or are similar.

[0053] The processor device 104 transmits at least the product brand name information, product name information, and product detail information recorded in one or more records extracted in this manner to the terminal device 101 via the connection device 102, so that the information can be notified to the user in a format such as that shown in Figure 2(b) as described above.

[0054] Here, as shown as the processing structure of 104c in FIG. 1, the processor device 104 has a structure for collecting multiple combinations of at least product color information, such as product RGB code, product brand name information, product name information, and product detail information, by scraping computers 120(#1) to 120(#M) (M is a natural number) of a product listing site listing multiple products that can be communicated via a network such as the Internet 106 in FIG. 1, and registering the combinations in multiple database fields of multiple records in the storage device 103.

[0055] This processing structure makes it possible to collect a large amount of product information across multiple brands in advance in the storage device 103.

[0056] 3 is a diagram showing an example of the configuration of another embodiment of a cosmetic product search device. In this example of the configuration of cosmetic product search device 300, a terminal device 101, a connection device 102, a storage device 103, and a processor device 104 are integrated into a single computer housing 301 and connected via an internal bus 105. In this case, the connection device 102 is configured to operate as a bus control device.

[0057] By installing such an all-in-one cosmetic product search device 300 at, for example, a cosmetics counter, a user can easily search for cosmetic product information that matches or is similar to the color that the user desires.

[0058] Fig. 4 is a diagram showing an example of the configuration of yet another embodiment of a cosmetic product search device. As shown as cosmetic product search device 400 in Fig. 4, a processor device 104 and a storage device 103 may have a structure in which they are connected via a network such as a LAN (local area network) instead of being connected by an internal bus 105 in the same housing as in the embodiment in Fig. 1.

[0059] According to the embodiment described above, it is possible to search for cosmetic products across brands. It is also possible to specify search color information by directly inputting a color code or visually selecting a color using a color picker. This makes it possible to search for cosmetic products that match or have a similar color to the specified color. [Explanation of symbols]

[0060] 100, 300, 400 Cosmetic product search device 101, 101a, 101b, 101c, 101d, 101e terminal equipment 102 Connection device 103 Storage device 104 Processor unit 105 Internal Bus 106 Internet 110 Touch panel display 111, 115 Microphones 112 Liquid crystal or organic electroluminescence display 113 Keyboard 114 Pointing Device 116 Speaker 117 Small Camera 118 LCD or OLED small display 200 Input Interface 201 Color code input text box 202a Color Picker 202b Color sample 203 Image upload button 204 Search button 401 LAN

Claims

1. a terminal device including an input / output device that provides an input interface through which a user can input search color information; A connection device capable of communicating with the terminal device; a storage device including a storage medium having data fields for registering at least product color information, product brand name information, product name information, and detailed product information, the storage medium physically configuring a plurality of records each consisting of the plurality of data fields; a processor that searches for the record in the storage device in which the product color information of a color that perceptually matches or is similar to the color indicated by the search color information is registered based on the search color information input from the terminal device via the connection device, and transmits at least the product brand name information, the product name information, and the product detail information recorded in the record obtained as a search result to the terminal device via the connection device so as to be notifiable to the user; A cosmetic product search system configured so that the above items can communicate with each other or together.

2. the search color information and the product color information input from the terminal device are a search RGB code and a product RGB code, respectively; the storage device further comprises a data field for registering a product color space code obtained by converting the product RGB code registered in each record into coordinates in a color space based on perception, the processor converts the search RGB code input from the terminal device into a search color space code indicating coordinates in the color space based on the perception, and searches for the record based on a distance calculation between the search color space code and the product color space code. The cosmetic product search system according to claim 1.

3. 3. The cosmetic product search system of claim 2, wherein the processor device further performs a process of converting the product RGB code registered in each of the records in the storage device into coordinates in the perceptual color space, and registering the resulting product color space code in the record.

4. the terminal device is a smartphone or a tablet terminal having at least a touch panel display and a microphone as the input / output device, The input interface is at least one of a color code input text box that is displayed on the touch panel display and allows the user to directly input the search color information by typing on a soft keyboard or by voice input into the microphone, a color picker that allows the user to tap a desired color on a color palette to specify the search color information, and an image upload button that allows the user to upload an arbitrary image by a tap operation and tap a desired color on the image to specify the search color information, the touch panel display notifies the user of the search results by displaying the search results in text and images; The cosmetic product search system according to claim 1.

5. the terminal device is a personal computer having at least a liquid crystal or organic EL display, a keyboard, and a pointing device as the input / output devices, the input interface is at least one of a color code input text box, which is displayed on the liquid crystal or organic EL display and allows the user to directly input the search color information by typing on the keyboard, a color picker, which allows the user to click on a desired color on a color palette with the pointing device to specify the search color information, and an image upload button, which allows the user to upload an arbitrary image with the keyboard or the pointing device and click on a desired color on the image with the pointing device to specify the search color information; the liquid crystal or organic EL display displays the search results in text and images to notify the user; The cosmetic product search system according to claim 1.

6. the terminal device is a smart speaker having at least a microphone and a speaker as the input / output devices, the input interface allows the user to input the search color information by voice input of a color code or a color name into the microphone; The speaker notifies the user of the search results by vocalizing the results. The cosmetic product search system according to claim 1.

7. the terminal device is a smart glass having at least a small camera and a small liquid crystal or organic EL display near the eyeglass lens as the input / output device, the input interface allows the user to input the search color information by taking a color image with the small camera; the liquid crystal or organic EL small display displays the search results in text and images to notify the user; The cosmetic product search system according to claim 1.

8. The cosmetic product search system of claim 1 , wherein the product detail information includes a product image or a product photo.

9. The cosmetic product search system according to claim 1 , wherein the detailed product information includes link information to a product website on which the detailed product information is posted.

10. The cosmetic product search system of claim 1 , wherein the storage device has a structure for physically storing a combination of at least the search color information, the product brand name information, the product name information, and the product detail information in a plurality of the data fields of a plurality of the records of a relational database.

11. The cosmetic product search system of claim 10 , wherein the processor device is configured to execute the search and obtain the search results by executing a search instruction code in a structured query language provided by a database management system program.

12. The cosmetic product search system of any one of claims 1 to 11, wherein the processor device is configured to collect multiple combinations of at least the product color information, the product brand name information, the product name information, and the product detail information by scraping a computer of a product listing site that lists multiple products that can be communicated via a network, and to register each of the combinations in the multiple database fields of the multiple records in the storage device.

Images