Color suggestion device, color suggestion method, and program

Abstract

We propose paint colors that meet specific conditions. [Solution] A paint color suggestion device that proposes paint colors comprises an image acquisition unit that acquires a reference image based on condition information related to paint colors, a color extraction unit that extracts color information from the reference image, and an output unit that outputs suggestion information that includes the color information as paint colors.

Description

Technical Field

[0001] The present disclosure relates to a coloring proposal device, a coloring proposal method, and a program.

Background Art

[0002] In order to evaluate the coloring of a paint applied to industrial products such as automobiles, a technique for visualizing the coloring applied to an industrial product by computer simulation is known. For example, in Patent Document 1, from the spectral reflectance of a metallic coloring measured at a plurality of light-receiving angles, the spectral reflectance of the metallic coloring for each predetermined angle is calculated, the colorimetric value for each predetermined angle is calculated, and a pixel of a painted surface image is replaced with a pixel showing a colorimetric value corresponding to the shade level of the pixel, and a method for generating a coloring evaluation image for generating a coloring evaluation image is disclosed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the conventional technology is a technology for evaluating an existing coloring, and not a technology for proposing a new coloring. For example, if a user can propose a coloring that they want to achieve, the development of paints and the like can be made more efficient.

[0005] One aspect of the present disclosure aims to propose a coloring according to specific conditions.

Means for Solving the Problems

[0006] One aspect of the present disclosure is a paint color suggestion device that suggests a paint color, comprising: an image acquisition unit configured to acquire a reference image based on condition information relating to the paint color; a color extraction unit configured to extract color information from the reference image; and an output unit configured to output suggestion information that includes the color information as the paint color. [Effects of the Invention]

[0007] According to one aspect of this disclosure, a paint color can be proposed that is suitable for specific conditions. [Brief explanation of the drawing]

[0008] [Figure 1] This is a block diagram showing an example of the overall configuration of a paint color suggestion system. [Figure 2] A block diagram showing an example of a computer hardware configuration. [Figure 3] This is a block diagram showing an example of the functional configuration of the paint color suggestion system according to the first embodiment. [Figure 4] This is a sequence diagram showing an example of a color coating proposal method according to the first embodiment. [Figure 5] This figure shows an example of a condition input screen. [Figure 6] This figure shows a specific example of the proposed information according to the first embodiment. [Figure 7] This is a block diagram showing an example of the functional configuration of the paint color suggestion system according to the second embodiment. [Figure 8] This figure shows a specific example of the proposed information according to the second embodiment. [Modes for carrying out the invention]

[0009] Hereinafter, embodiments of this disclosure will be described with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant descriptions will be omitted.

[0010] [First Embodiment] The first embodiment of this disclosure is an information processing system that proposes a paint color. Hereinafter, the information processing system according to this embodiment will be referred to as the "paint color proposal system".

[0011] In this embodiment, the paint color may include, as an example, a solid paint color, a pearl paint color, or a metallic paint color. A solid paint color is the paint color obtained when a solid color paint is applied to an object, and it is a paint color with a small flip-flop value. The flip-flop value is an index that shows the change in light intensity due to the difference in the reflection angle to incident light from a light source. A pearl paint color or a metallic paint color is the paint color obtained when a paint containing flake-like luminous material is applied to an object, and it is a paint color with a larger flip-flop value than a solid paint color.

[0012] Traditionally, in the development of paints for industrial products such as automobiles, the process involves matching the colors envisioned by the industrial product designer with specific color descriptions using language and images of color motifs. However, creating specific colors from the designer's words and motif images requires the paint developer's experience and sense of color, resulting in a time-consuming color matching process. For example, if paint developers could propose colors based on words or sentences that express the image of the color, or images that closely resemble that image, the time required for color matching could be significantly reduced, and paint development could be made more efficient.

[0013] In this embodiment, the objective is to propose a paint color that corresponds to specific conditions, such as a word or sentence that expresses a color image, or an image that closely resembles the color image. To this end, this embodiment acquires a reference image based on condition information related to the paint color, extracts color information from the reference image, and outputs proposed information that includes that color information as the paint color.

[0014] In one respect, this embodiment allows for the proposal of paint colors that meet specific conditions. In another respect, this embodiment allows users to easily obtain paint colors that meet specific conditions, thereby streamlining paint development.

[0015] <Overall Configuration> The overall configuration of the coloring proposal system according to this embodiment will be described with reference to FIG. 1. FIG. 1 is a block diagram showing an example of the overall configuration of the coloring proposal system.

[0016] As shown in FIG. 1, the coloring proposal system 1000 includes a coloring proposal device 10, an image providing device 20, and a terminal device 50. The coloring proposal device 10, the image providing device 20, and the terminal device 50 are connected so as to be capable of data communication via a communication network N such as a LAN (Local Area Network) or the Internet.

[0017] The coloring proposal device 10 is an example of an information processing device that proposes coloring. As an example, the coloring proposal device 10 may be a computer such as a personal computer, a workstation, or a server. [[ID=十三]]

[0018] The coloring proposal device 10 receives a proposal request from the terminal device 50. The proposal request includes condition information indicating conditions related to coloring. Based on the condition information included in the proposal request, the coloring proposal device 10 acquires an image from the image providing device 20. The coloring proposal device 10 extracts color information from the image acquired from the image providing device 20 and transmits proposal information including the color information as coloring to the terminal device 50.

[0019] The image providing device 20 is an example of an information processing device that provides images. As an example, the image providing device 20 may be a computer such as a personal computer, a workstation, or a server.

[0020] The image providing device 20 provides an image to the coloring proposal device 10 in response to a request from the coloring proposal device 10. The image providing device 20 may provide an image search result using the condition information as a search condition to the coloring proposal device 10. The image providing device 20 may search for images based on a predetermined search engine. As an example, the search engine may be a general-purpose search engine that searches for images on the Internet, or a search engine that can search for materials collected independently.

[0021] The image providing device 20 may provide the color suggestion device 10 with image generation results using conditional information as generation conditions. The image providing device 20 may generate images based on a machine learning model. The machine learning model may be, for example, an image generation model such as a variational autoencoder, a generative adversarial network, or a diffusion model.

[0022] Terminal device 50 is an example of an information processing terminal operated by a user of the paint color suggestion system 1000. Terminal device 50 may be a computer such as a personal computer, smartphone, or tablet terminal.

[0023] Terminal device 50 transmits a proposal request to color suggestion device 10. The proposal request includes condition information entered by the user. Terminal device 50 receives proposal information from color suggestion device 10 and presents it to the user.

[0024] The overall configuration of the paint color suggestion system 1000 shown in Figure 1 is just one example, and various system configurations are possible depending on the application and purpose. For example, one or more of the paint color suggestion devices 10, image providing devices 20, and terminal devices 50 may be included in multiple units of the paint color suggestion system 1000. For example, the image providing device 20 may be implemented by an external information processing device or information processing system and may not be included in the paint color suggestion system 1000.

[0025] For example, the paint color suggestion device 10 or the image provision device 20 may be implemented using multiple computers, or as a cloud computing service. For example, the paint color suggestion device 10 and the image provision device 20 may be implemented using a single server device that combines the functions of both. For example, the paint color suggestion system 1000 may be implemented using a standalone computer. The classification of devices such as the paint color suggestion device 10, image provision device 20, and terminal device 50 shown in Figure 1 is just one example.

[0026] <Hardware Configuration> The hardware configuration of the paint color suggestion system 1000 will be explained with reference to Figure 2. The paint color suggestion device 10, image provision device 20, and terminal device 50 included in the paint color suggestion system 1000 are implemented, for example, by a computer. Figure 2 is a block diagram showing an example of the computer's hardware configuration.

[0027] As shown in Figure 2, the computer 500 includes a CPU (Central Processing Unit) 501, ROM (Read Only Memory) 502, RAM (Random Access Memory) 503, HDD (Hard Disk Drive) 504, input device 505, display device 506, communication interface 507, and external interface 508. The CPU 501, ROM 502, and RAM 503 form what is known as a computer. Each piece of hardware in the computer 500 is interconnected via a bus line 509. The input device 505 and display device 506 may also be used by connecting them to the external interface 508.

[0028] The CPU 501 is a processing unit that controls and implements the overall functions of the computer 500 by reading programs and data from storage devices such as the ROM 502 or HDD 504 onto the RAM 503 and executing processing.

[0029] ROM502 is an example of non-volatile semiconductor memory (storage device) that can retain programs and data even when the power is turned off. ROM502 functions as the main memory, storing various programs and data necessary for the CPU501 to execute the programs installed on HDD504. Specifically, ROM502 stores boot programs such as BIOS (Basic Input Output System) and EFI (Extensible Firmware Interface) that are executed when the computer 500 starts up, as well as OS (Operating System) settings, network settings, and other data.

[0030] RAM503 is an example of volatile semiconductor memory (storage device) whose programs and data are erased when the power is turned off. RAM503 includes, for example, DRAM (Dynamic Random Access Memory) and SRAM (Static Random Access Memory). RAM503 provides a working area that is expanded when various programs installed on HDD504 are executed by CPU501.

[0031] HDD504 is an example of a non-volatile storage device that stores programs and data. The programs and data stored in HDD504 include the operating system (OS), which is the basic software that controls the entire computer 500, and applications that provide various functions on the OS. Note that computer 500 may use a storage device that uses flash memory as its storage medium (e.g., SSD: Solid State Drive) instead of HDD504.

[0032] The input device 505 includes a touch panel used by the user to input various signals, operation keys and buttons, a keyboard and mouse, and a microphone for inputting sound data such as voice.

[0033] The display device 506 consists of a display such as a liquid crystal or organic EL (Electro-Luminescence) that displays a screen, and a speaker that outputs sound data such as audio.

[0034] Communication I / F 507 is an interface that connects to a communication network and allows computer 500 to perform data communication.

[0035] External I / F 508 is an interface for external devices. Examples of external devices include the drive device 510.

[0036] The drive device 510 is a device for setting the recording medium 511. The recording medium 511 here includes media that record information optically, electrically, or magnetically, such as CD-ROMs, flexible disks, and magneto-optical disks. The recording medium 511 may also include semiconductor memory that records information electrically, such as ROMs and flash memory. This allows the computer 500 to read and / or write to the recording medium 511 via the external I / F 508.

[0037] The various programs to be installed on the HDD 504 are installed, for example, when the distributed recording medium 511 is set in a drive device 510 connected to an external I / F 508, and the various programs recorded on the recording medium 511 are read by the drive device 510. Alternatively, the various programs to be installed on the HDD 504 may be downloaded via the communication I / F 507 from a network other than the communication network and installed that way.

[0038] <Functional Configuration> The functional configuration of the paint color suggestion system 1000 will be explained with reference to Figure 3. Figure 3 is a block diagram showing an example of the functional configuration of the paint color suggestion system according to the first embodiment.

[0039] As shown in Figure 3, the paint color suggestion device 10 comprises a condition acquisition unit 110, an image acquisition unit 120, a brightness division unit 130, a color extraction unit 140, an image generation unit 150, and an output unit 160. The paint color suggestion device 10 functions as the condition acquisition unit 110, image acquisition unit 120, brightness division unit 130, color extraction unit 140, image generation unit 150, and output unit 160 when a pre-installed paint color suggestion program is executed.

[0040] For example, the condition acquisition unit 110, image acquisition unit 120, brightness division unit 130, color extraction unit 140, image generation unit 150, and output unit 160 are realized by a process in which a program loaded from the HDD 504 shown in Figure 2 onto the RAM 503 is executed by the CPU 501.

[0041] The condition acquisition unit 110 acquires condition information indicating conditions related to paint color. The condition acquisition unit 110 may receive a proposal request containing condition information from the terminal device 50. The condition acquisition unit 110 may accept input of condition information via the input device 505 of the paint color proposal device 10. The condition acquisition unit 110 may read condition information that has been pre-stored in a storage device such as the HDD 504.

[0042] Conditional information may include electronic data that expresses the impression of the paint color. Electronic data that expresses the impression of the paint color may include text data, image data, or sound data. Text data may include at least one word or one sentence. Image data may include images containing the desired paint color or colors similar to that paint color. Sound data may include audio signals in which one or more words or one or more sentences are spoken.

[0043] The image acquisition unit 120 acquires an image. The image acquisition unit 120 may also acquire an image to be referenced in order to extract color information to be included in the paint color. Hereinafter, the image acquired by the image acquisition unit 120 will also be referred to as the "reference image".

[0044] The image acquisition unit 120 may acquire a reference image based on the condition information acquired by the condition acquisition unit 110. The image acquisition unit 120 may acquire a reference image from the image providing device 20. The image acquisition unit 120 may send a request to the image providing device 20 to acquire a reference image. The image acquisition unit 120 may send an acquisition request to the image providing device 20 requesting an image search using the condition information as a search condition. The image acquisition unit 120 may send an acquisition request to the image providing device 20 requesting image generation using the condition information as a generation condition.

[0045] The image acquisition unit 120 may acquire reference images based on the image search results from the image providing device 20. The image acquisition unit 120 may acquire one or more reference images included in the image search results. The image acquisition unit 120 may acquire a predetermined number (for example, one) of reference images from the top of the image search results. The image acquisition unit 120 may present the image search results to the user and acquire the reference image specified by the user.

[0046] The image acquisition unit 120 may acquire a reference image based on the image generation result from the image providing device 20. The image acquisition unit 120 may request the image providing device 20 to generate multiple images. The image acquisition unit 120 may acquire one or more reference images included in the image generation result. The image acquisition unit 120 may present the image generation result to the user and acquire a reference image specified by the user.

[0047] The image acquisition unit 120 may transmit acquisition requests to the image providing device 20 requesting an image search using the condition information as a search condition, and an image generation request using the condition information as a generation condition. The image acquisition unit 120 may acquire reference images based on the image search results and image generation results from the image providing device 20. The image acquisition unit 120 may acquire one or more reference images included in either the image search results or the image generation results.

[0048] The brightness division unit 130 divides the reference image into multiple brightness regions. The brightness division unit 130 may divide the reference image acquired by the image acquisition unit 120 into multiple brightness regions. The brightness division unit 130 may divide the brightness distribution of the reference image into multiple brightness regions. The brightness distribution is information that shows the distribution of brightness information of each pixel included in the reference image.

[0049] The brightness division unit 130 may convert the RGB values ​​of each pixel in the reference image to HSV values ​​and use the V component of those HSV values ​​as brightness information. * a * b * Convert to a value, and that L * a * b* The L component of the value may be used as brightness information. The brightness division unit 130 may convert the reference image into a grayscale image and use the pixel values ​​of that grayscale image as brightness information.

[0050] The brightness division unit 130 may classify each pixel in the reference image into one of several brightness regions by comparing the brightness information of each pixel in the reference image with a predetermined threshold. For example, the brightness division unit 130 may divide the reference image into high-brightness regions and low-brightness regions. In this case, the brightness division unit 130 may use the 75th percentile of the brightness information as a threshold and classify pixels whose brightness information is above the threshold into the high-brightness region. Alternatively, the brightness division unit 130 may use the 60th percentile of the brightness information as a threshold and classify pixels whose brightness information is below the threshold into the low-brightness region.

[0051] As another example, the brightness division unit 130 may divide the reference image into high-brightness, medium-brightness, and low-brightness regions. In this case, the brightness division unit 130 may use the 67th percentile of the brightness information as a first threshold and classify pixels whose brightness information is equal to or greater than the first threshold into the high-brightness region. Alternatively, the brightness division unit 130 may use the 33rd percentile of the brightness information as a second threshold and classify pixels whose brightness information is equal to or less than the second threshold into the low-brightness region. Furthermore, the brightness division unit 130 may classify pixels whose brightness information is less than the first threshold but greater than the second threshold into the medium-brightness region.

[0052] The color extraction unit 140 extracts color information from the reference image. The color extraction unit 140 may also extract color information from the reference image acquired by the image acquisition unit 120. The color information may be, for example, RGB values ​​or HSV values. The color extraction unit 140 may also extract statistical values ​​of the color information of each pixel contained in the reference image. The color extraction unit 140 may also extract the mode, mean, or median of the color information.

[0053] The color extraction unit 140 may extract multiple color information from the reference image. The color extraction unit 140 may extract multiple color information including highlight colors and shade colors. The color extraction unit 140 may extract multiple color information by extracting color information from each of the multiple brightness regions divided by the brightness division unit 130. The color extraction unit 140 may extract highlight color information from the high brightness region. The color extraction unit 140 may extract shade color information from the low brightness region.

[0054] The highlight color is the color that appears bright and dazzling at angles close to specular reflection. For example, the highlight color may be the color measured at a receiving angle of 10 degrees when incident light is shone on the painted surface at a 45-degree angle. The shade color is the color that appears dark at angles far from specular reflection. For example, the shade color may be the color measured at a receiving angle of 110 degrees when incident light is shone on the painted surface at a 45-degree angle.

[0055] The image generation unit 150 generates an image that includes the paint color. The image generation unit 150 may also generate an image that simulates the paint color when the paint is applied to the painted surface. Hereinafter, the image that simulates the paint color generated by the image generation unit 150 will also be called a "color simulation image (CS image)". The image generation unit 150 may also generate a CS image that includes the color information extracted by the color extraction unit 140 as the paint color. The image generation unit 150 may also generate a CS image of a metallic paint color that includes highlight and shade colors.

[0056] The CS image may, for example, be a rectangular image containing a linear gradient in which the color changes along a predetermined direction. The CS image may, for example, be a spherical image containing a gradient in which the color changes along a predetermined direction. The CS image may, for example, be a simulation image of what it would look like when painted on a CG image of an arbitrary object shape.

[0057] The image generation unit 150 may generate a CS image by placing the color information extracted by the color extraction unit 140 at arbitrary positions and applying a gradient of those colors to the entire image. For example, the image generation unit 150 may generate a CS image by placing a highlight color and a shade color at predetermined positions and generating a linear gradient in which the color changes from the highlight color to the shade color (or from the shade color to the highlight color).

[0058] The output unit 160 outputs proposal information. The proposal information is information for proposing a color in response to a proposal request. The proposal information may include color information extracted by the color extraction unit 140. The proposal information may include multiple color information extracted by the color extraction unit 140. The proposal information may include an image having color information extracted by the color extraction unit 140. The proposal information may include a CS image generated by the image generation unit 150.

[0059] The proposed information may include the information used in the proposal. The information used in the proposal may include, for example, condition information acquired by the condition acquisition unit 110, image search results or image generation results provided by the image providing device 20, or at least one of the reference images acquired by the image acquisition unit 120.

[0060] <Processing Procedure> The paint color suggestion method performed by the paint color suggestion system 1000 will be explained with reference to Figure 4. Figure 4 is a sequence diagram showing an example of the paint color suggestion method according to the first embodiment.

[0061] In step S1, the user of the paint color suggestion system 1000 performs an operation to activate the condition input screen. The terminal device 50 displays the condition input screen on the display device 506 in response to the user's operation. The user enters condition information into the condition input screen displayed on the display device 506.

[0062] Figure 5 shows an example of a condition input screen. The condition input screen 600 shown in Figure 5 is an example of a condition input screen for requesting color suggestions based on image search. As shown in Figure 5, the condition input screen 600 may have a condition input section 601, a history display section 602, a condition addition section 603, and a search button 604.

[0063] The condition input unit 601 accepts input of condition information. The condition input unit 601 can accept input of text data, image data, or sound data that expresses the impression of the paint color. The text data may include at least one of one or more words or one or more sentences. The image data may be image data that has been stored in the terminal device 50 in advance, or image data that has been captured in real time by the imaging device provided in the terminal device 50. The sound data may be sound data that has been stored in the terminal device 50 in advance, or sound data that has been recorded in real time by the sound pickup device provided in the terminal device 50.

[0064] The history display unit 602 displays a list of previously entered condition information. When condition information is selected in the history display unit 602, the selected history information is entered into the condition input unit 601. If a user wants to enter conditions similar to those entered in the past, they can reduce the effort required to enter condition information by selecting the desired condition information from the history display unit 602.

[0065] The condition addition unit 603 accepts the selection of additional conditions. The condition addition unit 603 displays predefined additional conditions for selection. Additional conditions may include, for example, the texture of the painted surface or the color tone of the paint. Additional conditions are not limited to these and may include any conditions. The condition addition unit 603 may accept the selection of multiple additional conditions. Whether or not to select additional conditions in the condition addition unit 603 is at the user's discretion.

[0066] The search button 604 is a button for starting an image search. When the user presses the search button 604, the terminal device 50 receives the condition information entered in the condition input unit 601 and the additional conditions selected in the condition addition unit 603. The terminal device 50 generates a suggestion request that includes the received condition information as search conditions. The terminal device 50 transmits the generated suggestion request to the color suggestion device 10.

[0067] Furthermore, if the condition input screen 600 is configured to request color suggestions based on image generation, the condition input screen 600 may have a generate button instead of the search button 604. When the user presses the generate button, the terminal device 50 should generate a suggestion request that includes the condition information entered in the condition input unit 601 and the additional conditions selected in the condition addition unit 603 as generation conditions.

[0068] Let's return to Figure 4 for explanation. In step S2, the paint color suggestion device 10 receives a suggestion request from the terminal device 50. The condition acquisition unit 110 of the paint color suggestion device 10 acquires condition information from the suggestion request received by the paint color suggestion device 10. The condition acquisition unit 110 sends the acquired condition information to the image acquisition unit 120.

[0069] The image acquisition unit 120 receives condition information from the condition acquisition unit 110. Based on the condition information, the image acquisition unit 120 generates a request to acquire a reference image. In this embodiment, the image acquisition unit 120 generates an acquisition request to request an image search using the condition information as the search condition. The image acquisition unit 120 transmits the generated acquisition request to the image providing device 20.

[0070] In step S3, the image providing device 20 receives a request from the color suggestion device 10 to acquire a reference image. Based on the received acquisition request, the image providing device 20 acquires one or more images. The image providing device 20 transmits the acquired one or more images to the color suggestion device 10.

[0071] In this embodiment, the image providing device 20 searches for images that match the search conditions included in the acquisition request. If the condition information includes text data, the image providing device 20 searches for images that convey the impression expressed in the text data. If the condition information includes image data, the image providing device 20 searches for images similar to the image data. The image providing device 20 transmits the image search results, which include one or more images, to the color suggestion device 10.

[0072] In step S4, the paint color suggestion device 10 receives image search results from the image provision device 20. The image acquisition unit 120 of the paint color suggestion device 10 acquires one or more images (i.e., reference images) included in the image search results. The image acquisition unit 120 sends the reference images to the brightness division unit 130.

[0073] The brightness division unit 130 receives a reference image from the image acquisition unit 120. The brightness division unit 130 divides the brightness distribution of the reference image into multiple brightness regions. The brightness division unit 130 sends the results of the brightness region division to the color extraction unit 140. The results of the brightness region division may include brightness information of pixels belonging to each of the multiple brightness regions.

[0074] In step S5, the color extraction unit 140 of the color suggestion device 10 receives the results of the brightness region division from the brightness division unit 130. The color extraction unit 140 extracts color information from each of the multiple brightness regions. The color extraction unit 140 sends the multiple color information extracted from each of the multiple brightness regions to the image generation unit 150 and the output unit 160.

[0075] In step S6, the image generation unit 150 of the color suggestion device 10 receives multiple color information from the color extraction unit 140. The image generation unit 150 generates a CS image that includes the multiple color information as the paint color. The image generation unit 150 sends the CS image to the output unit 160.

[0076] In step S7, the output unit 160 of the color suggestion device 10 receives multiple color information from the color extraction unit 140. The output unit 160 also receives a CS image from the image generation unit 150. The output unit 160 generates suggestion information that includes at least one of the color information or the CS image. The output unit 160 transmits the generated suggestion information to the terminal device 50.

[0077] In step S8, the terminal device 50 receives proposal information from the color proposal device 10. The terminal device 50 displays the received proposal information on the display device 506. The terminal device 50 may also display a proposal result screen including the proposal information on the display device 506. The proposal result screen may display at least one of the color information or CS image included in the proposal information. The proposal result screen may also display the information used in the proposal included in the proposal information.

[0078] Users of the paint color suggestion system 1000 may refer to the suggestion information displayed on the terminal device 50 and evaluate the suggested paint colors. Users may use the evaluation results of the suggested paint colors in the development of paints. Users may repeatedly request paint color suggestions until they obtain the desired paint color. Users may also change the condition information, check the paint colors suggested according to the condition information, and search for the condition information that will yield the desired paint color.

[0079] Figure 6 is a diagram illustrating an example of proposed information according to the first embodiment. Figure 6 shows a reference image, color information extracted from the reference image, and a CS image generated based on the color information.

[0080] The reference image is an example of an image obtained by image search using the search term "burning flame". The color information is an example of color information extracted from the high-brightness, medium-brightness, and low-brightness regions of the reference image. Note that "#fce903" in the top row is the RGB value extracted from the high-brightness region, "#f25605" in the middle row is the RGB value extracted from the medium-brightness region, and "#110101" in the bottom row is the RGB value extracted from the low-brightness region. The CS image is an example of a CS image generated using "#fce903" extracted from the high-brightness region as the highlight color and "#110101" extracted from the low-brightness region as the shade color.

[0081] As shown in Figure 6, the color suggestion system 1000 can suggest appropriate colors that convey an impression, even with abstract expressions such as "burning flames." Users can easily obtain colors that convey such an impression simply by inputting condition information that expresses the impression of the color. Furthermore, since the impression of the suggested color can be easily confirmed with the color suggestion system 1000, users can repeatedly request color suggestions while changing the condition information until they obtain the desired color, thus efficiently obtaining the desired color. [Second Embodiment] In the first embodiment, a configuration was described in which a reference image is acquired according to condition information and suggested information corresponding to the reference image is output. In the second embodiment, a configuration is described in which a reference image is divided into multiple color regions and multiple pieces of suggested information corresponding to each of the multiple color regions are output.

[0082] The following describes the paint color suggestion system 1000 according to the second embodiment, focusing on the differences from the first embodiment. Unless otherwise specified, the paint color suggestion system 1000 according to the second embodiment may be configured in the same way as the first embodiment.

[0083] <Functional Configuration> The functional configuration of the paint color suggestion system 1000 according to the second embodiment will be described with reference to Figure 7. Figure 7 is a block diagram showing an example of the functional configuration of the paint color suggestion system according to the second embodiment.

[0084] As shown in Figure 7, the paint color suggestion device 10 according to this embodiment includes a condition acquisition unit 110, an image acquisition unit 120, a color division unit 125, a brightness division unit 130, a color extraction unit 140, an image generation unit 150, and an output unit 160. The paint color suggestion device 10 according to this embodiment differs from the first embodiment in that it further includes a color division unit 125.

[0085] The color division unit 125 divides the reference image into multiple color regions. The color division unit 125 may also divide the reference image into multiple color regions by classifying each pixel contained in the reference image into multiple color regions based on the color information of that pixel. As an example, the color division unit 125 may also classify each pixel into multiple color regions based on the RGB values ​​of each pixel.

[0086] The color division unit 125 may, for example, classify each pixel in the reference image into multiple clusters based on k-means clustering. The color division unit 125 may, for example, classify each pixel in the reference image into two clusters (i.e., k=2). The number of clusters can be arbitrarily determined, or it may be determined based on the color distribution of the reference image.

[0087] In this embodiment, the brightness division unit 130 divides each of the multiple color regions divided by the color division unit 125 into multiple brightness regions. The brightness division unit 130 may classify each of the pixels belonging to each of the multiple color regions into multiple brightness regions based on the brightness information of those pixels. The brightness division unit 130 may classify each of the pixels belonging to each of the multiple color regions into multiple brightness regions by comparing the brightness information of each pixel belonging to each of the multiple color regions with a predetermined threshold. The brightness division unit 130 may use a common threshold for each of the multiple color regions, or it may use different thresholds for each of the multiple color regions.

[0088] In this embodiment, the color extraction unit 140 extracts color information from each of the multiple color regions divided by the color division unit 125. Alternatively, the color extraction unit 140 may extract color information from each of the multiple brightness regions divided by the brightness division unit 130.

[0089] In this embodiment, the image generation unit 150 generates multiple CS images for each of the multiple color regions divided by the color division unit 125, each containing color information extracted from that color region. The image generation unit 150 may also generate multiple CS images for each of the multiple color regions, each containing multiple color information extracted from each of the multiple brightness regions into which that color region is divided.

[0090] In this embodiment, the output unit 160 outputs multiple pieces of suggestion information corresponding to each of the multiple color regions divided by the color division unit 125. The suggestion information corresponding to a color region may include at least one of the color information extracted from the color region or a CS image generated based on the color information extracted from the color region. The suggestion information corresponding to a color region may also include the information used for the suggestion.

[0091] Figure 8 is a diagram illustrating an example of proposed information according to the second embodiment. Figure 8 shows a reference image and a CS image generated based on color information extracted from the reference image. The CS image includes an image generated based on color information extracted from color region 1 and color region 2 when the reference image is divided into two color regions (color region 1 and color region 2), and an image generated based on color information extracted from the entire image without dividing the reference image into color regions.

[0092] The reference image is an example of an image obtained by image search using "rock" as the search condition. As shown in Figure 8, the reference image includes not only rocks but also other subjects (e.g., the blue sky). In this case, if the entire reference image is divided into brightness regions and color information is extracted from each brightness region, color information may be extracted from subjects other than rocks. As a result, a color scheme that does not correspond to the input condition information may be proposed.

[0093] By dividing the reference image into color regions and extracting color information from each region, it is possible to avoid suggesting a paint color that includes color information extracted from multiple subjects with dissimilar colors. As a result, a paint color corresponding to the input condition information can be suggested with high accuracy.

[0094] In this embodiment, both a color corresponding to the input condition information and a color not corresponding to the input condition information will be proposed simultaneously. The user may decide which color to adopt at their discretion. Reference images may also be presented to the user along with the proposed information. The user will be able to understand why a color not corresponding to the input condition information was proposed and will be able to select an appropriate color.

[0095] <Effects of the Embodiment> A paint color suggestion device 10 according to one embodiment of the present disclosure is a paint color suggestion device that suggests a paint color by acquiring a reference image based on condition information related to the paint color, extracting color information from the reference image, and outputting suggestion information that includes the color information as the paint color.

[0096] In one aspect, according to this embodiment, since color information extracted from an image acquired based on condition information regarding the paint color is output as the paint color, it is possible to propose a paint color that corresponds to specific conditions. In another aspect, according to this embodiment, since users can easily obtain a paint color that corresponds to specific conditions, the development of paints can be made more efficient. Consequently, since the development of paints can be completed earlier, the development of industrial products to which the paint is applied can also be made more efficient.

[0097] The color suggestion device 10 may acquire a reference image based on image search results using the condition information as a search condition, and / or image generation results using the condition information as a generation condition. In one aspect, according to this embodiment, a reference image containing a color corresponding to a specific condition can be searched or generated.

[0098] The color suggestion device 10 may extract multiple color information for a single reference image. The color suggestion device 10 may divide the brightness distribution of the reference image into multiple brightness regions and extract color information for each of the multiple brightness regions. The multiple color information may include highlight colors and shade colors. In one aspect, according to this embodiment, it is possible to suggest a color that includes multiple colors with different brightness levels. In another aspect, according to this embodiment, it is possible to suggest a color that looks different depending on the light receiving angle.

[0099] The color suggestion device 10 may divide the reference image into multiple color regions and extract color information for each of the multiple color regions. In one aspect, according to this embodiment, an appropriate color can be suggested even when an image is acquired in which multiple subjects with different colors are captured.

[0100] The paint color suggestion device 10 may generate a simulation image including the paint color based on the color information and output suggestion information including the simulation image. In one aspect, according to this embodiment, paint colors can be suggested in a manner that is easy for the user to understand.

[0101] The paint color may include metallic paint colors. In one aspect, according to this embodiment, metallic paint colors can be proposed to suit specific conditions.

[0102] [Other embodiments] In the embodiments described above, a configuration was described in which the color suggestion device 10 generates a CS image. However, the CS image may be generated using an external information processing device. For example, the color suggestion device 10 may output color information extracted from a reference image acquired based on condition information to an external information processing device. The external information processing device may generate a CS image based on the color information output from the color suggestion device 10 and transmit it to the color suggestion device 10. The color suggestion device 10 may include the CS image received from the external information processing device in the suggestion information and transmit it to the terminal device 50.

[0103] In the above embodiments, the configuration of a color suggestion system that proposes paint colors when paint is applied to industrial products such as automobiles has been described. However, each of the above embodiments can be applied to an information processing system that proposes various colors. For example, each of the above embodiments may be applied to suggesting the color of a film to be attached to the surface of an industrial product such as an automobile.

[0104] [supplement] Each of the embodiments described above can be implemented by one or more processing circuits. Hereinafter, "processing circuit" as used herein includes processors programmed to execute each function by software, such as CPUs (Central Processing Units) or GPUs (Graphics Processing Units) implemented by electronic circuits, as well as devices such as ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), FPGAs (Field Programmable Gate Arrays), and conventional circuit modules designed to execute each of the functions described above.

[0105] While embodiments of the present disclosure have been described in detail above, the embodiments disclosed herein are illustrative and not restrictive in all respects. The embodiments can be modified and improved in various ways without departing from the scope and spirit of the appended claims. The features described in the above embodiments can be combined in any way that is not inconsistent with other configurations.

[0106] Furthermore, the following forms are possible for disclosure technology.

[0107] (Note 1) A paint color suggestion device that suggests paint colors, An image acquisition unit is configured to acquire a reference image based on the aforementioned color-related condition information, A color extraction unit configured to extract color information from the aforementioned reference image, An output unit configured to output proposed information that includes the aforementioned color information as the paint color, A paint color suggestion device equipped with the following features.

[0108] (Note 2) The image acquisition unit is configured to acquire the reference image based on the image search results using the condition information as a search condition, and / or the image generation results using the condition information as a generation condition. The paint color suggestion device described in Appendix 1.

[0109] (Note 3) The color extraction unit is configured to extract multiple color pieces of information from a single reference image. A paint color suggestion device as described in Appendix 1 or 2.

[0110] (Note 4) The system further comprises a brightness division unit configured to divide the brightness distribution of the reference image into multiple brightness regions, The color extraction unit is configured to extract the color information for each of the plurality of brightness regions. The paint color suggestion device described in Appendix 3.

[0111] (Note 5) The aforementioned multiple color information includes highlight colors and shade colors. A paint color suggestion device as described in Appendix 3 or 4.

[0112] (Note 6) The color division unit is further configured to divide the aforementioned reference image into multiple color regions, The color extraction unit is configured to extract color information for each of the plurality of color regions. A paint color suggestion device as described in any of Appendix 1 to 5.

[0113] (Note 7) The system further comprises an image generation unit configured to generate a simulation image including the paint color based on the aforementioned color information, The output unit is configured to output the proposed information, including the simulation image. A paint color suggestion device as described in any of Appendix 1 to 6.

[0114] (Note 8) The aforementioned paint colors include metallic paint colors. A paint color suggestion device as described in any of Appendix 1 to 7.

[0115] (Note 9) A paint color suggestion device that proposes paint colors, A procedure for obtaining a reference image based on the aforementioned color-related condition information, A procedure for extracting color information from the aforementioned reference image, A procedure for outputting proposed information that includes the aforementioned color information as the aforementioned paint color, A method for proposing paint colors to be used.

[0116] (Note 10) A paint color suggestion device that proposes paint colors, A procedure for obtaining a reference image based on the aforementioned color-related condition information, A procedure for extracting color information from the aforementioned reference image, A procedure for outputting proposed information that includes the aforementioned color information as the aforementioned paint color, A program to execute. [Explanation of symbols]

[0117] 10: Paint color suggestion device 20: Image providing device 50: Terminal device 110: Condition Acquisition Section 120: Image acquisition unit 125: Color division part 130: Brightness division part 140: Color extraction section 150: Image generation unit 160: Output section 1000: Paint Color Suggestion System

Claims

1. A paint color suggestion device that suggests paint colors, An image acquisition unit is configured to acquire a reference image based on the aforementioned color-related condition information, A color extraction unit configured to extract color information from the aforementioned reference image, An output unit configured to output proposed information that includes the aforementioned color information as the paint color, A paint color suggestion device equipped with the following features.

2. The image acquisition unit is configured to acquire the reference image based on the image search results using the condition information as a search condition, and / or the image generation results using the condition information as a generation condition. The color suggestion device according to claim 1.

3. The color extraction unit is configured to extract multiple color pieces of information from a single reference image. The color suggestion device according to claim 1.

4. The system further comprises a brightness division unit configured to divide the brightness distribution of the reference image into multiple brightness regions, The color extraction unit is configured to extract the color information for each of the plurality of brightness regions. The color suggestion device according to claim 3.

5. The aforementioned multiple color information includes highlight colors and shade colors. The color suggestion device according to claim 3.

6. The color division unit is further configured to divide the aforementioned reference image into multiple color regions, The color extraction unit is configured to extract color information for each of the plurality of color regions. The color suggestion device according to claim 1.

7. The system further comprises an image generation unit configured to generate a simulation image including the paint color based on the aforementioned color information, The output unit is configured to output the proposed information, including the simulation image. A color-matching device according to any one of claims 1 to 6.

8. The aforementioned paint colors include metallic paint colors. A color-matching device according to any one of claims 1 to 6.

9. A paint color suggestion device that proposes paint colors, A procedure for obtaining a reference image based on the aforementioned color-related condition information, A procedure for extracting color information from the aforementioned reference image, A procedure for outputting proposed information that includes the aforementioned color information as the aforementioned paint color, A method for proposing paint colors to be used.

10. A paint color suggestion device that proposes paint colors, A procedure for obtaining a reference image based on the aforementioned color-related condition information, A procedure for extracting color information from the aforementioned reference image, A procedure for outputting proposed information that includes the aforementioned color information as the aforementioned paint color, A program to execute.

Images