Paint color suggestion device, paint color suggestion method, and program

Abstract

We suggest paint colors according to specific conditions. [Solution] A paint color proposal device that proposes paint colors includes an image acquisition unit that acquires a reference image based on condition information related to paint colors, a color extraction unit that extracts color information from the reference image, and an output unit that outputs proposal information including the color information as a paint color.

Description

[Technical field]

[0001] The present disclosure relates to a paint color suggestion device, a paint color suggestion method, and a program. [Background technology]

[0002] There is known a technique for visualizing the paint color applied to an industrial product by computer simulation in order to evaluate the paint color applied to an industrial product such as an automobile. For example, Patent Document 1 discloses a paint color evaluation image generating method that calculates the spectral reflectance of a metallic paint color for each predetermined angle from the spectral reflectance of the metallic paint color measured at a plurality of light receiving angles, calculates a colorimetric value for each predetermined angle, and generates a paint color evaluation image in which pixels of a painted surface image are replaced with pixels showing a colorimetric value corresponding to the shading level of the pixel. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2022-181555 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the conventional technology is a technology for evaluating existing paint colors, and is not a technology for proposing new paint colors. For example, if a user could propose a paint color that he or she wants to achieve, the development of paints and the like can be made more efficient.

[0005] One aspect of the present disclosure aims to propose paint colors according to specific conditions. [Means for solving the problem]

[0006] One aspect of the present disclosure is a paint color proposal device that proposes a paint color, comprising an image acquisition unit configured to acquire a reference image based on condition information related to the paint color, a color extraction unit configured to extract color information from the reference image, and an output unit configured to output proposal information including the color information as the paint color. Effect of the Invention

[0007] According to one aspect of the present disclosure, a paint color can be proposed according to specific conditions. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram showing an example of the overall configuration of a paint color suggestion system. [Diagram 2] FIG. 2 is a block diagram showing an example of a hardware configuration of a computer. [Diagram 3] 1 is a block diagram showing an example of a functional configuration of a paint color suggestion system according to a first embodiment; [Figure 4] FIG. 4 is a sequence diagram showing an example of a paint color suggestion method according to the first embodiment. [Diagram 5] FIG. 13 is a diagram showing an example of a condition input screen. [Figure 6] FIG. 4 is a diagram showing a specific example of proposal information according to the first embodiment. [Figure 7] FIG. 11 is a block diagram showing an example of a functional configuration of a paint color suggestion system according to a second embodiment. [Figure 8] FIG. 11 is a diagram showing a specific example of proposal information according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configurations are denoted by the same reference numerals, and redundant description will be omitted.

[0010] [First embodiment] A first embodiment of the present disclosure is an information processing system for proposing a paint color. Hereinafter, the information processing system according to the present embodiment will be referred to as a "paint color proposing system."

[0011] In this embodiment, the coating color may include, for example, a solid coating color, a pearl coating color, or a metallic coating color. A solid coating color is a coating color when a solid-colored paint is applied to an object, and has a small flip-flop value. The flip-flop value is an index that indicates the change in light intensity due to differences in the reflection angle of incident light from a light source. A pearl coating color or a metallic coating color is a coating color when a paint containing a flake-shaped glittering material is applied to an object, and has a large flip-flop value compared to a solid coating color.

[0012] Conventionally, in the development of paints for industrial products such as automobiles, the paint designer imagines a paint color, and the paint designer must verbalize the color expression or use an image of a color motif to create a specific color. However, in order to create a specific color from the designer's words or an image of a motif, the paint developer must have personal skills such as experience and sense, and the color adjustment process takes a lot of time. For example, if a paint color that matches an image based on a word or sentence that expresses the image of a color, or an image that is close to the image of a color, the time required for the color adjustment process can be significantly reduced, and the development of paints can be made more efficient.

[0013] In this embodiment, the purpose is to propose a paint color according to a specific condition, such as a word or sentence expressing an image of a color, or an image similar to the image of a color. To this end, this embodiment obtains a reference image based on condition information related to the paint color, extracts color information from the reference image, and outputs proposal information including the color information as the paint color.

[0014] In one aspect, the present embodiment allows a paint color to be proposed according to specific conditions. In another aspect, the present embodiment allows a user to easily obtain a paint color according to specific conditions, thereby making paint development more efficient.

[0015] <Overall composition> The overall configuration of the paint color suggestion system according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing an example of the overall configuration of the paint color suggestion system.

[0016] 1, the paint color proposal system 1000 includes a paint color proposal device 10, an image providing device 20, and a terminal device 50. The paint color proposal device 10, the image providing device 20, and the terminal device 50 are connected to each other so as to be able to communicate data with each other via a communication network N such as a LAN (Local Area Network) or the Internet.

[0017] The paint color suggestion device 10 is an example of an information processing device that suggests a paint color. The paint color suggestion device 10 may be, for example, a computer such as a personal computer, a workstation, or a server.

[0018] The paint color proposal device 10 accepts a proposal request from the terminal device 50. The proposal request includes condition information indicating conditions related to the paint color. The paint color proposal device 10 acquires an image from the image providing device 20 based on the condition information included in the proposal request. The paint color proposal device 10 extracts color information from the image acquired from the image providing device 20, and transmits proposal information including the color information as a paint color to the terminal device 50.

[0019] The image providing device 20 is an example of an information processing device that provides an image. The image providing device 20 may be, for example, a computer such as a personal computer, a workstation, or a server.

[0020] The image providing device 20 provides images to the paint color proposing device 10 in response to a request from the paint color proposing device 10. The image providing device 20 may provide the paint color proposing device 10 with image search results using the condition information as search conditions. The image providing device 20 may search for images based on a predetermined search engine. For example, the search engine may be a general-purpose search engine that searches for images on the Internet, or a search engine that allows users to search for independently collected materials.

[0021] The image providing device 20 may provide the painting color proposing device 10 with an image generation result in which the condition information is used as a generation condition. The image providing device 20 may generate an image based on a machine learning model. The machine learning model may be, for example, an image generation model such as a variational autoencoder, a generative adversarial network, or a diffusion model.

[0022] The terminal device 50 is an example of an information processing terminal operated by a user of the paint color proposal system 1000. The terminal device 50 may be, for example, a computer such as a personal computer, a smartphone, or a tablet terminal.

[0023] The terminal device 50 transmits a proposal request to the paint color proposing device 10. The proposal request includes condition information input by the user. The terminal device 50 receives proposal information from the paint color proposing device 10 and presents it to the user.

[0024] 1 is merely an example, and various system configurations are possible depending on the application and purpose. For example, the paint color proposal system 1000 may include a plurality of one or more of the paint color proposal device 10, the image providing device 20, and the terminal device 50. For example, the image providing device 20 may be realized by an external information processing device or information processing system, and may not be included in the paint color proposal system 1000.

[0025] For example, the paint color suggestion device 10 or the image providing device 20 may be realized by multiple computers, or may be realized as a cloud computing service. For example, the paint color suggestion device 10 and the image providing device 20 may be realized by a single server device that has both functions. For example, the paint color suggestion system 1000 may be realized by a stand-alone computer. The division of devices such as the paint color suggestion device 10, the image providing device 20, and the terminal device 50 shown in FIG. 1 is an example.

[0026] <Hardware configuration> The hardware configuration of the paint color suggestion system 1000 will be described with reference to Fig. 2. The paint color suggestion device 10, the image providing device 20, and the terminal device 50 included in the paint color suggestion system 1000 are realized by, for example, a computer. Fig. 2 is a block diagram showing an example of the hardware configuration of a computer.

[0027] 2, the computer 500 includes a central processing unit (CPU) 501, a read only memory (ROM) 502, a random access memory (RAM) 503, a hard disk drive (HDD) 504, an input device 505, a display device 506, a communication interface (I / F) 507, and an external I / F 508. The CPU 501, the ROM 502, and the RAM 503 form a so-called computer. Each piece of hardware of the computer 500 is connected to each other via a bus line 509. The input device 505 and the display device 506 may be connected to the external I / F 508 for use.

[0028] The CPU 501 is a calculation device that reads out programs and data from a storage device such as a ROM 502 or a HDD 504 onto a RAM 503 and executes processes, thereby realizing overall control and functions of the computer 500 .

[0029] The ROM 502 is an example of a non-volatile semiconductor memory (storage device) that can retain programs and data even when the power is turned off. The ROM 502 functions as a main storage device that stores various programs, data, etc. required for the CPU 501 to execute various programs installed in the HDD 504. Specifically, the ROM 502 stores boot programs such as a Basic Input Output System (BIOS) and an Extensible Firmware Interface (EFI) that are executed when the computer 500 is started, as well as data such as OS (Operating System) settings and network settings.

[0030] The RAM 503 is an example of a volatile semiconductor memory (storage device) in which programs and data are erased when the power is turned off. The RAM 503 is, for example, a dynamic random access memory (DRAM) or a static random access memory (SRAM). The RAM 503 provides a working area in which various programs installed in the HDD 504 are expanded when the CPU 501 executes them.

[0031] The HDD 504 is an example of a non-volatile storage device that stores programs and data. The programs and data stored in the HDD 504 include an OS, which is basic software that controls the entire computer 500, and applications that provide various functions on the OS. Note that the computer 500 may use a storage device that uses a flash memory as a storage medium (e.g., an SSD (Solid State Drive) or the like) instead of the HDD 504.

[0032] The input device 505 includes a touch panel, operation keys or buttons, a keyboard or mouse, a microphone for inputting sound data such as voice, etc., which are used by the user to input various signals.

[0033] The display device 506 is composed of a display such as a liquid crystal display or an organic EL (Electro-Luminescence) display for displaying a screen, a speaker for outputting sound data such as voice, and the like.

[0034] The communication I / F 507 is an interface that connects to a communication network and enables the computer 500 to perform data communication.

[0035] The external I / F 508 is an interface with external devices, such as a drive device 510.

[0036] The drive device 510 is a device for setting the recording medium 511. The recording medium 511 here includes media that record information optically, electrically, or magnetically, such as a CD-ROM, a flexible disk, or a magneto-optical disk. The recording medium 511 may also include semiconductor memories that record information electrically, such as a ROM or a flash memory. This allows the computer 500 to read and / or write data from and to the recording medium 511 via the external I / F 508.

[0037] The various programs to be installed in the HDD 504 are installed, for example, by setting the distributed recording medium 511 in a drive device 510 connected to the external I / F 508 and reading out the various programs recorded in the recording medium 511 by the drive device 510. Alternatively, the various programs to be installed in the HDD 504 may be installed by being downloaded from a network different from the communication network via the communication I / F 507.

[0038] <Functional configuration> The functional configuration of the paint color suggestion system 1000 will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of the functional configuration of the paint color suggestion system according to the first embodiment.

[0039] 3, the paint color proposal device 10 includes a condition acquisition unit 110, an image acquisition unit 120, a brightness division unit 130, a color extraction unit 140, an image generation unit 150, and an output unit 160. The paint color proposal device 10 functions as the condition acquisition unit 110, the image acquisition unit 120, the brightness division unit 130, the color extraction unit 140, the image generation unit 150, and the output unit 160 by executing a paint color proposal program installed in advance.

[0040] For example, the condition acquisition unit 110, the image acquisition unit 120, the brightness division unit 130, the color extraction unit 140, the image generation unit 150 and the output unit 160 are realized by processing executed by the CPU 501 of a program expanded from the HDD 504 shown in FIG. 2 onto the RAM 503.

[0041] The condition acquisition unit 110 acquires condition information indicating conditions related to a paint color. The condition acquisition unit 110 may receive a proposal request including the condition information from the terminal device 50. The condition acquisition unit 110 may accept input of the condition information via the input device 505 of the paint color proposal device 10. The condition acquisition unit 110 may read out the condition information pre-stored in a storage device such as the HDD 504.

[0042] The condition information may include electronic data expressing an impression of a paint color. The electronic data expressing an impression of a paint color may include text data, image data, or audio data. The text data may include at least one of one or more words or one or more sentences. The image data may include an image including the paint color to be realized or a color similar to the paint color. The audio data may include an audio signal in which one or more words or one or more sentences are spoken.

[0043] The image acquisition unit 120 acquires an image. The image acquisition unit 120 may acquire an image to be referenced in order to extract color information to be included in the paint color. Hereinafter, the image acquired by the image acquisition unit 120 is also referred to as a "reference image."

[0044] The image acquisition unit 120 may acquire a reference image based on the condition information acquired by the condition acquisition unit 110. The image acquisition unit 120 may acquire a reference image from the image providing device 20. The image acquisition unit 120 may transmit an acquisition request for the reference image to the image providing device 20. The image acquisition unit 120 may transmit an acquisition request for requesting an image search using the condition information as a search condition to the image providing device 20. The image acquisition unit 120 may transmit an acquisition request for requesting image generation using the condition information as a generation condition to the image providing device 20.

[0045] The image acquiring unit 120 may acquire a reference image based on the image search result by the image providing device 20. The image acquiring unit 120 may acquire one or more reference images included in the image search result. The image acquiring unit 120 may acquire a predetermined number of reference images (e.g., one) from the top of the image search result. The image acquiring unit 120 may present the image search result to a user and acquire a reference image specified by the user.

[0046] The image acquisition unit 120 may acquire a reference image based on an image generation result by the image providing device 20. The image acquisition unit 120 may request the image providing device 20 to generate a plurality of images. The image acquisition unit 120 may acquire one or more reference images included in the image generation result. The image acquisition unit 120 may present the image generation result to a user and acquire a reference image specified by the user.

[0047] The image acquisition unit 120 may transmit an acquisition request to the image providing device 20, the acquisition request requesting an image search using the condition information as a search condition and an image generation using the condition information as a generation condition. The image acquisition unit 120 may acquire a reference image based on the image search result and the image generation result by the image providing device 20. The image acquisition unit 120 may acquire one or more reference images included in either the image search result or the image generation result.

[0048] The brightness division unit 130 divides the reference image into a plurality of brightness regions. The brightness division unit 130 may divide the reference image acquired by the image acquisition unit 120 into a plurality of brightness regions. The brightness division unit 130 may divide the brightness distribution of the reference image into a plurality of brightness regions. The brightness distribution is information indicating the distribution of brightness information of each pixel included in the reference image.

[0049] The brightness splitting unit 130 may convert the RGB values ​​of each pixel included in the reference image into an HSV value, and use the V component of the HSV value as brightness information. * a * b * Convert the value to L * a * b* The brightness splitting unit 130 may convert the reference image into a grayscale image and use pixel values ​​of the grayscale image as the brightness information.

[0050] The brightness division unit 130 may classify each pixel included in the reference image into one of a plurality of brightness regions by comparing the brightness information of each pixel included in the reference image with a predetermined threshold. As an example, the brightness division unit 130 may divide the reference image into a high brightness region and a low brightness region. In this case, the brightness division unit 130 may classify pixels whose brightness information is equal to or greater than the threshold into a high brightness region, using the 75th percentile of the brightness information as a threshold. In addition, the brightness division unit 130 may classify pixels whose brightness information is equal to or less than the threshold into a low brightness region, using the 60th percentile of the brightness information as a threshold.

[0051] As another example, the brightness division unit 130 may divide the reference image into a high brightness region, a medium brightness region, and a low brightness region. In this case, the brightness division unit 130 may classify pixels whose brightness information is equal to or greater than the first threshold value, using the 67th percentile of the brightness information as a first threshold value, into a high brightness region. The brightness division unit 130 may also classify pixels whose brightness information is equal to or less than the second threshold value, using the 33rd percentile of the brightness information as a second threshold value, into a low brightness region. The brightness division unit 130 may also classify pixels whose brightness information is less than the first threshold value and more than the second threshold value into a medium brightness region.

[0052] The color extraction unit 140 extracts color information from the reference image. The color extraction unit 140 may extract color information from the reference image acquired by the image acquisition unit 120. The color information may be, for example, an RGB value or an HSV value. The color extraction unit 140 may extract a statistical value of the color information of each pixel included in the reference image. The color extraction unit 140 may extract a mode, an average value, or a median value of the color information.

[0053] The color extraction unit 140 may extract a plurality of pieces of color information from the reference image. The color extraction unit 140 may extract a plurality of pieces of color information including a highlight color and a shade color. The color extraction unit 140 may extract a plurality of pieces of color information by extracting color information from each of a plurality of brightness regions divided by the brightness division unit 130. The color extraction unit 140 may extract color information of a highlight color from a high brightness region. The color extraction unit 140 may extract color information of a shade color from a low brightness region.

[0054] The highlight color is a color that is perceived as bright and dazzling at angles close to the specular reflected light. The highlight color may be, for example, a color measured at a light receiving angle of 10 degrees when the incident light is irradiated at a 45-degree angle to the painted surface. The shade color is a color that is perceived as dark at angles far from the specular reflected light. The shade color may be, for example, a color measured at a light receiving angle of 110 degrees when the incident light is irradiated at a 45-degree angle to the painted surface.

[0055] The image generating unit 150 generates an image including a paint color. The image generating unit 150 may generate an image simulating the paint color when paint is applied to the painted surface. Hereinafter, the image simulating the paint color generated by the image generating unit 150 is also referred to as a "color simulation image (CS image)". The image generating unit 150 may generate a CS image including the color information extracted by the color extracting unit 140 as a paint color. The image generating unit 150 may generate a CS image including a plurality of color information extracted by the color extracting unit 140 as paint colors. The image generating unit 150 may generate a CS image of a metallic paint color including a highlight color and a shade color.

[0056] The CS image may be, for example, a rectangular image including a linear gradation in which the color changes along a predetermined direction. The CS image may be, for example, a spherical image including a gradation in which the color changes along a predetermined direction. The CS image may be, for example, a simulation image of the image when painted on a CG image of an arbitrary object shape.

[0057] The image generating unit 150 may generate a CS image by arranging the color information extracted by the color extracting unit 140 at an arbitrary position and gradating the color across the entire image. For example, the image generating unit 150 may generate a CS image by arranging a highlight color and a shade color at predetermined positions and generating a linear gradation in which the color changes from the highlight color to the shade color (or from the shade color to the highlight color).

[0058] The output unit 160 outputs the proposal information. The proposal information is information for proposing a paint color in response to a proposal request. The proposal information may include color information extracted by the color extraction unit 140. The proposal information may include a plurality of pieces of color information extracted by the color extraction unit 140. The proposal information may include an image having color information extracted by the color extraction unit 140. The proposal information may include a CS image generated by the image generation unit 150.

[0059] The proposal information may include information used for the proposal. The information used for the proposal may include, for example, at least one of the condition information acquired by the condition acquisition unit 110, the image search result or the image generation result provided by the image providing device 20, or the reference image acquired by the image acquisition unit 120.

[0060] <Processing Procedure> A paint color suggestion method executed by the paint color suggestion system 1000 will be described with reference to Fig. 4. Fig. 4 is a sequence diagram showing an example of the paint color suggestion method according to the first embodiment.

[0061] In step S1, a user of the paint color proposal system 1000 performs an operation to launch a condition input screen. In response to the operation by the user, the terminal device 50 displays the condition input screen on the display device 506. The user inputs condition information into the condition input screen displayed on the display device 506.

[0062] Fig. 5 is a diagram showing an example of a condition input screen. A condition input screen 600 shown in Fig. 5 is an example of a condition input screen for requesting a paint color proposal by image search. As shown in Fig. 5, the condition input screen 600 may have a condition input section 601, a history display section 602, a condition addition section 603, and a search button 604.

[0063] The condition input unit 601 accepts input of condition information. The condition input unit 601 can input text data, image data, or audio data expressing an impression of the paint color. The text data may include at least one of one or more words or one or more sentences. The image data may be image data stored in advance in the terminal device 50, or may be image data captured in real time by an imaging device included in the terminal device 50. The audio data may be audio data stored in advance in the terminal device 50, or may be audio data recorded in real time by a sound collection device included in the terminal device 50.

[0064] A list of condition information previously input is displayed in the history display section 602. When condition information is selected in the history display section 602, the selected history information is input to the condition input section 601. When a user wishes to input a condition similar to a condition previously input, the user can select the desired condition information from the history display section 602 to reduce the effort required to input the condition information.

[0065] The condition adding unit 603 accepts the selection of an additional condition. The condition adding unit 603 displays predetermined additional conditions in a selectable manner. The additional conditions may include, for example, the texture of the painted surface or the color tone of the paint. The additional conditions are not limited to these and may include any condition. The condition adding unit 603 may accept the selection of multiple additional conditions. Whether or not to select an additional condition in the condition adding unit 603 may be determined at the user's discretion.

[0066] The search button 604 is a button for starting an image search. When the user presses the search button 604, the terminal device 50 accepts the condition information input to the condition input unit 601 and the additional condition selected in the condition adding unit 603. The terminal device 50 generates a proposal request including the accepted condition information as a search condition. The terminal device 50 transmits the generated proposal request to the paint color proposing device 10.

[0067] When the condition input screen 600 is configured to request a paint color proposal by image generation, the condition input screen 600 may have a generate button instead of the search button 604. When the user presses the generate button, the terminal device 50 generates a proposal request including the condition information input to the condition input unit 601 and the additional condition selected in the condition adding unit 603 as generation conditions.

[0068] Returning to Fig. 4, in step S2, the paint color proposing device 10 receives a proposal request from the terminal device 50. The condition acquisition unit 110 of the paint color proposing device 10 acquires condition information from the proposal request received by the paint color proposing device 10. The condition acquisition unit 110 sends the acquired condition information to the image acquisition unit 120.

[0069] The image acquisition unit 120 receives the condition information from the condition acquisition unit 110. The image acquisition unit 120 generates an acquisition request for a reference image based on the condition information. In this embodiment, the image acquisition unit 120 generates an acquisition request for requesting an image search using the condition information as a search condition. The image acquisition unit 120 transmits the generated acquisition request to the image providing device 20.

[0070] In step S3, the image providing device 20 receives a reference image acquisition request from the paint color suggestion device 10. The image providing device 20 acquires one or more images based on the received acquisition request. The image providing device 20 transmits the acquired one or more images to the paint color suggestion device 10.

[0071] In this embodiment, the image providing device 20 searches for images that match the search conditions based on the search conditions included in the acquisition request. If the condition information includes text data, the image providing device 20 searches for images that give the impression expressed in the text data. If the condition information includes image data, the image providing device 20 searches for images similar to the image data. The image providing device 20 transmits an image search result including one or more images to the paint color proposal device 10.

[0072] In step S4, the paint color suggestion device 10 receives the image search result from the image providing device 20. The image acquisition unit 120 of the paint color suggestion device 10 acquires one or more images (i.e., reference images) included in the image search result. The image acquisition unit 120 sends the reference images to the brightness division unit 130.

[0073] The brightness division unit 130 receives a reference image from the image acquisition unit 120. The brightness division unit 130 divides the brightness distribution of the reference image into a plurality of brightness regions. The brightness division unit 130 sends the brightness region division results to the color extraction unit 140. The brightness region division results may include brightness information of pixels belonging to each of the plurality of brightness regions.

[0074] In step S5, the color extraction unit 140 of the paint color suggestion device 10 receives the segmentation results of the lightness regions from the lightness segmentation unit 130. The color extraction unit 140 extracts color information from each of the multiple lightness regions. The color extraction unit 140 sends the multiple pieces of color information extracted from each of the multiple lightness regions to the image generation unit 150 and the output unit 160.

[0075] In step S6, the image generating unit 150 of the painting color suggestion device 10 receives the plurality of pieces of color information from the color extracting unit 140. The image generating unit 150 generates a CS image including the plurality of pieces of color information as painting colors. The image generating unit 150 sends the CS image to the output unit 160.

[0076] In step S7, the output unit 160 of the painting color proposal device 10 receives a plurality of pieces of color information from the color extraction unit 140. The output unit 160 also receives a CS image from the image generation unit 150. The output unit 160 generates proposal information including at least one of the color information and the CS image. The output unit 160 transmits the generated proposal information to the terminal device 50.

[0077] In step S8, the terminal device 50 receives the proposal information from the paint color proposal device 10. The terminal device 50 displays the received proposal information on the display device 506. The terminal device 50 may display a proposal result screen including the proposal information on the display device 506. The proposal result screen may display at least one of the color information and the CS image included in the proposal information. The proposal result screen may display information used for the proposal included in the proposal information.

[0078] A user of the paint color suggestion system 1000 may refer to the suggestion information displayed on the terminal device 50 and evaluate the proposed paint colors. The user may use the evaluation results of the proposed paint colors in the development of paints. The user may repeatedly request paint color suggestions until the desired paint color is obtained. The user may change the condition information, check the paint colors suggested according to the condition information, and search for condition information that will allow the desired paint color to be obtained.

[0079] Fig. 6 is a diagram for explaining an example of the proposal information according to the first embodiment. Fig. 6 illustrates a reference image, color information extracted from the reference image, and a CS image generated based on the color information.

[0080] The reference image is an example of an image obtained by image search using "burning flame" as a search criterion. The color information is an example of color information extracted from the high-brightness, medium-brightness, and low-brightness regions of the reference image. Note that "#fce903" in the top row is the RGB value extracted from the high-brightness region, "#f25605" in the middle row is the RGB value extracted from the medium-brightness region, and "#110101" in the bottom row is the RGB value extracted from the low-brightness region. The CS image is an example of a CS image generated with "#fce903" extracted from the high-brightness region as the highlight color and "#110101" extracted from the low-brightness region as the shade color.

[0081] As shown in FIG. 6, the paint color suggestion system 1000 can suggest an appropriate paint color that gives an impression, even for an abstract expression such as "burning flames." A user can easily obtain a paint color that gives such an impression by simply inputting condition information that expresses the impression of the paint color. Furthermore, the paint color suggestion system 1000 allows the user to easily check the impression of the proposed paint color, and thus allows the user to repeatedly request paint color suggestions while changing the condition information until the desired paint color is obtained, thereby enabling the desired paint color to be obtained efficiently. [Second embodiment] In the first embodiment, a configuration is described in which a reference image according to condition information is acquired and proposal information corresponding to the reference image is output. In the second embodiment, a configuration is described in which a reference image is divided into a plurality of color regions and a plurality of pieces of proposal information corresponding to each of the plurality of color regions is output.

[0082] The following describes the paint color suggestion system 1000 according to the second embodiment, focusing on the differences from the first embodiment. Unless otherwise specified, the paint color suggestion system 1000 according to the second embodiment may be configured similarly to the first embodiment.

[0083] <Functional configuration> The functional configuration of the paint color suggestion system 1000 according to the second embodiment will be described with reference to Fig. 7. Fig. 7 is a block diagram showing an example of the functional configuration of the paint color suggestion system according to the second embodiment.

[0084] 7, the paint color suggestion device 10 according to this embodiment includes a condition acquisition unit 110, an image acquisition unit 120, a color division unit 125, a brightness division unit 130, a color extraction unit 140, an image generation unit 150, and an output unit 160. The paint color suggestion device 10 according to this embodiment differs from the first embodiment in that it further includes a color division unit 125.

[0085] The color division unit 125 divides the reference image into a plurality of color regions. The color division unit 125 may divide the reference image into a plurality of color regions by classifying each pixel included in the reference image into a plurality of color regions based on color information of the pixel. As an example, the color division unit 125 may classify each pixel into a plurality of color regions based on the RGB value of each pixel.

[0086] For example, the color splitting unit 125 may classify each pixel included in the reference image into a plurality of clusters based on k-means clustering. For example, the color splitting unit 125 may classify each pixel included in the reference image into two clusters (i.e., k=2). The number of clusters may be determined arbitrarily, and may be determined based on the color distribution of the reference image.

[0087] In this embodiment, the brightness splitting unit 130 splits each of the multiple color regions split by the color splitting unit 125 into multiple brightness regions. For each of the multiple color regions, the brightness splitting unit 130 may classify pixels belonging to the color region into multiple brightness regions based on brightness information of the pixels. For each of the multiple color regions, the brightness splitting unit 130 may classify each pixel belonging to the color region into multiple brightness regions by comparing the brightness information of each pixel belonging to the color region with a predetermined threshold. The brightness splitting unit 130 may use a common threshold for each of the multiple color regions, or may use a different threshold for each of the multiple color regions.

[0088] In this embodiment, the color extraction unit 140 extracts color information from each of the multiple color regions divided by the color division unit 125. The color extraction unit 140 may extract color information from each of the multiple lightness regions into which the lightness division unit 130 divides each of the multiple color regions.

[0089] In this embodiment, the image generating unit 150 generates a plurality of CS images including color information extracted from each of the plurality of color regions divided by the color dividing unit 125. The image generating unit 150 may generate a plurality of CS images including color information extracted from each of the plurality of brightness regions divided into the plurality of color regions.

[0090] In this embodiment, the output unit 160 outputs a plurality of pieces of proposed information corresponding to the plurality of color regions divided by the color dividing unit 125. The proposed information corresponding to a color region may include at least one of color information extracted from the color region and a CS image generated based on the color information extracted from the color region. The proposed information corresponding to a color region may include information used for the proposal.

[0091] Fig. 8 is a diagram for explaining an example of the proposed information according to the second embodiment. Fig. 8 shows a reference image and a CS image generated based on color information extracted from the reference image. When the reference image is divided into two color regions (color region 1 and color region 2), the CS image includes an image generated based on color information extracted from each of color region 1 and color region 2, and an image generated based on color information extracted from the entire image without dividing the reference image into color regions.

[0092] The reference image is an example of an image obtained by image search using "rock" as a search criterion. As shown in FIG. 8, the reference image contains rocks as well as other subjects (e.g., blue sky, etc.). In this case, if the entire reference image is divided into brightness regions and color information is extracted from each brightness region, color information may be extracted from subjects other than rocks. As a result, a paint color that does not correspond to the input condition information may be proposed.

[0093] By dividing the reference image into color regions and extracting color information from each color region, it is possible to avoid proposing paint colors that include color information extracted from multiple subjects with dissimilar colors. As a result, it is possible to accurately propose paint colors that correspond to the input condition information.

[0094] In this embodiment, a paint color that corresponds to the input condition information and a paint color that does not correspond to the input condition information are simultaneously proposed. The user may arbitrarily decide which paint color to adopt. Also, a reference image may be presented to the user together with the proposed information. The user can know the reason why a paint color that does not correspond to the input condition information has been proposed, and can select an appropriate paint color.

[0095] <Effects of the embodiment> A paint color proposal device 10 according to one embodiment of the present disclosure is a paint color proposal device that proposes a paint color by acquiring a reference image based on condition information related to a paint color, extracting color information from the reference image, and outputting proposal information including the color information as a paint color.

[0096] In one aspect, according to this embodiment, color information extracted from an image acquired based on condition information related to paint colors is output as paint colors, so that paint colors according to specific conditions can be proposed. In another aspect, according to this embodiment, a user can easily obtain paint colors according to specific conditions, so that paint development can be made more efficient. In addition, because paint development can be completed early, the development of industrial products to be painted with paint can also be made more efficient.

[0097] The paint color suggestion device 10 may acquire a reference image based on an image search result in which the condition information is used as a search condition and / or an image generation result in which the condition information is used as a generation condition. In one aspect, according to the present embodiment, a reference image including a color according to a specific condition can be searched for or generated.

[0098] The paint color suggestion device 10 may extract multiple pieces of color information for one reference image. The paint color suggestion device 10 may divide the brightness distribution of the reference image into multiple brightness regions and extract color information for each of the multiple brightness regions. The multiple pieces of color information may include highlight colors and shade colors. In one aspect, the present embodiment can suggest paint colors that include multiple colors with different brightnesses. In another aspect, the present embodiment can suggest paint colors that look different depending on the light receiving angle.

[0099] The paint color suggestion device 10 may divide the reference image into a plurality of color regions and extract color information for each of the plurality of color regions. According to one aspect, the present embodiment can suggest appropriate paint colors even when an image is acquired in which a plurality of subjects with different colors are captured.

[0100] The paint color suggestion device 10 may generate a simulation image including the paint color based on the color information, and output the suggestion information including the simulation image. In one aspect, according to the present embodiment, a paint color can be suggested in a manner that is easy for a user to understand.

[0101] The paint color may include a metallic paint color. According to one aspect, the present embodiment can propose a metallic paint color according to a specific condition.

[0102] [Other embodiments] In the above embodiments, the configuration in which the paint color suggestion device 10 generates the CS image has been described, but the CS image may be generated using an external information processing device. For example, the paint color suggestion device 10 may output color information extracted from a reference image obtained based on condition information to the external information processing device. The external information processing device may generate a CS image based on the color information output from the paint color suggestion device 10 and transmit it to the paint color suggestion device 10. The paint color suggestion device 10 may include the CS image received from the external information processing device in the proposal information and transmit it to the terminal device 50.

[0103] In each of the above embodiments, the configuration of a paint color suggestion system that suggests a paint color when an industrial product such as an automobile is painted has been described, but each of the above embodiments can be applied to an information processing system that suggests various colors. For example, each of the above embodiments can be applied to suggesting a color of a film to be attached to the surface of an industrial product such as an automobile.

[0104] [supplement] Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a CPU (Central Processing Unit) or GPU (Graphics Processing Unit) implemented by an electronic circuit, and an ASIC (Application Specific Integrated Circuit), DSP (Digital Signal Processor), FPGA (Field Programmable Gate Array), conventional circuit module, and other devices designed to execute each function described above.

[0105] Although the embodiments of the present disclosure have been described in detail above, the embodiments disclosed herein are illustrative and not restrictive in all respects. The embodiments can be modified and improved in various forms without departing from the scope and spirit of the appended claims. The matters described in the above embodiments can be configured in other ways as long as they are not inconsistent, and can be combined as long as they are not inconsistent.

[0106] In addition, the disclosed technology may take the following additional features.

[0107] (Appendix 1) A paint color suggestion device that suggests a paint color, an image acquisition unit configured to acquire a reference image based on the condition information regarding the paint color; a color extraction unit configured to extract color information from the reference image; an output unit configured to output proposal information including the color information as the paint color; A paint color suggestion device comprising:

[0108] (Appendix 2) The image acquisition unit is configured to acquire the reference image based on an image search result using the condition information as a search condition and / or an image generation result using the condition information as a generation condition. 2. A coating color suggestion device as described in appendix 1.

[0109] (Appendix 3) The color extraction unit is configured to extract a plurality of pieces of color information for one of the reference images. 3. The coating color suggestion device according to claim 1 or 2.

[0110] (Appendix 4) a brightness splitter configured to split a brightness distribution of the reference image into a plurality of brightness regions; The color extraction unit is configured to extract the color information for each of the plurality of brightness regions. 4. A coating color suggestion device as described in appendix 3.

[0111] (Appendix 5) The plurality of color information includes a highlight color and a shade color. 5. The coating color suggestion device according to claim 3 or 4.

[0112] (Appendix 6) a color segmentation unit configured to segment the reference image into a plurality of color regions; The color extraction unit is configured to extract the color information for each of the plurality of color regions. 6. A coating color suggestion device according to any one of appendix 1 to 5.

[0113] (Appendix 7) an image generating unit configured to generate a simulation image including the paint color based on the color information, The output unit is configured to output the proposal information including the simulation image. 7. A coating color suggestion device according to any one of appendix 1 to 6.

[0114] (Appendix 8) The paint color includes a metallic paint color. 8. A coating color suggestion device according to any one of appendix 1 to 7.

[0115] (Appendix 9) A paint color suggestion device that suggests paint colors, obtaining a reference image based on the condition information regarding the paint color; extracting color information from the reference image; a step of outputting proposal information including the color information as the paint color; A paint color suggestion method that performs the above.

[0116] (Appendix 10) A paint color suggestion device that suggests paint colors. obtaining a reference image based on the condition information regarding the paint color; extracting color information from the reference image; a step of outputting proposal information including the color information as the paint color; A program for executing the above. [Explanation of symbols]

[0117] 10: Paint color suggestion device 20: Image providing device 50: Terminal device 110: Condition acquisition section 120: Image acquisition unit 125: Color division part 130: Brightness division part 140: Color extraction section 150: Image generation unit 160: Output section 1000: Paint color suggestion system

Claims

1. A paint color suggestion device that suggests a paint color, an image acquisition unit configured to acquire a reference image based on the condition information regarding the paint color; a color segmentation unit configured to segment the reference image into a plurality of color regions; a color extraction unit configured to extract color information from the reference image for each of the plurality of color regions; an output unit configured to output proposal information including the color information as the paint color; A paint color suggestion device comprising:

2. The image acquisition unit is configured to acquire the reference image based on an image search result using the condition information as a search condition and / or an image generation result using the condition information as a generation condition. The coating color suggestion device according to claim 1 .

3. The color extraction unit is configured to extract a plurality of pieces of color information for one of the reference images. The coating color suggestion device according to claim 1 .

4. a brightness splitter configured to split a brightness distribution of the reference image into a plurality of brightness regions; The color extraction unit is configured to extract the color information for each of the plurality of brightness regions. The coating color suggestion device according to claim 3.

5. The plurality of color information includes a highlight color and a shade color. The coating color suggestion device according to claim 3.

6. an image generating unit configured to generate a simulation image including the paint color based on the color information, The output unit is configured to output the proposal information including the simulation image. The coating color suggestion device according to any one of claims 1 to 5.

7. The paint color includes a metallic paint color. The coating color suggestion device according to any one of claims 1 to 5.

8. A paint color suggestion device that suggests paint colors, obtaining a reference image based on the condition information regarding the paint color; Segmenting the reference image into a plurality of color regions; extracting color information from the reference image for each of the plurality of color regions; a step of outputting proposal information including the color information as the paint color; A paint color suggestion method that performs the above.

9. A paint color suggestion device that suggests paint colors. obtaining a reference image based on the condition information regarding the paint color; Segmenting the reference image into a plurality of color regions; extracting color information from the reference image for each of the plurality of color regions; a step of outputting proposal information including the color information as the paint color; A program for executing.

Images