Image conversion device, image conversion method, character information conversion device, character information conversion method, and program

Abstract

To provide an image having such textile drawn by using writing instruments of prescribed colors.SOLUTION: An image conversion device includes a storage part for storing a plurality of designation colors, an acquisition part for acquiring an input image, a color number reduction part for calculating a plurality of representative colors on the basis of the color component value of each pixel constituting the input image, and generating a color number-reduced image by converting the color component value of each pixel into the color component value of any representative color among the plurality of representative colors, a color conversion part for generating a converted image by converting the color component value of each pixel of the color number-reduced image into the color component value of a designation color having the minimum color difference in a Lab color space among the plurality of designation colors, and an output part for outputting the converted image.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an image conversion device, an image conversion method, a character information conversion device, a character information conversion method, and a program. [Background technology]

[0002] Conventionally, some writing implements are offered in a wide variety of colors, more than dozens of colors. In stores selling such writing implements, customers are provided with the opportunity to try out different colors of writing implements so that they can check the color and shape of handwriting when writing with each color of writing implement. However, the colors of the writing implements that can be used and the objects that can be written on are usually limited in the test writing. Therefore, it has been difficult to adequately convey the impression of using a combination of multiple colors of writing implements to customers through test writing, and to motivate them to purchase the writing implement.

[0003] Patent Document 1 describes a device that generates an image in which the color used in the original image is converted into an approximate color among pre-specified designated colors, and displays the image. By using the device of Patent Document 1, the color of the original image can be converted into the designated color of the writing implement, so that it is possible to properly convey to the customer the impression when multiple writing implement colors are combined and used. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2012-142757 A Summary of the Invention [Problem to be solved by the invention]

[0005] By presenting an image that combines the colors of the writing implements, as well as presenting the image with a texture that looks like it was drawn using the writing implement, it is possible to more strongly motivate customers to purchase the writing implement.

[0006] The present invention has been made to solve the above-mentioned problems, and aims to provide an image conversion device, an image conversion method, a character information conversion device, a character information conversion method, and a program that are capable of presenting an image that looks as if it was drawn using a writing instrument of a specified color. [Means for solving the problem]

[0007] The image conversion device of the present invention is characterized by having a memory unit that stores a plurality of specified colors, an acquisition unit that acquires an input image, a color number reduction unit that calculates a plurality of representative colors based on the color component values ​​of each pixel that constitutes the input image and generates a reduced color number image by converting the color component value of each pixel to the color component value of any one of the plurality of representative colors, a color conversion unit that generates a converted image by converting the color component value of each pixel of the reduced color number image to the color component value of a specified color among the plurality of specified colors that has the smallest color difference in Lab color space, and an output unit that outputs the converted image.

[0008] In addition, in the image conversion device of the present invention, it is preferable that the color number reduction unit converts the color component values ​​of each pixel based on the color component values ​​of pixels that have a predetermined relationship with each pixel, and calculates a plurality of representative colors based on the converted color component values.

[0009] It is also preferable that the image conversion device according to the present invention further comprises an edge detection section which applies edge detection processing to the input image to generate a binary image, and the output section further outputs the binary image.

[0010] In the image conversion device according to the present invention, it is preferable that the output section outputs an image obtained by combining the converted image and the binary image.

[0011] In addition, in the image conversion device of the present invention, it is preferable that the memory unit further has a presentation unit that stores information regarding the writing implement corresponding to each designated color, extracts a predetermined number of designated colors from the multiple designated colors that have a large number of pixels showing the color component values ​​of the designated colors in the converted image, and presents information regarding the writing implement corresponding to the extracted designated colors.

[0012] The image conversion method according to the present invention is characterized in that it includes storing a plurality of specified colors, acquiring an input image, calculating a plurality of representative colors based on the color component values ​​of each pixel constituting the input image, generating an image with a reduced number of colors by converting the color component values ​​of each pixel to the color component values ​​of any one of the plurality of representative colors, generating a converted image by further converting the color component values ​​of each pixel of the reduced number of colors into the color component values ​​of the specified color having the smallest color difference in Lab color space among the plurality of specified colors, and outputting the converted image.

[0013] The program of the present invention is characterized in that it causes a computer having a memory unit that stores a plurality of specified colors to acquire an input image, calculate a plurality of representative colors based on the color component values ​​of each pixel that constitutes the input image, generate a reduced color number image by converting the color component value of each pixel to the color component value of any one of the plurality of representative colors, generate a converted image by further converting the color component value of each pixel of the reduced color number image to the color component value of a specified color among the plurality of specified colors that has the smallest color difference in Lab color space, and output the converted image.

[0014] The character information conversion device of the present invention is characterized by having a memory unit that stores a plurality of designated colors, an acquisition unit that acquires an input image and character information, a calculation unit that calculates a plurality of representative colors based on color component values ​​of each pixel that constitutes the input image, an identification unit that identifies, for each of the plurality of representative colors, a designated color among the plurality of designated colors that has the smallest color difference in Lab color space, and an output unit that outputs designated color character information for displaying character information using the identified designated color.

[0015] The character information conversion method according to the present invention is characterized in that it includes storing a plurality of designated colors, acquiring an input image and character information, calculating a plurality of representative colors based on color component values ​​of each pixel constituting the input image, identifying, for each of the plurality of representative colors, a designated color among the plurality of designated colors that has the smallest color difference in Lab color space, and outputting designated color character information for displaying the character information using the identified designated color.

[0016] The program according to the present invention is characterized in that it causes a computer having a memory unit that stores a plurality of designated colors to acquire an input image and character information, calculate a plurality of representative colors based on color component values ​​of each pixel that constitutes the input image, identify, for each of the plurality of representative colors, a designated color among the plurality of designated colors that has the smallest color difference in Lab color space, and output designated color character information for displaying character information using the identified designated color. Effect of the Invention

[0017] The image conversion device, image conversion method, character information conversion device, character information conversion method and program according to the present invention make it possible to present an image that looks as if it was drawn using a writing implement of a specified color. [Brief description of the drawings]

[0018] [Figure 1] FIG. 1 is a schematic diagram for explaining an overview of the present invention. [Diagram 2] 1 is a diagram illustrating an example of a schematic configuration of a conversion system 1. FIG. [Diagram 3] FIG. 2 is a diagram illustrating an example of a schematic configuration of a terminal device 2. [Figure 4] FIG. 2 is a diagram illustrating an example of a schematic configuration of a conversion device 3. [Diagram 5] 13 is a diagram showing an example of a data structure of a specified color table T1. FIG. [Figure 6] 13 is a diagram showing an example of the data structure of a representative color table T2. FIG. [Figure 7] FIG. 11 is a sequence diagram showing an example of the flow of a conversion process. [Figure 8] FIG. 11 is a flowchart showing an example of the flow of a color number reduction process. [Figure 9] FIG. 2 is a diagram showing an example of a conversion information display screen 100. [Figure 10] FIG. 2 is a diagram showing an example of a writing implement information display screen 200. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Hereinafter, various embodiments of the present invention will be described with reference to the drawings. It should be noted that the technical scope of the present invention is not limited to these embodiments, but covers the claims and their equivalents.

[0020] FIG. 1 is a schematic diagram for explaining an overview of the present invention. The conversion device according to the present invention is used to present a user with an image that looks like it was drawn using a writing implement that comes in a predetermined color variation, for example, to motivate the user to purchase the writing implement. The conversion device stores colors that correspond to the color variations of the writing implement as designated colors in advance. For example, if a writing implement comes in 40 color variations, the conversion device stores each of the 40 colors as a designated color.

[0021] The conversion device acquires an input image IP and input character information IT. The input image IP and input character information IT are, for example, image and character information constituting a diary of a certain day. The input image IP and input character information IT are acquired by receiving the input image IP and input character information IT from another device. The input image IP and input character information IT may be acquired by capturing an image of a diary that includes an image and character information and is created in a predetermined format to generate a captured image, and applying known optical character recognition technology, image recognition technology, and the like to the captured image.

[0022] The conversion device calculates a plurality of representative colors based on the color component values ​​of each pixel constituting the acquired input image IP. The plurality of representative colors are determined based on the color component values ​​of each pixel, and the number of representative colors is determined in advance (for example, 60 colors). The representative color is a color that represents the plurality of colors used in the input image IP. For example, when the colors used in the input image IP are classified into a plurality of groups using a known clustering technique or the like, the representative color is calculated as a color that is an average of the colors belonging to each group. The conversion device generates a color-reduced image DP by converting the color component value of each pixel into the color component value of any one of the plurality of representative colors.

[0023] The conversion device specifies, for each of the representative colors, a designated color among the designated colors that has the smallest color difference from the representative color in the Lab color space. The conversion device generates a converted image CP by converting a color component value of each pixel of the reduced-color image DP, which is one of the representative colors, into a color component value of the designated color specified for that representative color.

[0024] The conversion device also generates designated color character information CT, which is display data for displaying the input character information IT in a designated color specified for any of the representative colors. The conversion device outputs a converted image CP and the designated color character information CT.

[0025] The converted image CP and the specified color character information CT are output, for example, as a diary image N including them. In the example shown in Fig. 1, the converted image CP included in the output diary image N is an image in which the color component values ​​of each pixel constituting the input image IP are converted into color component values ​​of one of a plurality of specified colors. Also, the specified color character information CT included in the diary image N is character information in which each character included in the input character information IT is written differently using the specified color included in the converted image CP.

[0026] In this way, the conversion device converts the color component values ​​of each pixel of the input image IP to generate a reduced-color image DP, and converts the color component values ​​of each pixel of the reduced-color image DP to a specified color with the smallest color difference among multiple specified colors to generate and output a converted image CP. This makes it possible for the image conversion device to present an image that combines predetermined colors and has the appearance of being drawn with a writing instrument of that color.

[0027] That is, the converted image CP is composed only of designated colors corresponding to the color variations of a predetermined writing implement. Also, since the converted image CP is generated based on the color-reduced image DP composed of a predetermined number of colors, it becomes an image with a so-called illustration touch in which fine shading is eliminated. Therefore, the converted image CP can give the user the impression that it was drawn using a predetermined writing implement.

[0028] The conversion device also outputs specified color character information CT for displaying character information in a specified color constituting the converted image CP, thereby making it possible for the conversion device to present character information that looks as if it was written with a writing implement of a specified color.

[0029] The above description is merely intended to provide a deeper understanding of the present invention, which is realized by the following embodiments and modifications.

[0030] Fig. 2 is a diagram showing an example of a schematic configuration of a conversion system 1 according to the present invention. The conversion system 1 has a user terminal 2 and a conversion device 3. The user terminal 2 is an information processing terminal such as a mobile phone, a multi-function mobile phone (smartphone) or a PC (Personal Computer) used by a user. The conversion device 3 is an information processing device such as a PC or a server. The user terminal 2 and the conversion device 3 are connected to each other so as to be able to communicate with each other via a network 4 such as the Internet or an intranet.

[0031] 3 is a diagram showing an example of a schematic configuration of the user terminal 2. The user terminal 2 includes a terminal storage unit 21, a terminal communication unit 22, a display unit 23, an operation unit 24, an imaging unit 25, and a device processing unit .

[0032] The device storage unit 21 is configured to store data and programs, and includes, for example, a semiconductor memory. The device storage unit 21 stores an operating system program, a driver program, an application program, data, etc., used in processing by the device processing unit 26.

[0033] The terminal communication unit 22 is configured to enable the user terminal 2 to communicate with the conversion device 3, and includes a communication interface circuit. The communication interface circuit included in the terminal communication unit 22 is a communication interface circuit for a wired LAN (Local Area Network), a wireless LAN, LTE (Long Term Evolution), or the like. The terminal communication unit 22 supplies data received from the conversion device 3 to the terminal processing unit 26, and transmits data supplied from the device processing unit 26 to the conversion device 3.

[0034] The display unit 23 is a component for displaying an image, and includes, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display. The display unit 23 displays an image based on display data supplied from the device processing unit 26.

[0035] The operation unit 24 is configured to receive input operations by the user to the user terminal 2, and includes, for example, a keypad, a keyboard, and a mouse. The operation unit 24 may include a touch panel integrated with the display unit 23. The operation unit 24 generates a signal according to the input operation by the user and supplies the signal to the device processing unit 26.

[0036] The imaging unit 25 is a component for generating an image by capturing an image, and includes, for example, a camera. The imaging unit 25 generates an image signal corresponding to a subject image formed by converging light rays from the subject using optical components such as a lens, converts the image signal into image data in a predetermined format, and supplies the image signal to the device processing unit 26.

[0037] The device processing unit 26 is configured to comprehensively control the operation of the user terminal 2, and includes one or more processors and their peripheral circuits. The device processing unit 26 includes, for example, a CPU (Central Processing Unit), an LSI (Large Scale Integration), or an ASIC (Application Specific Integrated Circuit). The device processing unit 26 may include a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), or the like. Based on the programs stored in the terminal storage unit 21, the device processing unit 26 controls the operation of each component of the user terminal 2 so that various processes of the user terminal 2 are appropriately executed, and executes various processes.

[0038] The device processing unit 26 includes, as functional blocks, a generation unit 261, a conversion information display unit 262, and a writing implement information display unit 263. Each of these units is a functional module realized based on a program executed by the device processing unit 26. Each of these units may be implemented in the user terminal 2 as firmware.

[0039] 4 is a diagram showing an example of a schematic configuration of the conversion device 3. The conversion device 3 includes a storage unit 31, a communication unit 32, and a processing unit 33.

[0040] The storage unit 31 is configured to store data and programs, and includes, for example, a semiconductor memory. The storage unit 31 stores an operating system program, a driver program, an application program, data, and the like, which are used in processing by the processing unit 33. These programs are installed in the storage unit 31 from a computer-readable, non-transitory storage medium, such as a CD (Compact Disc)-ROM (Read Only Memory), using a known setup program.

[0041] The communication unit 32 is configured to enable the conversion device 3 to communicate with the user terminal 2, and includes a communication interface circuit. The communication interface circuit included in the communication unit 32 is a communication interface circuit for a wired LAN, a wireless LAN, or the like. The communication unit 32 supplies data received from the user terminal 2 to the processing unit 33, and transmits data supplied from the processing unit 33 to the user terminal 2.

[0042] The processing unit 33 is configured to comprehensively control the operation of the conversion device 3, and includes one or more processors and their peripheral circuits. The processing unit 33 includes, for example, a CPU, an LSI, or an ASIC. The processing unit 33 may include a GPU, a DSP, an FPGA, or the like. Based on the programs stored in the storage unit 31, the processing unit 33 controls the operation of each component of the conversion device 3 so that various processes of the conversion device 3 are appropriately executed, and executes various processes.

[0043] The processing unit 33 has an acquisition unit 331, a number of colors reduction unit 332, a color conversion unit 333, an edge detection unit 334, a character information generation unit 335, an output unit 336, and a presentation unit 337. Each of these units is a functional module realized by a program executed by the processing unit 33. Each of these units may be implemented in the conversion device 3 as firmware.

[0044] 5 is a diagram showing an example of the data structure of a designated color table T1 that manages information about a plurality of designated colors and is stored in the storage unit 31. The designated color table T1 stores a designated color ID, a color component value, and writing implement information in association with each other.

[0045] The designated color ID is identification information for uniquely identifying each of the multiple designated colors. The color component value is information indicating the color component value corresponding to each designated color in a predetermined color space. The predetermined color space is hereinafter assumed to be the RGB color space, but may be any color space such as the CMY color space. The writing implement information is information regarding a writing implement that corresponds to the designated color among predetermined writing implements. The writing implement information includes, for example, the name of the color of the writing implement and an image of the writing implement.

[0046] The various data in the designated color table T1 are set in advance by an administrator of the conversion device 3 for each color variation of a given writing implement.

[0047] 6 is a diagram showing an example of the data structure of a representative color table T2 that manages information about a plurality of representative colors and is stored in the storage unit 31. The representative color table T2 stores representative color IDs, color component values, pixels, and corresponding designated colors in association with one another.

[0048] The representative color ID is information for uniquely identifying each of a plurality of representative colors determined based on the color component values ​​of each pixel constituting the input image. The color component value is information indicating a color component value corresponding to each representative color in a predetermined color space. The pixel is information for identifying a pixel associated with each representative color among the pixels constituting the input image. As described later, the color component value of each pixel constituting the input image is converted to the color component value of the associated representative color. As a result, a plurality of pixels have a color component value of a single representative color, and a color-number-reduced image including fewer colors than the input image is generated. The information for identifying the pixel is, for example, two-dimensional coordinates indicating the position of each pixel in the input image. The corresponding designated color is the designated color ID of the designated color that has the smallest color difference in the Lab color space with each representative color among the plurality of designated colors.

[0049] The data in the representative color table T2 is set in a conversion process which will be described later.

[0050] 7 is a sequence diagram showing an example of the flow of the conversion process executed by the conversion system 1. The conversion process is realized by the processing units of the respective devices cooperating with the hardware configurations of the respective devices based on a program.

[0051] First, the generation unit 261 of the user terminal 2 generates an input image and input character information (S101). For example, the generation unit 261 generates an input image by controlling the imaging unit 25 in response to a user's operation on the operation unit 24 to capture an image of an object. The generation unit 261 also acquires input character information by accepting a user's character input operation on the operation unit 24. The input image and input character information may be stored in the terminal storage unit 21 in advance, or may be generated by capturing an image of a diary created in a predetermined format. The generation unit 261 transmits the input character information and the input image to the conversion device 3 via the terminal communication unit 22.

[0052] Next, the acquisition unit 331 of the conversion device 3 acquires the input image and input character information by receiving them from the user terminal 2 via the communication unit 32 (S102).

[0053] Next, the color number reduction unit 332 executes a color number reduction process (S103). The color number reduction process is a process that calculates a plurality of representative colors based on the color component values ​​of each pixel constituting the input image, and converts the color component value of each pixel into the color component value of one of the plurality of representative colors to generate a color number reduced image.

[0054] 8 is a flow diagram showing an example of the flow of the color number reduction process. First, the color number reduction unit 332 converts the color component values ​​of each pixel constituting the input image based on the color component values ​​of pixels that have a predetermined relationship with each pixel, to generate a smoothed image (S201). The conversion of the color component values ​​is performed, for example, by a mean-shift filter described below.

[0055] First, the color number reduction unit 332 selects a processing target pixel pi from among the pixels constituting the input image. The color number reduction unit 332 sets variables (X, Y) to the coordinates (xi, yi) of the processing target pixel pi, and variables (R, G, B) to the color component values ​​(ri, gi, bi) of the processing target pixel pi in the RGB space. The color number reduction unit 332 generates a set {pj} of pixels pj that have a predetermined relationship with the processing target pixel pi among the pixels constituting the input image. The pixel pj that has a predetermined relationship with the processing target pixel pi is a pixel that satisfies each of the following expressions.

number

[0056] Next, the color number reduction unit 332 calculates the average value (x', y') of the coordinates of the pixels included in the set {pj} and the average value (r', g', b') of the color component values ​​of the pixels included in the set {pj}. The average value is, for example, an arithmetic mean, but is not limited to this and a geometric mean or the like may be used. The color number reduction unit 332 determines whether or not a termination condition is satisfied by comparing the coordinates and color component values ​​of the processing target pixel pi with the calculated pixel average value and average color component value average value. The termination condition is that the variables (X, Y) and (R, G, B) are close to the calculated average value, and for example, that either of the following two formulas is satisfied.

number

number

[0057] If it is determined that the termination condition is satisfied, the color number reduction unit 332 converts the color component values ​​(ri, gi, bi) of the processing target pixel pi into the average values ​​(r', g', b') of the calculated color component values. If it is determined that the termination condition is not satisfied, the color number reduction unit 332 resets the variables (X, Y) and (R, G, B) to (x', y') and (r', g', b'), respectively, and regenerates the set {pj} based on the reset variables. The color number reduction unit 332 repeats the above process until the termination condition is satisfied.

[0058] By selecting each pixel constituting the input image as a processing target pixel pi and performing the above-mentioned processing for each pixel, the color number reduction unit 332 converts the color component values ​​of each pixel constituting the input image and generates a smoothed image.

[0059] Next, the color number reduction unit 332 calculates a plurality of representative colors based on the color component values ​​of the smoothed image (S202). The color number reduction unit 332 classifies each pixel constituting the smoothed image into one of a plurality of clusters based on the color component values ​​of the pixels. The classification is performed, for example, by the k-means method described below.

[0060] First, the color number reduction unit 332 randomly classifies each pixel constituting the smoothed image into a predetermined number of clusters (for example, 60). For each cluster, the color number reduction unit 332 calculates the average value of the color component values ​​of the pixels belonging to that cluster. The color number reduction unit 332 calculates the color distance d between each pixel constituting the smoothed image and the calculated average value of the color component values ​​of the pixels belonging to each cluster using the following formula.

number

[0061] The color number reduction unit 332 reclassifies each pixel constituting the smoothed image into a cluster having the smallest calculated color distance d among a predetermined number of clusters. The color number reduction unit 332 compares the clusters before and after reclassification to determine whether or not a termination condition is satisfied. The termination condition is, for example, that the number of pixels that have changed clusters before and after reclassification is equal to or less than a predetermined number.

[0062] If it is determined that the termination condition is not satisfied, the color number reduction unit 332 calculates the average value of the color component values ​​of the pixels that belong to the reclassified cluster, and repeats the above-mentioned process.

[0063] If it is determined that the termination condition is satisfied, the color number reduction unit 332 calculates the average value of the color component values ​​of the pixels belonging to each cluster after reclassification, and sets the color corresponding to the calculated color component value as the representative color. The color number reduction unit 332 associates the representative color corresponding to each cluster with the coordinates of the pixels belonging to each cluster, and stores them in the representative color table T2.

[0064] Next, the color number reduction unit 332 converts the color component values ​​of each pixel constituting the smoothed image into the color component values ​​of one of the representative colors, thereby generating a color number reduced image (S203). The color number reduction unit 332 converts the color component values ​​of each pixel into the color component values ​​of the representative color associated with each pixel in the representative color table T2.

[0065] Returning to Fig. 7, the color conversion unit 333 generates a converted image by converting the color component values ​​of each pixel of the color-number reduced image into color component values ​​of a designated color having the smallest color difference in Lab color space among the multiple designated colors (S104). The color conversion unit 333 converts the color component values ​​in the RGB space of the multiple representative colors stored in the representative color table T2 into color component values ​​in the Lab color space (for example, the CIE1976 (L*, a*, b*) color space) using a known conversion formula. The color conversion unit 333 also converts the color component values ​​in the RGB space of the multiple designated colors stored in the designated color table T1 into color component values ​​in the Lab color space.

[0066] The color conversion unit 333 calculates the color difference between each representative color and each designated color. For example, a calculation formula defined by CIEDE2000 is used to calculate the color difference. The CIE1976 color difference calculation formula (i.e., Euclidean distance in the CIE1976 color space) or the CIE1994 color difference calculation formula may be used to calculate the color difference. The color conversion unit 333 identifies a designated color with the smallest calculated color difference among the multiple designated colors for each representative color, and stores the designated color in the representative color table T2 as the corresponding designated color. The color conversion unit 333 generates a converted image by converting the color component values ​​of each pixel constituting the smoothed image into the color component values ​​of the corresponding designated color associated in the representative color table T2.

[0067] Next, the edge detection unit 334 applies edge detection processing to the input image to generate a binary image (S105). The edge detection processing is, for example, the Canny edge detection method, but is not limited to this and any method may be used. The edge detection unit 334 generates a binary image in which the pixel value of the edge pixel in the input image detected by the edge detection processing is 1, and the pixel value of the other pixels is 0.

[0068] Next, the character information generating unit 335 generates designated color character information (S106). The character information generating unit 335 extracts a designated color stored as a corresponding designated color in the representative color table T2 from among the multiple designated colors. The character information generating unit 335 also applies a known morphological analysis process to the input character information to divide the input character information into words. The character information generating unit 335 generates designated color character information, which is display data for displaying each word in characters of one of the extracted designated colors.

[0069] In the designated color character information, it is preferable that adjacent words are displayed in different designated colors. The character information generating unit 335 may divide the input character information into phrases. In this case, the character information generating unit 335 identifies the part of speech of each word, and divides the input character information into phrases by combining specific parts of speech (e.g., nouns and particles, etc.), and generates designated color character information, which is display data for displaying each phrase in characters of one of the extracted designated colors. The character information generating unit 335 may divide the input character information into sentences or paragraphs to generate designated color character information.

[0070] Next, the output unit 336 outputs the converted image, the binary image, and the specified color character information by transmitting them to the user terminal 2 via the communication unit 32 (S107).

[0071] Next, the conversion information display unit 262 of the user terminal 2 displays the converted image, the binary image, and the specified color character information (S108). The conversion information display unit 262 displays a conversion information display screen including the converted image, the binary image, and the specified color character information on the display unit 23.

[0072] 9 is a diagram showing an example of the conversion information display screen 100. The conversion information display screen 100 includes an image 110 and text 120. The image 110 is an image obtained by combining a converted image and a binary image. In other words, the image 110 is an image in which the color component values ​​of pixels (i.e., edge pixels) that have a pixel value of 1 in the binary image, among the pixels constituting the converted image, are converted into values ​​corresponding to a predetermined color (e.g., black). This enhances contours in the image 110. Furthermore, the text 120 is displayed for each word in characters of any one of the designated colors included in the image 110.

[0073] Returning to Fig. 7, the presentation unit 337 of the conversion device 3 extracts a predetermined number of designated colors that have a large number of pixels showing color component values ​​in the converted image from among the multiple designated colors, and presents information about the writing implements corresponding to the extracted designated colors (S109). The presentation unit 337 refers to the representative color table T2 and counts the number of pixels associated with each corresponding designated color. The presentation unit 337 extracts a predetermined number of designated colors (e.g., 10 colors) in descending order of the number of counted pixels.

[0074] The presentation unit 337 acquires the writing implement information of the extracted designated color from the designated color table T1. The presentation unit 337 generates display data for the writing implement information display screen including the acquired writing implement information. The presentation unit 337 transmits the display data for the writing implement information display screen to the user terminal 2 via the communication unit 32.

[0075] Next, the writing implement information display unit 263 of the user terminal 2 displays information related to the writing implement (S110). The writing implement information display unit 263 displays a writing implement information display screen based on the received display data.

[0076] FIG. 10 is a diagram showing an example of a writing implement information display screen 200. The writing implement information display screen 200 includes a designated color display area 210 and a writing implement information display area 220. In the designated color display area 210, a plurality of circles filled with a designated color included in the converted image are displayed. The more pixels in the converted image that have the color component value of the corresponding designated color, the larger the area of ​​each circle is displayed. In the writing implement information display area 220, images 221 and names 222 of writing implements corresponding to a predetermined number of extracted designated colors are displayed. The images 221 and names 222 of writing implements are generated based on writing implement information corresponding to the extracted designated colors stored in a designated color table T1. In the example shown in FIG. 10, a plurality of writing implements are presented as an assortment (combination) recommended to the user.

[0077] As described above, the conversion device 3 generates a color-number-reduced image by converting the color component values ​​of each pixel constituting the input image to one of a plurality of representative colors. The conversion device 3 also generates a converted image by further converting the color component values ​​of each pixel of the color-number-reduced image to the color component value of a designated color among a plurality of designated colors that has the smallest color difference in the Lab color space. This makes it possible for the conversion device 3 to present an image that looks as if it was drawn with a writing implement of a specified color.

[0078] Moreover, the conversion device 3 converts the color component values ​​of each pixel based on the color component values ​​of pixels that have a predetermined relationship with each pixel, and calculates a plurality of representative colors based on the converted color component values. This allows the color component values ​​of each pixel to be smoothed based on the positional relationship of the pixels and the relationship between the color component values, making it possible for the conversion device 3 to present an image with a natural feel.

[0079] That is, by smoothing the color component values ​​of each pixel in advance based on the positional relationship and color component value relationship of each pixel, the color component values ​​of pixels that are close in position and have similar color component values ​​are converted to the same color component value, thereby eliminating or weakening shading in the image. As a result, in the input image, areas corresponding to objects of a single color are displayed with the same representative color in the color-reduced image, presenting an image with a natural feel.

[0080] In addition, the conversion device 3 applies edge detection processing to the input image to generate a binary image, and outputs an image obtained by combining the converted image with the binary image. This emphasizes the contour lines of the output image, enabling the conversion device 3 to present an image with a more illustrative feel.

[0081] Furthermore, the conversion device 3 extracts a predetermined number of designated colors that have a large number of pixels showing color component values ​​of the designated colors in the converted image from among the multiple designated colors, and presents information about writing implements corresponding to the extracted designated colors. In this way, the conversion device 3 further presents the user with information about writing implements suitable for drawing the presented image, making it possible to motivate the user to purchase the writing implements.

[0082] The conversion device 3 also calculates a plurality of representative colors based on the color component values ​​of each pixel constituting the input image, and specifies, for each of the plurality of representative colors, a designated color having the smallest color difference in the Lab color space among the plurality of designated colors. The conversion device 3 also outputs designated color character information for displaying character information in the specified designated color. This makes it possible for the conversion device 3 to present character information that looks as if it was written with a writing implement of a specified color.

[0083] In the above description, the conversion device 3 outputs both the converted image and the specified color character information, but it may output only one of them. When only the converted image is output, the user terminal 2 and the conversion device 3 do not need to generate and acquire input character information in S101 and S102 of the conversion process, respectively. Furthermore, the conversion device 3 does not need to execute S106 of the conversion process. When only the specified color character information is output, it is sufficient for the conversion system 1 to identify the specified color in S104, and it is not necessary to generate a converted image. Furthermore, the conversion device 3 does not need to execute S106 of the conversion process and S203 of the color number reduction process.

[0084] The conversion device 3 may not generate a binary image. In this case, the conversion device 3 may not execute S105 of the conversion process. The conversion device 3 may generate a binary image before generating the color-reduced image or the converted image.

[0085] The conversion device 3 may output the binary image and the converted image separately, without synthesizing them. This allows the conversion device 3 to enable the user to use the binary image as a line drawing for coloring. That is, the user can print the output binary image and enjoy coloring while referring to the converted image. At this time, since the converted image is composed only of the color of a predetermined writing implement, the user can color the image using the predetermined writing implement, which motivates the user to purchase the writing implement.

[0086] In the above description, the conversion device 3 generates a smoothed image using a Mean-Shift filter in S201 of the color number reduction process, but is not limited to this example. For example, the conversion device 3 may generate a smoothed image using other filters such as a bilateral filter or a Gaussian filter. The conversion device 3 may also use a box filter or a median filter. The conversion device 3 may also generate a color number reduced image directly from the input image by converting the color component values ​​of each pixel constituting the input image, without generating a smoothed image in the color number reduction process.

[0087] In the above description, information on one writing implement is associated with each designated color, but this is not limited to the example. A plurality of types of writing implements (e.g., ballpoint pens and markers) may be associated with each designated color. In this case, in S109, the conversion device 3 presents a plurality of types of writing implements corresponding to the extracted designated colors. This presents an image with a texture that looks like it was drawn with a marker and characters that look like they were written with a ballpoint pen. Therefore, the conversion device 3 can motivate the user to purchase a plurality of types of writing implements.

[0088] In the above description, the conversion system 1 includes the user terminal 2 and the conversion device 3, but is not limited to this example. Some or all of the functions of the conversion device 3 may be realized by the user terminal 2. In addition, the functions of the user terminal 2 or the conversion device 3 may be realized by multiple devices.

[0089] It should be understood by those skilled in the art that various changes, substitutions, and modifications can be made to the present invention without departing from the spirit and scope of the present invention. For example, the processes of the above-described parts may be executed in different orders as appropriate within the scope of the present invention. Furthermore, the above-described embodiments and modifications may be combined as appropriate within the scope of the present invention. [Explanation of symbols]

[0090] 3. Conversion Device 31 Storage section 32 Communications Department 331 Acquisition Department 332 Color Reduction Section 333 Color conversion unit 334 Edge detection unit 335 Character information generation section 336 Output section 337 Presentation section

Claims

1. A storage unit that stores a plurality of designated colors; An acquisition unit for acquiring an input image; a color number reduction unit that converts color component values ​​of each pixel constituting the input image based on color component values ​​of a pixel that is located near a processing target pixel selected from among the pixels and has a color component value similar to that of the processing target pixel, calculates a plurality of representative colors based on the converted color component values, and generates a color number reduced image by converting the color component value of each pixel into the color component value of any one of the plurality of representative colors; a color conversion unit that generates a converted image by converting a color component value of each pixel of the reduced color image into a color component value of a designated color having a smallest color difference in Lab color space among the plurality of designated colors; an output unit that outputs the converted image; having The storage unit stores information about a writing instrument corresponding to each designated color, and a presentation unit that extracts a predetermined number of designated colors from the plurality of designated colors, the designated colors having a large number of pixels that show color component values ​​of the designated colors in the converted image, and presents information about writing implements that correspond to the extracted designated colors.

2. an edge detection unit that applies edge detection processing to the input image to generate a binary image; The output unit further outputs the binary image.

2. The image conversion device according to claim 1.

3. The output unit outputs an image obtained by combining the converted image and the binary image.

3. The image conversion device according to claim 2.

4. A memory unit stores a plurality of designated colors; An input image is acquired by an acquisition unit; a color number reduction unit converts color component values ​​of each pixel constituting the input image based on color component values ​​of a pixel located in the vicinity of a processing target pixel selected from among the pixels and having a color component value similar to that of the processing target pixel, calculates a plurality of representative colors based on the converted color component values, and generates a color number reduced image by converting the color component value of each pixel into the color component value of any one of the plurality of representative colors; a color conversion unit converts a color component value of each pixel of the reduced color image into a color component value of a designated color having the smallest color difference in Lab color space among the plurality of designated colors, thereby generating a converted image; An output unit outputs the converted image; The storage unit stores information about a writing instrument corresponding to each designated color; a presentation unit extracts a predetermined number of designated colors having a large number of pixels showing color component values ​​of the designated colors in the converted image from the plurality of designated colors, and presents information about the writing implements corresponding to the extracted designated colors.

13. An image conversion method comprising:

5. A computer having a storage unit for storing a plurality of designated colors, Take an input image, converting color component values ​​of each pixel constituting the input image based on color component values ​​of a pixel located in the vicinity of a processing target pixel selected from among the pixels and having a color component value similar to that of the processing target pixel, calculating a plurality of representative colors based on the converted color component values, and generating an image with a reduced number of colors by converting the color component value of each pixel into the color component value of any one of the plurality of representative colors; generating a converted image by converting a color component value of each pixel of the reduced color image into a color component value of a designated color having a smallest color difference in Lab color space among the plurality of designated colors; Outputting the transformed image; storing information regarding a writing implement corresponding to each designated color; extracting a predetermined number of designated colors from the plurality of designated colors, the designated colors having a large number of pixels that indicate color component values ​​of the designated colors in the converted image, and presenting information about writing implements that correspond to the extracted designated colors; A program characterized by causing a user to execute the following:

6. A storage unit that stores a plurality of designated colors; An acquisition unit that acquires an input image and character information; a calculation unit that converts color component values ​​of each pixel constituting the input image based on color component values ​​of a pixel that is located near a processing target pixel selected from among the pixels and has a color component value similar to that of the processing target pixel, and calculates a plurality of representative colors based on the converted color component values; a specification unit that generates a converted image by specifying a designated color having the smallest color difference in Lab color space among the designated colors for each of the representative colors; an output unit that outputs designated color character information for displaying the character information in the specified designated color; having The storage unit stores information about a writing instrument corresponding to each designated color, a presentation unit that extracts a predetermined number of designated colors from the plurality of designated colors, the designated colors having a large number of pixels showing color component values ​​of the designated colors in the converted image, and presents information about a writing instrument corresponding to the extracted designated colors.

7. A memory unit stores a plurality of designated colors; The acquisition unit acquires input image and character information; a calculation unit converts color component values ​​of each pixel constituting the input image based on color component values ​​of a pixel located in the vicinity of a processing target pixel selected from among the pixels and having a color component value similar to that of the processing target pixel, and calculates a plurality of representative colors based on the converted color component values; a specifying unit for specifying a designated color having a smallest color difference in a Lab color space among the designated colors for each of the representative colors, thereby generating a converted image; outputting, by an output unit, designated color character information for displaying the character information in the specified designated color; The storage unit stores information about a writing instrument corresponding to each designated color, a presentation unit extracts a predetermined number of designated colors having a large number of pixels showing color component values ​​of the designated colors in the converted image from the plurality of designated colors, and presents information about the writing implements corresponding to the extracted designated colors. A character information conversion method comprising the steps of:

8. A computer having a storage unit for storing a plurality of designated colors, Acquire input image and text information; converting color component values ​​of each pixel constituting the input image based on color component values ​​of a pixel located in the vicinity of a processing target pixel selected from among the pixels and having a color component value similar to that of the processing target pixel, and calculating a plurality of representative colors based on the converted color component values; generating a converted image by identifying a designated color having the smallest color difference in Lab color space among the designated colors for each of the representative colors; outputting designated color character information for displaying the character information in the specified designated color; storing information regarding a writing implement corresponding to each designated color; extracting a predetermined number of designated colors from the plurality of designated colors, the designated colors having a large number of pixels that indicate color component values ​​of the designated colors in the converted image, and presenting information about writing implements that correspond to the extracted designated colors; A program characterized by causing a user to execute the following:

Images