Color estimation device, color estimation method and storage medium

Abstract

When estimating the color of the region of the candidate for identification having a smaller size than the Bayer color filter, the server estimates the color of the region of the candidate for identification using the average value of the hue H, saturation S, and lightness V of the region of the candidate for identification, i.e., the HSV average value, in consideration of the Bayer arrangement of the color filter. Furthermore, the server appropriately corrects the HSV average value, and converts the HSV average value into RGB (RGB average value) by performing pixel format conversion, and sets the RGB average value to all pixels of the region of identification.

Description

Technical Field

[0001] The present invention relates to a color estimation device, a color estimation method, and a program. Background Art

[0002] Consider a technology in which a marker modulates information with brightness and color in the visible light band and emits light to transmit information. In addition, there is also a technology in which the image sensor of a camera receives the modulated visible light and establishes a correspondence between the light receiving position in the image sensor and the demodulated information (for example, refer to Patent Document 1).

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2016-139998 Summary of the invention

[0006] Problems to be solved by the invention

[0007] However, the distance between the logo and the camera is long. As a result, if the light-receiving surface in the imaging element captures the image of the light emitted by the logo at a size below a given size, the color of the light image (luminous color) will be strongly affected by a certain color (color) of the red, green, and blue (RGB) arrangement of the color filter, resulting in the problem that the luminous color can no longer be correctly recognized.

[0008] The present invention has been made in view of such a problem, and an object of the present invention is to accurately estimate the color of an image of a size in which it is difficult to determine the color.

[0009] Means for solving problems

[0010] In order to achieve the above-mentioned purpose, the color estimation device involved in the present invention comprises: a light receiving unit, which is arranged with a plurality of light receiving elements for determining the color to which the light received from the position where the light is received belongs; and an estimation unit, which estimates the color to which the light belongs based on the brightness of the received light when the position of the light receiving element where the light is received is other than the position at which the color to which the received light belongs can be determined.

[0011] In order to achieve the above-mentioned purpose, the color estimation method involved in the present invention includes: a light receiving step, in which light is received by determining a plurality of arranged light receiving elements of a color to which the light received from the position where the light is received belongs; and an estimation step, in which, when the position of the light receiving element receiving the light in the light receiving step is outside the position at which the color to which the received light belongs can be determined, the color to which the received light belongs is estimated based on the brightness of the received light.

[0012] In order to achieve the above-mentioned purpose, the program involved in the present invention enables a computer to function as the following units: a light receiving unit, which is arranged with a plurality of light receiving elements for determining the color to which the light received from the position where the light is received belongs; and an estimation unit, which estimates the color to which the light belongs based on the brightness of the received light when the position of the light receiving element where the light is received is other than the position at which the color to which the received light belongs can be determined.

[0013] Effects of the Invention

[0014] According to the present invention, it is possible to accurately estimate the color of an image of a size in which it is difficult to determine the color. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 This is a diagram showing an example of a visible light communication system involved in an embodiment of the present invention.

[0016] Figure 2 This is a diagram showing an example of the structure of a mobile device involved in this embodiment.

[0017] Figure 3 This is a diagram showing an example of the configuration of a server according to this embodiment.

[0018] Figure 4 It is a diagram showing an example of the Bayer array of the color filter according to this embodiment.

[0019] Figure 5 (a) is a diagram showing an example in which the red marked area involved in the embodiment is included in the red filter, (b) is a diagram showing an example in which the red marked area involved in the embodiment overlaps with the green filter and the blue filter, and (c) is a diagram showing another example in which the red marked area involved in the embodiment overlaps with the green filter and the blue filter.

[0020] Figure 6 (a) is a diagram showing an example of a color circle according to the embodiment, and (b) is a diagram showing an example of a color plane according to the embodiment.

[0021] Figure 7 This is a flowchart showing an example of the color estimation operation of the server involved in this embodiment.

[0022] Figure 8 This is a flowchart showing an example of a detailed first operation of color estimation of the server involved in this embodiment.

[0023] Fig. 9 This is a flowchart showing an example of a detailed second operation of color estimation of the server involved in this embodiment.

[0024] Fig.10 This is a flowchart showing an example of a detailed third operation of color estimation of the server involved in this embodiment.

[0025] Fig.11 This is a flowchart showing an example of a detailed fourth operation of color estimation of the server involved in this embodiment. DETAILED DESCRIPTION

[0026] A visible light communication system as an information processing system according to an embodiment of the present invention will be described below with reference to the drawings.

[0027] Figure 1 is a diagram showing the structure of a visible light communication system. Figure 1 As shown, the visible light communication system 1 includes a server 200, mobile devices 100a, 100b, 100c and the server 200. In the following, when the mobile devices 100a, 100b, 100c are not limited, it is appropriate to refer to the "mobile device 100". The mobile device 100a includes an LED (Light Emitting Diode) 102a as an identifier, the mobile device 100b includes an LED 102b, and the mobile device 100c includes an LED 102c. In the following, when the LEDs 102a, 102b, 102c are not limited, it is appropriate to refer to "LED 102". The server 200 includes a shooting unit 201.

[0028] In this embodiment, the LED 102 in the mobile device 100 transmits information by emitting light corresponding to the ID (Identification) of the mobile device 100 as the information to be transmitted. On the other hand, in the server 200, the camera unit 201 in the server 200 takes a picture and obtains the ID of the mobile device 100 from the image of the light obtained by the photographing.

[0029] Figure 2 FIG. 1 is a diagram showing an example of the structure of the mobile device 100. Figure 2 As shown, the mobile device 100 includes an LED 102 , a control unit 103 , a memory 104 , a communication unit 108 , a drive unit 112 , and a battery 150 .

[0030] The control unit 103 is constituted by, for example, a CPU (Central Processing Unit) and controls various functions of the mobile device 100 by executing software processing according to a program stored in the memory 104 .

[0031] The memory 104 is, for example, a RAM (Random Access Memory) or a ROM (Read Only Memory). The memory 104 stores various information (programs, etc.) used for control, etc. in the mobile device 100. The communication unit 108 is, for example, a LAN (Local Area Network) card. The communication unit 108 communicates with other communication devices. The battery 150 supplies power required for the operation of the mobile device 100 to each unit.

[0032] The control unit 103 functionally includes a light emission control unit 124. The light emission control unit 124 determines a light emission pattern for emitting a predetermined light including arbitrary information modulated into a temporal change in the hue emitted by the LED 102, in accordance with the ID of the mobile device 100 or the like.

[0033] Furthermore, the light control unit 124 outputs information of the light pattern corresponding to the ID, etc. to the driving unit 112. The driving unit 112 generates a driving signal for changing the hue and brightness of the light emitted by the LED 102 over time in accordance with the information of the light pattern from the light control unit 124. The LED 102 emits light whose hue and brightness change over time in accordance with the driving signal output from the driving unit 112. The light color is the three primary colors, which are any of red (R), green (G), and blue (B) as the color of the wavelength band in the color modulation used in visible light communication.

[0034] Figure 3 2 is a diagram showing an example of the structure of the server 200. Figure 3 As shown, the server 200 includes an imaging unit 201 , a control unit 202 , an image processing unit 204 , a memory 205 , an operation unit 206 , a display unit 207 , and a communication unit 208 .

[0035] The imaging unit 201 includes a lens 203. The lens 203 is composed of a zoom lens or the like. The lens 203 moves by a zoom control operation from the operating unit 206 and a focus control by the control unit 202. The movement of the lens 203 controls the imaging angle of view and the optical image captured by the imaging unit 201.

[0036] The photographing unit 201 has a light receiving surface composed of a plurality of light receiving elements arranged regularly in two dimensions. The light receiving element is, for example, a photographing device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). Based on a control signal from the control unit 202, the photographing unit 201 photographs (receives light) an optical image entering through the lens 203 within a given range of photographing angle of view, and converts the image signal within the photographing angle of view into digital data to generate a frame. In addition, the photographing unit 201 continuously performs photographing and frame generation in time, and outputs continuous frames to the image processing unit 204.

[0037] A Bayer array of color filters is formed on the light receiving surface. Figure 4 As shown, the first column in which red filters 302 and green filters 304 are alternately arranged horizontally and the second column in which blue filters 306 and green filters 304 are alternately arranged horizontally are alternately arranged in the vertical direction to form a Bayer array filter.

[0038] The image processing unit 204 outputs the frame (digital data) output from the imaging unit 201 directly to the control unit 202 based on the control signal from the control unit 202, and adjusts the image quality and image size of the frame so that the display unit 207 can display it as a live view image, and outputs it to the control unit 202. In addition, when a control signal based on a recording instruction operation from the operation unit 206 is input, the image processing unit 204 has the following function: when a control signal based on a recording instruction operation from the operation unit 206 is input, the optical image within the shooting angle of view of the imaging unit 201 or displayed in the display range of the display unit 207 at the time point of the recording instruction is encoded and filed using a compression encoding method such as JPEG (Joint Photographic Experts Group).

[0039] The control unit 202 is composed of, for example, a CPU. The control unit 202 executes software processing according to a program stored in the memory 205 to control the following Figure 7 to Figure 11 The operations shown, etc., are various functions that the server 200 has.

[0040] The memory 205 is, for example, a RAM or a ROM. The memory 205 stores various information (such as programs) used for control and the like in the server 200. The communication unit 208 is, for example, a LAN card. The communication unit 208 communicates with an external communication device.

[0041] The operation unit 206 is composed of a keypad, function keys, etc., and is an interface for inputting user operation contents. The display unit 207 is composed of, for example, an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), an EL (Electro Luminescence) display, etc. The display unit 207 displays an image according to an image signal output from the control unit 202.

[0042] The control unit 202 functionally comprises a position determination unit 232, an estimation unit 234, and a decoding unit 236. The position determination unit 232 determines the position of the region on the light receiving surface that is illuminated by the light emitted by the LED 102 in the mobile device 100 (hereinafter referred to as the light emission position). In other words, the light emission position is the position of the region of the marker candidate formed by a frame of a given range centered on the marker position.

[0043] The estimation unit 234 estimates whether the color of the region constituting the candidate for identification is red (R), green (G), or blue (B). Based on the change in the color of the estimated region, the control unit 202 decodes information such as the ID of the mobile device 100 sent in response to the change. Here, when the above region in the light receiving surface is sufficiently large relative to the red filter 302, the green filter 304, and the blue filter 306 of the color filter, the estimation unit 234 can easily estimate whether the color of the region of the identification is red (R), green (G), or blue (B).

[0044] On the other hand, if the region constituting the candidate marker on the light receiving surface is smaller than the size of the DeBayer color filter (n×m pixels), the estimation unit 234 may not be able to correctly estimate the color of the region of the marker. Here, the size of the DeBayer color filter refers to the minimum size required to generate a color image determined by the arrangement of the color filters. For example, Figure 5 As shown in (a) to (c) of FIG. 8 , consider a case where there are positions of the color filters red filter 302 , green filter 304 , and blue filter 306 and a marker candidate region 310 which is a small region emitting red light.

[0045] exist Figure 5 In (a), the marker candidate region 310 is included in the red filter 302. In this case, the marker candidate region 310 is red with high brightness. Therefore, the estimation unit 234 can determine that the marker candidate region 310 is red.

[0046] On the other hand, Figure 5In (b) and (c), the candidate marker region 310 overlaps with the green filter 304 and the blue filter 306. In this case, the candidate marker region 310 has a low brightness and becomes a mixed color of green and blue due to the green filter 304 and the blue filter 306. In particular, in the Bayer arrangement, since the ratio of the green filter 304 is high, it is easily affected. Figure 4 The effect of the green filter 304 as shown.

[0047] To this end, in this embodiment, the estimation unit 234 corresponds to Figure 6 The color wheel shown in (a) and Figure 6 The color plane shown in (b) is used to estimate the color of the candidate region. Figure 6 As shown in (a), color is determined by hue, value, and saturation in the HSV color space, and is determined by the position on the cylindrical color space. Figure 6 In the color wheel (a), the circumferential direction represents the hue (H) (0 to 360), the height direction (vertical direction) represents the brightness (V), and the radial direction represents the saturation (S). Figure 6 (a) the color wheel and Figure 6 As shown in the color plane of (b), red (R), green (G), and blue (B) are distinguished by hue values. The hue value is any value from 0 to 360. In this embodiment, the hue value 105 to 180 is determined as a green area, the hue value 180 to 255 is determined as a blue area, and the hue value 330 to 30 is determined as a red area.

[0048] The decoding unit 236 performs control to decode the bit data string corresponding to the red (R), green (G), and blue (B) colors estimated by the estimation unit 234, and obtains the ID of the mobile device 100, which is the communication object in the visible light communication.

[0049] The following describes the operation of color estimation with reference to a flowchart. Figure 7 This is a flowchart showing an example of the color estimation operation of the server 200 .

[0050] The position identification unit 232 in the control unit 202 detects an area of ​​the light receiving surface having a predetermined brightness or higher, which can be regarded as a position where the LED 102 in the mobile device 100 emits light, as an area constituting a marker candidate (step S101).

[0051] Next, the estimation unit 234 determines whether the area of ​​the candidate marker is smaller than the size of the DeBayer filter (step S102). In the present embodiment, when the area of ​​the candidate marker is smaller than the size of the DeBayer filter, since the color of the area of ​​the candidate marker is likely to be determined toward any one of the red filter 302, the green filter 304, and the blue filter 306 of the color filter, it is considered that the color of the area of ​​the candidate marker cannot be correctly determined in the normal color determination.

[0052] When the area of ​​the candidate marker exceeds the size of the DeBayer filter (step S102: No), the color estimation unit 234 performs normal color estimation on the area of ​​the candidate marker (step S103). That is, the color estimation unit 234 performs color estimation on the color of the area of ​​the candidate marker based on the values ​​of red (R), green (G), and blue (B) (RGB values).

[0053] On the other hand, if the marker candidate region is smaller than the size of the Bayer filter (step S102: Yes), the color estimation unit 234 performs color estimation taking into account the Bayer arrangement of the color filter on the light receiving surface (step S104). The operation in step S104 will be described in detail below.

[0054] Figure 8 is a flowchart showing an example of a detailed first operation of color estimation by the server 200. Fig. 9 is a flowchart showing an example of the second action. Fig.10 is a flowchart showing an example of the third action. Fig.11 This is a flowchart showing an example of the fourth operation.

[0055] First, if Figure 8 As shown, the estimation unit 234 calculates the average value (RGB average value) of the red (R), green (G), and blue (B) values ​​of all pixels contained in the candidate identification area, and converts the RGB average value into an HSV average value consisting of the average value of the hue H (H average value), the average value of the saturation S (S average value), and the average value of the lightness V (V average value) of all pixels contained in the candidate identification area by converting the pixel format (step S201).

[0056] Next, the estimation unit 234 determines whether the H average value is less than 30 or the H average value is greater than 330 (step S202). The so-called H average value is less than 30 or the H average value is greater than 330, which means that the area estimated to be red is extracted as a label candidate. When the H average value is less than 30 or the H average value is greater than 330 (step S202 "Yes"), the estimation unit 234 determines whether the S average value is greater than 10 (step S203 "Yes"), which means that the area with high saturation S is extracted as a label candidate. When the S average value is greater than 10 (step S203 "Yes"), the estimation unit 234 determines whether the V average value is greater than 10 (step S204). The so-called V average value is greater than 10, which means that the area with high brightness V is extracted as a label candidate.

[0057] If the V average value is greater than 10 (step S204: Yes), the estimation unit 234 determines whether there is a region of a candidate marker estimated to be red in the same position as this time in the current frame before the frame of the image to be estimated (step S206). For example, the hue H, saturation S, lightness V, etc. of the color estimation result of the candidate marker region of each frame are stored in the memory 205.

[0058] If there is an area estimated to be a red marker candidate in the previous frame (step S206 "Yes"), the estimation unit 234 sets the brightness correction value to the maximum brightness in the area estimated to be a red marker candidate in the previous frame (step S207). On the other hand, if there is no area estimated to be a red marker candidate in the previous frame (step S206 "No"), the estimation unit 234 sets the brightness correction value to 32 (step S208). Here, the brightness correction value of 32 means a value (luminous brightness value) estimated when the LED 102 as the marker emits light.

[0059] After the brightness correction value is set in step S207 or step S208, the estimation unit 234 determines whether the V average value of the area of ​​the marker candidate is less than the brightness correction value (step S209). When the V average value of the area of ​​the marker candidate is less than the brightness correction value (step S209 "Yes"), the estimation unit 234 corrects the V average value of the area of ​​the marker candidate to the brightness correction value set in step S207 or step S208. Thus, it is corrected to a value larger than the V average value among the HSV average values. Next, the estimation unit 234 converts the corrected HSV average value into an RGB average value. Furthermore, the estimation unit 234 sets the RGB average value for all pixels in the area of ​​the marker candidate, stores the HSV average value and the RGB average value in the memory 205, and estimates the area of ​​the marker candidate to be red (step S210).

[0060] On the other hand, when the V average value of the candidate marker region is less than the brightness correction value (step S209: No), the estimation unit 234 converts the HSV average value into the RGB average value by performing pixel format conversion. Furthermore, the estimation unit 234 sets the RGB average value for all pixels in the candidate marker region, stores the HSV average value and the RGB average value in the memory 205, and estimates the candidate marker region as red (step S211).

[0061] If the S average value is not greater than 10 (step S203 “No”), or if the V average value is not greater than 10 (step S204 “No”), the estimation unit 234 estimates that the region as a candidate for a marker is not a marker (step S212). If the H average value is not less than 30 or the H average value is not greater than 330 (step S202 “No”), the process proceeds to Fig. 9 action.

[0062] The estimation unit 234 determines the hue H for all pixels included in the region of the candidate marker (in this case, the size of the maximum DeBayer filter), and determines the number of pixels in the region A where the hue H is 180<H<255 and the number of pixels in the region B where the hue H is 105<H≤180 (step S301). 180<H<255 indicates a hue value corresponding to blue, and 105<H≤180 indicates a hue value corresponding to green.

[0063] Next, the estimation unit 234 determines whether the number of pixels in each of the A region and the B region is more than 1 / 3 of the number of pixels in the entire region of the label candidate (step S302). If the number of pixels in each of the A region and the B region is more than 1 / 3 of the region of the label candidate (step S302 "Yes"), the estimation unit 234 calculates the average value of the saturation S (S average value) and the average value of the brightness V (V average value) in each of the A region and the B region, and determines whether the S average value is greater than 10 and the V average value is greater than 10 in the A region, and the S average value is greater than 10 and the V average value is greater than 10 in the B region (step S303).

[0064] When the average value S of saturation S>10 and the average value V of lightness V>10 in region A and region B (“Yes” in step S303), the estimation unit 234 then calculates the HSV average value (HSV average value of region A) composed of the average value of hue H (H average value), the average value of saturation S (S average value), and the average value of lightness V (V average value) of all pixels included in region A. Furthermore, the estimation unit 234 converts the HSV average value of region A into the RGB average value of region A by performing pixel format conversion (step S305).

[0065] Furthermore, the estimation unit 234 sets the RGB average value of the A region for all pixels in the region of the candidate marker, stores the HSV average value and the RGB average value in the memory 205 , and estimates the region of the candidate marker to be blue (step S306 ).

[0066] On the other hand, if the average value of S is not greater than 10 and the average value of V is not greater than 10 in the A region and the B region (step S303: No), the estimation unit 234 estimates that the region as the candidate for the marker is not the marker (step S307). In addition, if the number of pixels in the region as the candidate for the marker in either the A region or the B region is greater than 1 / 3 and less than 1 / 3 of the total number of pixels (step S302: No), the process moves to step S308. Fig.10 action.

[0067] After step S308, transfer to Fig.10 The estimation unit 234 is Figure 8 It is determined whether the H average value included in the HSV average value of the region of the marker candidate obtained in step S201 satisfies 180<H average value<255 (step S401).

[0068] If 180<H average<255 (Yes in step S401 ), the estimation unit 234 determines whether the S average and the V average of the marker candidate region satisfy S average>10 and V average>10 (step S402 ).

[0069] If the S average value is greater than 10 and the V average value is greater than 10 (step S402: Yes), then the estimation unit 234 converts the HSV average value into the RGB average value by converting the pixel format of the candidate marker region. Furthermore, the estimation unit 234 sets the RGB average value for all pixels in the candidate marker region, stores the HSV average value and the RGB average value in the memory 205, and estimates the candidate marker region as blue (step S404).

[0070] On the other hand, if the S average value is not greater than 10 and the V average value is not greater than 10 (step S402: No), the estimation unit 234 estimates that the region as a candidate for a marker is not a marker (step S405). In addition, if 180<H average value<255 is not (step S401: No), the process proceeds to Fig.11 action.

[0071] Estimation Department 234 Figure 8 It is determined whether the H average value included in the HSV average value of the region of the marker candidate obtained in step S201 satisfies 105<H average value ≤ 180 (step S501).

[0072] When 105<H average ≤ 180 (Yes in step S501 ), the estimation unit 234 determines whether the S average and the V average of the marker candidate region satisfy S average>10 and V average>10 (step S502 ).

[0073] If the S average value is greater than 10 and the V average value is greater than 10 (step S502: Yes), then the estimation unit 234 converts the HSV average value into the RGB average value by converting the pixel format of the candidate marker region. Furthermore, the estimation unit 234 sets the RGB average value for all pixels in the candidate marker region, stores the HSV average value and the RGB average value in the memory 205, and estimates the candidate marker region as green (step S504).

[0074] On the other hand, if 105<H average ≤ 180 is not satisfied (step S501 “No”), or if S average > 10 and V average > 10 are not satisfied (step S502 “No”), the estimation unit 234 estimates that the region as a candidate for a marker is not a marker (step S505).

[0075] Thus, in the present embodiment, the mobile device 100 makes the LED 102 serving as the identifier emit light corresponding to its own ID, etc. On the other hand, the server 200 detects the position of the region of the identifier on the light receiving surface, estimates the color of the region of the identifier, and decodes the information into the ID of the mobile device 100, etc. in the decoding unit 236 based on the change in the color of the estimated region of the identifier.

[0076] However, when the marked area on the light-receiving surface is smaller than a given range in the color filter (e.g., each filter of the red filter 302, the green filter 304, and the blue filter 306), the color of the marked area may not be estimated correctly. In this case, in the present embodiment, the server 200 performs a different color estimation process than usual, and considers the Bayer arrangement of the color filter, and uses the average value of the hue H, saturation S, and lightness V of the pixels in the marked area, i.e., the HSV average value, to estimate the color of the marked area. Furthermore, the server 200 converts the HSV average value into an RGB average value by appropriately correcting the HSV average value and converting the pixel format, and sets the RGB average value for all pixels in the marked area. Thus, the correct color can be estimated regardless of the size of the marked area.

[0077] In addition, the present invention is not limited to the description and drawings of the above-mentioned embodiments, and appropriate changes and the like can be added to the above-mentioned embodiments and drawings.

[0078] For example, in the above-mentioned embodiment, if Fig. 9As shown, when the area A where 180<H<255 and the area B where 105<H≤180 exist in the candidate marker area in more than 1 / 3, the candidate marker area is estimated to be blue. However, the present invention is not limited to this, and the candidate marker area may be determined to be green, or other than blue and green, depending on the characteristics of the color filter of the light receiving element, white balance, etc.

[0079] For example, in the above-mentioned embodiment, the information of the transmission object of the mobile device 100 is the ID of the mobile device 100, but it is not limited to this, and it can also be the location information of the mobile device 100, the information of the fault occurring in the mobile device 100, etc.

[0080] In addition, in the above-mentioned embodiment, the case where red, green and blue visible light is used in communication is described, but visible light of other colors may also be used. In addition, the light emission is not limited to the light emission whose hue and brightness change over time, but may also be the light emission whose saturation changes over time.

[0081] In addition, the light source in the mobile device 100 is not limited to the LED, and the light source may be formed as a part of an LCD, PDP, EL display, etc. constituting a display device, for example.

[0082] In addition, the server 200 may be any device as long as it is provided with an imaging unit and can perform imaging.

[0083] In addition, in the above-mentioned embodiment, the executed program can also be stored in a computer-readable recording medium such as a floppy disk, CD-ROM (Compact Disc Read-Only Memory), DVD (Digital Versatile Disc), MO (Magneto-Optical disc) for distribution, and a system for executing the above-mentioned processing can be constructed by installing the program.

[0084] Alternatively, the program may be stored in a disk device or the like of a predetermined server on a network such as the Internet, or may be superimposed on a carrier wave and downloaded.

[0085] In addition, when the OS (Operating System) shares the above functions, or when the OS and applications cooperate to realize the above functions, only the parts other than the OS may be stored in a medium for distribution, or may be downloaded, etc.

[0086] The preferred embodiments of the present invention are described above, but the present invention does not depart from the broad spirit and scope of the present invention, and various embodiments and variations can be realized. In addition, the above-mentioned embodiments are used to illustrate the present invention, and do not limit the scope of the present invention. That is, the scope of the present invention is not shown by the embodiments but by the claims. In addition, various variations implemented within the claims and within the scope of the meaning of the invention equivalent thereto are regarded as within the scope of the present invention.

[0087] This application is based on Japanese Patent Application No. 2019-138469 filed on July 29, 2019 and Japanese Patent Application No. 2020-032572 filed on February 28, 2020. The specifications, patent claims, and drawings of Japanese Patent Application No. 2019-138469 and Japanese Patent Application No. 2020-032572 are incorporated herein by reference in their entirety.

[0088] Industrial Applicability

[0089] The present invention can be used in the technical field of communication and the like that utilizes the color of light.

[0090] Description of Reference Numerals

[0091] 1...visible light communication system, 100, 100a, 100b, 100c...mobile device, 102, 102a, 102b, 102c...LED, 103, 202...control unit, 104, 205...memory, 108, 208...communication unit, 112...driving unit, 124...light-emitting control unit, 150...battery, 200...server, 201...shooting unit, 203...lens, 204...image processing unit, 206...operation unit, 207...display unit, 232...position determination unit, 234...estimation unit, 236...decoding unit, 302...red filter, 304...green filter, 306...blue filter, 310...area for marking candidate.

Claims

1. A color estimation device, characterized in that: have: A light receiving unit in which any one of a plurality of color components is allocated to each of a plurality of light receiving elements arranged two-dimensionally by a color filter arranged in a Bayer arrangement; and The estimation unit estimates the color of the received light using the average values ​​of the hue H, saturation S, and brightness V of the pixel, i.e., the HSV average value, when the size of the area of ​​light received by the light receiving unit as light above a specified brightness via the color filter is smaller than the size of the DeBayer color filter.

2. The color estimation device according to claim 1, characterized in that: The color filter has a red component and a green component as the plurality of color components. The prescribed estimation process prioritizes the estimation of blue over the estimation of green.

3. The color estimation device according to claim 1, characterized in that The color estimation device includes a determination unit that determines that the received light is not light emitted as a marker from a predetermined light emitting unit when the color of the received light cannot be estimated as a predetermined color by the estimation process.

4. The color estimation device according to claim 1, characterized in that The estimation unit estimates the color to which the received light belongs based on the values ​​of red R, green G, and blue B, i.e., RGB values, when the size of an area of ​​light received by the light receiving unit via the color filter as light above a specified brightness is larger than the size of the DeBayer filter.

5. The color estimation device according to claim 1, characterized in that: The color filter has a red component, a green component, and a blue component as the plurality of color components. The number of pixels of the green component is greater than the number of pixels of the red component, and greater than the number of pixels of the blue component.

6. The color estimation device according to claim 5, characterized in that: The number of pixels of the red component of the color filter is equal to the number of pixels of the blue component.

7. The color estimation device according to any one of claims 1 to 6, characterized in that: The color estimation device further comprises: A decoding unit decodes information used in a communication system that performs communication by modulating information into color, based on the color estimated by the estimation process.

8. A color estimation method, characterized in that: Include: A step of receiving light by allocating any one of a plurality of color components in a Bayer-arranged color filter to each of a plurality of light-receiving elements arranged two-dimensionally; and In the estimation step, when the size of the area of ​​light received by the light receiving unit as light above the specified brightness via the color filter is smaller than the size of the DeBayer color filter, the color of the received light is estimated using the average value of the pixel's hue H, saturation S, and brightness V, i.e., the HSV average value.

9. A storage medium for storing a program non-temporarily, characterized in that: The program causes the computer to function as the following means: A control unit that causes any one of the plurality of color components in the Bayer-arranged color filter to be allocated to each of the plurality of light-receiving elements arranged two-dimensionally to receive light; and The estimation unit estimates the color of the received light using the average values ​​of the hue H, saturation S, and brightness V of the pixel, i.e., the HSV average value, when the size of the area of ​​light received by the light receiving unit as light above a specified brightness via the color filter is smaller than the size of the DeBayer color filter.

Images