Information processing device, information processing method, and recording medium

The information processing device addresses the challenge of recommending color contact lenses by using eye and optical environment data to provide personalized suggestions, improving the accuracy and relevance of recommendations.

WO2025022667A1PCT designated stage expired Publication Date: 2025-01-30NEC CORP
View PDF 14 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2023/027617
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-07-27
Publication Date
2025-01-30

AI Technical Summary

Technical Problem

Existing information processing systems fail to accurately recommend color contact lenses that match individual eye characteristics and optical environments, leading to suboptimal suggestions based on purchase history alone.

Method used

An information processing device that acquires eye images and optical environment data to propose suitable color contact lenses by considering the target eye area, light environment, and additional factors like destination, time, and user information, using a processor with image acquisition and color control proposal units to output personalized recommendations.

Benefits of technology

The system provides more accurate and appropriate color contact lens recommendations by considering eye characteristics, optical environments, and other contextual factors, enhancing user satisfaction and authenticity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2023027617_30012025_PF_FP_ABST
    Figure JP2023027617_30012025_PF_FP_ABST
Patent Text Reader

Abstract

An information processing device (10) comprises: an image acquisition means (110) for acquiring an eye image including the eye region of a target; and a proposal means (120) for outputting information for proposing a colored contact lens suitable for the target on the basis of the acquired eye image and a lighting environment at the time when the eye image is captured. According to such an information processing device, it is possible to propose a colored contact lens suitable for a target in consideration of a lighting environment at the time when an eye image is captured.
Need to check novelty before this filing date? Find Prior Art

Description

Information processing device, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a recording medium.

[0002] One known example of this type of device is one that proposes color contact lenses to users. For example, Patent Document 1 discloses a technology that accepts input of a user's eye characteristic information and proposes contact lenses to the user based on the purchase history of other users whose eye characteristic information is similar to the user's eye characteristic information by a predetermined value or more.

[0003] Japanese Patent Application Laid-Open No. 2020-067870

[0004] An object of the present disclosure is to provide an information processing device, an information processing method, and a recording medium that are capable of proposing color contact lenses suitable for a subject.

[0005] One aspect of the information processing device disclosed herein comprises an image acquisition means for acquiring an eye image including the eye region of a subject, and a suggestion means for outputting information suggesting color contact lenses suitable for the subject based on the eye image and the lighting environment when the eye image was captured.

[0006] One aspect of the information processing method disclosed herein involves using at least one computer to acquire an eye image including a subject's eye region, and outputting information suggesting color contact lenses suitable for the subject based on the eye image and the lighting environment when the eye image was captured.

[0007] One aspect of the recording medium of this disclosure is a recording medium having a computer program recorded thereon that causes at least one computer to execute an information processing method that acquires an eye image including an eye region of a subject, and outputs information suggesting color contact lenses suitable for the subject based on the eye image and the lighting environment when the eye image was captured.

[0008] 1 is a block diagram showing the hardware configuration of a first information processing device. 2 is a block diagram showing the functional configuration of the first information processing device. 3 is a flowchart showing the flow of operations in the first information processing device. 4 is a block diagram showing the functional configuration of a second information processing device. 5 is a block diagram showing an example of acquisition of schedule information in the second information processing device. 6 is a flowchart showing the flow of operations in the second information processing device. 7 is a block diagram showing the functional configuration of a third information processing device. 8 is a flowchart showing the flow of operations in the third information processing device. 9 is a plan view showing an example of color contact lenses proposed by the third information processing device. 10 is a block diagram showing the functional configuration of a fourth information processing device. 11 is a flowchart showing the flow of operations in the fourth information processing device. 12 is a block diagram showing the functional configuration of a fifth information processing device. 13 is a flowchart showing the flow of operations in the fifth information processing device. 14 is a block diagram showing the functional configuration of a sixth information processing device. 15 is a flowchart showing the flow of operations in the sixth information processing device.

[0009] Hereinafter, embodiments of an information processing device, an information processing method, and a recording medium will be described with reference to the drawings.

[0010] First Embodiment A first information processing apparatus will be described with reference to FIGS. 1 to 3. FIG.

[0011] (Hardware Configuration) First, the hardware configuration of the first information processing apparatus will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the first information processing apparatus.

[0012] 1, a first information processing device 10 includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The information processing device 10 may further include an input device 15 and an output device 16. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, and output device 16 are connected to each other via a data bus 17. The data bus 17 may be an interface other than a data bus (for example, a LAN, a USB, etc.).

[0013] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the information processing device 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In particular, in this embodiment, when the processor 11 executes the loaded computer program, a functional block for suggesting color contact lenses (hereinafter referred to as "color contacts" or "colored contact lenses") suitable for the subject is realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control in the information processing device 10.

[0014] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a quantum processor. The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0015] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while it is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (D-RAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0016] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable read-only memory (PROM) or an erasable read-only memory (EPROM). Alternatively, other types of non-volatile memory may be used instead of the ROM 13.

[0017] The storage device 14 stores data that the information processing device 10 stores for a long period of time. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device may store computer programs executed by the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0018] The input device 15 is a device that receives input instructions from a user of the information processing device 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet. The input device 15 may be, for example, a device that includes a microphone and is capable of voice input. The input device 15 may be, for example, a device that is used only for maintenance. In such a case, the input device 15 may be omitted as appropriate from the components used when operating the information processing device 10.

[0019] The output device 16 is a device that outputs information related to the information processing device 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the information processing device 10. The output device 16 may also be a speaker or the like that can output information related to the information processing device 10 as audio. The output device 16 may be configured as a mobile terminal such as a smartphone or a tablet.

[0020] 1 shows an example of an information processing device 10 including multiple devices, but all or some of the functions may be realized by a single device. Such an information processing device may be configured to include only the above-mentioned processor 11, RAM 12, and ROM 13, and the other components (i.e., the storage device 14, input device 15, output device 16, etc.) may be provided by an external device connected to the information processing device 10. Furthermore, some of the calculation functions of the information processing device 10 may be realized by an external device (e.g., an external server, a cloud, etc.).

[0021] (Functional Configuration) Next, the functional configuration of the first information processing device 10 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the first information processing device.

[0022] 2, the first information processing device 10 is configured as a device that acquires an eye image including the iris region of a subject and proposes color contact lenses suitable for the subject. The first information processing device 10 is configured with an image acquisition unit 110 and a color contact lens proposal unit 120 as components for realizing its functions. Each of the image acquisition unit 110 and the color contact lens proposal unit 120 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0023] The image acquisition unit 110 is configured to acquire an eye image including the eye region of the subject. The eye image may be an image including not only the subject's eye but also the area surrounding the eye or parts other than the eye (e.g., eyebrows, nose, etc.). The image acquisition unit 110 may be configured to acquire the eye image directly from a camera that captured the eye image. Alternatively, the image acquisition unit 110 may be configured to acquire the eye image from a storage device that stores the eye image of the subject captured by the camera. The eye image may be automatically captured upon detecting the subject. For example, the eye image may be captured when a moving subject reaches a predetermined position. Alternatively, the eye image may be captured when the subject performs a predetermined operation. For example, the eye image may be captured when the subject presses a capture button. The eye image acquired by the image acquisition unit 110 is configured to be output to the color contact lens suggestion unit 120.

[0024] The color contact lens suggestion unit 120 is configured to be able to output information suggesting color contact lenses suitable for the subject (hereinafter referred to as "suggestion information" as appropriate) using the eye image acquired by the image acquisition unit 110. Note that "color contact lenses suitable for the subject" here may be color contact lenses that suit the subject, color contact lenses that match the subject's fashion, color contact lenses that match the subject's preferences, or color contact lenses that match the subject's purpose or TPO, etc.

[0025] The color contact lens suggestion unit 120 particularly suggests color contact lenses suitable for the subject based on the subject's eye image and the lighting environment when the eye image was captured. The color contact lens suggestion unit 120 can suggest color contact lenses suitable for the subject's eyes by using the subject's eye image. For example, it can suggest contact lenses that match the subject's eye color, size, etc. However, the impression of color contact lenses changes depending on the surrounding lighting environment. For example, even if the same person is wearing the same color contact lenses, the impression changes significantly depending on whether the surroundings are bright or dark. In addition, the color of color contact lenses also changes depending on the surrounding lighting environment. For example, even if the same person is wearing the same color contact lenses, the color contact lenses may appear slightly reddish under strongly reddish lighting. Therefore, by using the lighting environment when the eye image was captured, it is possible to more accurately determine and suggest color contact lenses suitable for the subject.

[0026] The colored contact lens proposal unit 120 may propose a specific colored contact lens (for example, a single product name). Alternatively, the colored contact lens proposal unit 120 may propose the color, pattern, size, etc. of the colored contact lens. Furthermore, the proposed colored contact lens proposal unit 120 may select and propose colored contact lenses suitable for the subject from among colored contact lenses owned by the subject. Alternatively, the colored contact lens proposal unit 120 may select and propose colored contact lenses suitable for the subject from among colored contact lenses available for purchase by the subject. Alternatively, the colored contact lens proposal unit 120 may propose newly created colored contact lenses (for example, custom-made colored contact lens patterns, etc.).

[0027] (Flow of Operation) Next, the flow of operation of the first information processing device 10 will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the flow of operation in the first information processing device.

[0028] 3, when the operation of the first information processing device 10 starts, the image acquisition unit 110 first acquires an image of the target's eye (step S101). The image acquisition unit 110 outputs the acquired image of the target's eye to the colored contact lens suggestion unit 120.

[0029] Next, the color contact lens suggestion unit 120 acquires information about the lighting environment when the eye image was captured (hereinafter referred to as "light environment information") (Step S102). Then, the color contact lens suggestion unit 120 determines the color contact lens suitable for the subject based on the eye image acquired by the image acquisition unit 110 and the lighting environment information when the eye image was captured (Step S103).

[0030] Thereafter, the colored contact lens proposal unit 120 outputs proposal information indicating colored contact lenses suitable for the subject (step S104). The colored contact lens proposal unit 120 may output the proposal information using, for example, the output device 16 (see FIG. 1). More specifically, the colored contact lens proposal unit 120 may display information indicating colored contact lenses suitable for the subject using a display. Alternatively, the colored contact lens proposal unit 120 may output information indicating colored contact lenses suitable for the subject as audio using a speaker.

[0031] (Technical Effects) Next, technical effects obtained by the first information processing device 10 will be described.

[0032] 1 to 3, the first information processing device 10 suggests color contact lenses suitable for a subject based on the subject's eye image and the lighting environment when the eye image was captured. In this way, by taking the lighting environment into consideration, it is possible to suggest more suitable color contact lenses.

[0033] Second Embodiment A second information processing device 10 will be described with reference to Figures 4 to 6. The second information processing device 10 differs only in part of the configuration and operation from the first information processing device 10 described above, and other parts may be similar to the first information processing device 10. Therefore, hereinafter, parts that differ from the first embodiment will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

[0034] (Functional Configuration) First, the functional configuration of the second information processing device 10 will be described with reference to Fig. 4. Fig. 4 is a block diagram showing the functional configuration of the second information processing device. Note that in Fig. 4, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0035] As shown in Fig. 4, the second information processing device 10 is configured to include, as components for realizing its functions, an image acquisition unit 110, a colored contact lens suggestion unit 120, and a schedule information acquisition unit 130. That is, the second information processing device 10 further includes the schedule information acquisition unit 130 in addition to the configuration of the first information processing device 10 (see Fig. 2). The schedule information acquisition unit 130 may be a processing block realized by, for example, the above-mentioned processor 11 (see Fig. 1).

[0036] The schedule information acquisition unit 130 is configured to be able to acquire schedule information regarding the destination and date and time of the subject. The schedule information acquired by the schedule information acquisition unit 130 is configured to be output to the color contact lens proposal unit 120. The color contact lens proposal unit 120 in the second information processing device 10 is configured to propose color contact lenses suitable for the subject based on the eye image, the lighting environment when the eye image was captured, and the schedule information acquired by the schedule information acquisition unit 130. Specifically, the color contact lens proposal unit 120 proposes color contact lenses that match the destination and date and time of the subject.

[0037] For example, the colored contact lens suggestion unit 120 may suggest natural colored contact lenses when the subject goes to work. The colored contact lens suggestion unit 120 may suggest flashy colored contact lenses when the subject goes shopping or to an event. Furthermore, for a subject who does not want others to know that they are wearing colored contact lenses, the colored contact lenses may be limited to dark tones that are difficult to notice if the destination is a bright place. On the other hand, the colored contact lenses may be suggested without any particular color restrictions if the destination is a dark place.

[0038] The colored contact lens suggestion unit 120 may suggest different colored contact lenses depending on the time of day, even if the target destination is the same. For example, if going to a restaurant in the daytime, colored contact lenses with a casual atmosphere may be suggested, whereas if going to a restaurant in the evening, colored contact lenses with a more subdued atmosphere may be suggested.

[0039] (Schedule Information Acquisition Method) Next, a method for the schedule information acquisition unit 130 to acquire schedule information will be specifically described with reference to Fig. 5. Fig. 5 is a block diagram showing an example of how schedule information is acquired in the second information processing apparatus.

[0040] As shown in FIG. 5 , the schedule information acquisition unit 130 may acquire schedule information from a mobile device 50 (e.g., a smartphone) owned by the subject. More specifically, the schedule information of the subject may be acquired from a schedule app 55 installed on the mobile device owned by the subject. The schedule app 55 is an app for managing the subject's schedule and stores information about the subject's destination and date and time. The schedule information acquisition unit 130 may cooperate with the schedule app 55 to automatically acquire the subject's schedule information. Note that if the information processing device 10 according to this embodiment (i.e., the function for suggesting color contact lenses suitable for the subject) is installed on the mobile device 50, the exchange of schedule information may be performed within the mobile device 50. The schedule information acquisition unit 130 may acquire schedule information from a device other than the mobile device 50 described above. The schedule information acquisition unit 130 may acquire schedule information from various devices or apparatuses that are not owned by the subject but may be used by the subject (e.g., a PC used by the subject at work).

[0041] (Operation Flow) Next, the operation flow of the second information processing device 10 will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the operation flow in the second information processing device. Note that in Fig. 6, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0042] 6, when the operation of the second information processing device 10 is started, the image acquisition unit 110 first acquires an image of the target's eye (step S101). The image acquisition unit 110 outputs the acquired image of the target's eye to the colored contact lens suggestion unit 120.

[0043] Next, the color contact lens suggestion unit 120 acquires information about the lighting environment when the eye image was captured (step S102). The schedule information acquisition unit 130 also acquires schedule information about the target (step S201). The schedule information acquisition unit 130 outputs the acquired schedule information to the color contact lens suggestion unit 120.

[0044] Next, the colored contact lens suggestion unit 120 determines colored contact lenses suitable for the subject based on the eye image of the subject acquired by the image acquisition unit 110, the light environment information when the eye image was captured, and the schedule information acquired by the schedule information acquisition unit 130 (step S202).The colored contact lens suggestion unit 120 then outputs suggested information indicating colored contact lenses suitable for the subject (step S104).

[0045] (Technical Effects) Next, technical effects obtained by the second information processing device 10 will be described.

[0046] As explained in Figures 4 to 6, the second information processing device 10 suggests color contact lenses suitable for the subject based on the eye image, the lighting environment, and schedule information. In this way, it is possible to suggest more appropriate color contact lenses according to the subject's destination and date and time. Furthermore, by acquiring schedule information from a device owned by the subject, it is possible to acquire accurate schedule information more easily.

[0047] <Third Embodiment> A third information processing device 10 will be described with reference to Figures 7 to 9. The third information processing device 10 differs only in part of the configuration and operation from the first and second information processing devices 10 described above, and other parts may be similar to the first and second information processing devices 10. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0048] (Functional Configuration) First, the functional configuration of the third information processing device 10 will be described with reference to Fig. 7. Fig. 7 is a block diagram showing the functional configuration of the third information processing device. Note that in Fig. 7, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0049] 7, the third information processing device 10 is configured to include, as components for realizing its functions, an image acquisition unit 110, a colored contact lens suggestion unit 120, and a region identification unit 140. That is, the third information processing device 10 further includes the region identification unit 140 in addition to the configuration of the first information processing device 10 (see FIG. 2). The region identification unit 140 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0050] The region identification unit 140 is configured to be able to identify an authentication region required for iris authentication. Information regarding the authentication region identified by the region identification unit 140 is configured to be output to the color contact lens proposal unit 120. The color contact lens proposal unit 120 in the third information processing device 10 is configured to propose color contact lenses suitable for the subject based on the eye image, the lighting environment when the eye image was captured, and the authentication region identified by the region identification unit 140. Specifically, the color contact lens proposal unit 120 proposes color contact lenses that do not obscure the subject's authentication region. For example, the color contact lens proposal unit 120 may propose color contact lenses with no pattern in the authentication region or color contact lenses with the authentication region painted with ink that transmits near-infrared light (i.e., light irradiated when capturing an iris image).

[0051] The region identification unit 140 may be configured to detect a feature portion containing features for identifying the target from the target's iris region and identify the region containing the feature portion as the authentication region. The feature portion can be detected using, for example, a reference iris generated using multiple irises. The reference iris may be, for example, an average iris obtained by combining the irises of multiple users. The region identification unit 140 may compare the reference iris with the target's iris region and detect a portion with a large degree of deviation as the feature portion. Note that the reference iris may be generated in advance and stored in a readable state. The target's iris region to be compared with the reference iris may be extracted from an eye image acquired by the image acquisition unit 110.

[0052] (Operation Flow) Next, the operation flow of the third information processing device 10 will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the operation flow in the third information processing device. Note that in Fig. 8, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0053] 8, when the operation of the third information processing device 10 is started, the image acquisition unit 110 first acquires an image of the target's eye (step S101). The image acquisition unit 110 outputs the acquired image of the target's eye to the colored contact lens suggestion unit 120.

[0054] Next, the color contact lens suggestion unit 120 acquires information about the light environment when the eye image was captured (step S102). The region identification unit 140 compares the target iris region with the reference iris to detect characteristic features (step S301). The region identification unit 140 then identifies the region containing the characteristic features as an authentication region (step S302). The region identification unit 140 outputs information about the identified authentication region to the color contact lens suggestion unit 120.

[0055] Next, the colored contact lens suggestion unit 120 determines colored contact lenses suitable for the subject based on the eye image acquired by the image acquisition unit 110, the light environment information when the eye image was captured, and the authentication area identified by the area identification unit 140 (step S303).The colored contact lens suggestion unit 120 then outputs suggestion information indicating colored contact lenses suitable for the subject (step S104).

[0056] (Specific Proposal Example) Next, an example of color contact lenses proposed by the third information processing device 10 will be described with reference to Fig. 9. Fig. 9 is a plan view showing an example of color contact lenses proposed by the third information processing device.

[0057] 9(a), when the periphery of the target pupil 60 is the characteristic portion 70, the colored contact lens suggestion unit 120 may suggest colored contact lenses in which the patterned portion 80 does not overlap the periphery of the pupil 60. In this case, the colored contact lens suggestion unit 120 may output information regarding the distance from the center of the pupil circle to the patterned portion 80.

[0058] 9(b), when the outer edge of the target iris region is the characteristic portion 70, the colored contact lens suggestion unit 120 may suggest colored contact lenses that do not overlap the pattern portion 80 with the outer edge of the iris. In this case, the colored contact lens suggestion unit 120 may output information regarding the distance from the center of the pupil circle to the end of the pattern portion 80.

[0059] 9(c), when the upper and lower end portions of the target iris region are characteristic portions 70, the colored contact lens suggestion unit 120 may suggest colored contact lenses that do not overlap the upper and lower end portions of the iris with the patterned portion 80. In this case, the colored contact lens suggestion unit 120 may output information regarding the distance from the center of the pupil circle to the upper characteristic portion 80 and the distance from the center of the pupil circle to the lower characteristic portion 80.

[0060] 9(d), when the lower right region of the target iris region is the characteristic portion 70, the colored contact lens suggestion unit 120 may suggest colored contact lenses that do not overlap the pattern portion 80 in the lower right region. In this case, the colored contact lens suggestion unit 120 may output information regarding the angular range of the lower right region as viewed from the center of the pupil circle.

[0061] (Technical Effects) Next, technical effects obtained by the third information processing apparatus 10 will be described.

[0062] As described with reference to Figures 7 to 9, the third information processing device 10 suggests color contact lenses suitable for a target based on an eye image, a light environment, and an authentication area. This makes it possible to suggest color contact lenses that allow iris authentication even while the contact lenses are worn, according to the authentication area specified for each target. Furthermore, by detecting a characteristic portion containing features for identifying the target, it is possible to appropriately specify the authentication area according to the characteristics of the target's iris area. Using a reference iris when detecting a characteristic portion makes it easier and more accurate to detect the characteristic portion.

[0063] <Fourth embodiment> A fourth information processing device 10 will be described with reference to Figures 10 and 11. The fourth information processing device 10 differs only in part of the configuration and operation from the first to third information processing devices 10 described above, and other parts may be similar to the first to third information processing devices 10. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0064] (Functional Configuration) First, the functional configuration of the fourth information processing device 10 will be described with reference to Fig. 10. Fig. 10 is a block diagram showing the functional configuration of the fourth information processing device. Note that in Fig. 10, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0065] 10, the fourth information processing device 10 is configured to include, as components for realizing its functions, an image acquisition unit 110, a colored contact lens suggestion unit 120, and a user information acquisition unit 150. That is, the fourth information processing device 10 further includes the user information acquisition unit 150 in addition to the configuration of the first information processing device 10 (see FIG. 2). The user information acquisition unit 150 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0066] The user information acquisition unit 150 is configured to be able to acquire user information, which is information about a target. The user information includes information about at least one of the target's iris, personal color, makeup, skin color, clothing, and color contact lenses currently being worn. The user information may be acquired from an eye image of the target acquired by the image acquisition unit 110, or may be acquired from something other than an eye image. For example, the user information acquisition unit 150 may acquire user information from an image other than an eye image. Alternatively, the user information acquisition unit 150 may acquire user information input by a user.

[0067] The user information acquired by the user information acquisition unit 150 is configured to be output to the color contact lens proposal unit 120. The color contact lens proposal unit 120 in the fourth information processing device 10 is configured to propose color contact lenses suitable for the subject based on the eye image, the lighting environment when the eye image was captured, and the user information acquired by the user information acquisition unit 150. Specifically, the color contact lens proposal unit 120 may propose color contact lenses that match the subject's iris, personal color, makeup, skin color, and clothing. Alternatively, the color contact lens proposal unit 120 may determine the subject's preferences from the color contact lenses currently worn and propose color contact lenses that match the subject's preferences.

[0068] (Operation Flow) Next, the operation flow of the fourth information processing device 10 will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the operation flow in the fourth information processing device. Note that in Fig. 11, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0069] 11 , when the operation of the fourth information processing device 10 starts, the image acquisition unit 110 first acquires an image of the target's eye (step S101). The image acquisition unit 110 outputs the acquired image of the target's eye to the colored contact lens suggestion unit 120.

[0070] Next, the color contact lens suggestion unit 120 acquires information about the lighting environment when the eye image was captured (step S102). The user information acquisition unit 150 also acquires user information (step S401). The user information acquisition unit 150 outputs the acquired user information to the color contact lens suggestion unit 120.

[0071] Next, the colored contact lens suggestion unit 120 determines colored contact lenses suitable for the subject based on the eye image of the subject acquired by the image acquisition unit 110, the light environment information when the eye image was captured, and the user information acquired by the user information acquisition unit 150 (step S402).The colored contact lens suggestion unit 120 then outputs suggested information indicating colored contact lenses suitable for the subject (step S104).

[0072] (Technical Effects) Next, technical effects obtained by the fourth information processing apparatus 10 will be described.

[0073] 10 and 11, the fourth information processing device 10 suggests color contact lenses suitable for a subject based on an eye image, a lighting environment, and user information. In this way, by taking into account user information related to the subject, it becomes possible to suggest more appropriate color contact lenses.

[0074] Fifth Embodiment A fifth information processing device 10 will be described with reference to Figures 12 and 13. The fifth information processing device 10 differs only in part of the configuration and operation from the first to fourth information processing devices 10 described above, and other parts may be similar to the first to fourth information processing devices 10. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0075] (Functional Configuration) First, the functional configuration of the fifth information processing device 10 will be described with reference to Fig. 12. Fig. 12 is a block diagram showing the functional configuration of the fifth information processing device. Note that in Fig. 12, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0076] 12, the fifth information processing device 10 is configured to include, as components for realizing its functions, an image acquisition unit 110, a colored contact lens suggestion unit 120, and a trend information acquisition unit 160. That is, the fifth information processing device 10 further includes the trend information acquisition unit 160 in addition to the configuration of the first information processing device 10 (see FIG. 2). The trend information acquisition unit 160 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0077] The trend information acquisition unit 160 is configured to acquire trend information. The trend information is information regarding the current trends in color contact lenses. For example, there are times when people prefer to wear color contact lenses to enlarge the pupils of their eyes, and there are times when people prefer contact lenses that enhance the pupils' appearance (e.g., natural-colored or soft-colored lenses) so that others do not notice that they are wearing color contact lenses. The trend information acquisition unit 160 may acquire the latest information as trend information from among such information regarding trends in color contact lenses. The trend information acquisition unit 160 may also acquire the latest trend information through machine learning. The trend information may be set by the user themselves. For example, the trend information acquisition unit 160 may acquire information input by the user according to their preferences as trend information. The trend information acquisition unit 160 may also acquire trend information selected by the user from multiple pieces of trend information collected in advance.

[0078] The trend information acquired by the trend information acquisition unit 160 is configured to be output to the color contact lens proposal unit 120. The color contact lens proposal unit 120 in the fifth information processing device 10 is configured to propose color contact lenses suitable for the subject based on the eye image, the lighting environment when the eye image was captured, and the trend information acquired by the trend information acquisition unit 160. Specifically, the color contact lens proposal unit 120 proposes color contact lenses that match the current trend. In other words, the color contact lens proposal unit 120 avoids proposing color contact lenses that do not match the current trend.

[0079] (Operation Flow) Next, the operation flow of the fifth information processing device 10 will be described with reference to Fig. 13. Fig. 13 is a flowchart showing the operation flow in the fifth information processing device. Note that in Fig. 13, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0080] 13, when the operation of the fifth information processing device 10 starts, the image acquisition unit 110 first acquires an image of the target's eye (step S101). The image acquisition unit 110 outputs the acquired image of the target's eye to the colored contact lens suggestion unit 120.

[0081] Next, the color contact lens suggestion unit 120 acquires information about the lighting environment when the eye image was captured (step S102). The trend information acquisition unit 160 also acquires trend information (step S501). The trend information acquisition unit 160 outputs the acquired trend information to the color contact lens suggestion unit 120.

[0082] Next, the colored contact lens suggestion unit 120 determines colored contact lenses suitable for the subject based on the eye image of the subject acquired by the image acquisition unit 110, the light environment information when the eye image was captured, and the trend information acquired by the trend information acquisition unit 160 (step S502).The colored contact lens suggestion unit 120 then outputs suggestion information indicating colored contact lenses suitable for the subject (step S104).

[0083] (Technical Effects) Next, technical effects obtained by the fifth information processing apparatus 10 will be described.

[0084] 12 and 13, the fifth information processing device 10 suggests colored contact lenses suitable for a subject based on an eye image, a lighting environment, and trend information. In this way, by taking into account trend information related to colored contact lenses, it becomes possible to suggest more suitable colored contact lenses.

[0085] Sixth Embodiment A sixth information processing device 10 will be described with reference to Figures 14 and 15. Note that the sixth information processing device 10 differs only in part of the configuration and operation from the first to fifth information processing devices 10 described above, and other parts may be similar to the first to fifth information processing devices 10. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0086] (Functional Configuration) First, the functional configuration of the sixth information processing device 10 will be described with reference to Fig. 14. Fig. 14 is a block diagram showing the functional configuration of the sixth information processing device. Note that in Fig. 14, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0087] 14, the sixth information processing device 10 is configured to include, as components for realizing its functions, an image acquisition unit 110, a colored contact lens suggestion unit 120, and an image generation unit 170. That is, the sixth information processing device 10 further includes an image generation unit 170 in addition to the configuration of the first information processing device 10 (see FIG. 2). The image generation unit 170 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0088] The image generation unit 170 is configured to be able to generate an image of what it would look like if the subject actually wore the colored contact lenses suggested by the colored contact lens suggestion unit 120. The image generation unit 170 uses information about the subject's iris region (e.g., information about the color and pattern of the subject's iris region) to generate an image of what it would look like if the subject wore the suggested colored contact lenses. The information about the subject's iris region may be acquired from the eye image acquired by the image acquisition unit 110, or may be acquired from a source other than the eye image.

[0089] The image generated by the image generating unit 170 may be, for example, an eye image including only the area around the subject's eyes, a face image including the subject's entire face, or a whole-body image including the subject's entire body. The image generating unit 170 may also generate a plurality of image images. For example, the image generating unit 170 may generate all of the above-described eye image, face image, and whole-body image. Alternatively, the image generating unit 170 may generate a plurality of image images in different lighting environments. For example, the image generating unit 170 may generate an image image in a bright environment and an image image in a dark environment.

[0090] When the schedule information described in the second embodiment has been acquired (see FIGS. 4 to 6 ), the image generating unit 170 may generate an image corresponding to the schedule information. For example, if the subject plans to attend an outdoor barbecue during the daytime, the image generating unit 170 may generate an image that is assumed to be photographed outdoors in bright light. Alternatively, if the subject plans to visit a club in the evening, the image generating unit 170 may generate an image that is assumed to be photographed indoors in a dark place.

[0091] (Operation Flow) Next, the operation flow of the sixth information processing device 10 will be described with reference to Fig. 15. Fig. 15 is a flowchart showing the operation flow in the sixth information processing device. Note that in Fig. 15, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0092] 15, when the operation of the sixth information processing device 10 starts, the image acquisition unit 110 first acquires an image of the target's eye (step S101). The image acquisition unit 110 outputs the acquired image of the target's eye to the colored contact lens suggestion unit 120.

[0093] Next, the color contact lens suggestion unit 120 acquires information about the light environment when the eye image was captured (step S102).The color contact lens suggestion unit 120 then determines color contact lenses suitable for the subject based on the eye image of the subject acquired by the image acquisition unit 110 and the light environment information when the eye image was captured (step S103).

[0094] Thereafter, the image generation unit 170 determines whether or not to generate an image (step S601). Whether or not to generate an image may be set in advance by, for example, the user. If an image is not to be generated (step S601: NO), the color contact lens recommendation unit 120 outputs only the recommendation information (i.e., information indicating color contacts suitable for the subject) (step S605).

[0095] On the other hand, if an image is to be generated (step S601: YES), the image generation unit 170 acquires information about the subject's iris (step S602). Then, the image generation unit 170 uses the information about the subject's iris to generate an image of what it would look like if the subject were wearing the colored contact lenses suggested by the colored contact lens suggestion unit 120 (step S603). In this case, the colored contact lens suggestion unit 120 outputs the suggested information, and the image generation unit 170 outputs an image (step S604).

[0096] (Technical Effects) Next, technical effects obtained by the sixth information processing apparatus 10 will be described.

[0097] As described with reference to FIGS. 14 and 15 , the sixth information processing device 10 generates an image of what the proposed colored contact lenses will look like when worn. This makes it possible to clearly communicate to the subject what the proposed colored contact lenses will look like when worn. Online shops that sell colored contact lenses sometimes post images of the colored contact lenses being worn, but these images are of models (i.e., people other than the subject), making it difficult to accurately grasp what the subject will look like when wearing them. However, in this embodiment, an image is generated using information about the subject's iris, making it possible to more accurately grasp what the subject will look like when wearing the colored contact lenses.

[0098] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0099] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processes by themselves, but also includes programs that execute processes by operating on an OS in conjunction with other software or expansion board functions. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal. The program may be provided to the user in, for example, a SaaS (Software as a Service) format.

[0100] <Supplementary Notes> The above-described embodiment may be further described as in the following supplementary notes, but is not limited to the following.

[0101] (Supplementary Note 1) The information processing device described in Supplementary Note 1 is an information processing device that includes an image acquisition means that acquires an eye image including an eye region of a subject, and a suggestion means that outputs information that suggests color contact lenses suitable for the subject based on the eye image and the lighting environment when the eye image was captured.

[0102] (Supplementary Note 2) The information processing device described in Supplementary Note 2 is the information processing device described in Supplementary Note 1, further comprising a schedule acquisition means for acquiring schedule information regarding the destination and date and time of the subject, and the suggestion means for suggesting color contact lenses suitable for the subject based on the eye image, the lighting environment, and the schedule information.

[0103] (Supplementary Note 3) The information processing device according to Supplementary Note 3 is the information processing device according to Supplementary Note 2, wherein the schedule acquisition means acquires the schedule information from a schedule stored in a terminal held by the subject.

[0104] (Appendix 4) The information processing device described in Appendix 4 is the information processing device described in any one of Appendices 1 to 3, further comprising an area identification means for identifying an authentication area required for iris authentication within the iris area of ​​the subject, and the suggestion means for suggesting color contact lenses suitable for the subject based on the eye image, the light environment, and the authentication area.

[0105] (Appendix 5) The information processing device described in Appendix 5 is the information processing device described in Appendix 4, in which the area identification means detects a characteristic portion including a feature for identifying the target from the iris area of ​​the target, and identifies the area including the characteristic portion as the authentication area.

[0106] (Supplementary Note 6) The information processing device described in Supplementary Note 6 is the information processing device described in Supplementary Note 5, in which the region identification means detects the characteristic portion by comparing a reference iris generated using a plurality of irises with the iris region of the target.

[0107] (Supplementary Note 7) The information processing device described in Supplementary Note 7 is the information processing device described in any one of Supplements 1 to 6, further comprising a user information acquisition means for acquiring user information including at least one of the subject's iris, personal color, makeup, skin color, clothing, and color contact lenses currently being worn, and the suggestion means for suggesting color contact lenses suitable for the subject based on the eye image, the light environment, and the user information.

[0108] (Appendix 8) The information processing device described in Appendix 8 is the information processing device described in any one of Appendices 1 to 7, further comprising a trend acquisition means for acquiring trend information regarding trends in the color contact lenses, and the suggestion means for suggesting color contact lenses suitable for the subject based on the eye image, the light environment, and the trend information.

[0109] (Appendix 9) The information processing device described in Appendix 9 is the information processing device described in any one of Appendices 1 to 8, further comprising an image generation means that uses information about the iris of the subject to generate an image of the subject wearing the color contact lenses suggested by the suggestion means.

[0110] (Supplementary Note 10) The information processing method described in Supplementary Note 10 is an information processing method that acquires an eye image including an eye region of a subject by at least one computer, and outputs information suggesting color contact lenses suitable for the subject based on the eye image and the lighting environment when the eye image was captured.

[0111] (Appendix 11) The recording medium described in Appendix 11 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, which acquires an eye image including an eye region of a subject, and outputs information suggesting color contact lenses suitable for the subject based on the eye image and the lighting environment when the eye image was captured.

[0112] (Supplementary Note 12) The computer program described in Supplementary Note 12 is a computer program that causes at least one computer to execute an information processing method that acquires an eye image including an eye region of a subject, and outputs information suggesting color contact lenses suitable for the subject based on the eye image and the lighting environment when the eye image was captured.

[0113] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0114] REFERENCE SIGNS LIST 10 Information processing device 11 Processor 50 Portable terminal 55 Schedule application 60 Pupil 70 Characteristic part 80 Pattern part 110 Image acquisition unit 120 Colored contact lens suggestion unit 130 Schedule information acquisition unit 140 Area identification unit 150 User information acquisition unit 160 Trend information acquisition unit 170 Image image generation unit

Claims

1. An information processing device comprising: an image acquisition means for acquiring an eye image including an eye region of a subject; and a suggestion means for outputting information suggesting color contact lenses suitable for the subject based on the eye image and the lighting environment when the eye image was captured.

2. The information processing device of claim 1, further comprising a schedule acquisition means for acquiring schedule information regarding the destination and date and time of the subject, and the suggestion means for suggesting color contact lenses suitable for the subject based on the eye image, the lighting environment, and the schedule information.

3. The information processing device according to claim 2, wherein the schedule acquisition means acquires the schedule information from a schedule stored in a terminal owned by the subject.

4. An information processing device as described in any one of claims 1 to 3, further comprising an area identification means for identifying an authentication area required for iris authentication from the iris area of ​​the target, wherein the suggestion means suggests color contact lenses suitable for the target based on the eye image, the light environment, and the authentication area.

5. The information processing device according to claim 4, wherein the area specification means detects a characteristic portion including features for identifying the target from the iris area of ​​the target, and specifies the area including the characteristic portion as the authentication area.

6. The information processing device according to claim 5, wherein the region specifying means detects the characteristic portion by comparing a reference iris generated using a plurality of irises with the iris region of the target.

7. An information processing device as described in any one of claims 1 to 3, further comprising a user information acquisition means for acquiring user information including at least one of the subject's iris, personal color, makeup, skin color, clothing, and currently worn color contact lenses, and the suggestion means suggests color contact lenses suitable for the subject based on the eye image, the light environment, and the user information.

8. An information processing device as described in any one of claims 1 to 3, further comprising a trend acquisition means for acquiring trend information regarding trends in color contact lenses, and the suggestion means for suggesting color contact lenses suitable for the subject based on the eye image, the lighting environment, and the trend information.

9. An information processing device according to any one of claims 1 to 3, further comprising an image generation means for generating an image of the subject wearing the color contact lenses suggested by the suggestion means, using information about the iris of the subject.

10. An information processing method comprising: acquiring, by at least one computer, an eye image including an eye region of a subject; and outputting information suggesting suitable color contact lenses for the subject based on the eye image and the lighting environment when the eye image was captured.

11. A recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, which comprises acquiring an eye image including an eye region of a subject, and outputting information suggesting suitable color contact lenses for the subject based on the eye image and the lighting environment when the eye image was captured.

Citation Information

Patent Citations

  • Color contact lens and its serving method

    JP2004021244A

  • Virtual makeup device and method therefor

    JP2004094917A

  • Method and system for ordering custom cosmetic contact lenses

    JP2004513389A

  • Interactive contact lens simulation system and method

    JP2010211210A

  • Simulation system, simulation method, program, and recording medium

    JP2015090555A