Information processing device, recording medium, nail art system, and nail art design selection method

Abstract

The present invention provides an information processing device, a recording medium, a nail art system and a nail art design selection method capable of suggesting a nail art design more suitable for a user's physical and mental state. The printing device (1) comprises: a control unit (110) that obtains biological information related to blood flow and determines a nail art design to be suggested to the user based on the obtained biological information.

Description

[0001] This application claims the composite priority of Japanese Patent Application No. 2021-050213 and Japanese Patent Application No. 2021-050214, and the entire disclosure of the prior application (including specification, abstract, claims, and drawings) is incorporated herein by reference. Technical Field

[0002] The invention relates to an information processing device, a recording medium, a nail art system and a nail art design selection method. Background Art

[0003] In the past, nail printers that can apply nail designs such as colors and patterns selected by users to fingernails are known. As a document recording this technology, there is Japanese Patent Publication No. 2017-18589. In addition, in Japanese Patent Publication No. 2020-62529, an image signal of a subject is obtained as an image, and brightness or image pulse waves are extracted based on the image.

[0004] The conventional nail art printer described in Japanese Patent Publication No. 2017-18589 presents a predetermined nail art design to the user. In the nail art, it has the effect of stabilizing the user's emotions or increasing the enthusiasm. There is room for improvement in presenting the nail art design based on the user's physical and mental state. Summary of the invention

[0005] The present invention has been made in view of such circumstances, and an object of the present invention is to provide an information processing device, a recording medium, a nail art system, and a nail art design selection method that can present a nail art design that is more suitable for the user's physical and mental state.

[0006] An information processing device is characterized by comprising a processing unit that acquires biological information related to blood flow and determines a nail design based on the acquired biological information.

[0007] A nail art system, characterized by comprising:

[0008] A printing device including a first communication unit capable of communicating with the outside and a printing unit capable of printing on a user's nail; and

[0009] an information processing device having a second communication unit capable of communicating with the printing device and a processing unit, the processing unit determining biometric information of the user based on information related to an image of at least a part of the user's body, and determining a nail design based on the determined biometric information,

[0010] The printing unit prints on the nails of the user based on the nail art design received by the first communication unit from the second communication unit.

[0011] A recording medium stores a program, characterized in that:

[0012] The program enables the computer to perform the following processing functions:

[0013] Biometric information related to blood flow is acquired, and a nail design to be presented to a user is determined based on the acquired biometric information.

[0014] A method for selecting a nail design, executed by an information processing device, is characterized in that:

[0015] The method includes: obtaining biological information related to blood flow, and determining a nail design to be presented to a user based on the obtained biological information.

[0016] According to the present invention, it is possible to provide an information processing device, a recording medium, a nail art system, and a nail art design selection method that can present a nail art design that is more suitable for the user's physical and mental state. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 This is a structural diagram showing the structure of a nail printer system according to one embodiment of the present invention.

[0018] Figure 2 This is a block diagram showing the hardware configuration of a printing device according to an embodiment of the present invention.

[0019] Figure 3 This is a structural diagram showing the structure of a printing unit according to an embodiment of the present invention.

[0020] Figure 4 This is a functional block diagram showing a functional configuration for executing a printing process, among the functional configurations of the printing apparatus according to one embodiment of the present invention.

[0021] Figure 5 This is a block diagram showing a hardware configuration of a user terminal according to an embodiment of the present invention.

[0022] Figure 6 This is a functional block diagram showing a functional configuration for executing a print process, among the functional configurations of a user terminal according to an embodiment of the present invention.

[0023] Figure 7 This is a schematic diagram for explaining the measurement area set in the area of ​​the skin of the finger.

[0024] Figure 8 This is a schematic diagram for explaining how pulse wave information is obtained based on the brightness values ​​of pixels within the measurement area.

[0025] Fig. 9 This is a schematic diagram for explaining the calculation of biological information based on pulse wave information.

[0026] Fig.10 This is a table that summarizes the biometric information that can be calculated, the judgment threshold corresponding to the biometric information, the design options presented to the user, and the results of inference of the physical and mental state.

[0027] Fig.11 This is a diagram showing a selection screen of suggested nail designs.

[0028] Fig.12 This is a graph showing an example of a Lorentz curve calculated from pulse wave information.

[0029] Fig.13 This is a flowchart illustrating the flow of processing executed by the printing apparatus according to one embodiment of the present invention.

[0030] Fig.14 This is a flowchart illustrating the flow of processing executed by the printing apparatus according to one embodiment of the present invention.

[0031] Fig.15 This is a block diagram showing the hardware configuration of a printing device according to a first modified example of the present invention.

[0032] Fig.16 It is a structural diagram showing the structure of a printing unit according to a first modified example of the present invention.

[0033] Fig.17 This is a functional block diagram showing a functional configuration for executing a printing process, among the functional configurations of the printing apparatus according to the first modified example of the present invention.

[0034] Fig.18 It is an explanatory diagram for explaining the difference in the pulse wave measurement result depending on whether or not the cuff is compressed.

[0035] Fig.19 This is a flowchart for explaining a part of the flow of processing executed by the printing apparatus according to the first modified example of the present invention.

[0036] Fig. 20 This is a flowchart for explaining a part of the flow of processing executed by the printing apparatus according to the second modified example of the present invention.

[0037] Fig.21 It is a schematic diagram showing the structure of a nail printer system according to a third modified example of the present invention. DETAILED DESCRIPTION

[0038] Hereinafter, embodiments of the present invention will be described using the drawings.

[0039] [Outline of Implementation Method]

[0040] <Nail Printer System>

[0041] Figure 1 1 is a structural diagram showing the overall structure of a nail printer system S including the printing device 1 according to the present embodiment. Figure 1 As shown, the nail printer system S includes a plurality of printing devices 1 , a user terminal 2 which is a tablet terminal corresponding to each printing device 1 , a network 3 , and a server group 4 .

[0042] The printing device 1 is a nail printer that prints nail designs such as colors / patterns / designs on the user's nails. The number of printing devices 1 is not particularly limited, and n (n is an arbitrary natural number) printing devices 1 may be included in the nail printer system S. In addition, in the following description, when the n printing devices 1 are described without distinguishing them, the letters at the end of the symbol are omitted and only "printing device 1" is referred to.

[0043] The printing device 1 of this embodiment measures the blood flow change of the user based on the image, and allows the user to select a nail design based on the measurement result. The printing device 1 prints the nail design selected by the user on the nail of the user. In addition, the printing device 1 is electrically connected to the user terminal 2 through wired communication or wireless communication to send and receive various information. In addition, the user terminal 2 is connected to each server included in the server group 4 via the network 3 so that it can communicate with each other.

[0044] The network 3 is implemented by, for example, the Internet, a LAN (Local Area Network), a mobile phone network, or a combination of these networks.

[0045] The server group 4 includes various servers that cooperate with the printing device 1. For example, the server group 4 includes an authentication server for authenticating the user of the printing device 1. In addition, for example, the server group 4 includes a nail design registration and distribution server in which the nail design data downloaded by the user terminal 2 is registered. Furthermore, the server group 4 includes a measurement data storage server that stores user profile information. The user profile information includes information such as setting information related to the user and the user's use history of the printing device 1.

[0046] Nail art design is a design applied to the nails of the user's fingers. For example, the nails are designed with colors, patterns, designs, patterns, images, etc. Nail art design is not only artistic, but also has a spiritual effect due to the impression of the nail art design, such as relieving stress or improving the enthusiasm of the person who has applied the nail art design.

[0047] in addition, Figure 1The nail printer system S shown is only an example, and servers having other functions may be included in the server group 4. In addition, the plurality of servers included in the server group 4 may be implemented by different server devices or by a single server device.

[0048] <Printing device>

[0049] Figure 2 1 is a block diagram showing the hardware configuration of a printing device 1 according to an embodiment of the present invention. Figure 2 As shown, the printing device 1 includes a CPU (Central Processing Unit) 11 as a processor, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, a camera unit 16, an input unit 17, an output unit 18, a storage unit 19, a communication unit 20, a driver 21, a power supply unit 22, a printing unit 32, and a pulse wave analysis unit 33.

[0050] The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 19 into the RAM 13 .

[0051] The RAM 13 also stores data and the like necessary for the CPU 11 to execute various processes as appropriate.

[0052] The CPU 11, ROM 12, and RAM 13 are connected to each other via a bus 14. An input / output interface 15 is also connected to the bus 14. The input / output interface 15 is connected to an imaging unit 16, an input unit 17, an output unit 18, a storage unit 19, a communication unit 20, a driver 21, a power supply unit 22, a printing unit 32, and a pulse wave analysis unit 33.

[0053] like Figure 3 As shown, the imaging unit 16 includes: a camera 16a having an optical lens unit and an image sensor; and an illumination 16b, which is disposed in a frame 32a described later and illuminates the interior of the frame 32a. The optical lens unit is composed of a lens that converges light, such as a focusing lens, a zoom lens, etc., in order to photograph a subject. The focusing lens is a lens that forms an image of the subject on the light receiving surface of the image sensor. The zoom lens is a lens that allows the focal length to be freely changed within a certain range. The imaging unit 16 is also provided with a peripheral circuit that adjusts setting parameters such as focus, exposure, and white balance as needed.

[0054] The image sensor includes a photoelectric conversion element, an AFE (Analog Front End), etc. The photoelectric conversion element includes, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element, etc. The subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element performs photoelectric conversion (imaging) on ​​the subject image and accumulates the image signal for a certain period of time, and sequentially supplies the accumulated image signal to the AFE as an analog signal. The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on the analog image signal. Through various signal processing, a digital signal is generated and output as an output signal of the imaging unit 16. Such an output signal of the imaging unit 16 is appropriately supplied to the CPU 11, etc. The lighting 16b includes, for example, an LED.

[0055] The input unit 17 includes various buttons, a microphone, and the like, and inputs various information in accordance with instruction operations and instruction voices of the user.

[0056] The output unit 18 is composed of a liquid crystal display or the like, and outputs the image data output by the CPU 11 , an image corresponding to the image data, or a video.

[0057] The storage unit 19 includes a semiconductor memory such as DRAM (Dynamic Random Access Memory) and stores various data.

[0058] The communication unit 20 performs communication control for the CPU 11 to communicate with other devices (for example, each server included in the server group 4 ) via the network 3 .

[0059] The drive 21 includes an interface capable of mounting the removable medium 100. The removable medium 100 including a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is appropriately mounted in the drive 21. Various programs, image data, video data, and other data may be stored in the removable medium 100. Furthermore, the programs, image data, video data, and other data read from the removable medium 100 by the drive 21 may be installed in the storage unit 19 as needed.

[0060] The power supply unit 22 is configured to be able to supply power to each unit of the printing device 1 by being connected to an external power source.

[0061] The printing unit 32 can print a nail design on the user's nails. Figure 3As shown, the printing unit 32 includes: a finger rest 32b for placing the user's finger 5; a sensor (not shown) for detecting the finger 5 placed on the finger rest 32b; a nail design printing unit (not shown) for printing a nail design on the nail 5a; and a frame 32a covering the finger rest 32b, the sensor, and the nail design printing unit. That is, in the printing device 1 of this embodiment, the nail design printing unit prints a nail design on the nail 5a of the finger 5 placed on the finger rest 32b.

[0062] In addition, the printing device 1 according to the present embodiment recognizes the finger 5 placed on the finger rest 32b by a sensor. However, the printing device 1 may recognize the finger 5 based on an image captured by the camera 16a of the imaging unit 16 instead of a sensor. For example, the printing device 1 may detect the skin color of the finger 5 in the captured image and recognize it.

[0063] The pulse wave analysis unit 33 has a pulse wave analysis circuit that can analyze the image of the user's skin, etc. to calculate the pulse wave information. For example, when the pulse wave analysis unit 33 receives the image captured by the camera unit 16, it calculates various biological information described later through the pulse wave analysis circuit. In the present embodiment, the image processing unit 111 of the control unit 110 described later analyzes the image and calculates the pulse wave information and various biological information, but the pulse wave analysis unit 33 may calculate them separately.

[0064] In addition to the above-mentioned hardware, the printing device 1 may further include other hardware. For example, the printing device 1 may further include an output unit including a lamp, a speaker, or a vibration motor, and outputting light, sound, or vibration signals.

[0065] Figure 4 Yes means Figure 2 The functional block diagram of the functional structure for executing the printing process among the functional structures of the printing device 1 of FIG. The printing process refers to a series of processes in which the printing device 1 displays the measurement result based on the change of the biological information acquired from the user.

[0066] First, the storage unit 19 storing various information is described. The storage unit 19 stores various data related to guidance in the process of screen display, information for measurement, information for displaying measurement results, information indicating measurement results, information related to nail art design, a history of printed nail art design, information related to printing processing, etc. In addition, the above-mentioned various data can be stored only in the storage unit 19, or can be appropriately stored in the removable medium 100 through the driver 21. Furthermore, each information can also be appropriately stored in the measurement data storage server included in the server group 4.

[0067] Next, each functional block that performs printing processing will be described. Figure 4 As shown, the control unit 110 of the present embodiment has an image processing unit (image processing function) 111, an output processing unit (output processing function) 112, an input processing unit (input processing function) 113, a data processing unit (data processing function) 114, a determination processing unit (determination processing function) 115, a communication processing unit (communication processing function) 116 and a printing processing unit (printing processing function) 117.

[0068] The image processing unit 111 obtains information related to the user (hereinafter referred to as "subject information") by analyzing the image of the user as the subject captured by the camera unit 16. The subject information is, for example, the color of each part of the finger 5 in the user image, the biometric information indicating the state of the user (sometimes also referred to as key data), etc. Since the measurement is performed by analyzing the information (image) obtained by the camera unit 16, the biometric information can be obtained sequentially without contacting the user. The specific analysis of the image data performed by the image processing unit 111 will be described later. In addition, when outputting the acquired biometric information, the image processing unit 111 outputs the biometric information to at least the storage unit 19. As a result, the history of the acquired biometric information is saved in the storage unit 19.

[0069] The output processing unit 112 controls the display of a dynamic image as a display image on the screen of the output unit 18. This allows the progress of the pulse wave measurement to be dynamically visualized and displayed in an easily understandable manner. In addition, the output processing unit 112 also performs synthesis processing such as synthesizing a guide image, measurement data, and nail art design. For example, the output processing unit 112 displays Fig. 9 The control of the synthesized image in which the user's finger 5 and an image showing the measurement result (measurement result table, graph, etc.) are synthesized as shown, and the preview image in which the user's finger 5 and the nail design image are synthesized.

[0070] The input processing unit 113 also performs processing for accepting a user operation input to the input unit 17. For example, the input processing unit 113 accepts a user operation to start a print process on the input unit 17 and inputs the operation to the print processing unit 117.

[0071] The data processing unit 114 performs processing for printing a nail design based on biometric information. For example, the data processing unit 114 obtains the biometric information calculated by the image processing unit 111. The data processing unit 114 outputs the obtained biometric information to the communication processing unit 116, and transmits it to the user terminal via the communication unit 20. In addition, the data processing unit 114 obtains information related to the nail design sent from the user terminal 2, and outputs a printing instruction signal to the printing unit 32.

[0072] The determination processing unit 115 performs various determinations in the printing process based on various thresholds stored in the storage unit 19. For example, the determination processing unit 115 performs determination by comparing the biometric information calculated by the image processing unit 111 with a given threshold, and outputs the determination result to the data processing unit 114.

[0073] The communication processing unit 116 performs processing for communicating with external devices. For example, it communicates with the authentication server included in the server group 4. As a result, the user performing the printing process is authenticated. In addition, the communication processing unit 116 communicates with the measurement data storage server included in the server group 4 to update the profile information of the user in the printing process.

[0074] The print processing unit 117 performs processing for controlling the operation of the print unit 32 of the printing device 1. For example, when receiving a print start command from the control unit 110, the print processing unit 117 causes the print unit 32 to print a nail design on the user's nail 5a.

[0075] <User terminal>

[0076] Next, use Figure 5 An example of the user terminal 2 will be described. Figure 5 It is a block diagram showing the hardware configuration of the user terminal 2 according to one embodiment of the present invention.

[0077] The user terminal 2 of this embodiment is a computer including a CPU 51, a ROM 52, a RAM 53, a bus 54, an input / output interface 55, an input unit 56, an output unit 57, a storage unit 58, a communication unit 59, and a battery 60. In addition, for the same or similar configurations as those already described, the same names may be denoted and detailed descriptions thereof may be omitted.

[0078] Next, the functional structure of the user terminal 2 will be described. Figure 6 It is a functional block diagram showing a part of the functional configuration of the user terminal 2 according to the present embodiment.

[0079] The control unit 70 that performs various controls on the user terminal 2 is implemented by the CPU 51 that executes arithmetic processing. The control unit 70 of this embodiment includes a communication processing unit (communication processing function) 71, an output processing unit (output processing function) 72, an input processing unit (input processing function) 73, and a print management unit (print management function) 74.

[0080] The communication processing unit 71 executes processing for exchanging various information with the server group 4 via the communication unit 59 . The communication processing unit 71 also executes processing for exchanging various information with the printing device 1 via the communication unit 59 .

[0081] The output processing unit 72 performs processing for displaying an image on the screen of the output unit 57. For example, when the communication processing unit 71 obtains the biometric information sent from the printing device 1, the output processing unit 72 performs processing for displaying the biometric information on the screen of the output unit 57 according to the instruction of the communication processing unit 71. In addition, when the communication processing unit 71 obtains the nail design selection information sent from the nail design registration and distribution server of the server group 4 described later, the output processing unit 72 performs processing for displaying the nail design selection information on the screen of the output unit 57 according to the instruction of the communication processing unit 71.

[0082] The input processing unit 73 performs processing for receiving user operations input to the input unit 56. For example, the input processing unit 73 receives information displayed on the output unit 57 as input in the touch panel, and sends a command to the output processing unit 72 to perform processing for switching information displayed on the screen of the output unit 57.

[0083] The print management unit 74 sends and receives information related to the printing apparatus 1 and the printing process via the communication unit 59. For example, upon receiving a user input to start printing, the print management unit 74 outputs a print start command to the communication processing unit 71, thereby causing the printing apparatus 1 to start the printing process via the communication unit 59.

[0084] [Analysis of image data]

[0085] Next, use Figures 7 to 9 Analysis of image data in the printing device 1 will be described. Figure 7 It means to place Figure 3 Schematic diagram of the finger 5 on the finger rest 32b and a region of interest (ROI) which is a measurement region set in the skin region of the finger. Figure 8 This is a schematic diagram for explaining the calculation of the brightness value of the pixel in the region of interest ROI and the display of the obtained pulse wave waveform. The thin line waveform represents the original waveform of the pulse wave, and the thick line represents the waveform of the pulse wave after the bandpass filter. Fig. 9 This is a schematic diagram for explaining how to calculate biological information based on measured pulse wave information. Figure 7 Acquisition of image data analyzed by the image processing unit 111 will be described.

[0086] The image processing unit 111 detects the outline, position, and skin area of ​​the finger by performing tracking-related processing such as pattern matching of the outline and part, and skin color recognition, and detects a given part area of ​​the finger. For example, the outline and position of the finger are detected from the user image in the image, and the area of ​​the finger is automatically recognized. Then, the image processing unit 111 detects the skin color of the detected part area. In addition, Figure 7 As shown in FIG. 1 , the image processing unit 111 sets a region of interest (ROI) indicated by a dotted-line frame on the base side of the nail 5 a of the finger 5 .

[0087] In addition, in the present embodiment, the region of interest ROI is set at the part of the skin other than the nail 5a. This is because a white base coat for position identification is applied to the nail 5a, and the pulse wave cannot be measured. In the case where the base coat is not applied to the nail 5a, the region of interest ROI may also be set to the nail 5a. In addition, in the present embodiment, the region of interest ROI is set within a predetermined range. However, the region of interest ROI may not be a predetermined range. For example, the control unit 110 may also automatically identify the skin area according to the color of the skin in the image, and automatically set the region of interest ROI to the maximum range.

[0088] The image processing unit 111 utilizes the pulse wave extraction from the image and the property that hemoglobin in the blood absorbs green light well to obtain biological information related to the blood flow such as the pulse and the pulse wave. The wavelength of the green signal is generally referred to as 495-570nm, and the absorption coefficient of hemoglobin becomes high near 500-600nm. When the blood flow rises, the amount of blood increases on the skin surface, and the amount of hemoglobin per unit time increases. Therefore, compared with before the blood flow rises, more green signals are absorbed by hemoglobin. Therefore, the brightness of the green signal detected when the blood flow rises decreases. In addition, when the imaging element of the imaging unit 16 converts light into brightness, RGB filters are arranged in front of the imaging element to calculate the brightness values ​​of each pixel of RGB. In this case, the light that passes through the green filter becomes the brightness value. Even if the sensitivity of the imaging element is not flat with respect to the wavelength, the wavelength band can be narrowed to a certain extent by the above-mentioned filter, so the green signal can be detected with high accuracy.

[0089] like Figure 8 As shown, the image processing unit 111 obtains the pulse wave information based on the brightness information included in the image information of the body in the image within the region of interest ROI. More specifically, the image processing unit 111 obtains the brightness of the green signal every unit time, and obtains the pulse wave information from the time change of the brightness of the green signal. In addition, the unit time is, for example, the frame rate of a dynamic image, and the brightness of the green signal can be obtained for each image that is continuous in time and constitutes the image.

[0090] Furthermore, the image processing unit 111 also obtains the brightness of the red signal per unit time, and can calculate the pulse wave information even if it is subtracted from the green signal obtained per unit time. The image processing unit 111 can obtain the pulse wave information based on the time change of the brightness obtained by subtracting the brightness of the red signal from the brightness of the green signal, and can further improve the accuracy of the pulse wave information. In addition, in this embodiment, the operation from the camera unit 16 photographing the target part of the user's body to the operation of obtaining the brightness of the green signal is explained as pulse wave measurement.

[0091] In addition, the pulse wave information includes the amplitude PA. Figure 8 The waveform shown by the bold line is a waveform obtained by applying the original waveform of the pulse wave to a bandpass filter to extract the amplitude component. The pulse wave analyzed from the image shows a waveform that represents the periodicity of the waveform within a certain amplitude PA range. The amplitude PA of the pulse wave means the difference between the adjacent maximum and minimum values ​​of the pulse wave waveform. In other words, the amplitude PA means the difference between the maximum and minimum values ​​of the brightness of the green signal.

[0092] In addition, the range for obtaining the amplitude PA is preferably an area where there are no abnormal values ​​and the amplitude is stable. For example, in the case where an abnormal value exceeding a preset threshold is detected, the pulse wave information is obtained with deviation from the abnormal value. Alternatively, it is also possible to display that the image cannot be properly obtained during the video recording, and to perform re-recording to obtain appropriate pulse wave information. Alternatively, the pulse wave after a given time from the start of the video recording can be used for the calculation of the amplitude. Alternatively, the amplitude can be calculated by removing the abnormal value from the pulse wave obtained within a given time. In this way, various methods can be applied to the calculation of the amplitude.

[0093] Furthermore, the image processing unit 111 according to the present embodiment can calculate various biological information described later by performing frequency analysis, time domain analysis, etc. on the pulse wave obtained by image analysis. Fig.10 As shown, it is possible to calculate physical and mental biological information such as LF / HF, SD (standard deviation) of FFI, deviation change rate of Lorentz curve, change rate of pulse rate, change rate of PA, change rate of baseline, CVRR, and deformation time. Details of each biological information will be described later.

[0094] In addition, in the printing device 1 according to the present embodiment, various biometric information is used as an index. Fig.10 The thresholds shown are compared, as Fig.10 As shown, the physical and mental states of four items can be inferred. Fig.10This is a table that summarizes biometric information that can be calculated by the printing device 1 according to the present embodiment, determination thresholds corresponding to the biometric information, design options presented to the user corresponding to the determination results, and physical and mental state estimation results.

[0095] For example, Fig.10 As shown, LF / HF, SD (standard deviation) of FFI, rate of change of deviation of Lorenz curve, and rate of change of pulse rate can infer whether the user's physical and mental state is tense or relaxed. In addition, the rate of change of PA and the rate of change of baseline can infer the quality of the user's blood circulation. In addition, CVRR and deformation time can infer the quality of the user's heart rate adjustment function and the level of the user's blood pressure. In addition, Fig.10 The threshold values ​​shown are merely examples, and the values ​​and conditions can be changed as appropriate.

[0096] In addition, the printing device 1 according to the present embodiment uses three indicators such as Fig.11 As the three pointers, there are a pointer indicating a nail design that indicates the user's physical and mental state, a pointer indicating a nail design that achieves a balance between the user's physical and mental state, and a pointer indicating a nail design that has an effect of maintaining health.

[0097] For example, in the pointer of the user's physical and mental state represented by the nail design, if the user's physical and mental state is estimated to be tense, the printing device 1 presents a nail design with bright colors that expresses the tense state. In addition, if the user's physical and mental state is estimated to be relaxed, the printing device 1 presents a nail design with stable colors. In addition, in the present embodiment, the nail design is mainly described with colors, but the pattern, design, and decoration may be changed according to the estimated physical and mental state.

[0098] Furthermore, in the pointer indicating the nail design that achieves a balance between the user's physical and mental state, when it is inferred that the user's physical and mental state tends to be tense, the printing device 1 suggests a nail design with a stable color that can relieve tension. Furthermore, when it is inferred that the user's physical and mental state tends to be relaxed, the printing device 1 suggests a nail design with a bright color that can increase motivation.

[0099] In addition, in the pointer indicating the nail design having the effect of maintaining health, when it is estimated that the user's blood pressure fluctuation is high, the printing device 1 prompts a nail design with a stable color. In addition, when it is estimated that the user's blood pressure fluctuation is low, the printing device 1 prompts a nail design with a bright color.

[0100] In addition, the printing device 1 can infer the user's physical and mental state with one indicator and make a design decision to present to the user. However, the printing device 1 can also combine multiple indicators to infer the physical and mental state and make a design decision. For example, the printing device 1 can also infer the physical and mental state for four items, namely, relaxation / tension tendency, blood circulation quality, heart rate regulation function quality, and blood pressure level, and judge their results through multiple decisions. In addition, the printing device 1 can also select any one of the items used in the judgment instead of multiple decisions.

[0101] In addition, it is also possible to select and determine items suitable for the processing capacity (resource) of the installed system. For example, in a printing device with low processing capacity, an indicator with a large load during calculation may not be selected. In addition, in this embodiment, an indicator for determination is preset, but the indicator used in the determination may also be set by the user.

[0102] In this embodiment, which pointer is used to indicate the nail design in advance or can be set by the user. In the printing process involved in this embodiment described later, a pointer is selected to indicate the user's physical and mental state with a nail design. In addition, the pointer for the design for the physical and mental state is not limited to the above three, and can be one of the three, or a pointer other than the above three. In addition, the pointer for the design for the physical and mental state can be fixed without the user selecting it.

[0103] Next, each biological information is described in detail. First, LF / HF is an index that indicates the fluctuation of the interval between pulses of the pulse wave and indicates the tendency of the autonomic nerve. In addition, LF / HF is calculated by frequency analysis, etc. The larger the value of LF / HF is, the more the printing device 1 can determine that the user is in a tense tendency. In addition, the smaller the value of LF / HF is, the more the printing device 1 can determine that the user is in a relaxed tendency.

[0104] Next, the standard deviation of FFI (Foot to Foot Interval) is described. FFI represents the time interval of the valley value of the pulse wave waveform, and the standard deviation of FFI is an index indicating the degree of deviation of the interval of the pulse wave waveform. The smaller the standard deviation of FFI, the printing device 1 can determine that the user is in a tense tendency. In addition, the larger the standard deviation of FFI, the printing device 1 can determine that the user is in a relaxed tendency.

[0105] Next, use Fig.12The deviation change rate of the Lorenz curve is explained. The deviation change rate of the Lorenz curve is an index indicating the tendency of the autonomic nerve. The deviation change rate of the Lorenz curve is calculated as follows. First, the Lorenz curve is explained. The Lorenz curve is a graph of adjacent intervals between two consecutive pulse waves, with one as the horizontal axis and the other as the vertical axis, and the deviation of the pulse wave interval can be seen.

[0106] For example, when focusing on the kth pulse wave, the interval between the kth pulse wave and the subsequent pulse wave, that is, the k+1th pulse wave, is plotted corresponding to the vertical axis and the horizontal axis of the graph. An example of such plotting is shown in FIG. Fig.12 The smaller the fluctuation of the intervals between successive pulse waves, the more the points are concentrated in the center. On the other hand, the larger the fluctuation of the intervals between successive pulse waves, the more the points are dispersed toward the periphery.

[0107] Here, the deviation of the Lorenz curve is described. First, the Lorenz curve is evaluated numerically. In the present embodiment, for example, the Lorenz curve is numerically quantified by projecting the Lorenz curve on orthogonal axes, and the deviation of the Lorenz curve is calculated. Specifically, in the graph of the Lorenz curve, the axis passing through the center of the distribution of the data of each Lorenz curve and the point where k and k+1 are the same is set to the yx axis. In addition, the axis passing through the center of the distribution of the data of each Lorenz curve and orthogonal to the yx axis is set to the y-(-x) axis.

[0108] Each Lorenz curve of the data within 1 to 3 minutes is projected onto the above two axes, as the deviation σ(x) on the yx axis and the deviation σ(-x) on the y-(-x) axis. In this case, the deviation of the Lorenz curve is evaluated as the area of ​​the ellipse S = π×σ(x)×σ(-x). The larger the area of ​​the ellipse, the greater the deviation, and the smaller the area of ​​the ellipse, the smaller the deviation.

[0109] The rate of change of the deviation of the Lorentz curve is calculated by dividing the deviation of the Lorentz curve during pulse wave measurement by the deviation of the Lorentz curve in the normal state. In this embodiment, the storage unit 19 stores the deviation of the Lorentz curve in the normal state in advance, and when the printing device 1 calculates the rate of change of the deviation of the Lorentz curve, it calls the deviation of the Lorentz curve in the normal state stored in the storage unit 19 for calculation.

[0110] In addition, the control unit 110 compares the deviation change rate of the Lorentz curve with a threshold value to infer the user's physical and mental state. When the calculated deviation change rate exceeds the threshold value, the printing device 1 can determine that the user is in a relaxed state. In addition, when the calculated deviation change rate is below the threshold value, the printing device 1 can determine that the user is in a tense state.

[0111] Next, the rate of change of the pulse rate is explained. The rate of change of the pulse rate is an indicator of the tendency of the autonomic nervous system. In addition, the pulse rate is the number of heart beats within a given time. For example, the number of heart beats in 1 minute is set as the pulse rate. The rate of change of the pulse rate is calculated by dividing the pulse rate during pulse wave measurement by the pulse rate in the normal state. In this embodiment, the storage unit 19 stores the pulse rate in the normal state in advance, and when calculating the rate of change of the pulse rate, the printing device 1 calls the pulse rate in the normal state stored in the storage unit 19 and uses it for calculation.

[0112] In addition, the control unit 110 compares the pulse rate change rate with a threshold value to infer the user's physical and mental state. For example, when the calculated pulse rate change rate exceeds the threshold value, the printing device 1 can determine that the user is in a tense tendency. In addition, when the calculated pulse rate change rate is below the threshold value, the printing device 1 can determine that the user is in a relaxed tendency.

[0113] Next, the change rate of PA (Pulse Amplitude) is an index showing the increase or decrease of the amplitude of the pulse waveform. The change rate of PA can be calculated as follows.

[0114] Rate of change of PA = (PA2 / PA1)... (Formula)

[0115] PA1: Average value of PA measurement in normal state

[0116] PA2: The average value of the PA measured at a given time in the measurement

[0117] The average value of the measured value of PA in the normal state is measured in advance and stored in the storage unit 19 of the printing device 1. When calculating the biological information, the control unit 110 calls the average value of the measured value of PA in the normal state from the storage unit 19 and uses the value for calculation. In addition, the smaller the rate of change of PA is, the printing device 1 can determine that the user tends to have poor blood circulation. In addition, the larger the rate of change of PA is, the more the printing device 1 can determine that the user tends to have good blood circulation.

[0118] Next, the baseline change rate is an index related to the blood circulation state. The baseline change rate can be calculated as follows.

[0119] Baseline change rate = (BL2 / BL1)... (Formula)

[0120] BL1: Baseline of pulse wave information in normal state

[0121] BL2: Baseline of pulse wave information under measurement

[0122] Here, the baseline refers to the average value of the converted brightness within a given time. In addition, in the present embodiment, the baseline of the pulse wave information in the normal state is measured in advance and stored in the storage unit 19 of the printing device 1. When calculating the biological information, the control unit 110 calls the baseline in the normal state from the storage unit 19 and uses the value for calculation. When the rate of change of the baseline is below the threshold, the printing device 1 can determine that the user's blood circulation is poor. In addition, when the rate of change of the baseline exceeds the threshold, the printing device 1 can determine that the user's blood circulation is good.

[0123] Next, the respective meanings of baseline and PA are examined. As described above, the principle of extracting pulse wave information from the brightness of the image is to capture the temporal change in the brightness of the green light absorbed by hemoglobin. Therefore, it is believed that the baseline is roughly proportional to the average amount of hemoglobin in the target part during the measurement period. That is, the change in the baseline can be interpreted as the change in the average blood volume of the measurement part. In contrast, the pulse wave amplitude itself represents the pulsation of the pulse, so the change in PA can be interpreted as the change in the intensity of the pulsation.

[0124] In addition, the control unit 110 involved in this embodiment stores the data of the normal state as the basis for calculation in the storage unit 19 when calculating the deviation change rate of the Lorentz curve, the change rate of the pulse rate, the change rate of the PA, and the change rate of the baseline. However, the data used as the basis for calculation is not limited to this, for example, the average value of users of the same age group or the average value of users of the same gender can be used. In addition, the image processing unit 111 can also obtain data twice or more during the printing process and use one of the obtained data as the basis for calculation.

[0125] Next, the fluctuation of the interval of pulse wave pulses, CVRR (Coefficient of Variation of R-R intervals), is an indicator of the state of the heart rate regulation function. In addition, CVRR is calculated by frequency analysis of pulse wave information, etc. The smaller the CVRR, the more likely the printing device 1 is to determine that the user's heart rate regulation function is in a poor state. In addition, the larger the CVRR, the more likely the printing device 1 is to determine that the user's heart rate regulation function is in a good state.

[0126] Next, deformation time is an index indicating the relative change of blood pressure. In addition, deformation time is the time deviation between the pulse wave component in the pulse wave information and the waveform deformation component caused by the change of blood pressure. The smaller the deformation time, the higher the blood pressure of the user can be determined by the printing device 1. In addition, the larger the deformation time, the lower the blood pressure of the user can be determined by the printing device 1. In addition, not limited to the above indicators, the printing device 1 involved in this embodiment can calculate various indicators indicating the physical and mental state of the user based on the acquired pulse wave information.

[0127] [Printing Action]

[0128] Next, refer to Figures 13-14 The flow of printing processing will be described. Figures 13-14 It indicates that Figure 4 Functional structure Figure 2 Flowchart of the process flow executed by the printing device 1. The printing process is started by the user's operation of starting the printing process on the input unit 56 of the user terminal 2 in a state where the user's finger is placed on the finger rest.

[0129] First, if Fig.13 As shown, the control unit 110 sets the measurement parameters of the imaging unit 16 to the preset initial values ​​(step S10). The measurement parameters are set values ​​related to the imaging of the camera 16a of the imaging unit 16. The set values ​​are, for example, numerical values ​​related to the settings of the exposure, focal length, magnification of the camera 16a, the brightness and brightness of the LED of the lighting 16b, etc. By appropriately setting the measurement parameters, the noise of the image can be reduced, and the reliability of the measured pulse wave information can be improved.

[0130] In addition, the brightness of the image sometimes changes depending on the skin color of the user being photographed, etc. Therefore, in the case where individual differences are assumed between users, each measurement parameter may not be an initial value, but a parameter may be set in cooperation with the user. For example, in step S11, the finger 5 on the finger rest 32b may be photographed, and the set value may be changed based on the image of the photographed finger 5. Furthermore, the control unit 110 may save the measurement parameters for each individual in the authentication server of the server group 4 via the network 3 at the timing of the end of the printing process, and call the measurement parameters from the authentication server to set them when other printing processes start.

[0131] In this embodiment, the control unit 110 sets the measurement parameters each time the printing process starts. However, the control unit 110 may store the set measurement parameters in the storage unit 19 and use the stored measurement parameters when printing for the same user next time or later.

[0132] Next, the control unit 110 determines whether the user's finger 5 is detected by the sensor of the printing unit 32 (step S11). If the user's finger 5 is detected by the sensor (step S11: Yes), the control unit 110 sets the region of interest ROI on the finger (step S12).

[0133] Next, the control unit 110 starts measuring the pulse wave by causing the imaging unit 16 to start imaging the finger 5 (step S13). When the pulse wave measurement is completed (step S14: Yes), the control unit 110 calculates the S / N (Signal to noise) value of the measured pulse wave information and compares it with the threshold value (step S15).

[0134] Here, the S / N value is an index for confirming how much noise other than the pulse wave is included in the measured pulse wave information. The smaller the S / N value, the higher the reliability of the acquired image data. In this embodiment, the threshold is set to 0.7, and the data with an S / N value less than 0.7 is set as reliable data. In addition, the threshold is not limited to 0.7, and can be set according to the purpose of the device to be used.

[0135] If the S / N value is less than 0.7 (step S15: No), the control unit 110 causes the imaging unit 16 to readjust the measurement parameters such as the exposure of the camera 16a (step S17), and transfers the process to step S11. On the other hand, if the S / N value exceeds 0.7 (step S15: Yes), the control unit 110 calculates Fig.10 The data used for determination in the biometric information shown is obtained (step S16). Next, the control unit 110 transmits the calculated biometric information to the user terminal 2 via the communication unit 20 in order to cause the user terminal 2 to display the calculated biometric information (step S18).

[0136] Next, the control unit 110 calculates the biological information, such as Fig.14 The control unit 110 determines the value of LF / HF by comparing it with the threshold value as shown in the figure (step S19). In the present embodiment, it is set to use LF / HF as an indicator of determination, and determine and suggest a nail design that expresses the physical and mental state. For example, the control unit 110 determines the value of LF / HF against the threshold value "1". When LF / HF exceeds the threshold value "1" (step S19: Yes), the control unit 110 sends determination information for creating and selecting a bright color group from the label of the design data to the user terminal 2 via the communication unit 20 (step S20).

[0137] Then, the control unit 70 of the user terminal 2 sends a command signal to the nail design registration and distribution server of the server group 4 via the communication unit 59, so that the nail design registration and distribution server sends the data of the nail design with the bright color label to the user terminal 2. The control unit 70 of the user terminal 2 uses the received nail design data to create a plurality of determined nail design groups. For example, Fig.11 The data of the two nail designs shown. In addition, the number of nail designs is not particularly limited.

[0138] Furthermore, the control unit 110 transmits a design selection display instruction signal to the user terminal 2 via the communication unit 20 in order to display a selection screen for the user to select a nail design (step S22 ).

[0139] The input processing unit 73 of the user terminal 2 receives the user's selection of a nail design through the input unit 56. The control unit 70 of the user terminal 2 transmits the selection information of the nail design to the printing device 1 via the communication unit 59.

[0140] The control unit 110 checks whether the communication unit 20 has received the nail design selection information (step S23). If the communication processing unit 71 has received the nail design selection information (step S23: Yes), the control unit 110 shifts the process to step S24.

[0141] On the other hand, when LF / HF is below the threshold "1" (step S19: No), the control unit 110 outputs to the communication processing unit 116, and sends the determination information for creating and selecting a stable color group from the label of the design data to the user terminal 2 via the communication unit 20 (step S21).

[0142] Then, the control unit 70 of the user terminal 2 sends a command signal to the nail design registration and distribution server of the server group 4 via the communication unit 59, so that the user terminal 2 sends the data of the nail design with the stable color label to the nail design registration and distribution server. The control unit 70 of the user terminal 2 uses the received data of the nail design to create a plurality of determined nail design groups.

[0143] Furthermore, the control unit 110 transmits a design selection display instruction signal to the user terminal 2 via the communication unit 20 in order to display a selection screen for selecting a nail design on the screen of the output unit 57 of the user terminal 2 (step S22 ).

[0144] The input processing unit 73 of the user terminal 2 receives the user's selection of a nail design through the input unit 56. The control unit 70 of the user terminal 2 transmits the selection information of the nail design to the printing device 1 via the communication unit 59.

[0145] The control unit 110 checks whether the communication unit 20 has received the nail design selection information (step S23). If the communication processing unit 71 has received the nail design selection information (step S23: Yes), the control unit 110 shifts the process to step S24.

[0146] Next, the control unit 110 generates a preview image in which the selected nail design is superimposed on the image of the photographed finger 5. In addition, the control unit 110 also superimposes a selection screen for whether to execute printing on the preview image. In addition, the control unit 110 transmits the generated preview image to the user terminal 2 via the communication unit 20 in order to display the preview screen on the user terminal 2 (step S24).

[0147] The control unit 70 of the user terminal 2 displays the received preview image on the screen of the output unit 57. In addition, a selection screen for whether to execute printing is displayed on the screen of the output unit 57 of the user terminal 2. When the user touches the option displayed on the screen, the control unit 70 of the user terminal 2 receives the selection information on whether to execute printing. The control unit 70 of the user terminal 2 sends the selection information to the printing device 1 via the communication unit 59.

[0148] Next, the control unit 110 checks whether to execute printing based on the received selection information (step S25). If the selection information is a selection not to execute printing (step S25: No), the control unit 110 transfers the process to step S22. If the selection information is a selection to execute printing (step S25: Yes), the control unit 110 prints the nail design selected in the printing unit 32 on the nail 5a of the user's finger 5. Next, the control unit 110 checks whether the printing operation of the printing unit 32 is completed (step S26).

[0149] When the printing operation of the printing unit 32 is completed (step S26 : Yes), the control unit 110 transmits a command signal for prompting the user terminal 2 to display the selection screen to confirm whether to continue printing, via the communication unit 20 .

[0150] The control unit 70 of the user terminal 2 displays a selection screen of whether to continue printing on the screen of the output unit 57. When the user touches the option displayed on the screen, the control unit 70 of the user terminal 2 receives the selection information of whether to continue printing. The control unit 70 of the user terminal 2 transmits the selection information to the printing device 1 via the communication unit 59. In addition, the so-called continued printing is assumed to print on the nail 5a of another finger 5 of the same user, or to use another user.

[0151] The control unit 110 confirms whether to continue the received printing selection information (step S27). If the selection information is a selection to continue printing (step S27: Yes), the control unit 110 sends a command signal for prompting the user terminal 2 to display the selection screen via the communication unit 20 in order to confirm whether the user who continues printing is the same user.

[0152] The control unit 70 of the user terminal 2 displays a selection screen for whether to continue printing on the screen of the output unit 57. When the user touches the option displayed on the screen, the control unit 70 of the user terminal 2 receives the selection information for whether to continue printing. The control unit 70 of the user terminal 2 transmits the selection information to the printing device 1 via the communication unit 59.

[0153] The control unit 110 confirms the selection information sent from the user terminal 2 (step S28). If the user who selected the information to continue printing is the same user (step S28: Yes), the control unit 110 transfers the process to step S22. As a result, the user can print the nail design on the nail 5a of another finger 5 without processing such as setting the measurement parameters.

[0154] On the other hand, if the user who selected the information to continue printing is not the same person (step S28: No), the control unit 110 transfers the process to step S10. Thus, the control unit 110 can perform the printing process for the new user from the setting of the measurement parameters. Next, the case of "No" in step S27 is described. If the selected input is a selection to end without continuing printing (step S27: No), the printing process ends. In addition, in this embodiment, Fig.14 The processes of steps S19 to S28 shown are performed by the control unit 110 of the printing device 1 , but may be performed by the control unit 70 of the user terminal 2 .

[0155] The printing device 1 configured as described above includes a control unit 110 that acquires biological information related to blood flow and determines a nail design to be presented to the user based on the acquired biological information.

[0156] Thus, in the printing device 1 according to the present embodiment, it is possible to present a nail design more suitable for the user's physical and mental state.

[0157] Furthermore, the control unit 110 acquires biological information based on at least information related to an image obtained by photographing a part of the body. Furthermore, the biological information is an image pulse wave.

[0158] Thus, the printing device 1 according to the present embodiment can acquire biometric information in a non-contact manner.

[0159] Furthermore, biometric information is acquired based on information related to an image obtained by photographing the user's finger.

[0160] Thus, the printing device 1 involved in the present embodiment can use the image of the camera of the nail printer to measure the pulse wave, and can achieve lightweight and cost reduction due to the reduction in the number of parts of the nail printer. In addition, the printing device 1 involved in the present embodiment can measure the pulse wave while printing the nail design using the nail printer. The printing device 1 can reduce the time and labor spent on pulse wave measurement. Furthermore, the part of the nail printer where the finger is placed is a place where external light, which is an important factor of the noise of the image pulse wave, is not incident. Therefore, the printing device 1 involved in the present embodiment can reduce the noise of the image used for pulse wave measurement.

[0161] Furthermore, the control unit 110 determines the blood circulation state based on the biological information, and determines the nail design to be presented to the user based on the determined blood circulation state.

[0162] Thus, the printing device 1 according to the present embodiment can provide a nail design corresponding to the blood circulation state of the user. For example, the printing device 1 can provide a nail design that expresses the blood circulation state of the user. The printing device 1 can make the nail design a stable color when the user's blood circulation is poor, or make the nail design a bright color when the user's blood circulation is good, so that the user can recognize the physical and mental state.

[0163] Furthermore, the control unit 110 determines the user's nervous state based on the biometric information, and determines a nail design to be presented to the user based on the determined nervous state.

[0164] Thus, the printing device 1 according to the present embodiment can provide a nail design that matches the user's nervous state. For example, the printing device 1 can provide a nail design that is balanced and suppresses the user's boredom. The printing device 1 can make the nail design a stable color when the user is nervous, or make the nail design a bright color when the user is relaxed, which can help balance the user's mood.

[0165] Furthermore, the control unit 110 determines the state of the heart rate adjustment function based on the biological information, and determines the nail design to be presented to the user based on the determined heart rate adjustment function.

[0166] Thus, the printing device 1 involved in this embodiment can provide a nail design corresponding to the state of the user's heart rate adjustment function. For example, the printing device 1 can provide a nail design that expresses the state of the user's heart rate adjustment function. The printing device 1 can make the nail design a stable color when the state of the user's heart rate adjustment function is poor, or make the nail design a bright color when the state of the user's heart rate adjustment function is good, so that the user can recognize the physical and mental state.

[0167] Furthermore, the control unit 110 determines the state of the blood pressure based on the biological information, and determines the nail design to be presented to the user based on the determined state of the blood pressure.

[0168] Thus, the printing device 1 according to the present embodiment can provide a nail design corresponding to the blood pressure state. For example, the printing device 1 can provide a nail design that expresses the blood pressure state of the user. For example, the printing device 1 can make the nail design a stable color when the user's blood pressure is low, or make the nail design a bright color when the user's blood pressure is high, thereby enabling the user to recognize the physical and mental state.

[0169] In addition, the printing device 1 according to the present embodiment has a group consisting of a plurality of nail designs set in advance, and the control unit 110 determines a group as a nail design to be presented to the user based on the biometric information.

[0170] Thus, the printing device 1 can further shorten the time required to determine the nail design to be presented to the user.

[0171] [Modifications]

[0172] In addition, the present invention is not limited to the above-mentioned embodiment, and deformation, improvement, etc. within the scope of being able to achieve the purpose of the present invention are also included in the present invention. For example, the above-mentioned embodiment can be deformed to become the following example of variation. In addition, the following example of variation can also be combined.

[0173] <First Modification>

[0174] In the above-mentioned embodiment, in the printing device 1, biological information such as LF / HF, standard deviation of FFI, deviation change rate of Lorentz curve, change rate of pulse rate, change rate of PA, change rate of baseline, CVRR, and deformation time are calculated, but it is not limited to this. For example, in a structure in which a cuff for pressing a finger is added, pulse wave measurement is performed respectively when the finger is pressed and when the finger is not pressed, thereby calculating the blood volume based on the pulse wave information before and after the finger is pressed. As a result, the printing device 1 can prompt the user with a nail design corresponding to the blood volume.

[0175] use Fig.15 The hardware configuration of the printing device 1 according to the first modification example will be described. Configurations that are the same as or similar to those already described are denoted by the same names and detailed descriptions may be omitted. Fig.15 This is a block diagram showing the hardware configuration of a printing device 1 according to a first modified example of the present invention.

[0176] The printing device 1 of the present embodiment is a computer including a CPU 11, a ROM 12, a RAM 13, a bus 14, an input / output interface 15, an imaging unit 16, an input unit 17, an output unit 18, a storage unit 19, a communication unit 20, a driver 21, a power supply unit 22, a printing unit 32, a pulse wave analysis unit 33, and a compression unit 34. In addition, for the same or similar configurations as those already described, the same names may be given and detailed descriptions thereof may be omitted.

[0177] The pressing part 34 has Fig.16 The cuff 34a shown is formed of a long and narrow bag-shaped cloth, and a pump unit (not shown) for sending air into the cuff 34a. Fig.16 This is a state where the cuff 34a is wound around the finger 5 placed on the finger support 32b in the printing unit 32 of the printing device 1. The compression unit 34, when the cuff 34a is wound around the user's finger 5, can expand the cuff 34a by sending air into the cuff 34a of the pump unit to compress the blood vessels of the finger 5 and adjust the blood flow. In addition, in this embodiment, the finger is compressed by sending air into the cuff 34a, but it is not limited to this. For example, the user's finger can also be compressed by binding with a tube or the like.

[0178] Next, the functional structure of the printing device 1 according to the first modification example will be described. Fig.17 This is a functional block diagram showing a part of the functional structure of the printing device 1 involved in the first modification. The control unit 110 that performs various controls of the printing device 1 involved in the first modification is implemented by the CPU 11 that executes arithmetic processing. The control unit 110 of this embodiment includes an image processing unit (image processing function) 111, an output processing unit (output processing function) 112, an input processing unit (input processing function) 113, a data processing unit (data processing function) 114, a determination processing unit (determination processing function) 115, a communication processing unit (communication processing function) 116, a printing processing unit (printing processing function) 117, and a compression processing unit (compression processing function) 118. In addition, for the same or similar structures as those already described, the same names are sometimes marked and detailed descriptions are omitted.

[0179] The compression processing unit 118 can drive the pump unit of the compression unit 34 according to the command to control the air supply into the cuff 34a. For example, in this modified example, when the pulse wave measurement is performed while the user's finger 5 is compressed, the compression processing unit 118 receives the command to start compression of the cuff 34a and drives the pump of the compression unit 34.

[0180] Fig.18 The diagrams are for explaining the difference in pulse wave measurement results based on whether or not the cuff 34a is compressed. The upper diagram shows pulse wave measurement when the finger 5 is not compressed, and the lower diagram shows pulse wave measurement when the finger 5 is compressed.

[0181] Specifically, the left figure in the upper section is a figure showing the situation of measurement when the pulse wave of the finger 5 is measured without pressure. The central figure in the upper section is a figure showing the situation of overlapping the region of interest ROI and the pulse wave waveform on the image of the finger 5 in the pulse wave measurement without pressure. The right figure in the upper section is a graph showing the baseline when the pulse wave measurement is performed without pressure on the finger 5. In this embodiment, the measured baseline is set as the normal baseline, and the red signal R1 is subtracted from the green signal G1 to calculate G1-R1.

[0182] In addition, specifically, the left figure in the lower section is a figure showing a situation in which the pulse wave of finger 5 is measured on the basis of compressing finger 5 by inflating cuff 34a. The figure of cuff 34a depicted with an oblique line shows that cuff 34a is in a compressed state. The central figure in the lower section is a figure showing a situation in which the region of interest ROI and the pulse wave waveform are overlapped on the image of finger 5 in the pulse wave measurement in a compressed state. The right figure in the lower section is a curve chart showing the baseline in the case of performing pulse wave measurement in a state of compressing finger 5. In this embodiment, the baseline measured in the compressed state is used as the reference baseline, and the red signal R is subtracted from the green signal G to calculate GR.

[0183] like Fig.18 As shown in the left figure of the upper and lower sections of FIG, the pulse wave measurement performed by pressing the finger 5 is performed under the same conditions except that the cuff 34a is used for pressing. Fig.18 As can be seen from the figure in the middle of the upper and lower sections, the amplitude of the pulse wave in the figure in the middle of the lower section is smaller than that in the figure in the middle of the upper section. That is, it can be seen that the pulse wave amplitude becomes smaller by pressing the finger 5 with the cuff 34a. Fig.18 As shown in the left figure of the upper and lower sections of , even when the calculated baselines are compared, the baseline GR based on the pulse wave information in the compressed state becomes smaller.

[0184] In this embodiment, the control unit 110 subtracts the baseline (GR) obtained by measuring the pulse wave with compression from the normal baseline (G1-R1) obtained by measuring the pulse wave without compression as a reference, thereby being able to calculate the amount of blood increased during the pulse wave measurement based on the blood volume in the reference state.

[0185] Next, specific processing of the first modification example will be described. Fig.19 This is a part of the flowchart for explaining the flow of the printing process of the printing device 1. Steps S10 to S16 and steps S18 to S28 are the same as those in one embodiment of the present invention, and thus the flowchart and detailed description are omitted.

[0186] from Fig.13 The control unit 110 calculates various biological information based on the acquired pulse wave information (step S16). Next, the generated biological information, such as the calculated baseline (G1-R1), is saved (step S100). Next, the control unit 110 causes the compression unit 34 to drive the pump, and air is introduced into the cuff 34a wrapped around the finger 5 to start compression of the finger 5 (step S101).

[0187] The control unit 110 obtains the compression value (pressure) in the cuff 34a from the compression unit 34, and checks whether the compression value exceeds the preset value (step S102). If the pressure value exceeds the set value (step S102: yes), the control unit 110 causes the compression unit 34 to stop the pump operation and stop the compression of the finger 5 (step S103). Next, the control unit 110 causes the imaging unit 16 to start imaging the finger 5 and start pulse wave measurement (step S104).

[0188] After the pulse wave measurement is completed (step S105: Yes), the control unit 110 causes the compression unit 34 to release the air in the pump to release the compression of the finger 5 (step S106). Various biological information is calculated from the pulse wave measured in steps S104 to S105 (step S107). Next, the control unit 110 transmits the biological information and the command signal to the user terminal 2 via the communication unit 20 in order to display the calculated biological information on the screen of the output unit 57 of the user terminal 2 (step S108).

[0189] The control unit 70 of the user terminal 2 displays the calculated biometric information, for example, the calculated baseline information (GR), on the screen of the output unit 57 based on the acquired biometric information and the command signal.

[0190] Next, the control unit 110 calculates the blood volume by subtracting the calculated baseline information (GR) from the stored baseline information (G1-R1) (step S109). Next, the control unit 110 transmits the calculated various information and command signals to the user terminal 2 via the communication unit 20 in order to display the calculated blood volume and the transition of the graph on the screen of the output unit 57 of the user terminal 2.

[0191] The control unit 70 of the user terminal 2 displays the calculated blood volume and graph transition on the screen of the output unit 57 based on the acquired various information and the command signal (step S110). Next, the control unit 110 sends a command signal to the user terminal 2, which prompts the display of a selection screen for whether to end the printing task of printing the nail design on the nail 5a.

[0192] When receiving the command signal, the control unit 70 of the user terminal 2 displays a selection screen for whether to end the print job on the screen of the output unit 57. When the user touches the option displayed on the screen, the control unit 70 of the user terminal 2 receives the user's selection information. In addition, the control unit 70 of the user terminal 2 sends the selection information for whether to end the print job to the printing device 1 via the communication unit 59.

[0193] Next, the communication unit 20 of the control unit 110 confirms the selection information (step S111). If the selection information does not end the selection of the print job (step S111: No), the control unit 110 causes the storage unit 19 to store the calculated biometric information and transfers the process to step S18 (step S112). If the selection information is a selection to end the print job (step S111: Yes), the control unit 110 transfers the process to step S10. Fig.13 The same processing as the above-described embodiment is described.

[0194] As described above, in the printing device 1 involved in the first variant, in addition to one embodiment of the present invention, a structure for pressing the finger is further provided. The printing device 1 measures the pulse wave without pressing the finger and calculates the blood volume. Thus, the printing device 1 can provide a nail design suggestion corresponding to the blood volume as the user's physical and mental state.

[0195] <Second Modification>

[0196] In the first modification, the stop control of the pressing of the pressing section 34 during the printing process ( Fig.19In step S102), a preset value is used as a threshold value for comparison and determination, but the present invention is not limited thereto. For example, when the noise included in the measured pulse wave exceeds a certain value, the control of stopping is also performed. As a method for determining the noise included in the pulse wave information, the S / N value is used for determination. In addition, the printing device 1 involved in the second modification example has the same structure as the printing device 1 involved in the first modification example, and the same name is given and the detailed description is omitted.

[0197] The specific processing of the second modification example will be described. Fig. 20 This is a part of the flowchart for explaining the flow of printing processing of the printing device 1. The flowchart of this modification is a process in which steps S102 to S104 of the first modification are replaced with steps S200 to S202. The other processes are the same as those of the first modification, so the flowchart and detailed description are omitted.

[0198] First, the explanation starts from step S101. The control unit 110 causes the compression unit 34 to drive the pump, and puts air into the cuff 34a wrapped around the finger 5 to start compression of the finger 5 (step S101). Next, the control unit 110 causes the camera unit 16 to start imaging the finger 5 and start pulse wave measurement (step S200). Next, the control unit 110 confirms the S / N value of the acquired pulse wave information and the compression value (pressure) of the cuff 34a (step S201). When the S / N value is less than 0.3 or the compression value exceeds the set value (step S201: yes), the control unit 110 causes the compression unit 34 to stop the pump action and stop compression of the finger 5 (step S202). Thereafter, execution is performed with reference to Fig.19 The same processing as the above-mentioned modified example. In addition, the threshold value of the S / N value is not limited to 0.3, and can be set according to each individual.

[0199] As described above, in the printing device 1 according to the second variant, the pulse wave is measured without pressing the finger, and when calculating the blood volume, the amount of noise in the pulse wave information is observed to determine the stop of the pressing. Thus, the printing device 1 can measure the pulse wave more accurately, and can provide a nail design suggestion corresponding to the user's physical and mental state with higher accuracy.

[0200] <Third Modification>

[0201] In one of the above embodiments, the pulse wave information is obtained by analyzing the image of the finger, but it is not limited to this. Fig.21As shown, the printing device 1 may also acquire pulse wave information by capturing an image of the face by a camera provided outside the printing device 1 and analyzing the image of the face. In addition, the printing device 1 according to the third modification is the same as the first embodiment except that the imaging unit 16 is provided outside the housing of the printing unit 32, and the same names are given and detailed description is omitted. In addition, the specific processing of this modification is the same as that of the above-mentioned embodiment, so the flowchart and detailed description are omitted.

[0202] As described above, in the printing device 1 involved in the third variant, pulse wave information is obtained from the image of the face and biological information is calculated. As a result, the degree of freedom in the design of the printing device 1 is improved. In addition, in this variant, the printing device 1 captures the image of the face, but is not limited to this. For example, the part to be photographed may be the user's feet or arms. In addition, in this variant, the printing device 1 includes a camera, but the photographing may be performed by a camera that is different from the camera unit 16 and can be connected to the printing device 1.

[0203] In addition, in this embodiment, the pulse wave information is obtained by analyzing the image of the finger, but it is not limited to this. For example, the pulse wave measurement can also be a measurement using a sensor composed of a light emitting element and a light receiving element that combine infrared light, or a measurement using a method that captures the volume change of the artery as a pressure change using a pressure sensor.

[0204] In addition, in the present embodiment, the nail design stored in the nail design registration and distribution server is downloaded to the user terminal 2 to determine the nail design to be prompted to the user, but it is not limited to this. For example, the user terminal 2 can also generate a nail design based on the inferred physical and mental state. In addition, in the present embodiment, the nail design prompted by the user terminal 2 is displayed so that the user can choose, but it is not limited to this. For example, the printing device 1 can also be provided with a screen display function and a selection input function, and the printing device 1 displays the nail design prompted on the screen so that the user can choose. In addition, in the present embodiment, the present invention is applied to the printing device 1, but it is not limited to this. For example, the information processing device involved in the present invention can also be the user terminal 2 or the server. In addition to printing the nail design and obtaining an image of a part of the body, the printing device 1 involved in the present embodiment also performs processing of detecting the image pulse wave, obtaining biological information from the image pulse wave, and determining the nail design based on the biological information obtained, but the processing of determining the nail design can also be performed on the user terminal 2 side or the server side.

[0205] That is, the nail art system S may also be configured to include: a printing device 1 having: an imaging unit 16 (acquisition unit) for acquiring an image of at least a part of the user's body; a communication unit 20 capable of transmitting the image acquired by the imaging unit 16 to the outside; a printing unit 32 capable of printing the user's nails; a user terminal 2 having: a communication unit 59 capable of communicating with the printing device 1; and a control unit 70 for determining the user's biological information based on the image of at least a part of the user's body, and determining the nail art design to be presented to the user based on the determined biological information. In this configuration, the printing unit 32 prints the user's nails based on the nail art design received by the communication unit 20 from the communication unit 59. In addition, in the above, the imaging unit 16 has the printing device 1, but it is not limited to this. The imaging unit 16 may also be a camera device separate from the printing device 1, or may be a camera possessed by the user terminal 2. For example, when a camera device separate from the printing device 1 is used as the camera unit 16, the camera unit 16 may directly send information related to the image to the user terminal 2 or to the server after obtaining an image of at least a part of the user's body. In addition, when a camera included in the user terminal 2 is used as the camera unit 16, the camera unit 16 may directly send information related to the image to the server after obtaining an image of at least a part of the user's body or may not send the image to the server, and the control unit 110 directly determines the nail design based on the information related to the image from the user terminal 2.

[0206] The above series of processing can be executed by hardware or software. Figure 4 The functional structure is merely an example and is not particularly limited. That is, as long as the printing device 1 has the function of being able to execute the above series of processes as a whole, the functional modules used to implement the function are not particularly limited. Figure 4 Example.

[0207] In addition, a functional block can be composed of a hardware monomer, a software monomer, or a combination thereof. The functional structure in this embodiment is implemented by a processor that performs arithmetic processing. Among the processors that can be used in this embodiment, in addition to processors composed of various processing device monomers such as a single processor, a multi-processor, and a multi-core processor, it also includes a structure obtained by combining these various processing devices with processing circuits such as ASIC (Application Specific Integrated Circuit) and FPGA (Field-Programmable Gate Array).

[0208] When a series of processes are performed by software, the program constituting the software is installed from a network or a recording medium to a computer, etc. The computer may also be a computer assembled in dedicated hardware. In addition, the computer may also be a computer capable of performing various functions by installing various programs, such as a general-purpose personal computer.

[0209] The recording medium including such a program includes not only a recording medium distributed separately from the apparatus main body in order to provide the program to the user, but also a recording medium including ... Figure 2 The removable medium 100 includes a recording medium provided to the user in a state pre-assembled in the device body. The removable medium 100 includes, for example, a magnetic disk (including a floppy disk), an optical disk, or an optical magnetic disk. Examples of optical disks include CD-ROM (Compact Disk-Read Only Memory), DVD (Digital Versatile Disk), Blu-ray (registered trademark) Disc, etc. Optical magnetic disks include MD (Mini-Disk), etc. In addition, the recording medium provided to the user in a state pre-assembled in the device body includes, for example, a CD-ROM (Compact Disk-Read Only Memory), DVD (Digital Versatile Disk), Blu-ray (registered trademark) Disc, etc. Optical magnetic disks include MD (Mini-Disk), etc. Figure 2 ROM12, Figure 2 The storage unit 19 includes a hard disk, etc.

[0210] In addition, in this specification, the steps of the program recorded in the recording medium include not only the processing performed in time sequence according to the order thereof, but also the processing not necessarily performed in time sequence but performed in parallel or individually. In addition, in this specification, the term system refers to an overall device including a plurality of devices, a plurality of units, etc.

[0211] Several embodiments of the present invention have been described above, but these embodiments are merely illustrative and do not limit the technical scope of the present invention. The present invention can adopt various other embodiments, and further, various changes such as omission and substitution can be made without departing from the scope of the present invention. These embodiments and their variations are included in the scope and gist of the invention described in this specification, etc., and are included in the invention described in the claims and their equivalents.

Claims

1. An information processing device, characterized in that: A processing unit is provided, and the processing unit performs the following processing: Acquire biological information related to the user's blood flow, inferring which of a plurality of physical and mental states the user's physical and mental state is based on the acquired biological information, A nail design corresponding to the estimated physical and mental state is determined as a nail design for the user among a plurality of nail designs that are determined in advance to correspond to the plurality of physical and mental states, respectively.

2. The information processing device according to claim 1, characterized in that The processing unit acquires the biological information based on information related to an image obtained by imaging a region of a portion of skin other than a nail provided on the base side of the nail of the finger.

3. The information processing device according to claim 2, characterized in that: The biological information is an image pulse wave.

4. The information processing device according to claim 2 or 3, characterized in that: storing corresponding information establishing a correspondence between each of the plurality of physical and mental states and each of the plurality of nail art designs, The processing unit performs the following processing: acquiring the biometric information based on information related to an image obtained by photographing a finger of the user, And a nail art design for the user is determined based on the biological information and the corresponding information.

5. The information processing device according to claim 4, characterized in that The multiple physical and mental states include relaxation tendency, tension tendency, The various nail art designs include designs with stable colors and designs with bright colors. The processing unit determines a blood circulation state based on the biological information, and determines a nail design based on the determined blood circulation state and the corresponding information.

6. The information processing device according to any one of claims 1 to 3, characterized in that: The processing unit determines a user's nervous state based on the biological information, and determines a nail design based on the determined nervous state.

7. The information processing device according to any one of claims 1 to 3, characterized in that: The processing unit determines a state of a heart rate adjustment function based on the biological information, and determines a nail design based on the determined heart rate adjustment function.

8. The information processing device according to any one of claims 1 to 3, characterized in that: The processing unit determines a high or low state of blood pressure based on the biological information, and determines a nail design based on the determined high or low state of the blood pressure.

9. The information processing device according to any one of claims 1 to 3, characterized in that: There are pre-set groups including multiple nail designs. The processing unit determines the group as the nail design to be presented to the user based on the biometric information.

10. A nail art system, characterized in that: have: A printing device including a first communication unit capable of communicating with the outside and a printing unit capable of printing on a user's nail; and An information processing device includes a second communication unit capable of communicating with the printing device and a processing unit, wherein the processing unit performs the following processing: acquiring biological information related to the blood flow of the user based on information related to an image obtained by photographing a region of a portion of the skin other than the nail provided on the root side of the nail of the user's finger, inferring which of a plurality of physical and mental states the user's physical and mental state is based on the acquired biological information, determining, as a nail design for the user, a nail design corresponding to the inferred physical and mental state from among a plurality of nail designs that are predetermined to correspond to the plurality of physical and mental states, respectively; The printing unit prints on the nails of the user based on the nail art design received by the first communication unit from the second communication unit.

11. A recording medium storing a program, characterized in that: The program enables the computer to perform the following processing functions: Acquire biological information related to the user's blood flow, inferring which of a plurality of physical and mental states the user's physical and mental state is based on the acquired biological information, A nail design corresponding to the estimated physical and mental state is determined as a nail design to be presented to the user, among a plurality of nail designs that are determined in advance to correspond to the plurality of physical and mental states, respectively.

12. A method for selecting a nail design, executed by an information processing device, characterized in that: The processing steps include: obtaining biological information related to the user's blood flow; inferring which of a plurality of physical and mental states the user's physical and mental state is based on the acquired biological information; A nail design corresponding to the estimated physical and mental state is determined as a nail design to be presented to the user, among a plurality of nail designs that are determined in advance to correspond to the plurality of physical and mental states, respectively.

Images