Diagnostic system, diagnostic device, program, diagnostic method, skin diagnostic method, and pressure diagnostic method

Abstract

The present invention addresses the problem of efficiently performing diagnosis when necessary elements required for each diagnosis are different. A diagnostic system according to one embodiment of the present invention is a system including a terminal and a server, and is provided with: a first diagnostic processing unit that executes a first diagnostic process; a second diagnostic processing unit that executes second diagnostic processing different from the first diagnostic processing; a face state detection unit that detects the face state of the user; and a diagnostic process switching unit that determines which of the first diagnostic process and the second diagnostic process is to be executed on the basis of the result of the detection.

Description

Technical Field

[0001] The present invention relates to a diagnostic system, a diagnostic device, a program, a diagnostic method, a skin diagnostic method and a stress diagnostic method. Background Art

[0002] In the past, there is a known method for analyzing an image of a user's face to diagnose the user's condition. For example, Patent Document 1 describes the following: a plurality of images showing a process of expression change are obtained, an image between an image at the beginning of the expression change and an image at the end of the expression change is extracted as an analysis object, and the extracted image is used to analyze the characteristics of the skin.

[0003] <Prior Art Literature>

[0004] <Patent Documents>

[0005] Patent Document 1: Japanese Patent Application Publication No. 2019-098168 Summary of the invention

[0006] <Problems to be Solved by the Invention>

[0007] The imaging method or the user's facial state required for a certain diagnosis is different from that required for another diagnosis. Therefore, when performing multiple diagnoses, the necessary conditions required for each diagnosis must be met, and the diagnosis process is complicated, which puts a burden on the user.

[0008] Therefore, an object of the present invention is to efficiently perform diagnosis when the necessary conditions required for each diagnosis are different.

[0009] <Methods used to solve the problem>

[0010] As one embodiment of the present invention, a diagnostic system is a system including a terminal and a server, and comprises: a first diagnostic processing unit, which performs a first diagnostic processing; a second diagnostic processing unit, which performs a second diagnostic processing different from the first diagnostic processing; a facial state detection unit, which detects the facial state of the user; and a diagnostic processing switching unit, which determines which of the first diagnostic processing and the second diagnostic processing to perform based on the result of the detection.

[0011] <Effects of the Invention>

[0012] According to the present invention, when the necessary conditions required for each diagnosis are different, diagnosis can be performed efficiently. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 This is a diagram for explaining the processing flow when a plurality of types of diagnosis are executed sequentially.

[0014] Figure 2It is a figure for explaining the outline of the present invention.

[0015] Figure 3 This is an overall configuration example according to one embodiment of the present invention.

[0016] Figure 4 This is a functional block diagram of a diagnostic device according to one embodiment of the present invention.

[0017] Figure 5 This is a flowchart of a diagnostic process according to one embodiment of the present invention.

[0018] Figure 6 This is a hardware configuration diagram of a diagnostic device and a terminal according to an embodiment of the present invention. DETAILED DESCRIPTION

[0019] Hereinafter, embodiments of the present invention will be described based on the drawings.

[0020] First, refer to Figure 1 , indicating that multiple diagnostics are performed in sequence (in Figure 1 In the example of FIG. 1 , the processing flow for two diagnoses (skin diagnosis and stress diagnosis) is as follows. In steps 1 and 2, the skin diagnosis is performed, and in steps 4 and 5, the stress diagnosis is performed.

[0021] In step 1 (S1), a device having a camera function such as a smart mirror takes a picture of the user's face when the user is serious. In order to perform skin diagnosis, a high-resolution image and an image of the user's serious face are required.

[0022] In step 2 (S2), the user's skin is diagnosed using the image captured in S1.

[0023] In step 3 (S3), the skin diagnosis mode of S1 and S2 is switched to the pressure diagnosis mode.

[0024] In step 4 (S4), the smart mirror or the like captures the user's face when smiling. In order to diagnose stress, a low-resolution image and an image of the user's smiling face are required. S4 will be described in detail below through steps 41 to 43.

[0025] In step 41 (S41), a smart mirror or the like instructs the user to change to a serious face.

[0026] In step 42 (S42), the smart mirror or the like instructs the user to change into a smiling face.

[0027] In step 43 (S43), the smart mirror or the like takes a picture of the user.

[0028] In step 5 (S5), the user's stress is diagnosed using the image captured in S4.

[0029] Like this, when performing multiple types of diagnostics (in Figure 1 In the example of skin diagnosis and stress diagnosis), the necessary conditions required for each diagnosis must be met (in Figure 1 In the example of FIG. 1 , a high-resolution image of a serious face is required for skin diagnosis, and a low-resolution image of a smiling face is required for stress diagnosis), and the diagnosis process is complicated, which places a burden on the user. Therefore, in the present invention, the diagnosis process is switched according to the user's facial state.

[0030] <Outline>

[0031] Figure 2 It is a figure for explaining the outline of the present invention.

[0032] In step 100 (S100), a device with a camera function such as a smart mirror starts to capture a dynamic image of the user's face. If a serious face is detected during the dynamic image capture, the process proceeds to step 101. If a smiling face is detected during the dynamic image capture, the process proceeds to step 111.

[0033] First, steps 101 to 106 are described.

[0034] Assume that in step 101 ( S101 ), during the moving image shooting started in S100 , a serious face of the user is detected.

[0035] In step 102 ( S102 ), the smart mirror or the like switches to a high-resolution photographing mode to photograph the user's face (take a still image) based on the detection of the user's serious face in S101 .

[0036] In step 103 (S103), the user's skin is diagnosed using the image captured in S102. After that, the smart mirror or the like restarts the dynamic image capture of the user's face.

[0037] Assume that in step 104 ( S104 ), the smiling face of the user is detected during the moving image shooting restarted in S103 .

[0038] In step 105 ( S105 ), the smart mirror or the like switches to a low-resolution shooting mode to shoot the user's face (shoot a still image) in response to the detection of the user's smiling face in S104 .

[0039] In step 106 ( S106 ), the user's stress is diagnosed using the image captured in S105 .

[0040] Next, steps 111 to 116 are described.

[0041] Assume that in step 111 ( S111 ), during the moving image shooting started in S100 , a smiling face of the user is detected.

[0042] In step 112 ( S112 ), the smart mirror or the like switches to a low-resolution shooting mode to shoot the user's face (shoot a still image) in response to the detection of the user's smiling face in S111 .

[0043] In step 113 (S113), the user's stress is diagnosed using the image captured in S112. After that, the smart mirror or the like resumes capturing a dynamic image of the user's face.

[0044] Assume that in step 114 (S114), during the moving image shooting restarted in S113, a serious face of the user is detected.

[0045] In step 115 ( S115 ), the smart mirror or the like switches to a high-resolution photographing mode to photograph the user's face (take a still image) in response to the detection of the user's serious face in S114 .

[0046] In step 116 (S116), the user's skin is diagnosed using the image captured in S115.

[0047] <Overall structure example>

[0048] Figure 3 This is an overall configuration example according to one embodiment of the present invention.

[0049] [Structural Example 1]

[0050] The diagnostic system 1 includes a diagnostic device (eg, a server) 10 and a terminal 11. The diagnostic device 10 and the terminal 11 are connected to each other via an arbitrary network so as to be communicable. In the configuration example 1, a user 20 (or a beauty specialist of a cosmetics store, etc.) operates the terminal 11. Each of these is described below.

[0051] <<Diagnostic device>>

[0052] The diagnostic device 10 is a device that determines which of a plurality of diagnostic processes (a first diagnostic process and a second diagnostic process different from the first diagnostic process) to execute according to the facial state of the user 20. For example, the diagnostic device 10 is a server composed of one or more computers.

[0053] For example, the diagnostic device 10 detects the expression of the user 20 based on the features of the image obtained by photographing the face of the user 20. When the expression of the user 20 is serious, the diagnostic device 10 causes the terminal 11 to capture a still image with high image quality, and when the expression of the user 20 is smiling, the diagnostic device 10 causes the terminal 11 to capture a still image with low image quality.

[0054] <<Terminal>>

[0055] The terminal 11 captures the face of the user 20 and sends the captured image to the diagnostic device 10. In addition, the terminal 11 receives and displays the result of the diagnosis by the diagnostic device 10. In addition, the terminal 11 may also execute a part of the processing of the diagnostic device 10 described in this specification. For example, the terminal 11 is a smart mirror (specifically, a display with a camera function) installed in a store, a smart phone with a camera function, a tablet with a camera function, etc. In addition, the terminal 11 without a camera function may be configured to cause a camera device to capture an image.

[0056] [Structural Example 2]

[0057] In configuration example 2, the user 20 (or a beauty specialist in a cosmetics store, etc.) operates the diagnostic device 10 .

[0058] <<Diagnostic device>>

[0059] The diagnostic device 10 is a device that determines which of a plurality of diagnostic processes (a first diagnostic process and a second diagnostic process different from the first diagnostic process) to execute according to the facial state of the user 20. For example, the diagnostic device 10 is a smart mirror (specifically, a display with a camera function), a smart phone with a camera function, a tablet with a camera function, etc. In addition, the diagnostic device 10 without a camera function may be configured to obtain an image by causing a camera device to shoot.

[0060] For example, the diagnostic device 10 captures the face of the user 20, and detects the expression of the user 20 based on the features of the image obtained by capturing the face of the user 20. The diagnostic device 10 captures a still image with high image quality when the expression of the user 20 is serious, and captures a still image with low image quality when the expression of the user 20 is smiling, and displays the result of the diagnosis.

[0061] <Function block>

[0062] Figure 4 1 is a functional block diagram of a diagnostic device 10 according to an embodiment of the present invention. The diagnostic device 10 includes an image acquisition unit 101, a facial state detection unit 102, a first determination unit 103, a second determination unit 104, a diagnostic process switching unit 105, a first diagnostic process unit 106, a second diagnostic process unit 107, a diagnostic history storage unit 108, a receiving unit 109, and a notification unit 110. The diagnostic device 10 functions as the image acquisition unit 101, the facial state detection unit 102, the first determination unit 103, the second determination unit 104, the diagnostic process switching unit 105, the first diagnostic process unit 106, the second diagnostic process unit 107, the receiving unit 109, and the notification unit 110 by executing a program.

[0063] The image acquisition unit 101 acquires an image obtained by capturing the face of the user 20. For example, the image acquisition unit 101 acquires a moving image captured when the camera mode is the "moving image capture mode". In addition, the image acquisition unit 101 acquires a high-quality still image captured when the camera mode is the "skin diagnosis mode". In addition, the image acquisition unit 101 acquires a low-quality still image captured when the camera mode is the "stress diagnosis mode".

[0064] The facial state detection unit 102 detects the facial state of the user 20 .

[0065] For example, the facial state detection unit 102 detects the expression of the user 20 based on the features of the image acquired by the image acquisition unit 101. Specifically, the facial state detection unit 102 determines whether the user 20 has a serious face based on the coordinates of the various parts of the face of the user 20 (e.g., eyes, nose, mouth, etc.) in the dynamic image captured when the camera mode is the "dynamic image shooting mode". In addition, the facial state detection unit 102 determines whether the user 20 has a smiling face based on the coordinates of the various parts of the face of the user 20 (e.g., eyes, nose, mouth, etc.) in the dynamic image captured when the camera mode is the "dynamic image shooting mode".

[0066] The first judgment unit 103 judges whether the first diagnostic process has been executed a specified number of times (at least 1 time). For example, the first judgment unit 103 can judge whether the first diagnostic process has been executed a specified number of times within a session (that is, whether it has been executed in a series of processes currently in progress). For example, the first judgment unit 103 can judge whether the first diagnostic process has been executed a specified number of times outside a session (for example, whether it has been executed on another day in the past) (in addition, the first judgment unit 103 can determine the user 20 through facial recognition, ID input, etc., thereby judging whether the user 20 has executed the first diagnostic process outside a session).

[0067] The second judgment unit 104 judges whether the second diagnostic process has been executed a specified number of times (at least 1 time). For example, the second judgment unit 104 can judge whether the second diagnostic process has been executed a specified number of times within the session (i.e., whether it has been executed in a series of processes currently in progress). For example, the second judgment unit 104 can judge whether the second diagnostic process has been executed a specified number of times outside the session (e.g., whether it has been executed on another day in the past) (in addition, the second judgment unit 104 can determine the user 20 through facial recognition, ID input, etc., thereby judging whether the user 20 has executed the second diagnostic process outside the session).

[0068] The diagnosis process switching unit 105 determines which of the first diagnosis process and the second diagnosis process to execute based on the result detected by the facial state detection unit 102 (for example, the expression of the user 20 ).

[0069] The first diagnostic processing unit 106 executes the first diagnostic processing. In addition, the first diagnostic processing unit 106 can execute the first diagnostic processing when the first determination unit 103 determines that the first diagnostic processing has not been executed for a specified number of times. For example, a representative value such as an average value of the results of the diagnosis executed multiple times can be used, or a part of the results of the diagnosis executed multiple times can be used. The specified number of times can be set by the user 20.

[0070] The second diagnostic processing unit 107 performs a second diagnostic processing different from the first diagnostic processing. In addition, the second diagnostic processing unit 107 can perform the second diagnostic processing when the second determination unit 104 determines that the second diagnostic processing has not been performed a specified number of times. For example, a representative value such as an average value of the results of the diagnosis performed multiple times may be used, or a portion of the results of the diagnosis performed multiple times may be used. The specified number of times may be set by the user 20.

[0071] Alternatively, user 20 may select only the first diagnostic process, only the second diagnostic process, or both the first diagnostic process and first diagnostic processing unit 106 and second diagnostic processing unit 107 may execute the diagnostic process selected by user 20 .

[0072] The diagnostic history storage unit 108 stores the history records of the first diagnostic process being executed and the history records of the second diagnostic process being executed. In addition, an effective period may be set for the information of each history record, and the first judgment unit 103, the first diagnostic processing unit 106, the second judgment unit 104, and the second diagnostic processing unit 107 only use the information of the history records within the effective period (in addition, the effective period may be set manually or automatically based on past data (for example, the transition of an individual's diagnostic results (the transition of stress status)), season, etc.).

[0073] The accepting unit 109 accepts instructions (for example, settings) input by the user 20 to the terminal 11 (in the case of configuration example 1) or the diagnostic device 10 (in the case of configuration example 2).

[0074] The notification unit 110 notifies the user 20 of information (for example, the result of diagnosis) by displaying it on a screen of the terminal 11 (in the case of configuration example 1) or the diagnostic device 10 (in the case of configuration example 2).

[0075] For example, the notification unit 110 can specify the first facial state or the second facial state to the user 20 (and the facial state detection unit 102 can use the facial state specified by the notification unit 110 as the detected facial state of the user).

[0076] For example, when at least one of the first facial state and the second facial state is not detected within a certain period, the notification unit 110 may indicate the undetected facial state to the user 20. In addition, the certain period may be set by the user 20, or may be determined based on past detection times (for example, an average value or a maximum value of the times required to detect facial states of multiple users in the past, or setting the detection time for each person based on the past detection time of each person).

[0077] In addition, the diagnostic device 10 may skip the processing related to the facial state that has not been detected within a certain period (that is, not perform the diagnostic operation). In addition, the diagnostic device 10 may also ask the user 20 whether the skipping is allowed. In addition, the diagnostic device 10 may also switch between automatically performing the skipping and asking the user 20 whether the skipping is allowed. In addition, the diagnostic device 10 may also notify the user 20 that the skipping is performed.

[0078] <<Facial condition>>

[0079] Here, the facial state is described in detail. In this specification, the facial state of the user 20 is mainly described as "expression", but the present invention is not limited to this, and the facial state of the user 20 may also be any facial state such as "face position" or "face orientation". In addition, two or more of "expression", "face position" and "face orientation" may be combined as the facial state.

[0080] [expression]

[0081] For example, the facial state of the user 20 is the expression of the user 20. In this specification, the case where the expression is "serious face" and "smiling face" is mainly described, but the present invention is not limited to this, and other expressions may also be used.

[0082] A serious face is an expression when the face does not show any emotion (no expression). For example, whether the user 20 has a serious face is determined based on the coordinates of the various parts of the user 20's face (such as eyes, nose, mouth, etc.) in the image. For example, if the height of the end of the mouth is less than a certain value relative to the center height of the mouth, it is determined to be a serious face. Alternatively, it is possible to make a determination based on the result of machine learning that recognizes serious faces and smiling faces from photos of multiple expressions obtained in advance.

[0083] The so-called smile is a smiling expression. For example, whether the user 20 is smiling is determined based on the coordinates of the various parts of the user 20's face (such as eyes, nose, mouth, etc.) in the image. For example, if the height of the end of the mouth relative to the height of the center of the mouth is greater than a certain value, it is determined to be a smiling face. In addition, it is also possible to make a determination based on the results of machine learning that recognizes serious faces and smiling faces from photos of multiple expressions obtained in advance.

[0084] [Position of the face]

[0085] For example, the facial state of the user 20 is the position of the face of the user 20 .

[0086] For example, when the facial state of user 20 is "face position", when the distance between the face position of user 20 and the position of terminal 11 (the case of structural example 1) or diagnostic device 10 (the case of structural example 2) is short (that is, the face is photographed from close), diagnosis suitable for using an image of the face taken from a close distance can be performed, and when the distance between the face position of user 20 and the position of terminal 11 (the case of structural example 1) or diagnostic device 10 (the case of structural example 2) is long (that is, the face is photographed from a distance), diagnosis suitable for using an image of the face taken from a distance can be performed.

[0087] For example, in a case where the facial state of user 20 is "position of the face", when the face of user 20 is photographed in a first position, a diagnosis suitable for using an image of the face photographed at the first position can be performed, and when the face of user 20 is photographed in a second position, a diagnosis suitable for using an image of the face photographed at the second position can be performed.

[0088] [Facial orientation]

[0089] For example, the facial state of the user 20 is the orientation of the face of the user 20 .

[0090] For example, in a case where the facial state of user 20 is "facial orientation", when the face of user 20 is photographed in a first orientation, a diagnosis suitable for using an image of the face photographed in the first orientation can be performed, and when the face of user 20 is photographed in a second orientation, a diagnosis suitable for using an image of the face photographed in the second orientation can be performed.

[0091] <<Diagnosis>>

[0092] Here, the diagnosis is described in detail. In this specification, the diagnosis is mainly described as skin diagnosis and stress diagnosis, but the present invention is not limited to this, and it can also be any diagnosis such as diagnosis of the body including the face, psychological or mental diagnosis.

[0093] The imaging methods required for the images in the respective diagnostic processes are different (ie, the imaging method in the first diagnostic process and the imaging method in the second diagnostic process are different imaging methods). The imaging method includes at least one of resolution, field angle, focal length, and shutter speed.

[0094] <<Example of Diagnosis>>

[0095] Next, an example of diagnosis will be described.

[0096] For example, in skin diagnosis, fine lines can be determined based on the frequency components of images of various parts of the face.

[0097] For example, in skin diagnosis, the length of the nasolabial folds can be detected by detecting the length of the edge component of the range at the position below the cheek.

[0098] For example, in skin diagnosis, the smoothness can be determined based on the frequency components of an image of the entire cheek.

[0099] For example, in skin diagnosis, pores and clogging of the pores can be determined based on changes in brightness values ​​and the magnitude of the changes.

[0100] For example, in skin diagnosis, it is possible to perform inference based on machine learning using measurement results of other equipment or evaluation results through visual observation as correct answer data.

[0101] For example, in stress diagnosis, the positions of the mouth corners and eye corners when smiling are detected, and the facial distortion is detected from the positions of the left and right mouth corners and eye corners of the face. The degree of stress can be determined based on the size of the facial distortion.

[0102] The following describes a method for capturing images required for skin diagnosis and stress diagnosis.

[0103] [Skin diagnosis]

[0104] Image resolution: 2048 x 1536 pixels

[0105] ·Focus···Shallow field. Easy to detect the bumps and depressions of the skin.

[0106] Image processing: Weak. Used for capturing delicate details of the skin.

[0107] Image processing: Edge-free harmonization processing. Used to capture the delicate state of the skin.

[0108] [Stress diagnosis]

[0109] Image resolution: 640×480 pixels

[0110] Focus Depth of field (pan focus)

[0111] · Image processing···Strong. Convenient for extracting the coordinates of the corners of the eyes, etc.

[0112] · Image processing··· Edge coordination processing is available. It is easy to extract the coordinates of the corners of the eyes, etc.

[0113] Furthermore, for example, the presence or absence of partial chewing can be diagnosed using an image when the facial state (expression) is a serious face. Furthermore, for example, the presence or absence of teeth grinding or clenching can be diagnosed using an image when the facial state (expression) is a serious face. Furthermore, for example, sagging can be diagnosed using an image when the facial state (facial orientation) is horizontal. Furthermore, for example, the scalp can be diagnosed using an image when the facial state (facial orientation) is downward. Furthermore, for example, the scalp can be diagnosed using an image when the facial state (facial position) is located below relative to the camera lens.

[0114] <Method>

[0115] Figure 5 1 is a flowchart of a diagnostic process according to an embodiment of the present invention. Figure 1 1) or the diagnostic device 10 ( Figure 1 2) before, or user 20 to terminal 11 ( Figure 1 1) or the diagnostic device 10 ( Figure 1 In the case of structural example 2), when an instruction is input, processing begins.

[0116] In step 1001 (S1001), the diagnostic device 10 sends the terminal 11 ( Figure 1 1) or the diagnostic device 10 ( Figure 1 In the case of the configuration example 2), the camera mode is switched to the "moving image shooting mode". In addition, the image shot in the "moving image shooting mode" only needs to be an image of a quality that can detect the expression of the user 20.

[0117] In step 1002 ( S1002 ), the diagnostic device 10 detects the expression of the user 20 while capturing a moving image in the “moving image capturing mode” switched in S1001 .

[0118] In step 1003 ( S1003 ), the diagnostic device 10 determines whether the expression detected in S1002 is a “serious face” or a “smiling face.” If it is a “serious face,” the process proceeds to step 1004 , and if it is a “smiling face,” the process proceeds to step 1010 .

[0119] In step 1004 (S1004), the diagnostic device 10 determines whether the diagnosis (skin diagnosis) using the image of the serious face has been completed. If the skin diagnosis has been completed, the process proceeds to step 1005, and if the skin diagnosis has not been completed, the process proceeds to step 1007.

[0120] In step 1005 (S1005), the diagnostic device 10 determines whether the skin diagnosis and the stress diagnosis have been completed. If the skin diagnosis and the stress diagnosis have been completed, the process proceeds to step 1006, and if the skin diagnosis and the stress diagnosis have not been completed, the process returns to S1001.

[0121] In step 1006 (S1006), the diagnostic device 10 causes the terminal 11 ( Figure 1 1) or the diagnostic device 10 ( Figure 1 In the case of structural example 2), the diagnosis result is displayed.

[0122] In step 1007 (S1007), the diagnostic device 10 sends the terminal 11 ( Figure 1 1) or the diagnostic device 10 ( Figure 1 In the case of structural example 2), the camera mode is switched to the "skin diagnosis mode".

[0123] In step 1008 (S1008), the diagnostic device 10 causes the terminal 11 ( Figure 1 1) or the diagnostic device 10 ( Figure 1 (Structural example 2) in which still images are captured with high image quality.

[0124] In step 1009 ( S1009 ), the diagnostic device 10 executes a skin diagnosis process using the high-quality still image of the serious face captured in S1008 . Thereafter, the process proceeds to step 1005 .

[0125] In step 1010 ( S1010 ), the diagnostic device 10 determines whether the diagnosis using the image of the smiling face (stress diagnosis) has been completed. If the stress diagnosis has been completed, the process proceeds to step 1005 , and if the stress diagnosis has not been completed, the process proceeds to step 1011 .

[0126] In step 1011 (S1011), the diagnostic device 10 sends the terminal 11 ( Figure 1 1) or the diagnostic device 10 ( Figure 1 In the case of structural example 2), the camera mode is switched to the "pressure diagnosis mode".

[0127] In step 1012 (S1012), the diagnostic device 10 causes the terminal 11 ( Figure 1 1) or the diagnostic device 10 ( Figure 1 (Structural Example 2) In the case of capturing still images with low image quality.

[0128] In step 1013 ( S1013 ), the diagnostic device 10 executes a stress diagnosis process using the low-quality still image of the smiling face captured in S1012 . Thereafter, the process proceeds to step 1005 .

[0129] <Effect>

[0130] Thus, in one embodiment of the present invention, the processing is switched to a diagnosis (e.g., skin diagnosis or stress diagnosis) corresponding to the user's facial state (e.g., expression, facial position, facial orientation, etc.), so that multiple diagnoses can be easily performed without bothering the user or a beauty specialist.

[0131] <Hardware Structure>

[0132] Figure 6 1 is a hardware configuration diagram of the diagnostic device 10 and the terminal 11 according to one embodiment of the present invention. The diagnostic device 10 and the terminal 11 may include a control unit 1001, a main storage unit 1002, an auxiliary storage unit 1003, an input unit 1004, an output unit 1005, and an interface unit 1006. Each of these will be described below.

[0133] The control unit 1001 is a processor (for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc.) that executes various programs installed in the auxiliary storage unit 1003 .

[0134] The main storage unit 1002 includes a nonvolatile memory (ROM (Read Only Memory)) and a volatile memory (RAM (Random Access Memory)). The ROM stores various programs and data required for the control unit 1001 to execute various programs installed in the auxiliary storage unit 1003. The RAM provides a work area that is developed when the control unit 1001 executes various programs installed in the auxiliary storage unit 1003.

[0135] The auxiliary storage unit 1003 is an auxiliary storage device that stores various programs and information used when executing the various programs.

[0136] The input unit 1004 is an input device for the operators of the diagnostic apparatus 10 and the terminal 11 to input various instructions to the diagnostic apparatus 10 and the terminal 11 .

[0137] The output unit 1005 is an output device that outputs the internal states of the diagnostic apparatus 10 and the terminal 11 and the like.

[0138] The interface unit 1006 is a communication device for connecting to a network and communicating with other devices.

[0139] As mentioned above, although the embodiment of the present invention was described in detail, the present invention is not limited to the above-mentioned specific embodiment, and various deformation|transformation and changes are possible within the scope of the gist of the present invention described in the claims.

[0140] This application claims priority based on Japanese Patent Application No. 2022-171404 filed on October 26, 2022, and the entire contents of No. 2022-171404 are hereby incorporated by reference into this application.

[0141] Explanation of symbols

[0142] 1: Diagnostic system

[0143] 10: Diagnostic device

[0144] 11: Terminal

[0145] 20: User

[0146] 101: Image acquisition unit

[0147] 102: Facial state detection unit

[0148] 103: First Judgment Unit

[0149] 104: Second judgment unit

[0150] 105: Diagnosis processing switching unit

[0151] 106: First diagnostic processing unit

[0152] 107: Second diagnosis processing unit

[0153] 108: Diagnosis history storage unit

[0154] 109: Reception Department

[0155] 110: Notification Department

[0156] 1001: Control Department

[0157] 1002: Main storage unit

[0158] 1003: Auxiliary storage unit

[0159] 1004: Input unit

[0160] 1005: Output unit

[0161] 1006: Interface part.

Claims

1. A diagnostic system is a system including a terminal and a server, which has: a first diagnosis processing unit that performs a first diagnosis process; a second diagnostic processing unit that performs a second diagnostic processing different from the first diagnostic processing; a facial state detecting unit that detects a user's facial state; and A diagnostic process switching unit determines which of the first diagnostic process and the second diagnostic process to execute based on a result of the detection.

2. The diagnostic system according to claim 1, wherein: The facial state is an expression.

3. The diagnostic system according to claim 2, wherein: The facial state detection unit detects the expression of the user based on features of the image of the user's face captured by the terminal.

4. The diagnostic system according to claim 1, wherein: The imaging method in the first diagnosis process and the imaging method in the second diagnosis process are different imaging methods.

5. The diagnostic system according to claim 4, wherein: The imaging method is the resolution of the image used for diagnosis.

6. The diagnostic system according to claim 1, comprising: a diagnostic history storage unit storing a history of execution of the first diagnostic process and a history of execution of the second diagnostic process, The diagnostic system also has: a first determination unit that determines whether the first diagnostic process has been executed a predetermined number of times within a session; and a second determination unit for determining whether the second diagnostic process has been executed a predetermined number of times within the session; The first diagnostic processing unit executes the first diagnostic processing if the first diagnostic processing has not been executed the predetermined number of times, The second diagnostic processing unit executes the second diagnostic processing when the second diagnostic processing has not been executed the predetermined number of times.

7. The diagnostic system according to claim 1, comprising: a diagnostic history storage unit storing a history of execution of the first diagnostic process and a history of execution of the second diagnostic process, The diagnostic system also has: a first determination unit that determines whether the first diagnostic process has been executed a predetermined number of times outside the session; and a second determination unit for determining whether the second diagnostic process has been executed a predetermined number of times outside the session; The first diagnostic processing unit executes the first diagnostic processing if the first diagnostic processing has not been executed the predetermined number of times, The second diagnostic processing unit executes the second diagnostic processing when the second diagnostic processing has not been executed the predetermined number of times.

8. The diagnostic system according to claim 6 or 7, wherein: The setting made by the user is accepted the predetermined number of times.

9. The diagnostic system according to claim 6 or 7, wherein: The first diagnostic process execution history and the second diagnostic process execution history are set with an expiration date.

10. The diagnostic system according to claim 1, wherein: A selection by the user of only the first diagnostic process, only the second diagnostic process, or both the first diagnostic process and the second diagnostic process is accepted, and the accepted diagnostic process is executed.

11. The diagnostic system according to claim 1, further comprising: a notification unit that specifies the first facial state or the second facial state to the user, The facial state detection unit sets the facial state specified by the notification unit as the detected facial state of the user.

12. The diagnostic system according to claim 1, further comprising: A notification unit that indicates the undetected facial state to the user when at least one of the first facial state and the second facial state is not detected within a certain period of time.

13. The diagnostic system according to claim 12, wherein: The certain period is set by the user or determined based on past detection time.

14. The diagnostic system according to claim 12, wherein: The processing related to the facial state that has not been detected within the certain period is skipped.

15. The diagnostic system according to claim 14, wherein: The user is asked whether the skipping is allowed.

16. The diagnostic system of claim 14, wherein: Switching is performed between automatically executing the skipping and asking the user whether the skipping is permitted.

17. The diagnostic system of claim 14, wherein: The user is notified that the skipping is performed.

18. The diagnostic system of claim 1, wherein: When it is detected that the user is in front of the terminal or the user inputs an instruction to the terminal, the process starts.

19. A diagnostic device comprising: a first diagnosis processing unit that performs a first diagnosis process; a second diagnostic processing unit that performs a second diagnostic processing different from the first diagnostic processing; a facial state detecting unit that detects a user's facial state; and A diagnostic process switching unit determines which of the first diagnostic process and the second diagnostic process to execute based on a result of the detection.

20. A program for causing a computer to function as the following units: a first diagnosis processing unit that performs a first diagnosis process; a second diagnostic processing unit that performs a second diagnostic processing different from the first diagnostic processing; a facial state detecting unit that detects a user's facial state; and A diagnostic process switching unit determines which of the first diagnostic process and the second diagnostic process to execute based on a result of the detection.

21. A diagnostic method is a method performed by a diagnostic device, comprising: The step of detecting the user's facial state; A step of determining which of a first diagnostic process and a second diagnostic process different from the first diagnostic process to execute based on a result of the detection; as well as The steps of performing the first diagnostic process or the second diagnostic process are performed.

22. A skin diagnosis method is a method performed by a diagnosis device, comprising: Step of detecting that the user's expression is a serious face; Based on the detection of the serious face, photographing the user's face with high resolution; as well as The step of diagnosing the skin of the user using a high-resolution image of the serious face of the user.

23. A pressure diagnosis method is a method performed by a diagnosis device, comprising: The step of detecting that the user's expression is a smiling face; Based on the detection of the smiling face, a step of photographing the user's face at a low resolution; as well as The step of diagnosing the stress of the user by using a low-resolution image of the user's smiling face.

Images