EMG measuring device, method, and system

The myoelectric potential measuring device addresses the challenge of capturing dynamic smile characteristics by assessing facial muscle activity to provide real-time feedback, improving the naturalness and attractiveness of smiles.

JP7803015B2Active Publication Date: 2026-01-21SHISEIDO CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023506985
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2021-03-17
Filing Date
2022-03-07
Publication Date
2026-01-21
Estimated Expiration
2042-03-07

AI Technical Summary

Technical Problem

Existing methods for measuring smile value from still images fail to capture dynamic characteristics and can result in unnatural smiles due to users smiling while aware of the camera.

Method used

A myoelectric potential measuring device that assesses myoelectric potential at multiple facial locations to determine if the smile characteristics align with those of an attractive smile, providing real-time feedback through sound, vibration, or light.

Benefits of technology

Enables the support of natural and attractive smiling by providing real-time feedback on smile dynamics, enhancing the expression of smiles.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007803015000001
    Figure 0007803015000001
  • Figure 0007803015000002
    Figure 0007803015000002
  • Figure 0007803015000003
    Figure 0007803015000003
Patent Text Reader

Abstract

The purpose of the present invention is to assist the expression of a smile. The myoelectric potential measuring instrument according to an embodiment of the present invention is for measuring myoelectric potential, the myoelectric potential measuring instrument comprising: a determining unit for determining whether the difference between a feature amount of the myoelectric potential measured by the myoelectric potential measuring instrument and the feature amount of the myoelectric potential objectively judged to be an attractive smile is within a prescribed range; and an output unit for outputting an indication that the difference is within the prescribed range or outside the prescribed range.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an electromyography device, method, and system. [Background technology]

[0002] Smiling is required in many situations in various occupations and daily life, so methods for supporting the expression of a smile have been developed.

[0003] For example, Patent Document 1 describes a method for measuring a user's smile value contained in a captured image, converting the smile value into a smile level, and presenting a face image with a higher smile level than the measured smile value, thereby increasing the user's smile level. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2017-182594 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in Patent Document 1, the smile value is measured from a still image, and the dynamic characteristics of a smile cannot be captured.

[0006] Furthermore, in Patent Document 1, the user makes a facial expression while facing the camera of the smile feedback device. Since the user smiles while looking at their own face while being aware of the camera, there is a possibility that the smile will be unnatural and not normal.

[0007] Therefore, an object of the present invention is to support the expression of a smile. [Means for solving the problem]

[0008] One embodiment of the present invention is a myoelectric potential measuring device that measures myoelectric potential, and includes a judgment unit that judges whether the difference between a feature of the myoelectric potential measured by the myoelectric potential measuring device and a feature of the myoelectric potential that is objectively judged to be an attractive smile is within a predetermined range, and an output unit that outputs whether the difference is within or outside the predetermined range. [Effects of the Invention]

[0009] According to the present invention, it is possible to support the expression of a smile. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram illustrating an overall configuration according to an embodiment of the present invention. [Figure 2] 1 is a functional block diagram of a smile detection system according to an embodiment of the present invention; [Figure 3] FIG. 10 is a diagram showing the results of evaluating a subject's smile according to an embodiment of the present invention. [Figure 4] FIG. 10 is a diagram showing the results of evaluating a subject's smile according to an embodiment of the present invention. [Figure 5] FIG. 10 is a diagram showing the results of evaluating the attractiveness of a subject's smile according to one embodiment of the present invention. [Figure 6] FIG. 10 is a diagram showing the results of evaluating the attractiveness of a subject's smile according to one embodiment of the present invention. [Figure 7] FIG. 1 is a diagram illustrating a myoelectric potential according to an embodiment of the present invention; [Figure 8] FIG. 2 is a diagram illustrating eight feature amounts according to an embodiment of the present invention. [Figure 9] FIG. 10 is a diagram for explaining the relationship between the attractiveness of a smile and the correlation between the size of the smile, the speed at which the smile rises, and the eyes and mouth according to one embodiment of the present invention. [Figure 10] 10 is a flowchart of a registration process according to an embodiment of the present invention. [Figure 11] 10 is a flowchart of a smile detection process according to an embodiment of the present invention. [Figure 12]1 is a block diagram showing an example of the hardware configuration of a myoelectric potential measuring device and a smile detection device according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0012] Although the present specification describes an embodiment using myoelectric potentials at four locations on the user's face, the present invention is not limited to this, and can detect a smile using myoelectric potentials at multiple locations on the user's face. For example, the multiple locations may be two or more locations including the area around the eyes and at least one of the zygomatic minor muscle, the zygomatic major muscle, and the laughing muscle.

[0013] <Overall composition> Fig. 1 is a diagram showing the overall configuration of an embodiment of the present invention. As shown in Fig. 1, the smile detection system 1 includes an electromyography measuring device 10 and a smile detection device 20. The electromyography measuring device 10 can transmit and receive data to and from the smile detection device 20 via wired or wireless communication. Each of these will be described below.

[0014] The myoelectric potential measuring device 10 is a device for measuring myoelectric potential. The myoelectric potential measuring device 10 can determine whether the user is smiling or not based on the myoelectric potential of the user measured by the myoelectric potential measuring device 10, and output the determination result.

[0015] The smile detection device 20 can determine whether the user is smiling or not based on the user's myoelectric potential measured by the myoelectric potential measuring device 10, and output the determination result. The smile detection device 20 may be any computer, such as a personal computer, tablet terminal, or smartphone.

[0016] <Function block> Figure 2 is a functional block diagram of a smile detection system 1 according to an embodiment of the present invention. As shown in Figure 2, the smile detection system 1 can include a measurement unit 101, a registration unit 102, a determination unit 103, an output unit 104, and an electromyogram data storage unit 105. Furthermore, by executing a program, the smile detection system 1 can function as the measurement unit 101, the registration unit 102, the determination unit 103, and the output unit 104.

[0017] The myoelectric potential measuring device 10 may include the measuring unit 101, the registration unit 102, the judgment unit 103, the output unit 104, and the electromyogram data storage unit 105 (i.e., the smile detection device 20 is not used), or the smile detection device 20 may include at least some of the registration unit 102, the judgment unit 103, the output unit 104, and the electromyogram data storage unit 105 (i.e., the smile detection device 20 is used).

[0018] The measurement unit 101 measures the myoelectric potential of the user's face and generates an electromyogram (a time-series record of action potentials generated in muscles).

[0019] For example, the measurement unit 101 measures myoelectric potentials in at least two of the orbicularis oculi muscle, the zygomatic minor muscle, the zygomatic major muscle, and the laughing muscle in the user's face.

[0020] For example, the measurement unit 101 measures a total of two channels: the myoelectric potential at the right or left eye of the user's face (i.e., one channel), and the myoelectric potential at one of the right or left zygomatic minor muscle, the right or left zygomatic major muscle, and the right or left laughing muscle (i.e., one channel). For example, the measurement unit 101 measures a total of four channels: the myoelectric potential at the left and right eyes of the user's face (i.e., two channels), and the myoelectric potential at one of the left and right zygomatic minor muscles, the left and right zygomatic major muscles, and the left and right laughing muscles (i.e., two channels). For example, the myoelectric potential at the eyes is the myoelectric potential at the orbicularis oculi muscle, the myoelectric potential at the frontalis muscle, etc. (The case of the orbicularis oculi muscle will be described below in this specification).

[0021] The registration unit 102 stores the magnitude of the user's myoelectric potential (for example, maximum and minimum values ​​(or amplitude)) in the electromyogram data storage unit 105. In one embodiment of the present invention, the maximum and minimum values ​​(or amplitude) of the myoelectric potential when the user is smiling are registered, and when the myoelectric potential approaches the maximum and minimum values ​​(or amplitude), it can be determined whether the smile is attractive or not.

[0022] Information related to myoelectric potential is stored in the electromyogram data storage unit 105. Below, we will explain the maximum and minimum values ​​(or amplitude) of the user's myoelectric potential and the feature amount of the myoelectric potential of an attractive smile separately.

[0023] <<Maximum and minimum values ​​(or amplitude) of the user's myoelectric potential>> The electromyogram data storage unit 105 stores the maximum and minimum values ​​(or amplitudes) of the user's myoelectric potential stored by the registration unit 102.

[0024] <<Features of EMG of an Attractive Smile>> The electromyogram data storage unit 105 stores features of myoelectric potential that are objectively judged to be an attractive smile (for example, the integrated value of myoelectric potential (magnitude of smile), rising speed, correlation between eyes and mouth, etc.).

[0025] The judgment unit 103 judges whether the difference between the feature of the myoelectric potential measured by the measurement unit 101 and the feature of the myoelectric potential that is objectively judged to be an attractive smile and stored in the electromyogram data storage unit 105 (for example, the integrated value of the myoelectric potential (size of the smile), rising speed, correlation between the eyes and mouth, etc.) is within a predetermined range.

[0026] Specifically, the determination unit 103 extracts feature amounts from the myoelectric potential measured by the measurement unit 101. For example, the determination unit 103 determines whether the difference between the integrated value of the myoelectric potential at each of the four locations on the user's face (which indicates the magnitude of the smile, as will be described later) and the magnitude of the smile stored in the electromyogram data storage unit 105 is within a predetermined range. The determination unit 103 also determines whether the difference between the speed at which the myoelectric potential at each of the four locations on the user's face reaches a maximum (which indicates the rise speed, as will be described later) and the rise speed stored in the electromyogram data storage unit 105 is within a predetermined range. The determination unit 103 also determines whether the difference between the strength of the correlation (which indicates the correlation between the eyes and the mouth, as will be described later) between the myoelectric potential of the orbicularis oculi muscle and the myoelectric potential of at least one of the zygomatic minor muscle, the zygomatic major muscle, and the laughing muscle and the strength of the correlation between the eyes and the mouth stored in the electromyogram data storage unit 105 is within a predetermined range. The determination unit 103 may determine only the integrated value of the myoelectric potential (the size of the smile), or may determine only the rising speed, or may determine only the correlation between the eyes and the mouth.

[0027] In this way, the determination unit 103 can determine whether the feature amount of the myoelectric potential when the user is smiling is within a predetermined range in which a smile is determined to be attractive.

[0028] <<Predetermined range>> The predetermined range may be a range determined based on the results of machine learning, or may be a range determined by a human.

[0029] The output unit 104 outputs whether the difference determined by the determination unit 103 is within a predetermined range or outside the range. Specifically, when the difference determined by the determination unit 103 is within or outside the predetermined range, the output unit 104 notifies the user by generating sound, vibration, light, a combination thereof, or the like. The output unit 104 notifies the user instantly based on the result of the determination unit 103.

[0030] <Features of EMG> Here, we will explain the features of myoelectric potential that can be objectively judged as an attractive smile. Below, we will explain them in sections such as <<Myoelectric potential integrated value (smile size)>>, <<rise speed>>, <<correlation between eyes and mouth>>, and <<others>>.

[0031] <<Integrated value of myoelectric potential (size of smile)>> For example, the feature of myoelectric potential that is objectively determined to be an attractive smile is the integrated value of the myoelectric potential. More specifically, the feature is the integrated value of the myoelectric potential at each of four locations (or two locations) on the user's face. The integrated value of the myoelectric potential indicates the size of the smile. By using the size of the smile, smiles that are not large enough can be excluded from the list of attractive smiles.

[0032] <<Rise speed>> For example, a feature of myoelectric potential that can be objectively determined as an attractive smile is the speed at which the myoelectric potential reaches its maximum value. More specifically, the feature is the speed at which the myoelectric potential reaches its maximum value at each of four locations on the face (or two locations would be acceptable). The speed at which the myoelectric potential reaches its maximum value at each of the four locations on the face indicates the speed at which the smile becomes most attractive. By using the rise speed, smiles with a slow rise speed (i.e., unnatural smiles that reach their maximum speed) can be excluded from attractive smiles.

[0033] <<Correlation between eyes and mouth>> For example, a feature of myoelectric potential that is objectively determined to be an attractive smile is the strength of correlation between the myoelectric potential around the eyes and the myoelectric potential around the mouth. More specifically, the feature is the strength of correlation between the myoelectric potential mainly in the orbicularis oculi muscle and the myoelectric potential of at least one of the zygomatic minor muscle, the zygomatic major muscle, and the laughing muscle. The strength of correlation between the myoelectric potential mainly in the orbicularis oculi muscle and the myoelectric potential of at least one of the zygomatic minor muscle, the zygomatic major muscle, and the laughing muscle indicates the strength of correlation between the eye movement and the mouth movement when smiling. By using the eye-mouth correlation, smiles with a weak correlation between the eyes and the mouth (i.e., unnatural smiles where the eyes and the mouth are not correlated (e.g., the eyes are not moving)) can be excluded from attractive smiles.

[0034] <<Others>> For example, the myoelectric feature quantity that can be objectively determined to be an attractive smile may be the magnitude of the myoelectric potential, the timing at which the myoelectric potential is measured, the pattern of change in the myoelectric potential over time, or the rate of decline (i.e., information on the rate at which the myoelectric potential at each of the four points on the face changes from a smiling state to a neutral state).Furthermore, the myoelectric feature quantity that can be objectively determined to be an attractive smile may be a combination of multiple types of myoelectric feature quantities, or the average or deviation between the four channels (four points on the face) of the myoelectric feature quantities.

[0035] Hereinafter, an experiment for finding the feature amount of the myoelectric potential will be described with reference to FIGS.

[0036] First, videos of seven different smiles were filmed for each of the five subjects (three in their 20s and two in their 40s). Then, 40 evaluators watched the videos and evaluated whether the smiles were natural (5 levels depending on how natural they were, 5 levels depending on how unnatural they were, and 11 levels depending on how unnatural they were), and whether the smiles were attractive (5 levels depending on how attractive they were, 5 levels depending on how unattractive they were, and 11 levels depending on how unattractive they were). Figures 3 and 4 show the results of evaluating the smiles of the subjects according to one embodiment of the present invention.

[0037] As shown in Figure 3, each smile of each subject (5 subjects: Subject No. 1, Subject No. 2, Subject No. 3, Subject No. 4, and Subject No. 5) was evaluated for its naturalness and attractiveness. The horizontal axis shows the seven types of smiles, and the vertical axis shows the average evaluation by 40 evaluators.

[0038] As shown in Figure 4, when we investigated the correlation between the degree of naturalness / unnaturalness and the degree of attractiveness / unattractiveness using the data of all smiles from all subjects, we found that the two were correlated. In other words, we found that the more natural a smile, the more attractive it is. Therefore, in this invention, in order to detect a natural smile, we decided to determine whether the user is smiling based on the myoelectric potential of the user's face.

[0039] FIG. 5 shows the results of evaluating the attractiveness of subjects' smiles according to one embodiment of the present invention. The graph shows the results of evaluations of the attractiveness of each smile (seven types of smiles: Smile #1, Smile #2, Smile #3, Smile #4, Smile #5, Smile #6, and Smile #7) by 40 evaluators (five subjects: Subject No. 1, Subject No. 2, Subject No. 3, Subject No. 4, and Subject No. 5). The horizontal axis represents attractiveness (i.e., the degree of attractiveness and the degree of unattractiveness (normalized based on standard deviation)), and the vertical axis represents the number of evaluators who evaluated that attractiveness. As shown in FIG. 5, evaluations of the attractiveness of smiles vary depending on the evaluator. Therefore, in one embodiment of the present invention, as shown in FIG. 6, this variation among evaluators is taken into account, enabling evaluation of the attractiveness of smiles with approximately 89% accuracy. In FIG. 6, the 25%, 50%, and 75% levels represent the top 25%, 50% (median), and 75% levels of the scores from the 40 evaluators. Here, accuracy is measured by defining the estimated value as being within 25 to 75 percent as the "correct answer."

[0040] Fig. 7 is a diagram for explaining myoelectric potential according to one embodiment of the present invention. In one embodiment of the present invention, an integrated electromyogram as shown in Fig. 7 can be used as a feature quantity of myoelectric potential. In Fig. 7, the attack time is the period until the myoelectric potential at each of the four parts of the face reaches its maximum value. Furthermore, the release time is the period until the myoelectric potential at each of the four parts of the face returns from a smiling state to a neutral state.

[0041] 8 is a diagram illustrating eight feature amounts according to an embodiment of the present invention. A total of four channels were measured: myoelectric potentials mainly in the left and right orbicularis oculi muscles of the face (i.e., two channels), and myoelectric potentials in one of the left and right zygomatic minor muscles, the left and right zygomatic major muscles, and the left and right laughing muscles (i.e., two channels).

[0042] iEMG is the integral value of the myoelectric potential (i.e., the size of the smile) at each of the four locations on the face (i.e., each of the four channels). iEMG is the area of ​​the shaded area in Figure 7.

[0043] iEMG(min) indicates the minimum value of the integrated value of the myoelectric potential in each channel.

[0044] iEMG(ave) indicates the average of the integrated values ​​of the myoelectric potentials in each channel across four channels.

[0045] iEMG(dev) indicates the variance among the four channels of the integrated values ​​of the myoelectric potential in each channel.

[0046] iEMG(w1) is weighted to the latter half of the measurement time.

[0047] iEMG(w2) is weighted for the first half of the measurement time.

[0048] B(ave) indicates the speed at which the myoelectric potential at each of the four locations on the face (i.e., each of the four channels) reaches its maximum value (i.e., the speed at which the smile becomes largest). More specifically, it is the average of the speeds at which the myoelectric potential at each channel reaches its maximum value across the four channels.

[0049] B(dev) mainly indicates the strength of correlation between the myoelectric potential of the orbicularis oculi muscle and the myoelectric potential of at least one of the zygomaticus minor, zygomaticus major, and laughing muscles (i.e., the strength of correlation between eye movement and mouth movement when smiling). More specifically, it is the variance across the four channels of the speed at which the myoelectric potential of each channel reaches its maximum. A small variance can be interpreted as a strong correlation, and a large variance as a weak correlation.

[0050] Among the features of myoelectric potential, the features correlated with the attractiveness of a smile were found, as shown in Figure 9.

[0051] 9 is a diagram for explaining the relationship between the attractiveness of a smile and the correlation between the size of the smile, the speed of the smile rising, and the eyes and mouth according to one embodiment of the present invention. As shown in FIG. 9, there was a correlation between the attractiveness of a smile and the size of the smile (iEMG), the speed of the smile rising (B(ave)), and the correlation between the eyes and mouth (B(dev)).

[0052] Thus, among the facial myoelectric potential features, it was found that the size of the smile (iEMG), the rise speed (B(ave)), and the correlation between the eyes and mouth (B(dev)) are correlated with the attractiveness of the smile.

[0053] <Method> The registration process will be described below with reference to FIG. 10, and the smile detection process will be described with reference to FIG.

[0054] <<Registration process>> FIG. 10 is a flowchart of a registration process according to an embodiment of the present invention.

[0055] In step 11 (S11), the measurement unit 101 measures the myoelectric potential of the user's face when the user is smiling (for example, when the user expresses the most attractive smile of their own smiles). For example, the measurement unit 101 measures the myoelectric potential mainly in the orbicularis oculi muscles on the left and right sides of the user's face (i.e., two channels), and the myoelectric potential in one of the left and right zygomatic minor muscles, the left and right zygomatic major muscles, and the left and right laughing muscles (i.e., two channels).

[0056] In step 12 (S12), the registration unit 102 stores in the electromyogram data storage unit 105 the magnitude of the user's myoelectric potential (for example, the maximum and minimum values ​​(or amplitude)).

[0057] <<Smile detection processing>> FIG. 11 is a flowchart of a smile detection process according to an embodiment of the present invention.

[0058] In step 21 (S21), the measurement unit 101 measures myoelectric potentials of the user's face. For example, the measurement unit 101 measures myoelectric potentials mainly in the orbicularis oculi muscles on the left and right sides of the user's face (i.e., two channels), and myoelectric potentials in one of the left and right zygomatic minor muscles, the left and right zygomatic major muscles, and the left and right laughing muscles (i.e., two channels).

[0059] In step 22 (S22), the determination unit 103 extracts the feature amount of the myoelectric potential of S21.

[0060] In step 23 (S23), the determination unit 103 determines whether the difference between the feature of the myoelectric potential extracted in S22 and the registered feature (i.e., the feature stored in the electromyogram data storage unit 105) is within a predetermined range. If it is within the predetermined range, the process proceeds to step 24. If it is not within the predetermined range, the process ends (note that it may be configured to output a message that it is not within the predetermined range).

[0061] In step 24 (S24), the output unit 104 outputs that the difference of S23 is within a predetermined range.

[0062] In one embodiment of the present invention, the expression of an attractive smile can be assisted by using the myoelectric potential measuring device 10. Specifically, the myoelectric potential measuring device 10 measures the myoelectric potential of the user's face, and the user can be notified that the user is smiling attractively according to the output of the myoelectric potential measuring device 10.

[0063] <Effects> In this way, in one embodiment of the present invention, the user is notified in real time the moment they achieve an attractive smile, allowing them to realize "what feeling" or "what emotion" they were in when they achieved that smile. By having the brain associate and remember the "things" and "moments" that gave the user an attractive smile, the user will naturally be able to achieve an attractive smile.

[0064] <Hardware configuration> FIG. 12 is a block diagram showing an example of the hardware configuration of the myoelectric potential measuring device 10 and the smile detection device 20 according to an embodiment of the present invention.

[0065] The myoelectric potential measuring device 10 has a measuring device 1010 that measures myoelectric potential.

[0066] The electromyography device 10 and the smile detection device 20 each have a central processing unit (CPU) 1001, a read only memory (ROM) 1002, and a random access memory (RAM) 1003. The CPU 1001, the ROM 1002, and the RAM 1003 form a so-called computer.

[0067] Furthermore, the myoelectric potential measuring device 10 and the smile detection device 20 may have an auxiliary storage device 1004, a display device 1005, an operation device 1006, an I / F (Interface) device 1007, and a drive device 1008. The hardware components of the myoelectric potential measuring device 10 and the smile detection device 20 are connected to each other via a bus B.

[0068] The CPU 1001 is a computing device that executes various programs installed in the auxiliary storage device 1004 .

[0069] The ROM 1002 is a non-volatile memory. The ROM 1002 functions as a main storage device that stores various programs, data, etc. required for the CPU 1001 to execute various programs installed in the auxiliary storage device 1004. Specifically, the ROM 1002 functions as a main storage device that stores boot programs such as a BIOS (Basic Input / Output System) and an EFI (Extensible Firmware Interface).

[0070] The RAM 1003 is a volatile memory such as a dynamic random access memory (DRAM) or a static random access memory (SRAM). The RAM 1003 functions as a main storage device that provides a working area in which various programs installed in the auxiliary storage device 1004 are expanded when the CPU 1001 executes them.

[0071] The auxiliary storage device 1004 is an auxiliary storage device that stores various programs and information used when the various programs are executed.

[0072] The display device 1005 is a display device that displays the internal states of the electromyography device 10 and the smile detection device 20, etc.

[0073] The operation device 1006 is an input device through which an administrator of the myoelectric potential measuring device 10 and the smile detecting device 20 inputs various instructions to the myoelectric potential measuring device 10 and the smile detecting device 20 .

[0074] The I / F device 1007 is a communication device that connects to a network and communicates with the electromyography device 10 and the smile detection device 20 .

[0075] Drive device 1008 is a device for loading storage medium 1009. The storage medium 1009 here includes media that record information optically, electrically, or magnetically, such as CD-ROMs, flexible disks, and magneto-optical disks. Storage medium 1009 may also include semiconductor memories that record information electrically, such as EPROMs (Erasable Programmable Read Only Memory) and flash memories.

[0076] The various programs to be installed in the auxiliary storage device 1004 are installed, for example, by setting the distributed storage medium 1009 in the drive device 1008 and reading out the various programs recorded on the storage medium 1009 by the drive device 1008. Alternatively, the various programs to be installed in the auxiliary storage device 1004 may be installed by being downloaded from a network via the I / F device 1007.

[0077] Although the examples of the present invention have been described in detail above, the present invention is not limited to the specific embodiments described above, and various modifications and variations are possible within the scope of the gist of the present invention as set forth in the claims.

[0078] This international application claims priority to Japanese Patent Application No. 2021-043016, filed on March 17, 2021, the entire contents of which are hereby incorporated by reference into this international application. [Explanation of symbols]

[0079] 1. Smile detection system 10. Myoelectric potential measuring device 20 Smile detection device 101 Measurement section 102 Registration Department 103 Judgment Department 104 Output section 105 Electromyogram data storage unit 1001 CPU 1002 ROM 1003 RAM 1004 Auxiliary storage device 1005 Display device 1006 Operating device 1007 I / F device 1008 Drive device 1009 Storage medium 1010 Measuring equipment

Claims

1. A myoelectric potential measuring device that measures myoelectric potential, a determination unit that determines whether a difference between a feature amount of the myoelectric potential measured by the myoelectric potential measurement device and a feature amount of the myoelectric potential that is objectively determined to be an attractive smile is within a predetermined range; an output unit that outputs that the difference is within a predetermined range or outside the range; wherein the feature amount of the myoelectric potential is a speed at which the myoelectric potential at each of a plurality of locations on the user's face reaches a maximum value.

2. A myoelectric potential measuring device that measures myoelectric potential, a determination unit that determines whether a difference between a feature amount of the myoelectric potential measured by the myoelectric potential measurement device and a feature amount of the myoelectric potential that is objectively determined to be an attractive smile is within a predetermined range; an output unit that outputs that the difference is within a predetermined range or outside the range; wherein the feature amount of the myoelectric potential is a strength of correlation between the myoelectric potential around the eyes and the myoelectric potential in at least one of the zygomatic minor muscle, the zygomatic major muscle, and the laughing muscle.

3. 3. The myoelectric potential measuring device according to claim 1, wherein the feature quantities of the myoelectric potential further include information on the magnitude of the myoelectric potential, a pattern of change over time of the myoelectric potential, a rate of rise and fall, a combination of a plurality of types of said information, and an average and deviation of said information among a plurality of locations on the user's face.

4. The electromyography measuring device according to claim 1 , wherein the feature amount of the electromyography further includes an integrated value of the electromyography at each of a plurality of locations on the user's face.

5. The electromyography measuring device according to claim 1 , wherein the output unit immediately notifies the user based on the result of the determination unit.

6. The myoelectric potential measuring device according to claim 1 , wherein the output unit notifies the user by generating sound, vibration, light, or a combination thereof.

7. 7. The myoelectric potential measuring device according to claim 1, wherein the predetermined range is determined based on the results of machine learning so that when the difference is input, it outputs whether or not a smile is objectively judged to be attractive.

8. 2. The myoelectric potential measuring device according to claim 1, wherein the plurality of locations are two or more locations including the area around the eyes and at least one of the zygomatic minor muscle, the zygomatic major muscle, and the laughing muscle.

9. A method performed by a myoelectric potential measuring device for measuring myoelectric potential, comprising: a step of determining whether or not a difference between a feature amount of the myoelectric potential measured by the myoelectric potential measuring device and a feature amount of the myoelectric potential that is objectively determined to be an attractive smile is within a predetermined range; outputting the difference as being within or outside a predetermined range; wherein the feature amount of the myoelectric potential is a speed at which the myoelectric potential at each of a plurality of locations on the user's face reaches a maximum value.

10. A method performed by a myoelectric potential measuring device for measuring myoelectric potential, comprising: a step of determining whether or not a difference between a feature amount of the myoelectric potential measured by the myoelectric potential measuring device and a feature amount of the myoelectric potential that is objectively determined to be an attractive smile is within a predetermined range; outputting the difference as being within or outside a predetermined range; wherein the feature amount of the myoelectric potential is a strength of correlation between the myoelectric potential around the eyes and the myoelectric potential in at least one of the zygomatic minor muscle, the zygomatic major muscle, and the laughing muscle.

11. A system including a myoelectric potential measuring device that measures myoelectric potentials and a computer, a determination unit that determines whether a difference between a feature amount of the myoelectric potential measured by the myoelectric potential measurement device and a feature amount of the myoelectric potential that is objectively determined to be an attractive smile is within a predetermined range; an output unit that outputs that the difference is within a predetermined range or outside the range; wherein the feature amount of the myoelectric potential is a speed at which the myoelectric potential at each of a plurality of locations on the user's face reaches a maximum value.

12. A system including a myoelectric potential measuring device that measures myoelectric potentials and a computer, a determination unit that determines whether a difference between a feature amount of the myoelectric potential measured by the myoelectric potential measurement device and a feature amount of the myoelectric potential that is objectively determined to be an attractive smile is within a predetermined range; an output unit that outputs that the difference is within a predetermined range or outside the range; wherein the feature amount of the myoelectric potential is a strength of correlation between the myoelectric potential around the eyes and the myoelectric potential in at least one of the zygomatic minor muscle, the zygomatic major muscle, and the laughing muscle.

Citation Information

Patent Citations

  • Face movement estimating device and face movement estimating method

    JP2011143059A

  • Program, terminal and system for giving emotional identifier to application by using myoelectrical signal

    JP2017021737A

  • Information processing device, program and information processing system

    JP2017182594A