Information Processing Apparatus, Information Processing Method, and Program

Abstract

To provide an information processing device, an information processing method, and a program capable of improving determination of a relationship between two persons.SOLUTION: An information processing device comprises: an acquisition unit which acquires data including a detection result obtained by detecting exercise performed by a plurality of users; a phase unit which phases the detection result; a synchronization ratio calculation unit which calculates a synchronization ratio of phased data of two users constituting a combination with respect to one or more sets of combinations constituted by two different users among the plurality of users; and a determination unit which determines a relationship of the two users constituting the combination with respect to one or more sets of combinations, on the basis of the synchronization ratio.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] In human-to-human communication, compatibility has drawn attention. Conventionally, compatibility has been used for compatibility diagnosis and the like. Most of such conventional compatibility diagnoses and the like are performed based on subjective profiling and questionnaires. In recent years, matching applications have been used by smartphones.

[0003] For example, Patent Document 1 discloses a technique for estimating interactions occurring among a plurality of people. Further, Patent Document 2 proposes a technique for determining the compatibility between users by determining the compatibility between robots based on how each user uses the robots.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the prior art, problems remain such as low accuracy of matching and time-consuming for matching to be established.

[0006] The present invention has been made in view of the above problems, and an object thereof is to provide an information processing apparatus, an information processing method, and a program capable of improving the determination of the relationship between two people.

Means for Solving the Problems

[0007] (1) To achieve the above object, an information processing apparatus according to an aspect of the present invention includes an acquisition unit that acquires data including detection results of movements performed by a plurality of users, a phase conversion unit that converts the detection results into phases, a synchronization rate calculation unit that calculates a synchronization rate of the phase-converted data of two users who constitute one or more combinations among the plurality of users, and a determination unit that determines the relationship between the two users who constitute the one or more combinations based on the synchronization rate.

[0008] (2) Further, an information processing apparatus according to an aspect of the present invention is the information processing apparatus according to (1) above, in which the phase conversion unit calculates a movement rhythm using the acquired detection results and converts the calculated movement rhythm into a phase.

[0009] (3) Further, an information processing apparatus according to an aspect of the present invention is the information processing apparatus according to (1) or (2) above, in which the phase conversion unit decomposes the detection results into an X-axis direction component, a Y-axis direction component, and a Z-axis direction component, converts each of the X-axis direction component, the Y-axis direction component, and the Z-axis direction component into a phase, and the synchronization rate calculation unit calculates the synchronization rate using the phase-converted data of the same axis components of the two users who constitute the combination.

[0010] (4) Further, an information processing apparatus according to an aspect of the present invention is the information processing apparatus according to any one of (1) to (3) above, in which the phase conversion unit constructs a database by associating the phase-converted data with user identification information for identifying the users for a plurality of users, and the synchronization rate calculation unit refers to the database to extract the phase-converted data of other users and calculates the synchronization rate between the extracted phase-converted data of the other users and the phase-converted data of each of the plurality of users.

[0011] (5) Further, in the information processing apparatus according to one aspect of the present invention, the determination unit determines the relationship between two users who are a combination of each of the plurality of users and the other user based on the synchronization rate between the phased data of the other user and the phased data of each of the plurality of users. The information processing apparatus according to (4) above.

[0012] (6) Further, in the information processing apparatus according to one aspect of the present invention, the synchronization rate calculation unit calculates the synchronization rate between each of the plurality of users and the other user, and the determination unit determines, based on the synchronization rate, the relationship between two users who are a combination of each of the plurality of users and the other user, and selects the other user whose synchronization rate is higher than a predetermined value. The information processing apparatus according to (4) above.

[0013] (7) Further, in the information processing apparatus according to one aspect of the present invention, the determination unit determines the relationship between two users who are a combination of each of the plurality of users and the other user based on the synchronization rate, and selects a plurality of users. The information processing apparatus according to (4) above.

[0014] (8) To achieve the above object, an information processing method according to one aspect of the present invention is an information processing method in which a computer of an information processing apparatus acquires data including a detection result of detecting the movements performed by a plurality of users, phases the detection result, calculates the synchronization rate of the phased data of the two users constituting the combination for one or more combinations constituted by two different users among the plurality of users, and determines the relationship between the two users constituting the combination for the one or more combinations based on the synchronization rate.

[0015] (9) To achieve the above object, a program according to an aspect of the present invention causes a computer of an information processing apparatus to acquire data including detection results of movements made by a plurality of users, phase the detection results, and calculate a synchronization rate of the phased data of two users constituting one or more combinations formed by different two users among the plurality of users, and based on the synchronization rate, cause the relationship between the two users to be determined.

Advantages of the Invention

[0016] According to the above (1) to (9), the determination of human relationships can be improved.

Brief Description of the Drawings

[0017]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

MODE FOR CARRYING OUT THE INVENTION

[0018] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings used in the following description, the scale of each member is appropriately changed in order to make each member recognizable. In all the drawings for explaining the embodiments, those having the same function are denoted by the same reference numerals, and repeated explanations are omitted. In addition, “based on XX” as used in the present application means “based on at least XX”, and includes cases where it is based on another element in addition to XX. Also, “based on XX” is not limited to the case where XX is directly used, and includes cases where it is based on something obtained by performing an operation or processing on XX. “XX” is an arbitrary element (for example, arbitrary information).

[0019] <First Embodiment> FIG. 1 is a diagram showing a configuration example of the information processing system according to the present embodiment. As shown in FIG. 1, the information processing system 1 includes, for example, terminals 2 (2-1, 2-2,...) and an information processing apparatus 3. The terminals 2 and the information processing apparatus 3 are connected to each other via a network NW. The network NW may be a wired network or a wireless network. In the following description, when one of the terminals 2-1, 2-2,... is not specified, it is referred to as the terminal 2.

[0020] The terminal 2 includes, for example, an operation unit 21, a display unit 22, a detection unit 23, a processing unit 24, and a communication unit 25. The information processing apparatus 3 includes, for example, an acquisition unit 31, a phasing unit 32, a synchronization rate calculation unit 33, a storage unit 34, a determination unit 35, and an output unit 36.

[0021] For example, a measurement application is downloaded and installed on the terminal 2 from the information processing apparatus 3. Note that the application may be provided by a device other than the information processing apparatus 3. The terminal 2 performs measurement using the application and transmits measurement data to the information processing apparatus 3. The terminal 2 acquires and presents determination information including, for example, a matching determination result from the information processing apparatus 3. The terminal 2 is, for example, a smartphone, a tablet terminal, a game terminal, a dedicated terminal, a notebook personal computer, or the like.

[0022] The operation unit 21 is, for example, a keyboard, a game pad, a touch pad, a mouse, or the like. Note that the operation unit 21 may be a touch panel provided on the display unit 22. In this case, the operation unit 21 may also serve as the detection unit 23.

[0023] The display unit 22 is, for example, a liquid crystal display device, an organic EL (Electro-Luminescence) display device, or the like.

[0024] The detection unit 23 is a sensor that detects the operation of the user. The detection unit 23 is, for example, a 6-axis sensor that detects the movement of the user, a motion sensor, a microphone that detects the sound when a keyboard or the like is pressed, or the like. Alternatively, the detection unit 23 is a photographing device. Or, the detection unit 23 is a brain wave detection sensor.

[0025] The processing unit 24 causes the display unit 22 to display the application according to the measurement application to be installed, and the detection unit 23 detects the detection result of the operation by the user according to the application. The processing unit 24 transmits, via the communication unit 25, data including the detection result with user identification information for identifying the user added to the detection result according to the application, to the information processing device 3. Note that the data including the detection result may include information indicating the detected method, information indicating the detected date and time, and the like.

[0026] The communication unit 25 receives the application. The communication unit 25 transmits the detection result.

[0027] The information processing device 3 acquires the detection result from the terminal 2, processes the acquired detection result, and calculates the unique rhythm for each user. The information processing device 3 calculates the synchronization rate between two users. Note that the combination of two users may be determined in advance by the users, or may be a combination of one person sequentially extracted from a plurality of users and one person among the remaining users, etc. The information processing device 3 determines the relationship between two users based on the unique rhythm and the synchronization rate. Note that the relationship between two persons is, for example, the degree of connection of the human relationship between the two persons. For example, in the case of lovers, husband and wife, friends, work colleagues, etc., whether the compatibility between the two is good or bad, whether they get along well or not, whether the tempo of work matches or not, etc.

[0028] The acquisition unit 31 acquires data including the detection results of a plurality of users from the terminal 2. For example, the acquisition unit 31 acquires data including the detection results of a plurality of users for each user, for each pair of two users, or for each of a plurality of three or more users.

[0029] The phase conversion unit 32 performs phase conversion using the detection result. The phase conversion unit 32 associates the phase-converted data with the user identification information and stores it in the storage unit 34. Note that the phase conversion unit 32 may calculate the motion rhythm from the detection result and perform phase conversion on the calculated motion rhythm. Also, the phase conversion unit 32 decomposes the detection result into an X-axis direction component, a Y-axis direction component, and a Z-axis direction component. In this embodiment, phase conversion means, for example, assuming one cycle with the extreme value in one direction as a peak and the extreme value in the opposite direction (180° opposite to the former) as a valley for the movement in the X, Y, or Z-axis direction in a finite space, and creating a phase during that period. Note that phase conversion is not limited to this. The phase conversion method and the method for calculating the motion rhythm will be described later.

[0030] The synchronization rate calculation unit 33 calculates the synchronization rate of the phases of two users. The synchronization rate calculation unit 33 selects a combination of two users based on the result calculated by the synchronization rate calculation unit 33. Note that the method for calculating the synchronization rate will be described later. The combination of two users to be selected may be determined in advance by the user, or may be, for example, a combination of one person sequentially extracted from a plurality of users and one of the remaining users. In this way, the synchronization rate calculation unit 33 may calculate the synchronization rate of the phase-converted data of the two users constituting one or more combinations formed by different two users among a plurality of users.

[0031] The storage unit 34 stores the formula used for calculation, the threshold value used for determination, the measurement application, etc. The storage unit 34 stores the phase-converted data in association with the user identification information for each user. The storage unit 34 stores the compatibility judgment result in association with each range of the synchronization rate (for example, 20 or less, 20 to 39, 40 to 59, 60 to 80, 80 or more), for example.

[0032] The determination unit 35 determines the relationship between the two based on the synchronization rate. Note that the determination unit 35 may determine the relationship between two users who make up a combination for one or more combinations of users based on the synchronization rate. The determination unit 35 outputs the determination result (including the synchronization rate) to the terminal 2 via the output unit 36.

[0033] The output unit 36 outputs the selection result to the terminal 2.

[0034] [Method for Measuring Movement Rhythm, Calculation Example] Next, the method for measuring the movement rhythm and the calculation example will be described with reference to FIGS. 2 to 4. Note that in this embodiment, the movement rhythm is a unique rhythm having a central value, fluctuation, etc. of the detection result obtained when the user performs a predetermined movement (for example, tapping, dancing, etc.).

[0035] (First Measurement Method; Tapping) FIG. 2 is a diagram for explaining a measurement example of the movement rhythm according to this embodiment. The measurement application requests the user to press the operation unit 21 of the keyboard, etc. at a favorite pace at regular time intervals, for example. The user presses or taps the operation unit 21 at a favorite pace at regular time intervals. The detection unit 23 detects that it has been pressed or tapped.

[0036] FIG. 3 is a diagram showing an example of the detection result. In FIG. 3, the horizontal axis is the tapping interval (sec) and the vertical axis is the number of taps (times). The phasing unit 32 sets the tapping interval with the largest number of taps (maximum value or maximum value) as the movement rhythm R1 of the user. Alternatively, the phasing unit 32 calculates the average value or standard deviation in the distribution of the tapping interval and the number of taps, and sets the calculated average value or standard deviation as the movement rhythm R1 of the user.

[0037] Note that the above-described method for calculating the exercise rhythm is just an example and is not limited thereto. For example, Reference 1 describes a method of measuring and analyzing the brain waves of a user during a tapping operation. And in Reference 1, the amplitude at each time point during the tapping period and the observation period is defined as the arctangent of the result of convolving the original brain wave signal s(t) with the complex Morlet wave function w(t,f) as shown in the following formula (1).

[0038] [Number]

[0039] In formula (1), σ t is the standard deviation of the Gaussian window. For example, f ranges from 1 Hz to 20 Hz (in 1 Hz steps). Using this method, the rhythm of the brain waves may be calculated as the exercise rhythm.

[0040] Reference 1; Kouki Edagawa, Masahiro Kawasaki, “Beta phase synchronization in the frontal-temporalcerebellar network during auditory-to-motor rhythm learning”, Scientific Reports, 7,(2017), 42721, 2017

[0041] (Second measurement method: Dance) FIG. 4 is a diagram for explaining another example of the measurement method according to the present embodiment. In the example of FIG. 4, for example, a reflector or the like is attached to the body of the user (reference sign g11), and the terminal 2 takes a picture to continuously acquire motion capture data (reference sign g12) at a predetermined time interval (sampling interval). Note that during the measurement, the application plays a predetermined rhythm or song, for example, and requests the user to move the body in three-dimensional space in accordance with the rhythm (for example, dance).

[0042] The phase conversion unit 32 separates the acquired detection result into components in the X-axis direction, Y-axis direction, and Z-axis direction using a well-known method. The phase conversion unit 32 associates each of the components in the X-axis direction, Y-axis direction, and Z-axis direction thus calculated with the user identification information and stores them in the storage unit 34.

[0043] [Example of method for calculating synchronization rate] Next, an example of a method for calculating the synchronization rate will be described with reference to FIGS. 5 to 8.

[0044] (First method for calculating synchronization rate; tapping) FIG. 5 is a diagram for explaining an example of a method for calculating the synchronization rate according to the present embodiment. In FIG. 5, the horizontal axis represents the tapping interval (sec), and the vertical axis represents the number of taps (times). The image g10 is an example of a combination of two persons with a low synchronization rate. The reference sign g11 is the measured value (motion rhythm) of the first user, and the reference sign g12 is the measured value (motion rhythm) of the second user. The motion rhythms of the first user are approximately 400 (msec) and approximately 500 (msec). The motion rhythm of the second user is approximately 360 (msec). The image g20 is an example of a combination of two persons with a high synchronization rate. The reference sign g11 is the measured value (motion rhythm) of the first user, and the reference sign g12 is the measured value (motion rhythm) of the second user. The motion rhythms of the first user and the second user are approximately 460 (msec).

[0045] In this way, the difference in the motion rhythms between the first user and the second user is equal to or greater than a predetermined value. The synchronization rate calculation unit 33 may calculate the rhythm or ratio of the motion rhythms between the first user and the second user as the synchronization rate in this way.

[0046] (Example of method for calculating synchronization rate using phase) Next, an example of a method for calculating the synchronization rate when using phase will be described. FIG. 6 is a diagram showing an example of time vs. amplitude for a first user and a second user. In FIG. 6, the horizontal axis represents time and the vertical axis represents the magnitude of the amplitude. The synchronization rate is calculated using components in the same axis direction. For example, the synchronization rate is calculated using the component in the X-axis direction (waveform g41) of the first user and the component in the X-axis direction (waveform g42) of the second user. In the example of FIG. 6, the phase of the component in the X-axis direction of the first user is φ X and the phase of the component in the X-axis direction of the second user is φ Y is assumed to be.

[0047] FIG. 7 is a diagram showing an example of the time change of the phase difference between the first user and the second user. In FIG. 7, the horizontal axis represents time and the vertical axis represents the phase difference (π to -π). Also, waveform g51 is the time change of the phase difference of the first user, and waveform g52 is the time change of the phase difference of the second user.

[0048] FIG. 8 is a diagram for explaining the determination result based on the synchronization rate. In FIG. 8, the horizontal axis is a real number and the vertical axis is an imaginary number. Image g60 is an example of a state where the phases of the two are synchronized, that is, it is determined that the compatibility is good. Image g70 is an example of a state where the phases of the two are not synchronized, that is, it is determined that the compatibility is bad.

[0049] (1) First calculation method The synchronization rate calculation unit 33 evaluates, at the same event (time), how constant the phases of the two are, for example, using the measured brain waves with the following formula (2) (see, for example, Reference 2).

[0050]

Equation

[0051] Reference 2: Kunihiro Aiba, Eri Miyauchi, Masahiro Kawasaki, “Synchronous brain networks for passive auditory perception in depressive states: A pilot study”, Heliyon, 2019

[0052] In Equation (2), t is time, f is frequency, X is the brain wave of the first user, Y is the brain wave of the second user, φ is the phase, and N is the total number of epochs. For example, X may be the movement rhythm of the first user and Y may be the movement rhythm of the second user.

[0053] (2) The second calculation method The synchronization rate calculation unit 33 evaluates, for the same time window, how constant the phases of the two are using, for example, the measured brain waves with the following Equation (3) (see, for example, Reference 3).

[0054] [Number]

[0055] In Equation (3), Δφ jk (t,f) is the phase difference between the j-th and k-th electrodes. i is an index. Also, the number N of time points at 1-second intervals is, for example, 1000.

[0056] Reference 3: Masahiro Kawasakia, Keiichi Kitajob, et al., “Sensory-motor synchronization in the brain corresponds to behavioral synchronization between individuals”, Neuropsychologia 119 (2018) p.56-67, 2018

[0057] (3) The third calculation method The synchronization rate calculation unit 33 evaluates, for the same time window, how correlated the amplitudes and phases of the two are, using the device, electroencephalogram, and voice to be compared (see, for example, Reference 4). The correlation comparison is performed, for example, as shown in Figures 3 to 5 of Reference 4.

[0058] Reference 4: Masahiro Kawasaki, Yohei Yamada, et al., “Inter-brain synchronization during coordination of speech rhythm in human-to-human social interaction”, SCIENTIFIC REPORTS, 2013

[0059] Note that the above-described method for calculating the synchronization rate is an example and is not limited thereto. In this embodiment, the relationship between the two is determined based on the calculated synchronization rate. Note that the information processing device 3 determines the relationship between the two by quantifying and associating the relationship between the two for each range of the synchronization rate.

[0060] [Example of information stored in the storage unit] Here, an example of the information stored in the storage unit 34 will be described. FIG. 9 is a diagram showing an example of the information stored in the storage unit according to this embodiment. As shown in FIG. 9, the storage unit 34 stores, in association with the user identification information, for example, detection result data and phase-converted data. Note that the information processing device 3 may discard the detection result after phase conversion.

[0061] [Example of processing procedure] Next, an example of the processing procedure performed by the information processing system 1 will be described. FIG. 10 is a flowchart of the processing procedure performed by the information processing system according to this embodiment.

[0062] (Step S1) The acquisition unit 31 acquires data including detection results of a plurality of users from the terminal 2.

[0063] (Step S2) The phase conversion unit 32 converts the detection result into a phase, and associates the phase-converted data with the user identification information and stores it in the storage unit 34.

[0064] Note that the phase conversion unit 32 may calculate motion data from the detection result and convert the calculated motion data into a phase. (Step S3) The acquisition unit 31 acquires a determination request from the terminal 2.

[0065] (Step S4) The synchronization rate calculation unit 33 extracts, in response to the acquired determination request, one or more pairs of users who make up a combination from among a plurality of users stored in the storage unit 34, for example, different two users.

[0066] (Step S5) The synchronization rate calculation unit 33 calculates the synchronization rate using the phase-converted data of the same axis components of the two users who make up the extracted combination.

[0067] (Step S6) The determination unit 35 determines the relationship between the two users who make up a combination for one or more combinations based on the result calculated by the synchronization rate calculation unit 33. The determination unit 35 may select, for example, a pair of two persons whose synchronization rate is equal to or higher than a threshold value based on the calculated result. Note that this process may not be performed.

[0068] (Step S7) The output unit 36 outputs the determination result to the terminal 2. Alternatively, the output unit 36 outputs the result of the compatibility determination based on the synchronization rate to the terminal 2.

[0069] [Specific Example] Here, a usage example of the information processing system 1 will be described. Users (A, B, C, and D) operate their respective terminals 2 to perform measurements. The measurements are, for example, tapping at a preferred timing according to the instructions of an application. Note that, as described above, the measurements capture the timing of tapping, movements such as dancing, etc. Also, if it is possible to measure brain waves by connecting a simple brain wave sensor to a smartphone or a notebook computer, the measurements may also include brain wave measurements.

[0070] The information processing device 3 acquires the detection results of each of the users (A, B, C, and D) and calculates the phase for each user. User A, for example, requests a compatibility judgment by operating the terminal 2.

[0071] The information processing device 3 extracts user B and calculates the synchronization rate of the phases of users A and B. The information processing device 3 extracts user C and calculates the synchronization rate of the phases of users A and C. The information processing device 3 extracts user D and calculates the synchronization rate of the phases of users A and D. The information processing device 3 provides the judgment result based on the synchronization rate for each pair, or the judgment result with the best synchronization rate, to the terminal 2 via the output unit 36.

[0072] Note that the content output by the output unit 36 is, for example, information indicating a person with good compatibility, the result of judging the compatibility between two people, information indicating the members who form a team organized based on the judgment, etc. Note that the information processing device 3 may extract the user's most compatible partner based on the synchronization rate. For example, the information processing device 3 may calculate the synchronization rate between the user and each of a plurality of other users, judge the relationship between the user and another user based on the synchronization rate of the two-person combination, and select another user with a high synchronization rate with the user. In such a case, the information processing device 3 may calculate the synchronization rate for all the users stored in the storage unit 34 and select the person with the highest synchronization rate, or may end the selection when a selector with a synchronization rate equal to or higher than a predetermined value is selected.

[0073] Further, the processing performed by the information processing apparatus 3 may be performed by an application. And the information processing apparatus 3 may be provided with the application. In this case, for example, the terminal 2 may perform measurement by a web application.

[0074] FIG. 11 is a diagram showing an example of a determination result. In FIG. 11, reference numerals g101 to g104 are examples of results obtained by phase-aligning the movement rhythms between two persons and calculating the synchronization rate. Such a determination result can be applied to, for example, determination of compatibility with friends, determination of compatibility with lovers or spouses, determination of compatibility with colleagues at work, and the like. Note that, for example, when used for selection of persons participating in a meeting, not only combinations with good compatibility may be selected, but combinations with poor compatibility may be deliberately selected and mixed.

[0075] Accordingly, according to the present embodiment, for example, measurement can be performed using an application installed on the terminal 2 of each user, and the information processing apparatus 3 can determine and present the relationship between two persons using the detection result.

[0076] Note that the application may be provided, for example, on the cloud. Also, a part of the processing performed by the information processing apparatus 3 (for example, calculation of movement rhythm) may be performed by the application on the terminal 2, and the calculated movement rhythm data may be transmitted to the information processing apparatus 3.

[0077] Also, a database may be constructed by storing the movement rhythm data of a large number of users in the above-described storage unit 34. Note that in the database, the movement rhythm of each user and the synchronization rate between users as shown in FIG. 11 may be stored in association with each other.

[0078] <Second Embodiment> In the first embodiment, an example in which each user performs measurement has been described, but the present invention is not limited to this. For example, when two people can participate in the measurement simultaneously, the measurement may be performed by the two people. Although measurement is preferably performed in the same room, for example, even if they meet in different rooms, one person or both may participate in the measurement online. Note that the configuration example of the information processing system 1 is the same as that of FIG. 1 in the first embodiment.

[0079] FIG. 12 is a diagram for explaining an example of the measurement method according to the present embodiment. In this measurement example, two users sequentially tap a keyboard alternately and adjust the tapping interval to match that of the other party. For example, as indicated by reference sign g201, user A first taps, and then user B tries to tap in accordance therewith, as indicated by reference sign g202. Tapping is performed a plurality of times so as to match the tapping intervals (see, for example, Reference 3). In the measurement, for example, each of the two users wears an electroencephalogram measurement sensor on the head to perform the measurement. The detection of the user's operation may be performed, for example, by "a sensor incorporated in the keyboard" or "a motion sensor attached to the body such as the arm". Alternatively, the detection of the user's operation may be performed by an RGB image sensor, a depth sensor, a position sensor using a laser, or the like.

[0080] FIG. 13 is a diagram showing the relationship between the number of tapping times and the tapping interval of two persons. The horizontal axis represents the number of tapping times (times), and the vertical axis represents the tapping interval (sec). Note that FIG. 13 shows an example of a combination with a poor synchronization rate.

[0081] In order to specify the time-frequency amplitude and phase during the alternating tapping task, a wavelet transform using Morlet's function was applied in the time domain (SDσ t ) and the frequency domain (SDσ f ) centered on the analysis target frequency (f). Also, as in the following expressions (4) and (5), the amplitude E(t, f) at each time point was calculated as the square norm of the convolution result of the original electroencephalogram signal s(t) and the Morlet wavelet function w(t, f).

[0082]

Number

[0083]

Number

[0084] Note that σ f is 1 / (2πσ t ).

[0085] The wavelet used has a constant ratio (f / σ f = 7) at 1 Hz intervals in the range where f is from 1 to 20 Hz. Also, the amplitude was calculated by subtracting the baseline data measured during the session interval for each frequency band. And the vibration amplitude of each frequency band was averaged over the time period from the onset to the offset of the session for each condition. In this measurement, the synchronization rate of the phases of the two can be calculated using the above-mentioned formula (3).

[0086] Also, as follows, in order to apply the data of the tapping interval, the discrete tapping interval data can be converted into continuous data (see, for example, Reference 5). For each user, the interval from one tap to the next tap is defined as one cycle and converted into a sine wave of one cycle. The phase (-π to π) at time t is defined as x(t) and y(t) for the two users (X, Y) respectively. Note that in the measurement, the first 10 taps were excluded because there were some with unstable timing. As shown in Fig. 14, the action data (code g210) for calculating TE (Transfer Entropy) is converted into continuous phase data (g220). Fig. 14 is a diagram for explaining the TE analysis. TE(X, Y, τ) represents the entropy of the time difference τ from X to Y and is calculated by the following formula (6).

[0087]

Number

[0088] For example, TE was calculated by controlling the task conditions and averaging the data within a defined time window of T = 270 seconds. Also, to estimate the information flow, TE(X,Y,τ) and TE(Y,X,τ) were compared using a permutation test (1,000 times). When there was a significant difference between TEs in the permutation test, a causal information flow was indicated (p < 0.05).

[0089] Reference 5: Kenji Takamizawa, Masahiro Kawasaki, “Transfer entropy for synchronized behavior estimation of interpersonal relationships in human communication: identifying leaders or followers”, SCIENTIFIC REPORTS, 2019

[0090] (Variant example) When measuring simultaneously by two persons, the relationship between the two persons (leader or follower) can also be determined as follows (see, for example, Reference 5). As in Reference 5, the relationship between the two persons (leader or follower) is determined for the two persons using three questions (Autism Spectrum Quotient (AQ), Empathy Quotient (EQ), Systematization Quotient (SQ)). Note that AQ is an index for measuring the symptoms of autism spectrum disorder characterized by communication ability disorders and the presentation of restrictive behaviors. EQ is an index of empathy ability, and SQ is an index of systematization ability.

[0091] Using TE analysis, the causal relationship between the two can be clarified, and leaders and followers can be identified. For example, the result of comparing the significant differences in TE between two people is shown in FIG. 15. FIG. 15 is a diagram showing examples of the average values of AQ, EQ, and SQ scores for the leader group and the follower group. As shown in FIG. 15, the SQ score of the leader group is significantly higher than that of other groups (p < 0.05). On the other hand, no significant differences were found in AQ (t = -1.16; p = 0.25) and EQ (t = 1.34; p = 0.18). Thus, in the measurement, by evaluating the systematization index (SQ) for the measurer, leaders and followers can be identified.

[0092] Note that the method for identifying leaders and followers described above is just an example, and the method used for identification is not limited to TE analysis. Also, when measuring these two simultaneously in this way, questions may be asked and collected for both of them. The content of the questions is not limited to the above-mentioned autism spectrum index (AQ), empathy index (EQ), and systematization index (SQ), but can be, for example, the empathy level and feelings before and after the measurement.

[0093] [Example of processing procedure] Next, an example of the processing procedure performed by the information processing system 1 will be described. FIG. 16 is a flowchart of the processing procedure performed by the information processing system according to the present embodiment.

[0094] (Step S101) The acquisition unit 31 acquires data including the detection results of two users from the terminal 2. In the measurement, as described above, the two users alternately tap (or press), or the motion of the two users is captured by motion capture.

[0095] (Step S102) The phasing unit 32 phases each of the detection results of the two, and stores the phased data in the storage unit 34 in association with the user identification information. Note that the phasing unit 32 may calculate the motion rhythm from each of the detection results of the two, and phase each of the calculated motion rhythms.

[0096] (Step S103) The synchronization rate calculation unit 33 calculates the synchronization rate of the two users whose phases have been adjusted.

[0097] (Step S104) The determination unit 35 determines the relationship between the two users based on the result calculated by the synchronization rate calculation unit 33.

[0098] (Step S105) The output unit 36 outputs the determination result to the terminal 2. Or, the output unit 36 outputs to the terminal 2 the determination result indicating the relationship between the two users determined based on the synchronization rate.

[0099] [Specific Example] Here, a usage example of the information processing system 1 will be described. The two users (A, B) operate their respective terminals 2 to perform measurements. The measurements are, for example, tapping alternately at a timing according to the instructions of an application, or moving to communicate. The information processing device 3 acquires the detection results of the two parties, and phases the acquired detection results of each of the two parties. The information processing device 3 calculates the synchronization rate between the two parties using the phased data. The information processing device 3 obtains the relationship (such as compatibility, etc.) between the two parties based on the calculated synchronization rate.

[0100] Note that the information processing device 3 may also acquire the questions asked to the two parties (subjective impressions of the other party, feelings about the actions performed by the two parties), and the results of the actions performed, and associate and store them with the user identification information, synchronization rate, and combination content. The information processing device 3 may construct a database using the information stored in this way.

[0101] Also, the information processing device 3 may obtain the relationship between the two parties by referring to the information stored in the storage unit 34 in the same manner as in the first embodiment for the calculated synchronization rate between the two parties. Alternatively, the information processing device 3 may associate a weighting coefficient with the calculated synchronization rate, and use this weighting coefficient to obtain the relationship between the two parties.

[0102] Then, based on the synchronization rate, the information processing apparatus 3 outputs, for example, the compatibility between two persons, the compatibility of a team, etc.

[0103] According to this embodiment, the relationship between two persons can be obtained and presented. Note that the persons for whom the relationship is obtained are not limited to two persons, and may be three or more persons. In this case, it is not limited to one-to-one, and it is also possible to present the relationships of a plurality of persons. Also, obtaining the relationship is not limited to simultaneously measuring the motion rhythms of two persons and three or more persons. The relationship of the target persons can also be, for example, measuring their respective motion rhythms at different times, and presenting persons with good compatibility or bad compatibility among a plurality of persons using the data.

[0104] Note that a program for realizing all or part of the functions of the information processing apparatus 3 in the present invention may be recorded on a computer-readable recording medium, and the program recorded on this recording medium may be read into a computer system and executed to perform all or part of the processing performed by the information processing apparatus 3. Here, the "computer system" shall include hardware such as an OS and peripheral devices. Also, the "computer system" shall include a WWW system equipped with a homepage providing environment (or a display environment). Further, the "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, etc., and a storage device such as a hard disk built into a computer system. Furthermore, the "computer-readable recording medium" also includes a volatile memory (RAM) inside a computer system that becomes a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line, and that holds the program for a certain period of time.

[0105] In addition, the above program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the "transmission medium" for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) like the Internet or a communication line (communication wire) like a telephone line. Further, the above program may be for realizing a part of the functions described above. Furthermore, it may be a so-called difference file (difference program) that can realize the functions described above in combination with a program already recorded in the computer system.

[0106] As described above, the embodiments for implementing the present invention have been described using the embodiments. However, the present invention is not limited to such embodiments, and various modifications and substitutions can be made without departing from the gist of the present invention.

Explanation of Reference Numerals

[0107] 1... Information processing system, 2... Terminal, 3... Information processing device, 21... Operation unit, 22... Display unit, 23... Detection unit, 24... Processing unit, 25... Communication unit, 31... Acquisition unit, 32... Phase conversion unit, 33... Synchronization rate calculation unit, 34... Storage unit, 35... Judgment unit, 36... Output unit

Claims

1. An acquisition unit that acquires data including detection results of movements performed by a plurality of users; A phasing unit that phases the detection results; A synchronization rate calculation unit that calculates a synchronization rate of the phased data of two users who make up one or more combinations among the plurality of users; A determination unit that determines the relationship between two users who make up the combination for the one or more combinations based on the synchronization rate; Comprising; The phasing unit constructs a database by associating the phased data with user identification information for identifying the user for a plurality of users; The synchronization rate calculation unit refers to the database to extract the phased data of other users, and calculates the synchronization rate between the extracted phased data of the other users and the phased data of each of the plurality of users; An information processing apparatus.

2. The phasing unit calculates a movement rhythm using the acquired detection results, and phases the calculated movement rhythm. The information processing apparatus according to claim 1.

3. The phasing unit decomposes the detection results into an X-axis direction component, a Y-axis direction component, and a Z-axis direction component, and phases each of the X-axis direction component, the Y-axis direction component, and the Z-axis direction component; The synchronization rate calculation unit calculates the synchronization rate using the phased data of the same axis components of the two users who make up the combination; The information processing apparatus according to claim 1 or claim 2.

4. The determination unit determines the relationship between two users who are a combination of each of the plurality of users and the other user based on the synchronization rate between the phased data of the other user and the phased data of each of the plurality of users; The information processing apparatus according to claim 1 or claim 2.

5. The synchronization rate calculation unit calculates the synchronization rate between each of the plurality of users and the other user; The determination unit determines the relationship between two users who are a combination of each of the plurality of users and the other user based on the synchronization rate, and selects the other user whose synchronization rate is higher than a predetermined value; The information processing apparatus according to claim 1 or claim 2.

6. The determination unit determines the relationship between two persons, each being one of the plurality of users and the other user, based on the synchronization rate, and selects a plurality of users. The information processing apparatus according to claim 1 or claim 2.

7. An acquisition unit that acquires data including detection results of movements performed by a plurality of users; A phase conversion unit that converts the detection results into phases; A synchronization rate calculation unit that calculates a synchronization rate of the phase-converted data of two users constituting the combination for one or more combinations each constituted by two different users among the plurality of users; A determination unit that determines the relationship between two users constituting the combination for the one or more combinations based on the synchronization rate; comprising The phase conversion unit decomposes the detection results into an X-axis direction component, a Y-axis direction component, and a Z-axis direction component, and converts each of the X-axis direction component, the Y-axis direction component, and the Z-axis direction component into a phase. The synchronization rate calculation unit calculates the synchronization rate using the phase-converted data of the same-axis components of the two users constituting the combination. Information processing apparatus.

8. The computer of the information processing apparatus acquires data including detection results of movements performed by a plurality of users, converts the detection results into phases, calculates a synchronization rate of the phase-converted data of two users constituting the combination for one or more combinations each constituted by two different users among the plurality of users, and determines the relationship between two users constituting the combination for the one or more combinations based on the synchronization rate. An information processing method, comprising: constructing a database by associating the phase-converted data with user identification information for identifying the users for a plurality of users; referring to the database to extract the phase-converted data of other users, and calculating the synchronization rate between the extracted phase-converted data of the other users and the phase-converted data of each of the plurality of users. Information processing method.

9. The computer of the information processing apparatus acquires data including detection results of movements performed by a plurality of users, converts the detection results into phases, calculates a synchronization rate of the phase-converted data of two users constituting the combination for one or more combinations each constituted by two different users among the plurality of users, Based on the synchronization rate, determine the relationship between the two users who make up the combination for the one or more combinations. An information processing method, Decompose the detection result into an X-axis direction component, a Y-axis direction component, and a Z-axis direction component, and phase each of the X-axis direction component, the Y-axis direction component, and the Z-axis direction component. Calculate the synchronization rate using the phase-converted data of the same-axis components of the two people who make up the combination. Information processing method.

10. Cause the computer of the information processing device to Acquire data including the detection result of the movement performed by a plurality of users, Phase the detection result, Calculate the synchronization rate of the phased data of the two users who make up the combination for one or more combinations composed of two different users among the plurality of users, Based on the synchronization rate, determine the relationship between the two users. A program, For a plurality of users, construct a database by associating the phased data with user identification information for identifying the users. Refer to the database to extract the phased data of other users, and calculate the synchronization rate between the extracted phased data of other users and the phased data of each of the plurality of users. Program.

11. Cause the computer of the information processing device to Acquire data including the detection result of the movement performed by a plurality of users, Phase the detection result, Calculate the synchronization rate of the phased data of the two users who make up the combination for one or more combinations composed of two different users among the plurality of users, Based on the synchronization rate, determine the relationship between the two users. A program, Decompose the detection result into an X-axis direction component, a Y-axis direction component, and a Z-axis direction component, and phase each of the X-axis direction component, the Y-axis direction component, and the Z-axis direction component. Calculate the synchronization rate using the phase-converted data of the same-axis components of the two people who make up the combination. Program.

Images