Psychological evaluation device, psychological evaluation method, and program
The psychological evaluation device uses frequency analysis of gravity components from a 3-axis acceleration sensor to estimate user interest in content, overcoming the need for constant posture, ensuring accurate and versatile interest evaluation.
Patent Information
- Application Number
- JP2021548913
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-09-24
- Filing Date
- 2020-09-23
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2040-09-23
AI Technical Summary
Conventional methods for evaluating user interest in content using a 3-axis acceleration sensor in smartphones require the user to maintain a constant posture, limiting versatility and accuracy.
A psychological evaluation device and method that utilizes a 3-axis acceleration sensor to detect physiological tremors, performing frequency analysis on gravity components of acceleration data to estimate user interest without requiring a specific hand posture.
Accurately estimates user interest in content while using a smartphone naturally, enabling precise recommendations based on physiological tremor detection.
Smart Images

Figure 0007584064000001 
Figure 0007584064000002 
Figure 0007584064000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a psychological evaluation device and a psychological evaluation method for evaluating the preferences of a user browsing content. and Programs Regarding. [Background technology]
[0002] Conventionally, with the widespread use of electronic devices such as smartphones and tablet terminals, the electronicization of content has progressed. Due to the increase in electronic content, users have more opportunities to display and view various contents on the displays of electronic devices. Examples of electronic content include books, comics, and various videos, and these electronic contents are displayed on the displays of smartphones and the like for users to view.
[0003] When viewing electronic content on a smartphone, a user accesses a site that provides (sells) the electronic content, selects the desired electronic content from a list of electronic content provided by the site, and receives the content from the site.
[0004] Here, sites that provide electronic content judge the content preferences of users based on the user's past download history, browsing history, etc., and recommend electronic content that is thought to match the user's tastes.
[0005] For example, Patent Document 1 describes a process for determining a content to be recommended based on the number of times that content distributed via a network has been viewed. Non-Patent Document 1 also describes a method for reading an acceleration waveform during content browsing using a 3-axis acceleration sensor built into a smartphone, and evaluating the relevance between the 3D acceleration of the smartphone itself and interest in the content due to behavior during browsing. That is, Non-Patent Document 1 describes, as a specific example of evaluating relevance, that when the content is unlikely to be of interest to the user, the distribution of frequency components obtained by Fourier transforming the 3D acceleration is dispersed, whereas when the content is highly interesting to the user, the distribution of frequency components obtained by Fourier transforming the 3D acceleration is concentrated in the low frequency component region. [Prior art documents] [Patent documents]
[0006] [Patent Document 1] JP 2019-106033 A [Non-patent literature]
[0007] [Non-Patent Document 1] Yan Hong, Research on content browsing support methods by estimating user interests based on user behavior, Kyushu University Learning Information Repository, 2015 Summary of the Invention [Problem to be solved by the invention]
[0008] As described in Non-Patent Document 1, it has been known that when viewing content, the user's interest in the viewed content can be estimated using acceleration data from a 3-axis acceleration sensor built into a smartphone. However, in order to perform an accurate evaluation using the 3-axis acceleration sensor built into a smartphone with the conventional method, the user needs to always maintain a constant posture when holding the smartphone in his / her hand. Specifically, if the user's posture when holding the smartphone changes, the acceleration waveform acquired by the 3-axis acceleration sensor changes, making it impossible to perform an accurate evaluation.
[0009] Therefore, the conventional method described in Non-Patent Document 1 has a problem that it is necessary for the user to hold the smartphone in a predetermined posture in order to estimate the user's interest, and therefore it is not a highly versatile interest estimation method. In other words, the conventional method requires the user to hold the smartphone in a form different from the normal usage state, so it is difficult to estimate the user's interest in the content displayed on the smartphone in the state in which the smartphone is used on a daily basis.
[0010] The present invention aims to provide a psychological evaluation device, a psychological evaluation method, and a program that can accurately evaluate a user's interests while using a terminal such as a smartphone on a daily basis. do. [Means for solving the problem]
[0011] The psychological evaluation device of the present invention is a psychological evaluation device that estimates a subject's interest in content that is used in conjunction with a terminal held by the subject, the psychological evaluation device including an acceleration component acquisition unit that acquires acceleration data obtained by an acceleration sensor built into the terminal, and a processing unit that calculates the acceleration data obtained by the acceleration component acquisition unit. Among these, the acceleration data in the gravity direction is frequency-analyzed. Frequency analysis section and 、 When the device displays content other than the specified content, Based on the results of the frequency analysis performed by the frequency analysis unit, the subject's interest in specific content is estimated. An evaluation unit.
[0012] The psychological evaluation method of the present invention is a psychological evaluation method for estimating a subject's interest in content used in conjunction with a terminal held by the subject, the method comprising: an acceleration component acquisition process for acquiring acceleration data obtained by an acceleration sensor built into the terminal; and a step of acquiring acceleration data from the acceleration component acquisition process. The acceleration data in the direction of gravity A frequency analysis process for performing frequency analysis; an average calculation process for calculating an average for each predetermined time period for each frequency component obtained by the frequency analysis process; and an integral value of the average of each frequency component calculated by the average calculation process when the terminal displays specific content, when the terminal displays content other than the specific content. Based on the frequency analysis results of the frequency analysis process, the subject's interest in a particular content is estimated. and an evaluation process.
[0013] The program of the present invention is for causing a computer to implement and execute the procedures for executing each step of the psychological evaluation method described above.
[0014] According to the present invention, it is possible to accurately detect vibrations caused by a subject's physiological tremor with a simple configuration and accurately estimate the subject's interest in content. [Brief description of the drawings]
[0015] [Figure 1] FIG. 1 is a diagram showing an application example of a psychological evaluation device according to a first embodiment of the present invention. [Diagram 2] 1 is a block diagram showing an example of the configuration of an apparatus according to a first embodiment of the present invention. [Diagram 3] 1 is a block diagram showing a functional configuration of a psychology evaluation device according to a first embodiment of the present invention. [Figure 4] 3 is a diagram showing an example of acceleration data obtained from the acceleration sensor according to the first embodiment of the present invention. FIG. [Diagram 5] 3 is a diagram showing an example in which a DC component and an AC component of acceleration data obtained from the acceleration sensor according to the first embodiment of the present invention are separated. FIG. [Figure 6] 4 is a flowchart showing the flow of a psychological evaluation process according to the first embodiment of the present invention. [Figure 7] FIG. 11 is a diagram showing an application example of a psychological evaluation device according to a second embodiment of the present invention. [Figure 8] FIG. 11 is a block diagram showing an example of the configuration of an apparatus according to a second embodiment of the present invention. [Figure 9] 13 is a flowchart showing the flow of a psychological evaluation process according to a second embodiment of the present invention. [Figure 10] FIG. 11 is a diagram showing an example of amplitude for each frequency when content is browsed, measured by applying the first and second embodiments of the present invention. [Figure 11]FIG. 13 is a diagram showing an example of the correlation between the interestingness of a work and the amplitude integral value measured by applying the first and second embodiments of the present invention. [Figure 12] FIG. 11 is a diagram showing an example of an amplitude integral value at 2.5 Hz to 3.5 Hz measured by applying the second embodiment of the present invention. [Figure 13] FIG. 11 is a diagram showing an example of a questionnaire evaluation value measured by applying the second embodiment of the present invention. [Figure 14] FIG. 13 is a diagram comparing frequency analysis results when content is viewed and when it is not viewed according to the third embodiment of the present invention. [Figure 15] FIG. 13 is a diagram showing an example of a posture during measurement according to the third embodiment of the present invention. [Figure 16] FIG. 13 is a diagram comparing the results of frequency analysis according to the third embodiment of the present invention, depending on whether or not a specific subject (subject A) has an interest. [Figure 17] FIG. 13 is a diagram comparing the results of frequency analysis according to the third embodiment of the present invention, depending on whether or not a specific subject (subject B) has an interest. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0016] <1. First embodiment> A first embodiment of the present invention will be described below with reference to FIGS. [1-1. Examples of psychological evaluation device applications] FIG. 1 shows an application example of the psychological evaluation device according to the present embodiment. In this embodiment, content (such as electronic comics) is displayed on terminal 100 (smartphone) held in one hand by a user (subject), and a psychological evaluation is performed on terminal 100 (or server 200) to infer the user's interest in the content being viewed.
[0017] That is, the terminal 100 communicates with a server 200 that distributes content via the Internet N, and the content (e.g., digital comics) distributed from the server 200 is displayed on a screen 101a of a display unit 101 (FIG. 2) of the terminal 100. An application program for causing the terminal 100 to function as a psychological evaluation device is implemented in the terminal 100, which is a smartphone.
[0018] Here, it is assumed that the terminal 100 is held in the hand b of a user a. Terminal 100 has a built-in three-axis acceleration sensor 105 (FIG. 2), and terminal 100 can detect acceleration on three axes (x-axis, y-axis, z-axis) when held in hand b. As shown in FIG. 1, the y-axis of the acceleration (vector) detected by three-axis acceleration sensor 105 built into terminal 100 is the longitudinal direction (vertical direction) of screen 101a, the x-axis is the lateral direction (horizontal direction) of screen 101a, and the z-axis is a direction perpendicular to screen 101a. For ease of explanation, three axes (x-axis, y-axis, z-axis) are set based on the orientation of screen 101a, but the three mutually orthogonal axes, x-axis, y-axis, and z-axis, may be set based on other orientations such as the direction of gravity. For example, the direction of gravity (vertical direction) may be set as the y-axis, and two axes orthogonal to the direction of gravity may be set as the x-axis and z-axis. These three orthogonal axes, x-axis, y-axis, and z-axis, are set by three-axis acceleration sensor 105. In this embodiment, a three-axis acceleration sensor 105 built into the terminal 100 detects vibrations called physiological tremor of the hand b of the user a.
[0019] Physiological tremor is a vibration caused by repeated muscle contraction and relaxation, and occurs even in healthy people, and is different from tremors caused by some disease or disorder. However, physiological tremor is a very small vibration, and healthy people usually do not notice it. The frequency of physiological tremor is known to be low, for example, around 10 Hz, but varies depending on the part of the body. For example, in the hand beyond the wrist, the main frequency of vibration in the direction of gravity due to physiological tremor is in the range of 2.5 Hz to 3.5 Hz.
[0020] [1-2. Example of device configuration] FIG. 2 shows an example of the hardware configuration of the terminal 100 and the server 200 shown in FIG. The terminal (smartphone) 100 includes a display unit 101, a central processing unit (CPU) 102, a read only memory (ROM) 103, a random access memory (RAM) 104, a three-axis acceleration sensor 105, and a wireless communication unit 106, each of which is connected via a bus line to enable data transfer.
[0021] Images generated within the terminal 100, images downloaded from outside, etc. are displayed on the display unit 101. A touch panel is disposed on the display unit 101, and the display unit 101 accepts operations from a user through this touch panel. The CPU 102 is an arithmetic processing unit that reads out from the ROM 103 and executes the code of the program executed by the terminal 100 . The ROM 103 stores programs such as applications executed by the terminal 100. The ROM 103 also stores a program for performing a psychological evaluation process for estimating an interest in the content being viewed, which will be described in this embodiment. In the RAM 104, variables and parameters that are generated during the calculation process are temporarily written.
[0022] The three-axis acceleration sensor 105 detects the acceleration acting on the terminal 100 along three orthogonal axes (x-axis, y-axis, and z-axis). The wireless communication unit 106 is a circuit that performs wireless communication via a wireless telephone line, a wireless LAN (local area network), etc. For example, the terminal 100 can access the server 200 via the Internet N by wireless communication via the wireless communication unit 106.
[0023] The server 200 includes a network interface 201 , a user management unit 202 , and a content storage unit 203 . The network interface 201 communicates with the terminal 100 accessed via the Internet N. The user management unit 202 recognizes users registered for each accessed terminal 100 and performs management processing for the recognized users. One of the user management processing performed by the user management unit 202 is, for example, a processing for recommending appropriate content to the corresponding user according to the past access history of each user and the preferences estimated by the psychological evaluation processing. In addition, the user management unit 202 acquires and holds the data of the result of the psychological evaluation processing performed in the accessed terminal 100.
[0024] The content storage unit 203 stores content (e.g., digital comics and electronic books) provided by the server 200. The content stored in the content storage unit 203 is read out by the user management unit 202 and transferred to the terminal 100 in response to an instruction from the terminal 100 that has accessed the server 200.
[0025] [1-3. Example of configuration for performing psychological evaluation processing] Fig. 3 is a functional block diagram showing a configuration for performing psychological evaluation processing by the terminal 100. The configuration and functions of each processing unit shown in Fig. 3 are obtained by the CPU 102 included in the terminal 100 shown in Fig. 2 reading and executing a program from the ROM 103. As shown in FIG. 3, the configuration for terminal 100 to perform psychological evaluation processing includes an acceleration data acquisition unit 111, a low-frequency component acquisition unit 112, a high-frequency component acquisition unit 113, a gravity component acquisition unit 114, a frequency analysis unit 115, an average calculation unit 116, and an evaluation unit 117.
[0026] The acceleration data acquisition unit 111 acquires three-axis acceleration data detected by the three-axis acceleration sensor 105 (acceleration data acquisition process). The acceleration data acquisition unit 111 samples the three-axis acceleration output by the three-axis acceleration sensor 105 at a predetermined sampling frequency (e.g., 50 Hz) to acquire instantaneous values of the acceleration. The low-frequency component acquisition unit 112 acquires low-frequency components for each of the three axes from the instantaneous values of the three-axis acceleration acquired by the acceleration data acquisition unit 111 by cutting off high-frequency components using a moving average method. For example, the low-frequency components of 1 Hz or less are acquired by setting the cutoff frequency to 1 Hz and the number of moving average points to 23. The high-frequency component acquisition unit 113 subtracts the low-frequency components obtained by the low-frequency component acquisition unit 112 from the three-axis acceleration data acquired by the acceleration data acquisition unit 111, and acquires high-frequency components with frequencies higher than the cut-off frequency (1 Hz) for each of the three axes.
[0027] The gravity component acquisition unit 114 acquires the gravity components for each of the three axes, and combines the acquired gravity components for the three axes (gravity component acquisition process). The gravity component acquisition unit 114 acquires the gravity component, for example, according to the following formula [1].
[0028] (Number 1) f H ×(f L / 9.8)
[0029] Here, fH is the high frequency component acquired by the high frequency component acquisition unit 113, and fL is the low frequency component acquired by the low frequency component acquisition unit 112. In [Equation 1], the low frequency component is divided by 9.8 because the gravitational acceleration is 9.8 m / s 2 This is based on the fact that... Then, the gravity component acquisition unit 114 calculates the gravity components X G , Y G , Z G That is, the gravity component acquisition unit 114 synthesizes the sum of the gravity components of the three axes [X G +Y G +Z G ] is obtained.
[0030] In this way, obtaining the gravity component from the three-axis acceleration data obtained by the acceleration data obtaining unit 111 is equivalent to decomposing the DC component (static acceleration) and AC component (dynamic acceleration) contained in the three-axis acceleration data to obtain the AC component in the direction of gravity. That is, the acceleration data d detected by the three-axis acceleration sensor 105x The acceleration data d shown in FIG. x As shown in Figure 5, DC and AC component d AC It can be decomposed into AC component d AC is the acceleration data d detected by the three-axis acceleration sensor 105. x From the above, the DC component d DC is obtained by removing
[0031] DC component d DC corresponds to the gravitational acceleration, and the AC component d AC corresponds to the acceleration of the terminal 100. Here, the gravity component acquisition unit 114 acquires an AC component d AC and its AC component in the direction of gravity d AC are used in the user interest analysis process described below. In this way, the DC component d DC and AC component d AC By decomposing the signal into the above, it is possible to easily and accurately detect an AC component corresponding to the acceleration of the movement of the terminal 100 from the output of the triaxial acceleration sensor 105. As described below, the AC component corresponding to the acceleration of the movement of the terminal 100 is an accurate detection of physiological tremor, which is a physical state of the user, and can be applied to various estimations such as estimation of the user's interests while browsing content. It should be noted that there are three-axis acceleration sensors 105 that ignore the DC component of 0 Hz and those that do not ignore the DC component of 0 Hz, but the terminal (smartphone) 100 of this embodiment uses a three-axis acceleration sensor 105 that does not ignore the DC component of 0 Hz.
[0032] Returning to the explanation of FIG. 3, the frequency analysis unit 115 calculates the sum of the gravity components of the three axes [X G +Y G +Z G] is subjected to a fast Fourier transform and frequency analysis to obtain components for each frequency (frequency analysis process). Here, the frequency analysis unit 115 performs a fast Fourier transform with, for example, 512 calculation points. The frequency analysis is performed by the fast Fourier transform to obtain an AC component d AC By obtaining the analysis results of the high frequency components corresponding to the AC component d AC The frequency analysis result will be obtained as follows. The average calculation unit 116 obtains an average value for a predetermined time for each frequency from the results of frequency analysis by the frequency analysis unit 115 (average calculation process). Here, the average calculation unit 116 performs a process of obtaining an ensemble average, and obtains an average value for each predetermined time with 50% overlap.
[0033] The evaluation unit 117 integrates the first peak frequency component (the frequency at which the highest peak is obtained) between 2 Hz and 5 Hz for the average value obtained by the average calculation unit 116 for a certain period (e.g., the content viewing period), and estimates the interest of the user viewing the content from the integral value (evaluation process).
[0034] [1-4. Example of psychological evaluation process flow] FIG. 6 is a flowchart showing a flow of the psychological evaluation process performed by the terminal 100. The psychological evaluation process shown in the flowchart of FIG. 6 is executed by each processing unit shown in FIG. First, the acceleration data acquisition unit 111 acquires the three-axis acceleration data detected by the three-axis acceleration sensor 105 by sampling at a predetermined sampling frequency (for example, 50 Hz) (step S11).
[0035] Next, the low-frequency component acquisition unit 112 acquires low-frequency components below a predetermined frequency (for example, below 1 Hz) for each of the three axes from the three-axis acceleration acquired by the acceleration data acquisition unit 111 (step S12). Furthermore, the high-frequency component acquisition unit 113 subtracts the low-frequency components obtained by the low-frequency component acquisition unit 112 from the three-axis acceleration data acquired by the acceleration data acquisition unit 111 to acquire high-frequency components higher than the cutoff frequency (1 Hz) for each of the three axes (step S13).
[0036] Thereafter, the gravity component acquisition unit 114 acquires the gravity components for each of the three axes (step S14), and combines the acquired gravity components for the three axes (step S15). Then, the frequency analysis unit 115 calculates the composite value of the gravity components of the three axes (the sum [X G +Y G +Z G ]) is subjected to a fast Fourier transform and frequency analysis (step S16).
[0037] Furthermore, the average calculation unit 116 obtains an average value (ensemble average with 50% overlap) for each frequency over a predetermined period of time as a result of the frequency analysis performed by the frequency analysis unit 115 (step S17). Then, the evaluation unit 117 integrates the frequency that is the first peak between 2 Hz and 5 Hz for the average value obtained by the average calculation unit 116 for a certain period of time, and estimates the interest of the user who is viewing the content from the integral value (step S18).
[0038] A specific example of evaluation of the user interest estimation process according to this embodiment will be described in comparison with the other embodiment examples after the description of the second embodiment example described later.
[0039] <2. Second embodiment> Next, a second embodiment of the present invention will be described with reference to FIGS. 7 to 9, parts corresponding to those in FIGS. 1 to 6 described in the first embodiment are given the same reference numerals, and duplicated explanations will be omitted.
[0040] [2-1. Examples of psychological evaluation device applications] FIG. 7 shows an application example of the psychological evaluation device according to the second embodiment. In the second embodiment, as in the first embodiment, content (such as electronic comics) is displayed on a terminal 100 (smartphone) held in one hand by a user (subject), and a psychological evaluation is performed on the terminal 100 or the server 200 to infer the user's interest in the content being viewed. Also, like the first embodiment, the terminal 100 communicates with the server 200 via the Internet N, and the content delivered from the server 200 is displayed on the screen 101a of the display unit 101 of the terminal 100.
[0041] In the second embodiment, as shown in Fig. 6, an auxiliary terminal 300 called a smart watch is worn on the user's arm c. Here, the arm c is the arm that holds the terminal 100. The auxiliary terminal (smart watch) 300 has a shape similar to a wristwatch, and various information is displayed on a screen 301a of a display unit 301. That is, the auxiliary terminal 300 has various sensors built in that measure the user's condition such as pulse rate, and the measured pulse rate and the like are displayed on the screen 301a. The auxiliary terminal 300 also has a function of performing short-distance wireless communication with the terminal 100, and can also notify the terminal 100 of incoming calls and e-mails. Furthermore, the auxiliary terminal 300 has a built-in three-axis acceleration sensor 305 (FIG. 8).
[0042] The terminal 100 detects vibrations, called physiological tremors, of the hand b of the user a using a three-axis acceleration sensor 105 built into the terminal 100 and a three-axis acceleration sensor 305 built into the auxiliary terminal 300. The terminal 100 estimates the user's interest in the content based on the vibration state of the user while browsing the content (psychological evaluation). As shown in FIG. 7, the three coordinate axes (x-axis, y-axis, z-axis) detected by the three-axis acceleration sensor 105 built into the terminal 100 and the three coordinate axes (x-axis, y-axis, z-axis) detected by the three-axis acceleration sensor 305 built into the auxiliary terminal 300 are local coordinate axes corresponding to the orientations of the respective terminals 100 and 300, and do not coincide.
[0043] [2-2. Example of device configuration] FIG. 8 shows an example of the hardware configuration of the terminal 100, the server 200, and the auxiliary terminal 300 shown in FIG. The configurations of the terminal (smartphone) 100 and the server 200 are basically the same as those in the first embodiment shown in Fig. 2. However, the terminal 100 in the second embodiment differs from the terminal 100 shown in Fig. 2 in that it includes a short-range wireless communication unit 107 for communicating with the auxiliary terminal 300.
[0044] The auxiliary terminal (smart watch) 300 includes a display unit 301, a CPU 302, a ROM 303, a RAM 304, a three-axis acceleration sensor 305, and a short-range wireless communication unit 306, all of which are connected via a bus line to enable data transfer.
[0045] An image including a message generated within the auxiliary terminal 300 is displayed on the display unit 301 . The CPU 302 is a processing unit that reads out from the ROM 303 and executes the code of the program executed by the auxiliary terminal 300 . The ROM 303 stores programs such as applications executed by the auxiliary terminal 300. The RAM 404 temporarily stores variables, parameters, and the like that are generated during the computation process.
[0046] The three-axis acceleration sensor 305 detects the acceleration applied to the auxiliary terminal 300 along three orthogonal axes (x-axis, y-axis, and z-axis). The short-range wireless communication unit 306 performs wireless communication with the terminal 100. The short-range wireless communication unit 306 performs wireless communication with the short-range wireless communication unit 107 on the terminal 100 side, for example, according to a short-range wireless communication standard called Bluetooth (registered trademark).
[0047] [2-3. Example of psychological evaluation process flow] FIG. 9 is a flowchart showing a flow of performing a psychological evaluation process using the terminal (smartphone) 100 and the auxiliary terminal (smartwatch) 300. In FIG. 9, the processing shown in steps S11 to S18 is the same as the processing performed by the terminal 100, and has been explained in FIG. 6 of the first embodiment, so a detailed explanation will be omitted.
[0048] In the auxiliary terminal 300, the CPU 302 executes a program prepared in the ROM 303 to sample and acquire 3-axis acceleration data detected by the 3-axis acceleration sensor 305 at a predetermined sampling frequency (e.g., 50 Hz) (step S21). Then, under the control of the CPU 302, the auxiliary terminal 300 acquires low-frequency components below a predetermined frequency (e.g., 1 Hz or less) for each of the three axes from the 3-axis acceleration acquired by the 3-axis acceleration sensor 305 (step S22), and also acquires high-frequency components higher than the cutoff frequency (1 Hz) for each of the three axes (step S23).
[0049] Furthermore, under the control of the CPU 302, the auxiliary terminal 300 acquires the gravity components of each of the three axes from the high-frequency components of the acceleration of the three axes (step S24), and combines the acquired gravity components of the three axes (step S25). The combined value (added value) of the gravity components of the three axes acquired in step S25 is transmitted from the short-range wireless communication unit 306 to the terminal 100.
[0050] In the terminal 100, the short-range wireless communication unit 107 receives the composite value of the gravitational components of the three axes transmitted from the auxiliary terminal 300, and calculates the difference between the composite value of the gravitational components of the three axes of the terminal 100 calculated in step S15 and the composite value of the gravitational components of the three axes obtained in step S25 (step S26). This calculation of the difference is performed, for example, by the gravitational component acquisition unit 114 of the terminal 100 shown in FIG. 3.
[0051] Then, the difference between the composite values of the gravitational components of the three axes between the terminal 100 and the auxiliary terminal 300 obtained in step S26 is sent to the frequency analysis unit 115, and frequency analysis is performed by fast Fourier transform of the difference between the composite values of the gravitational components of the three axes (step S16). Thereafter, the process of step S17 and the process of step S18 are performed by the average calculation unit 116 and the evaluation unit 117, similar to the process of the flowchart in FIG.
[0052] <3. Example of Evaluation of the First and Second Embodiments> Next, a specific example of the evaluation process for estimating the user's interest when browsing content according to the first and second embodiments described above and the effects thereof will be described. FIG. 10 shows the amplitude of the vertical component (component in the direction of gravity) versus frequency of acceleration data of a terminal held by a user, which occurs while the user is viewing content (digital comics here) on terminal (smartphone) 100.
[0053] The horizontal axis of Fig. 10 is frequency, and the vertical axis is acceleration amplitude, with the horizontal axis showing the frequency range from 1 Hz to 25 Hz. The amplitude is the average integral value of the acceleration data while viewing the content. The characteristic W1 shown in Fig. 10 is the amplitude for each frequency of the acceleration data detected by the three-axis acceleration sensor 105 of the terminal (smartphone) 100. This characteristic W1 corresponds to the value calculated in the first embodiment.
[0054] Furthermore, characteristic W2 is the amplitude for each frequency based on acceleration data detected by 3-axis acceleration sensor 305 of auxiliary terminal (smart watch) 300, and characteristic W3 is the amplitude for each frequency based on differential data between the output of 3-axis acceleration sensor 105 of terminal 100 and the output of 3-axis acceleration sensor 305 of auxiliary terminal 300. This characteristic W3 corresponds to the value calculated in the second embodiment. It should be noted that the differential data shown in FIG. 10 is obtained by analyzing the difference between frequency signals, and therefore the amplitude W3 of the difference may be larger than the amplitudes W1 and W2 of the original signals depending on the phase of each acceleration data.
[0055] As can be seen from the characteristics W1, W2, and W3 in Fig. 10, in the frequency band below 2 Hz, there is a very large amplitude based on the movement of the hand or arm holding the terminal 100, but in the frequency band from 2 Hz to 5 Hz, a reasonable amplitude with a peak at about 3 Hz is detected. In particular, the amplitude characteristic W1 based on the output of the 3-axis acceleration sensor 105 of the terminal 100 and the differential amplitude characteristic W3 are mountain-shaped characteristics with clear peaks detected. Furthermore, in the frequency band higher than 5 Hz, the detected amplitude is smaller than in the frequency band from 2 Hz to 5 Hz, and the detected amplitude value is very small.
[0056] Among the amplitude characteristics shown in FIG. 10, the amplitude detected in the band of 2 Hz to 5 Hz corresponds to the vibration component caused by the physiological tremor of the user. The physiological tremor of the user is a vibration caused by repeated contraction and relaxation of muscles, and normally, a healthy person is not aware of the vibration caused by the physiological tremor. The frequency of the vibration caused by the physiological tremor varies depending on the part of the body, but for example, the physiological tremor of the fingers is known to have the main frequencies at 10 Hz and 25 Hz. However, these frequencies are the frequencies when the fingers are not holding anything.
[0057] It is known that the vibration state caused by a user's physiological tremor changes depending on the user's interests. In other words, when a user holds terminal 100 in his / her hand and views content such as digital comics displayed on terminal 100, it is known that if the user is interested in the content (if the user finds the content interesting), the hand vibrations due to physiological tremor will decrease, and if the user is not interested in the content (if the content is not interesting), the hand vibrations due to physiological tremor will increase.
[0058] The peak amplitude values detected in the band from 2 Hz to 5 Hz of the characteristic W1 based on the output of the 3-axis acceleration sensor 105 of the terminal 100 shown in Fig. 10 and the characteristic W3 based on the differential data between the terminal 100 and the auxiliary terminal 300 are detected components of hand vibration caused by physiological tremor, and change reflecting the user's interest in the content viewed. In the content interest evaluation process in step S18 of the flowcharts in Fig. 6 and Fig. 9, when the peak amplitude value is low, it is estimated that the user has a high interest in the content viewed at that time, and when the peak amplitude value is high, it is estimated that the user has a low interest in the content viewed at that time.
[0059] FIG. 11 shows an example of the correlation between the interest level of a certain piece of content and the amplitude integral value of each frequency band when the content is viewed by a user. Figure 11 shows the average and variance of the amplitude integral value of the output from the three-axis acceleration sensor 105 of the terminal (smartphone) 100 and the amplitude integral value of the differential output between the terminal 100 and the auxiliary terminal 300 for four frequency bands: 1 Hz to 2 Hz, 2 Hz to 3 Hz, 3 Hz to 4 Hz, and 4 Hz to 5 Hz.
[0060] In the case of the amplitude integral value detected by terminal 100 alone, the average of the amplitude integral value in the band from 3 Hz to 4 Hz is the highest value, so interest evaluation processing can be performed using the average and variance of the amplitude integral value in the band from 3 Hz to 4 Hz.
[0061] In the case of the amplitude integral value of the differential output between terminal 100 and auxiliary terminal 300, the average of the amplitude integral value in the band from 2 Hz to 3 Hz is the highest value, so when using the differential output, the interest evaluation process can be performed using the average and variance of the amplitude integral value in the band from 2 Hz to 3 Hz.
[0062] FIG. 12 shows the integral value of the amplitude during viewing when three subjects [1], [2], and [3] viewed three pieces of content, works A, B, and C, for a certain period of time each on the terminal 100. FIG. 13 shows the results of a questionnaire given to the three subjects [1], [2], and [3] after viewing the three pieces of content, works A, B, and C, for a certain period of time each on the terminal 100. The questionnaire results show an example in which the subjects rated whether or not they found each of works A, B, and C interesting on a 10-point scale (10 being the highest rating and 1 being the lowest rating). The amplitude integral value shown in FIG. 12 is the amplitude integral value of the difference output between the terminal 100 and the auxiliary terminal 300.
[0063] In the case of subject [1], as shown in Figure 12, the amplitude integral values of works A and C are relatively low, while the amplitude integral value of work B is higher than those of works A and C. On the other hand, in the questionnaire results shown in Figure 13, work B received the lowest evaluation value of "5", while work A received a higher evaluation value of "6", and work C received an even higher evaluation value of "7". Therefore, it can be seen that the amplitude integral values roughly reflect subject [1]'s interest in works A, B, and C.
[0064] In the case of subject [2], as shown in Figure 12, the amplitude integral values of works A, B, and C are almost the same. On the other hand, in the questionnaire results shown in Figure 13, work A was rated "7", work B was rated "8", and work C was rated "7", meaning that there was almost no change in interest among the three works. Therefore, in the case of subject [2] as well, it can be seen that the amplitude integral values roughly reflect the interest in works A, B, and C.
[0065] In the case of subject [3], as shown in Figure 12, the amplitude integral value of work A is relatively high, while the amplitude integral values of works B and C are lower. On the other hand, in the questionnaire results shown in Figure 13, work A received the lowest evaluation value of "4", work B received a higher evaluation value of "7", and work C received an even higher evaluation value of "9". Therefore, in the case of subject [3] as well, it can be seen that the amplitude integral value roughly reflects the interest in works A, B, and C. Thus, there is a clear correlation between interest in a work (content) and the amplitude integral value. Note that the example in Figure 12 is an amplitude integral value according to the second embodiment, but as shown in Figure 1, the amplitude integral value measured by the terminal (smartphone) 100 alone also has a peak near 3 Hz, and interest in the work can be similarly estimated from the peak component.
[0066] In this way, according to the first and second embodiments of the present invention, when a user displays and views some content (electronic comics, books, magazines, videos, etc.) on terminal 100 held in his / her hand, the integral value of the vibration component corresponding to physiological tremor is obtained based on the acceleration data detected by the acceleration sensor during viewing, and the user's interest can be estimated from the magnitude of the integral value. Therefore, for example, by sending an interest estimate obtained by terminal 100 to the content distributor, it is possible to obtain information such as the tendency of content that interests users who possess terminal 100, and to recommend content that interests each user.
[0067] In this case, in the first and second embodiments of the present invention, the AC component in the direction of gravity is extracted from the output of the 3-axis acceleration sensor built into terminal 100, and the AC component is subjected to frequency analysis. This makes it possible to accurately estimate interest regardless of the position of the hand holding terminal 100 (i.e., without having to specifically fix the hand to determine interest), and makes it easy to estimate interest when the user browses content on a daily basis.
[0068] In the second embodiment, the terminal (smartphone) 100 and the auxiliary terminal (smartwatch) 300 are used to perform frequency analysis of the difference in output between the three-axis acceleration sensors built into both terminals, so that the vibration components of the arm are removed from the amplitude integral value, enabling interest to be estimated with higher accuracy. However, as described in Fig. 12 and Fig. 13, even in the first embodiment using only the terminal (smartphone) 100, interest can be estimated from the calculated value, and the auxiliary terminal (smartwatch) 300 is not essential.
[0069] <4. Third embodiment> Next, a third embodiment of the present invention will be described with reference to FIGS. In the first and second embodiments already described, users who are highly interested in the content are estimated using the terminals 100 and auxiliary terminals 300 owned by multiple users. In contrast, in the third embodiment of the present invention, frequency analysis is performed on the output of a three-axis acceleration sensor built into the terminal 100 or auxiliary terminal 300 owned by a single user, and the presence or absence of interest in the content of the user who owns the terminal is estimated.
[0070] In the third embodiment of the present invention, similarly to the second embodiment, the terminal (smartphone) 100 and the auxiliary terminal (smartwatch) 300 are used to perform frequency analysis of the difference in output of the 3-axis acceleration sensor built into both of them. The process of frequency analysis of the difference in output of the 3-axis acceleration sensor is the same as the process already described in the second embodiment. In the third embodiment of the present invention, the process of evaluating the obtained frequency analysis result is different from the second embodiment.
[0071] FIG. 14 shows the frequency analysis result (d) when a particular content of interest is displayed on the terminal 100 held by the user in his / her hand in the third embodiment of the present invention. 12 ) and the frequency analysis results when content other than a specific content that is of no interest is displayed (d 11 ) compared to The frequency analysis result in Fig. 14 was measured when the user was in the position shown in Fig. 15. That is, the user is seated and holds the terminal (smartphone) 100 in the hand b, wears the auxiliary terminal (smartwatch) 300 on the arm c, and views content on the terminal 100 with the elbow of the arm c resting on the desk 400. When viewing content in the position shown in Fig. 15, vibrations corresponding to the variation in distance α between the desk 400 and the hand b are generated in the terminal 100 and the auxiliary terminal 300, mainly with the elbow resting on the desk 400 as a fulcrum. In the frequency analysis result in Fig. 14, the frequency band of about 3 Hz to 5 Hz has a high amplitude value.
[0072] The frequency analysis results shown in Fig. 14 (d 11 , d 12 ) is the result of analyzing such frequency components, and the frequency analysis result (d 12 The amplitude of the frequency analysis result (d 11 ) is significantly higher than the amplitude of In other words, the relationship between the amplitude when viewing interesting content and the amplitude when viewing uninteresting content holds. This indicates that vibrations called intention tremors occur when viewing interesting content.
[0073] In addition, the influence of the intention tremor appears in the frequency band of about 3 Hz to 5 Hz when the terminal 100 is held in the state shown in FIG. 15, and the frequency band in which the influence of the intention tremor appears varies depending on the user's posture. Figures 16 and 17 show examples of frequency bands affected by intention tremor. The analysis results shown in Fig. 16 (d 21 , d 22 ) is a frequency analysis result (d 22 ) and the frequency analysis results when uninteresting content is displayed (d 2116, similarly to the example of FIG. 14, a large change in the amplitude value occurs in a frequency band of approximately 3 Hz to 5 Hz.
[0074] The analysis results shown in Fig. 17 (d 31 , d 32 ) is a frequency analysis result (d 32 ) and the frequency analysis results when uninteresting content is displayed (d 31 In the example of FIG. 17, a large change in amplitude occurs in the frequency band of 3 Hz to 20 Hz. In particular, in the frequency band of 7 Hz to 11 Hz within the frequency band of 3 Hz to 20 Hz, the frequency analysis result (d 32 ) with large amplitude values, and intention tremor was prominent in the 7 Hz to 11 Hz range.
[0075] In addition, although not shown, when the user is standing and holding the terminal 100, an intention tremor appears in a frequency band near 1 Hz, and a relatively large change occurs around 1 Hz between the frequency analysis results when content of interest is displayed and the frequency analysis results when content of no interest is displayed. Considering these various postures, in the case of this embodiment, it is preferable to determine whether there is a change in amplitude in the frequency band of 1 Hz to 20 Hz and estimate the presence or absence of interest.
[0076] As described above, according to the third embodiment of the present invention, interest in a specific content displayed on the terminal 100 can be estimated well based on the difference in intention tremor when other content is displayed. 14, 16, and 17, which estimate the user's own interest, are all performed using the terminal 100 and the auxiliary terminal 300, and are examples in which the difference between the frequency detected by the terminal 100 and the frequency detected by the auxiliary terminal 300 is taken. Although it is preferable to use the terminal 100 and the auxiliary terminal 300 in this manner, similar frequency analysis results can be obtained even in the example in which only the terminal 100 described in the first embodiment is used.
[0077] <5. Modifications> In the above-described embodiments, a smartphone is used as the terminal 100 and a smartwatch is used as the auxiliary terminal 300. However, the present invention may be applied to other terminals having a built-in three-axis acceleration sensor, such as a tablet terminal.
[0078] In addition, in each of the above-described embodiments, all data processing for evaluation from the acceleration data is performed within the terminal 100, but some or all of the processing from the acquisition processing of the acceleration data to the evaluation processing may be performed externally, such as by the server 200. For example, the terminal 100 may perform frequency analysis of the acceleration data and calculation of an average value, and transmit the integral value of the calculated average value to the server 200, where the evaluation processing may be performed.
[0079] In addition, in each of the above-described embodiments, the results of frequency analysis are integrated to obtain an average value obtained by ensemble averaging, and an amplitude integral value is obtained. Alternatively, other average values may be obtained. When obtaining the average amplitude integral value for each frequency, the integral value for the content viewing period is obtained, but the integral value may be obtained by integrating the average amplitude integral value for a certain period of time (e.g., a fixed period of time such as one minute or three minutes) while the content is viewed.
[0080] The processes described in the above-mentioned embodiments are executed by a program installed in the terminal 100, etc., and the psychological evaluation device described in each embodiment can be configured by preparing a program that executes the corresponding processes and installing it in an existing terminal such as a smartphone. The program installed in the terminal can be sent to the terminal via various recording media or a network.
[0081] In addition, in each of the above-described embodiments, the process of evaluating interest in electronic content (such as electronic comics or electronic books) displayed on the screen by the display unit 101 of the terminal 100 is performed. In contrast to this, for example, the process of evaluating interest when the user is viewing other content used in conjunction with the terminal 100 may be performed. For example, the process of evaluating interest when viewing a paper book (such as a comic, magazine, or other book) placed on the terminal 100 may be performed based on the output of the acceleration sensor 105 (and the auxiliary terminal (smart watch) 300) built into the terminal 100. Furthermore, when applied to reading a paper book, the terminal 100 may be small enough to be sandwiched between the book, and the paper book (content) and the terminal 100 may be used together. [Explanation of symbols]
[0082] 100... terminal (smartphone), 101... display unit, 101a... screen, 102... central control unit (CPU), 103... ROM, 104... RAM, 105... 3-axis acceleration sensor, 106... wireless communication unit, 107... short-range wireless communication unit, 111... acceleration data acquisition unit, 112... low-frequency component acquisition unit, 113... high-frequency component acquisition unit, 114... gravity component acquisition unit, 115... frequency analysis unit, 116... average calculation unit, 117... evaluation unit, 200... server, 201... network interface, 202... user management unit, 203... content storage unit, 300... auxiliary terminal (smart watch), 301... display unit, 301a... screen, 302... central control unit (CPU), 303... ROM, 304... RAM, 305... 3-axis acceleration sensor, 306... short-range wireless communication unit
Claims
1. A psychological evaluation device for estimating an interest of a subject in a content used in conjunction with a terminal held by the subject, comprising: an acceleration data acquisition unit that acquires acceleration data obtained by an acceleration sensor built into the terminal; a frequency analysis unit that performs frequency analysis on acceleration data in a gravity direction among the acceleration data obtained by the acceleration data acquisition unit; and an evaluation unit that estimates the subject's interest in the specific content based on a frequency analysis result by the frequency analysis unit when the terminal displays the specific content. Psychological assessment equipment.
2. The acceleration data acquisition unit acquires acceleration data obtained by an acceleration sensor built into an auxiliary terminal worn on the arm of the subject, in addition to the acceleration data obtained by the acceleration sensor built into the terminal, and obtains differential data of both low frequency data; The frequency analysis unit performs frequency analysis on the differential data. The psychological evaluation device according to claim 1 .
3. The frequency analysis unit performs frequency analysis on the acceleration data of the AC component in the gravity direction in at least a band from 1 Hz to 20 Hz. The psychological evaluation device according to claim 1 or 2.
4. The evaluation unit estimates that the interest in the content is high when the peak integral value among the average integral values of the frequency components is a small value, and estimates that the interest in the content is low when the peak integral value is a large value. The psychological evaluation device according to any one of claims 1 to 3.
5. 1. A psychological evaluation method for estimating an interest of a subject in content used in conjunction with a terminal held by the subject, comprising: An acceleration data acquisition process for acquiring acceleration data obtained by an acceleration sensor built into the terminal; a frequency analysis process for performing a frequency analysis on acceleration data in the gravity direction among the acceleration data obtained by the acceleration data acquisition process; and an evaluation process of estimating an interest of the subject in the specific content based on a frequency analysis result of the frequency analysis process when the terminal displays the specific content. Psychological assessment methods.
6. In the acceleration data acquisition process, in addition to the acceleration data obtained by the acceleration sensor built in the terminal, acceleration data obtained by an acceleration sensor built in an auxiliary terminal worn on the arm of the subject is also acquired, and differential data between the two low frequency components is obtained; In the frequency analysis process, the difference data is frequency analyzed. The psychological evaluation method according to claim 5.
7. A program for causing a computer to execute a psychological evaluation for estimating an interest of a subject in content used in conjunction with a terminal held by the subject, an acceleration data acquisition step of acquiring acceleration data obtained by an acceleration sensor built into the terminal; a frequency analysis step of frequency-analyzing acceleration data in a gravity direction among the acceleration data obtained by the acceleration data acquisition step; When the terminal displays a specific content, and an evaluation procedure for estimating the subject's interest in the particular content based on a frequency analysis. program.
8. In the acceleration data acquisition step, in addition to the acceleration data obtained by the acceleration sensor built in the terminal, acceleration data obtained by an acceleration sensor built in an auxiliary terminal worn on the arm of the subject is also acquired, and differential data between the two acceleration data is obtained; In the frequency analysis step, the difference data is subjected to frequency analysis. The program according to claim 7.
9. an average calculation unit that calculates an average for each predetermined time period for each frequency component obtained by the frequency analysis in the frequency analysis unit; The evaluation unit estimates that the subject is highly interested in the specific content when the average integral value of each frequency component calculated by the average calculation unit is lower than the average integral value when the terminal displays content other than the specific content. The psychological evaluation device according to claim 1 .
10. an average calculation process for calculating an average for each predetermined time period for each frequency component obtained by the frequency analysis in the frequency analysis process; The evaluation process estimates that the subject is highly interested in the specific content when the average integral value of each frequency component calculated in the averaging process is lower than the average integral value when the terminal displays content other than the specific content. The psychological evaluation method according to claim 5.
11. an average calculation step of calculating an average for each predetermined time period for each frequency component obtained by the frequency analysis in the frequency analysis step; The evaluation step estimates that the subject is highly interested in the specific content when the average integral value of each frequency component calculated in the averaging step is lower than the average integral value when the terminal displays content other than the specific content. The program according to claim 7.
Citation Information
Patent Citations
Pulse measuring device, pulse measuring method, and pulse measuring program
JP2016000153A
Viewing count measurement system
JP2018007265A
Degree of interest evaluation program, device, and method
JP2018036912A
Apparatus and method for providing information, and program
JP2019106033A
Posture sensor automatic calibration
US20090312973A1
