Portable device, program, and method for determining user touch events on a touch panel display

Abstract

To provide a mobile device, etc. that determines touch events by a user on a touch panel display using a lighting state of the touch panel display and measured values of a motion sensor.SOLUTION: The mobile device includes lighting detection means for detecting whether a touch display is lit or unlit and touch event determination means for considering to have a touch event by a user against the touch panel display when the touch display is lit and the measured values of elements of the motion sensor at the moment are within a predetermined range. The motion sensor is one of an acceleration sensor, a gravity sensor, or an angular velocity sensor, or a combination thereof, and the measured values of the respective element of the motion sensor may be the measured values of multiple elements of a single motion sensor, or the measured values of the respective elements of a plurality of motion sensors.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a technique for determining a user's touch event on a touch panel display.

Background Art

[0002] In recent years, with the use of smartphones, there has been an increasing number of people who feel that they have suffered some adverse effects such as "decrease in sleep time", "deterioration of eyesight", and "disruption of lifestyle" (see, for example, Non-Patent Document 1). This is considered to be partly due to the user's long-term fixation on the smartphone display.

[0003] Conventionally, there is a technique for suppressing smartphone operations during user movement (see, for example, Patent Document 1). According to this technique, when an application is running during user movement, it alerts the user. After that, even if the application is running while the user is moving, it restricts the user's use of the smartphone. Then, while the user's use is restricted and the user's movement stop is detected, it plays question-type content. When the user's answer is completed, it ends the playback of the question-type content and解除 the restriction.

[0004] Also, there is a technique for estimating the viewing time of the screen of an information terminal (see, for example, Patent Document 2). According to this technique, for a monitoring area, it detects the action of walking while looking at the smartphone screen by a camera and alerts from a speaker. From the video data captured by the camera, (sI) it detects a person and detects the moving speed and moving direction of the person, (s2) it detects the left-right movement of the body of the person and determines whether the arms are fixed in the front, (s3) it determines that the person is looking down by the direction of the face, and (s4) when the person's arms are fixed in the front for a certain period and the forward and downward postures are repeatedly interrupted, it determines that the smartphone is being used during movement.

Prior Art Documents

Patent Documents

[0005] [Patent Document 1] Japanese Patent Publication No. 2021-083069 [Patent Document 2] Patent No. 6655727 [Patent Document 3] Patent No. 6621208 [Patent Document 4] Patent No. 6632071 [Non-patent literature]

[0006] [Non-Patent Document 1] "Can Smartphone Addiction Be Cured with Apps? What Kind of Research is KDDI Conducting for Healthy and Appropriate Smartphone Use?", TIME&SPACE by KDDI, [online], [Accessed August 16, 2023], Internet<URL:https: / / time-space.kddi.com / au-kddi / 20210721 / 3137> [Overview of the project] [Problems that the invention aims to solve]

[0007] According to the technology described in Patent Document 1, it is determined that the user is looking at the smartphone display if a pre-specified application is running. In other words, there are no restrictions on the use of applications other than the pre-specified application. Furthermore, it does not determine whether the user is actually looking at the pre-specified application or not. Furthermore, while the technology described in Patent Document 2 can estimate the user's gaze state on an information terminal, it requires video data from a camera pre-installed indoors.

[0008] Generally, the screen-on time of a mobile device's display can be used to estimate the user's attention time. However, just because a display is lit doesn't necessarily mean the user is looking at it. Here, when a user touches the touch panel display of a mobile device, it is possible to estimate the user's gaze time. However, the operating system (OS) of mobile devices such as smartphones may block touch events from applications. This is because, from a personal information security perspective, applications are not permitted to use the detection of user touch events.

[0009] In response to this, the inventors of the present invention considered whether it would be possible to determine touch events by a running application, even if the operating system of a mobile device does not permit the detection of user touch events on the touch panel display. If user touch events can be determined, the user's gaze time can also be determined.

[0010] Therefore, the present invention aims to provide a portable device, program, and method capable of determining user touch events on a touch panel display. [Means for solving the problem]

[0011] According to the present invention, in a portable device having a touch panel display and a motion sensor, A lighting detection means for detecting whether the touch display is lit or turned off, A touch event determination means that determines that a user touch event has occurred on the touch panel display when the touch display is lit and the measured values ​​of each element of the motion sensor at the current time are within a predetermined range. to have death, The means for determining touch events is: In a vector space where each element is a dimension, each data point from the past is positioned corresponding to a measured value. Clustering multiple data points in a vector space, From among multiple clusters, select one or more clusters where the data for the touch panel display lighting up for all data exceeds a predetermined condition. The range in the vector space within the selected cluster is defined as a predetermined range. It is characterized by the following:

[0012] According to another embodiment of the mobile device of the present invention, the motion sensor is any one or a combination of an acceleration sensor, a gravity sensor, or an angular velocity sensor, and the measured value of each element of the motion sensor is the measured value of a plurality of elements of one motion sensor or the measured value of each element of each of a plurality of motion sensors. This is also preferable.

[0014] According to another embodiment of the mobile device of the present invention, the touch event determination means calculates the centroid on the vector space in the selected cluster and sets a range within a predetermined distance from the centroid as a predetermined range. This is also preferable.

[0015] According to another embodiment of the mobile device of the present invention, the touch event determination means selects, as a predetermined condition, one or more clusters that contain a predetermined number or more of data and in which the ratio of the lighting data of the touch panel display with respect to all the data is equal to or greater than a predetermined ratio. This is also preferable.

[0016] According to another embodiment of the mobile device of the present invention, the mobile device further includes a positioning unit, and further has a movement state determination means for determining a movement state when the distance of the position moved in a predetermined period is equal to or greater than a predetermined distance and determining a staying state when it is shorter than the predetermined distance, and the touch event determination means stores in advance a predetermined range on the vector space for each of the movement state or the staying state of the mobile device and applies a predetermined range corresponding to the current movement state or staying state. This is also preferable.

[0017] According to another embodiment of the mobile device of the present invention, The touch event determination means stores a predetermined range in the vector space according to the position, and when the movement state determination means is in a staying state at the present time, it applies the predetermined range according to the staying position. That is also desirable.

[0018] According to another embodiment of the portable device of the present invention, The movement status determination means, upon determining that a movement status has been determined, determines the mode of transport on which the user is riding, based on the distance traveled to a predetermined location within a specified period. The touch event determination means stores a predetermined range in the vector space depending on the moving medium, and when the movement state determination means determines that the medium is currently in a moving state, it applies the predetermined range corresponding to the movement state. That is also desirable.

[0019] According to another embodiment of the portable device of the present invention, A gaze time derivation means derives the gaze time of the user by accumulating the time during which touches are deemed to have occurred by the touch event detection means. Furthermore, it is also preferable to have it.

[0020] According to the present invention, a program for operating a computer mounted on a portable device having a touch panel display and a motion sensor, A lighting detection means for detecting whether the touch display is lit or turned off, A touch event determination means that determines that a user touch event has occurred on the touch panel display when the touch display is lit and the measured values ​​of each element of the motion sensor at the current time are within a predetermined range. do Make it work, The means for determining touch events is: In a vector space where each element is a dimension, each data point from the past is positioned corresponding to a measured value. Clustering multiple data points in a vector space, From among multiple clusters, select one or more clusters where the data for the touch panel display lighting up for all data exceeds a predetermined condition. The range in the vector space within the selected cluster is defined as a predetermined range. like It is characterized by enabling the computer to function.

[0021] According to the present invention, a method for determining touch events in a portable device having a touch panel display and a motion sensor, Mobile devices are A first step involves detecting whether the touch display is lit or turned off, A second step in which a user touch event on the touch panel display is considered to have occurred when the touch display is lit and the measured values ​​of each element of the motion sensor at the current time are within a predetermined range. of Execute, The second step is, In a vector space where each element is a dimension, each data point from the past is positioned corresponding to a measured value. Clustering multiple data points in a vector space, From among multiple clusters, select one or more clusters where the data for the touch panel display lighting up for all data exceeds a predetermined condition. The range in the vector space within the selected cluster is defined as a predetermined range. It is characterized by the following: [Effects of the Invention]

[0022] According to the portable device, program, and method of the present invention, a user's touch event on the touch panel display can be determined using the illumination state of the touch panel display and the measurement value of a motion sensor. This makes it possible to determine touch events without depending on the security settings in the operating system of the portable device. [Brief explanation of the drawing]

[0023] [Figure 1] This is a diagram illustrating the functional configuration of a portable device according to the present invention. [Figure 2] This is an explanatory diagram illustrating steps S1 and S2 of the pre-processing in the touch event determination unit of the present invention. [Figure 3] This is an explanatory diagram illustrating steps S3 and S4 of the pre-processing in the touch event determination unit of the present invention. [Figure 4] This is an explanatory diagram for determining touch events on a mobile device while it is in use. [Figure 5] This is a flowchart illustrating the process of the present invention. [Figure 6] This is an explanatory diagram illustrating the processing of step S4 in a mobile device in a moving state. [Figure 7] This is an explanatory diagram for determining touch events on a mobile device while it is in motion. [Figure 8] This is a flowchart illustrating the processing of the movement state determination unit. [Modes for carrying out the invention]

[0024] Embodiments of the present invention will be described in detail below with reference to the drawings.

[0025] Figure 1 is a diagram illustrating the functional configuration of a portable device according to the present invention.

[0026] According to Figure 1, the mobile device 1 may be a smartphone owned by the user. The mobile device 1 has, as hardware, a touch panel display 101, a motion sensor 102, and a positioning unit 103.

[0027] The touch panel display 101 is a display that the user focuses on, and it also allows the user to operate applications through touch events.

[0028] The motion sensor 102 detects measured values ​​based on motion, and may be, for example, one of an acceleration sensor, a gravity sensor, or an angular velocity sensor, or a combination thereof. In the case of an acceleration sensor, the measured values ​​of each element (x, y, z) are the standard gravitational acceleration G in MSK gravitational units (-1G to +1G, 1G = 9.80665 m / s²). 2 It is expressed as ). A gravity sensor outputs measured values ​​of gravity in each direction, and may also be an acceleration sensor that detects gravitational acceleration. An angular velocity sensor (gyroscope) detects the rotation angle per unit time (degrees per second).

[0029] The positioning unit 103 may be, for example, a GPS (Global Positioning System) sensor, or a communication interface that communicates with a mobile phone base station. The positioning unit 103 required by the present invention does not need to output accurate location information; it is sufficient that it can at least detect the displacement of position (distance traveled) based on elapsed time.

[0030] According to Figure 1, the portable device 1 includes a lighting detection unit 11, a touch event determination unit 12, a movement state determination unit 13, and a gaze time derivation unit 14. These functional components are realized by executing a program that enables the computer installed in the portable device to function. Furthermore, the processing flow of these functional components can also be understood as a touch event determination method.

[0031] [Light detection unit 11] The lighting detection unit 11 detects whether the touch display is lit or turned off. The detected information is output to the touch event determination unit 12.

[0032] [Touch event determination unit 12] The touch event determination unit 12 uses the illumination state of the touch panel display 101 and the measurement value from the motion sensor 102 to determine a user touch event on the touch panel display 101. The determination result is output to the gaze time derivation unit 14. The measured values ​​for each element of a motion sensor are either the measured values ​​for multiple elements of a single motion sensor, or the measured values ​​for each element of multiple motion sensors. In other words, at least two or more measured values ​​are required. For example, it may be possible to use only the x-element and y-element measurements of a single accelerometer. Alternatively, for example, only the x-element measurement value of the acceleration sensor and the x-element measurement value of the gravity sensor may be used.

[0033] Figure 2 is an explanatory diagram showing steps S1 and S2 of the preprocessing in the touch event determination unit of the present invention.

[0034] (S1) In a vector space where each element is a dimension, each data point from the past is positioned corresponding to a measured value. The vector space in Figure 2 consists of the x-axis dimension of the accelerometer and the y-axis dimension of the accelerometer. Of course, a multidimensional vector space may be constructed according to each element of the motion sensor 102. Furthermore, each data point in the past corresponds to the measured value of each element and the display ON / OFF status. In Figure 2, black circles represent data with the display ON, and white circles represent data with the display OFF. Furthermore, the processing of each data point in the past using S1-S4 may be done by batch-based expansion into a vector space using past training data, or by real-time expansion into a vector space using current data.

[0035] (S2) Next, we cluster multiple data points in a vector space. Clustering is a method of classifying a dataset into multiple clusters (non-hierarchical clustering), such as the k-means method. As shown in Figure 2, with k=5, all data is classified into one of five clusters. Specifically, it is performed in the following steps. (s21) First, determine the representative point (center) of k clusters. (s22) Next, all the data is distributed to the cluster closest to the center. (s23) The centroid (mean value) of each cluster is recalculated. In this way, by shifting the centroid, the data belonging to each cluster will also change. (S24) Repeat s23 until there are no more changes to the clusters of all the data, classifying the data into k clusters.

[0036] Figure 3 is an explanatory diagram illustrating steps S3 and S4 of the preprocessing in the touch event determination unit of the present invention.

[0037] (S3) From among multiple clusters, select one or more clusters where the data of the touch panel display lighting up for all data is equal to or greater than the "predetermined condition". Specifically, the clusters selected for the predetermined condition are as follows: • The data contains more than the "specified number" and, • The proportion of data where the touch panel display is lit relative to all data is equal to or greater than a "predetermined proportion".

[0038] Here, the "predetermined percentage" is arbitrary and may be set to, for example, 90%. For example, in order to calculate the predetermined percentage, it is preferable to pre-configure clusters using a group of past data including the presence or absence of touch events (measured values ​​of each element of the motion sensor, display ON / OFF status, presence or absence of touch events). This requires that the presence or absence of touch events be detected in advance by an OS capable of detecting them. Then, from among the multiple clusters, a cluster is selected that contains a predetermined number or more of data and in which the presence or absence of touch events exceeds a certain percentage, and the percentage of data in the illuminated state of the touch panel display within that cluster is calculated as the "predetermined percentage". This makes it possible to select a cluster in which the illuminated state of the touch panel display exceeds the predetermined percentage, even if the presence or absence of touch events is unknown.

[0039] (S4) The range in the vector space for the selected cluster is defined as the "predetermined range". Specifically, the "predetermined range" is defined as the range within a predetermined distance from the "centroid" of the vector space for the selected cluster. Of course, it is not limited to this, and the predetermined range may also be expressed in terms of the range of each dimension of the vector.

[0040] As shown in Figures 2 and 3 above, clusters were constructed by clustering the data from past points in time in order to determine the "predetermined range." Of course, this is not the only method; for example, the predetermined range may be determined by general supervised learning based on a regression algorithm. According to the present invention, it is sufficient that the "predetermined range" is set by some method, and it may even be arbitrarily set by a human.

[0041] Figure 4 is an explanatory diagram for determining touch events on a mobile device while it is in use.

[0042] Figure 4 shows an example of a dwell state, where the lighting state of the lighting detection unit 11 and the measured values ​​of each element of the motion sensor 102 are shown in chronological order. The touch event determination unit 12 considers a user touch event to have occurred on the touch panel display 101 in the following cases: The output from the lighting detection unit 11 is in a lit state, and • The current measured values ​​of each element of the motion sensor 102 are within the "predetermined range". At the very least, if the light detection unit 11 indicates that the light is off, it will be considered that there was no user touch event.

[0043] Figure 5 is a flowchart illustrating the process of the present invention.

[0044] (S11) If the output from the lighting detection unit 11 is "lit," it is assumed that the user may be operating on the touch panel display 101, and the process proceeds to S12. If the output is "off," it is assumed that there is "no touch event" from the user on the touch panel display 101. (S12, S13) If the current measured values ​​of each element of the motion sensor 102 are within the "predetermined range" (YES), it is considered that there has been a "touch event" by the user on the touch panel display 101, and the process proceeds to S14. If the values ​​are not within the "predetermined range" (NO), it is considered that there has been no "touch event" by the user on the touch panel display 101. (S14) If a "touch event occurred," its duration is considered the user's "gaze time," and this time is accumulated.

[0045] Here, a problem arises with the accuracy of the touch event determination unit 12 in determining whether a touch event has occurred or not. The biggest problem is that when the "predetermined range" (distance from the center of gravity) selected according to Figures 2 and 3 above is calculated as data from past points in time, there is a large variation in the statistical range depending on whether the user is stationary or moving, which reduces the accuracy of determining whether a touch event has occurred. To that end, the "predetermined range" in S13 of Figure 5 is changed according to the difference between the stay state and the move state determined by the move state determination unit 13.

[0046] Figure 6 is an explanatory diagram illustrating the processing of step S4 in a mobile device in motion. Figure 7 is an explanatory diagram illustrating how to determine touch events on a mobile device while it is in motion.

[0047] Depending on whether the portable device 1 is stationary or moving, the measured values ​​output from the motion sensor 102 are classified as follows: • Measurement values ​​of motion sensors in portable devices while stationary (see Figures 2-4) • Measurement values ​​of motion sensors in mobile devices while they are in motion (see Figures 6 and 7) The touch event determination unit 12 stores a predetermined range in the vector space for each of the mobile device 1's dwelling state and movement state. Then, it applies the predetermined range corresponding to the current dwelling state or movement state to determine whether or not a user touch event has occurred.

[0048] Figure 6, segment S4, shows the data distribution during movement, and the "predetermined range" (center of gravity and distance from the center of gravity) is different compared to S4 in Figure 3, which shows the data distribution during stationary state.

[0049] As shown in Figure 7, in comparison with Figure 4, this is an example of a moving state, where the lighting state of the lighting detection unit 11 and the measured values ​​of each element of the motion sensor 102 are shown in chronological order.

[0050] In another embodiment, the touch event determination unit 12 may pre-store a predetermined range in the vector space according to the "location" of the mobile device 1. The movement state determination unit 13 applies the "predetermined range" according to the "location" if the user is currently in a stationary state. For example, by applying different predetermined ranges depending on whether the user is at home or at work, the accuracy of determining the user's touch events can be improved.

[0051] [Movement status determination unit 13] The movement status determination unit 13 receives location information (latitude and longitude) in a time series from the positioning unit 103. The movement state determination unit 13 determines that the state is "moving" if the distance traveled to a predetermined location during a predetermined period is greater than or equal to a predetermined distance, and determines that the state is "staying" if the distance is less than the predetermined distance. The movement status determination unit 13, for example, arranges the location information in chronological order and determines that the log from the first log to the log immediately preceding any log that is more than a predetermined threshold (distance m) away from the starting point is the same location. The time from the first time to the last time when the location is determined to be the same location is determined to be the "staying state," and all other time is determined to be the "moving state."

[0052] As a result, the touch event determination unit 12 distinguishes between the dwell state and the movement state and makes the following estimations. As for the target data, if the mobile device 1 is in a "staying state," and the measured value output from the motion sensor 102 falls within the first predetermined range, it is considered a "touch event occurred." On the other hand, if it does not fall within that range, it is considered a "no touch event occurred." Alternatively, if the mobile device 1 is in a "moving state," and the measured value output from the motion sensor 102 falls within the second predetermined range, it is considered a "touch event." On the other hand, if it does not fall within that range, it is considered a "no touch event."

[0053] [Gaze time derivation unit 14] The gaze time calculation unit 14 calculates the user's gaze time by accumulating the time during which the touch event determination unit 12 determines that a "touch event occurred". Here, the gaze time is accumulated assuming that the gaze state continues even if no other event occurs, until it is determined that there is "no touch event". Furthermore, the gaze time derivation unit 14 may calculate the "gaze ratio" for a predetermined period. Gaze rate = Time with touch event / Designated period

[0054] Figure 8 is a flowchart illustrating the processing of the movement state determination unit.

[0055] When the movement status determination unit 13 determines that the user is in a movement state, it determines the mode of transport the user is using based on the distance traveled to the location within a predetermined period. The touch event determination unit 12 has pre-stored a predetermined range in the vector space according to the moving medium, and when the movement state determination unit 13 determines that the medium is currently in a moving state, it applies the predetermined range according to the movement state and the moving medium.

[0056] According to Figure 8, the movement state determination unit 13 processes as follows. (S131) ​​Taking the unit time t0 to t1 (for example, 5 minutes), the positioning unit 103 obtains the position at time t0 and the position at time t1. Then, the distance traveled between the two positions at the same time is calculated. (S132) Next, it is determined whether the distance traveled is longer than the distance stayed (for example, 10m). If the distance traveled is longer than the distance stayed, it is determined to be in a "traveling state"; otherwise, it is determined to be in a "staying state". (S133) Next, if the system is in a moving state, it is determined whether the distance traveled is longer than the walking distance (e.g., 50m). If the distance traveled is within the walking distance, it is determined to be in a "walking (moving) state". (S134) Next, if the distance traveled is longer than the walking distance (e.g., 50m), it is determined whether the distance traveled is longer than the distance traveled by car (e.g., 500m). If the distance traveled is within the distance traveled by car, it is determined to be in a "car-riding (traveling) state". Otherwise, it may be determined to be in a "railway-riding (traveling) state", for example.

[0057] Furthermore, according to the same applicant as the present application, there is a technology that estimates the necessity of bidirectional transportation between locations based on time-series location information from multiple mobile terminals for a user's mode of transport (see, for example, Patent Document 3). In addition, there is a technology that estimates routes between locations on a map with high accuracy using a small amount of location information and a small amount of computation within the movement trajectory of a mobile terminal (see, for example, Patent Document 4).

[0058] As described in detail above, according to the portable device, program, and method of the present invention, it is possible to determine a user's touch event on the touch panel display using the illumination state of the touch panel display and the measured value of the motion sensor.

[0059] According to the present invention, since only the motion sensor mounted on the mobile device is used, no separate device is required. Furthermore, touch events can be determined regardless of the application the user is using. In addition, by using a positioning unit, vibrations of the motion sensor during movement can be taken into account, and touch events can be determined with high accuracy in both stationary and moving states.

[0060] Furthermore, this will enable, for example, the detection of the amount of time a user spends looking at their smartphone screen, thereby contributing to Goal 3 of the United Nations-led Sustainable Development Goals (SDGs), which is "Ensure healthy lives and promote well-being for all at all ages."

[0061] Various changes, modifications, and omissions to the scope of the technical concept and viewpoint of the present invention can be readily made by those skilled in the art with respect to the various embodiments of the present invention described above. The above description is merely illustrative and is not intended to limit the present invention in any way. The present invention is limited only to what is limited by the claims and their equivalents. [Explanation of Symbols]

[0062] 1. Portable devices 101 Touch Panel Display 102 Motion Sensor 103 Positioning Unit 11 Light detection unit 12 Touch event detection unit 13 Movement state determination unit 14. Gaze Time Derivation Section

Claims

1. In a portable device having a touch panel display and a motion sensor, A lighting detection means for detecting whether the touch display is lit or turned off, A touch event determination means that determines that a user touch event has occurred on the touch panel display when the touch display is lit and the measured values ​​of each element of the motion sensor at the current time are within a predetermined range. It has, The means for determining touch events is: In a vector space where each element is a dimension, each piece of data from past points in time is positioned corresponding to a measured value. Clustering multiple data points in a vector space, From among multiple clusters, select one or more clusters where the data for the touch panel display lighting up for all data exceeds a predetermined condition. The range in the vector space within the selected cluster is defined as a predetermined range. A portable device characterized by the following features.

2. A motion sensor is one of the following: an acceleration sensor, a gravity sensor, or an angular velocity sensor, or a combination thereof. The measured values ​​of each element of a motion sensor are either the measured values ​​of multiple elements of a single motion sensor, or the measured values ​​of each element of multiple motion sensors. The portable device according to feature 1.

3. The touch event detection means calculates the centroid in the vector space of the selected cluster and defines the range within a predetermined distance from the centroid as the predetermined range. The portable device according to feature 1.

4. The touch event determination means selects one or more clusters that contain a predetermined number of data points, where the ratio of data indicating a lit touch panel display to all data points is at or above a predetermined ratio, as a predetermined condition. The portable device according to feature 1.

5. The portable device is further equipped with a positioning unit. The system further includes a movement state determination means that determines a state of movement if the distance traveled to a predetermined location within a predetermined period is greater than or equal to a predetermined distance, and determines a state of stay if the distance is less than the predetermined distance. The touch event detection means pre-stores a predetermined range in the vector space for each of the mobile device's movement state and stay state, and applies the predetermined range according to the current movement state or stay state. The portable device according to feature 1 or 2.

6. The touch event determination means stores a predetermined range in the vector space according to the position, and when the movement state determination means is in a staying state at the present time, it applies the predetermined range according to the staying position. The portable device according to feature 5.

7. The movement status determination means, upon determining that a movement status has been determined, determines the mode of transport on which the user is riding, based on the distance traveled to a predetermined location within a specified period. The touch event determination means pre-stores a predetermined range in the vector space depending on the moving medium, and when the movement state determination means determines that the medium is currently in a moving state, it applies the predetermined range corresponding to the movement state. The portable device according to feature 5.

8. A gaze time derivation means derives the gaze time of the user by accumulating the time during which touches are deemed to have occurred by the touch event detection means. The portable device according to claim 1 or 2, further characterized by having the following features.

9. A program for operating a computer installed in a portable device having a touch panel display and a motion sensor, A lighting detection means for detecting whether the touch display is lit or turned off, A touch event determination means that determines that a user touch event has occurred on the touch panel display when the touch display is lit and the measured values ​​of each element of the motion sensor at the current time are within a predetermined range. and make it work The means for determining touch events is: In a vector space where each element is a dimension, each piece of data from past points in time is positioned corresponding to a measured value. Clustering multiple data points in a vector space, From among multiple clusters, select one or more clusters where the data for the touch panel display lighting up for all data exceeds a predetermined condition. The range in the vector space within the selected cluster is defined as a predetermined range. A program characterized by causing a computer to function in a certain way.

10. A method for determining touch events in a portable device having a touch panel display and a motion sensor, Mobile devices are A first step involves detecting whether the touch display is lit or turned off, A second step is to consider a user touch event on the touch panel display to have occurred if the touch display is lit and the current measured values ​​of each element of the motion sensor are within a predetermined range. Execute, The second step is, In a vector space where each element is a dimension, each piece of data from past points in time is positioned corresponding to a measured value. Clustering multiple data points in a vector space, From among multiple clusters, select one or more clusters where the data for the touch panel display lighting up for all data exceeds a predetermined condition. The range in the vector space within the selected cluster is defined as a predetermined range. A method for determining touch events in a mobile device, characterized by the following features.

Images