Mobile device, program, and method for determining touch event by user on touch panel display

Abstract

To provide a mobile device, etc. that determines touch events by a user on a touch panel display using a lighting state of the touch panel display and measured values of a motion sensor.SOLUTION: The mobile device includes lighting detection means for detecting whether a touch display is lit or unlit and touch event determination means for considering to have a touch event by a user against the touch panel display when the touch display is lit and the measured values of elements of the motion sensor at the moment are within a predetermined range. The motion sensor is one of an acceleration sensor, a gravity sensor, or an angular velocity sensor, or a combination thereof, and the measured values of the respective element of the motion sensor may be the measured values of multiple elements of a single motion sensor, or the measured values of the respective elements of a plurality of motion sensors.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a technique for determining a touch event of a user on a touch panel display. [Background technology]

[0002] In recent years, an increasing number of people feel that smartphone use has had some negative effects, such as "reduced sleep time," "deteriorated eyesight," and "disordered lifestyles" (see, for example, Non-Patent Document 1). One of the reasons for this is thought to be that users stare at smartphone displays for long periods of time.

[0003] Conventionally, there is a technique for preventing a user from operating a smartphone while moving (see, for example, Patent Document 1). According to this technique, if an application is running while the user is moving, the user is alerted. If the application is still running even though the user is moving, the user's use of the smartphone is restricted. Then, while the user's use is restricted and the user's movement has been detected as having stopped, question-type content is played back. When the user has completed answering the question, the playback of the question-type content is terminated and the restriction is lifted.

[0004] There is also a technology that estimates the time spent gazing at the screen of an information terminal (see, for example, Patent Document 2). According to this technology, a camera detects the behavior of walking while looking at the screen of a smartphone in a monitored area, and an alarm is issued from a speaker. From the video data captured by the camera, (s1) a person is detected and the speed and direction of movement of the person are detected, (s2) the left and right movements of the person's body are detected to determine whether or not the arms are fixed in front, (s3) it is determined that the person is looking down based on the direction of the face, and (s4) when the person's arms are fixed in front for a certain period of time and the posture of looking forward and downward is intermittently repeated, it is determined that the smartphone is being used while moving. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent Publication No. 2021-083069 [Patent Document 2] Patent No. 6655727 [Patent Document 3] Patent No. 6621208 [Patent Document 4] Patent No. 6632071 [Non-patent literature]

[0006] [Non-Patent Document 1] "Cure smartphone addiction with an app? KDDI's research into healthy and appropriate smartphone use," TIME&SPACE by KDDI, [online], [searched August 16, 2023], Internet<URL:https: / / time-space.kddi.com / au-kddi / 20210721 / 3137> Summary of the Invention [Problem to be solved by the invention]

[0007] According to the technology described in Patent Document 1, when a pre-specified application is running, it is merely determined that the user is gazing at the smartphone display. In other words, there is no restriction on the use of applications other than the pre-specified application. In addition, it is not determined whether the user is actually gazing at the pre-specified application. Furthermore, the technology described in Patent Document 2 makes it possible to estimate the user's gaze state on an information terminal, but requires video data from a camera that is installed indoors beforehand.

[0008] In general, the lighting time of the display of a mobile device can be estimated as the user's gaze time. However, just because the display is lit does not necessarily mean that the user is gazing at the display. Here, when a touch event occurs on the touch panel display of a mobile device, the gaze time of the user can be estimated. However, the OS (Operating System) of a mobile device such as a smartphone may block touch events from applications. This is because, from the viewpoint of personal information security, the detection of a touch event by the user is not permitted to be used by applications.

[0009] In response to this, the inventors of the present application wondered whether it would be possible to determine touch events using a running application even if the OS of the mobile device does not permit detection of user touch events on the touch panel display. If the user's touch events can be determined, the user's gaze time can also be determined.

[0010] SUMMARY OF THE PRESENT DISCLOSURE In view of the above, an object of the present invention is to provide a mobile device, a program, and a method capable of determining a user's touch event on a touch panel display. [Means for solving the problem]

[0011] According to the present invention, in a mobile device having a touch panel display and a motion sensor, A lighting detection means for detecting lighting or extinction of the touch display; a touch event determination means for determining that a user's touch event has occurred on the touch panel display when the touch display is turned on and the current measured values ​​of each element of the motion sensor are within a predetermined range; The present invention is characterized by having the following.

[0012] According to another embodiment of the mobile device of the present invention, The motion sensor is any one of an acceleration sensor, a gravity sensor, and an angular velocity sensor, or a combination thereof; The measurement of each element of the motion sensor may be a measurement of multiple elements of one motion sensor, or a measurement of each element of each of multiple motion sensors. It is also preferable.

[0013] According to another embodiment of the mobile device of the present invention, The touch event determination means includes: Each element is placed in a vector space with dimensions, and each past data point is placed in correspondence with the measured value. Cluster multiple data in vector space. Select one or more clusters from among the plurality of clusters, in which the data of the lighting of the touch panel display for all the data meets or exceeds a predetermined condition; The range of the selected cluster in the vector space is set as a predetermined range. It is also preferable.

[0014] According to another embodiment of the mobile device of the present invention, The touch event determination means calculates a center of gravity in the vector space of the selected cluster, and sets a range of a predetermined distance from the center of gravity as a predetermined range. It is also preferable.

[0015] According to another embodiment of the mobile device of the present invention, The touch event determination means selects, as a predetermined condition, one or more clusters that include a predetermined number of data or more and in which the ratio of data indicating lighting of the touch panel display to all data is a predetermined ratio or more. It is also preferable.

[0016] According to another embodiment of the mobile device of the present invention, The portable device further includes a positioning unit, a moving state determination means for determining a moving state when a distance between positions moved during a predetermined period is equal to or greater than a predetermined distance, and determining a staying state when the distance is shorter than the predetermined distance, The touch event determination means stores in advance a predetermined range in the vector space for each of the moving state and the staying state of the portable device, and applies the predetermined range according to the moving state or the staying state at the current time. It is also preferable.

[0017] According to another embodiment of the mobile device of the present invention, The touch event determination means stores in advance a predetermined range in the vector space according to the position, and applies the predetermined range according to the stay position when the movement state determination means is currently in a stay state. It is also preferable.

[0018] According to another embodiment of the mobile device of the present invention, the moving state determination means, when determining that the user is in a moving state, determines a transportation medium that the user will board in accordance with a distance to a location traveled during a predetermined period; The touch event determination means stores in advance a predetermined range in the vector space according to the moving medium, and when the moving state determination means is currently in a moving state, applies the predetermined range according to the moving state. It is also preferable.

[0019] According to another embodiment of the mobile device of the present invention, a gaze time deriving means for deriving a gaze time of the user by accumulating a time during which the touch event determining means determines that a touch has occurred; It is also preferable to further include

[0020] According to the present invention, there is provided a program for causing a computer installed in a mobile device having a touch panel display and a motion sensor to function, the program comprising: A lighting detection means for detecting lighting or extinction of the touch display; a touch event determination means for determining that a user's touch event has occurred on the touch panel display when the touch display is turned on and the current measured values ​​of each element of the motion sensor are within a predetermined range; The present invention is characterized in that it causes a computer to function.

[0021] According to the present invention, there is provided a touch event determination method for a mobile device having a touch panel display and a motion sensor, comprising the steps of: The mobile device is A first step of detecting whether a touch display is on or off; a second step of determining that a user's touch event has occurred on the touch panel display when the touch display is turned on and the current measured values ​​of each element of the motion sensor are within a predetermined range; It is characterized by carrying out Effect of the Invention

[0022] According to the mobile device, program, and method of the present invention, a touch event by a user on a touch panel display can be determined using the lighting state of the touch panel display and the measurement value of a motion sensor, thereby making it possible to determine a touch event without relying on security settings in the OS of the mobile device. [Brief description of the drawings]

[0023] [Figure 1] FIG. 2 is a functional configuration diagram of a portable device according to the present invention. [Diagram 2] 4 is an explanatory diagram illustrating steps S1 and S2 of pre-processing in a touch event determination unit of the present invention. FIG. [Diagram 3] 11 is an explanatory diagram illustrating steps S3 and S4 of pre-processing in a touch event determination unit of the present invention. FIG. [Figure 4] 11 is an explanatory diagram for determining a touch event on a mobile device in a stay state; [Diagram 5] 2 is a flowchart showing the process of the present invention. [Figure 6] FIG. 11 is an explanatory diagram showing the process of step S4 in the mobile device in a moving state. [Figure 7] FIG. 11 is an explanatory diagram for determining a touch event on a mobile device in a moving state; [Figure 8]13 is a flowchart showing a process of a movement state determination unit. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0025] FIG. 1 is a functional configuration diagram of a portable device according to the present invention.

[0026] 1, the mobile device 1 may be a smartphone carried by a user. The mobile device 1 has a touch panel display 101, a motion sensor 102, and a positioning unit 103 as hardware.

[0027] The touch panel display 101 is a display that the user gazes at, and enables applications to be operated by the user's touch events.

[0028] The motion sensor 102 detects a measurement based on motion and may be, for example, any one or a combination of an acceleration sensor, a gravity sensor, or an angular velocity sensor. In the case of an acceleration sensor, the measurement value of each element (x, y, z) is expressed as the standard gravitational acceleration G (-1G to +1G, 1G = 9.80665m / s 2 ) In the case of a gravity sensor, it outputs a measurement value of gravity in each direction, and may be an acceleration sensor that detects gravitational acceleration. An angular velocity sensor (gyro sensor) detects the rotation angle per unit time (degrees per second).

[0029] The positioning unit 103 may be, for example, a GPS (Global Positioning System) sensor or a communication interface for communicating with a mobile phone base station. The positioning unit 103 required by the present invention does not need to output accurate position information, but only needs to be able to detect at least a change in position (movement distance) based on elapsed time.

[0030] 1, the mobile device 1 includes an illumination detection unit 11, a touch event determination unit 12, a moving state determination unit 13, and a gaze time derivation unit 14. These functional components are realized by executing a program that causes a computer installed in the mobile device to function. The process flow of these functional components can also be understood as a touch event determination method.

[0031] [Lighting detection unit 11] The lighting detection unit 11 detects whether the touch display is turned on or off. The detected information is output to the touch event determination unit 12.

[0032] [Touch event detection part 12] Touch event determination unit 12 determines a touch event of the user on touch panel display 101, using the lighting state of touch panel display 101 and the measurement value of motion sensor 102. The determination result is output to gaze duration derivation unit 14. The measurements of each element of the motion sensor may be measurements of multiple elements of one motion sensor, or measurements of each element of multiple motion sensors, i.e., at least two or more measurements are required. For example, only the x-element measurement value and the y-element measurement value of one acceleration sensor may be used. Also, for example, only the measurement value of the x element of the acceleration sensor and the measurement value of the x element of the gravity sensor may be used.

[0033] FIG. 2 is an explanatory diagram showing steps S1 and S2 of pre-processing in the touch event determination unit of the present invention.

[0034] (S1) Each piece of past data is placed in a vector space with each element as a dimension, corresponding to the measured value. The vector space in Fig. 2 is composed of the dimension of the x-axis of the acceleration sensor and the dimension of the y-axis of the acceleration sensor. Of course, a multi-dimensional vector space may be configured according to each element of the motion sensor 102. Also, each piece of past data corresponds to the measurement value of each element and whether the display is ON or OFF. According to Fig. 2, black circles represent data when the display is ON, and white circles represent data when the display is OFF. In addition, the processing of S1 to S4 for each piece of past data may be performed by expanding the past teaching data into a vector space in a batch manner, or may be performed by expanding the current data into a vector space in real time.

[0035] (S2) Next, multiple data are clustered in the vector space. Clustering is a method of classifying a data group into multiple clusters (non-hierarchical clustering), for example, the k-means method. According to Figure 2, with k=5, all data is classified into one of five clusters. Specifically, it is performed in the following steps. (s21) First, the representative points (centers) of the k clusters are determined. (s22) Next, all the data is assigned to the cluster closest to the center. (s23) The center of gravity (average value) of each cluster is recalculated. In this way, by displacing the center of gravity, the data belonging to the cluster also becomes different. (S24) Repeat s23 until there are no changes to the clusters of all the data, and classify the data into k clusters.

[0036] FIG. 3 is an explanatory diagram showing steps S3 and S4 of the pre-processing in the touch event determination unit of the present invention.

[0037] (S3) From among the multiple clusters, one or more clusters are selected in which the data of the lighting of the touch panel display for all data is equal to or exceeds a "predetermined condition." Specifically, the following clusters are selected as the predetermined condition. - Contains more than the "predetermined number" of data, and The ratio of data with the touch panel display lit up to all data is equal to or greater than the "predetermined ratio."

[0038] Here, the "predetermined ratio" is arbitrary and may be set to, for example, 90%. For example, in order to calculate the predetermined ratio, it is also preferable to configure a cluster in advance using a group of past data including the presence or absence of a touch event (measurement values ​​of each element of the motion sensor, display ON / OFF, presence or absence of a touch event). This needs to be detected in advance by an OS that can detect the presence or absence of a touch event. Then, from among the multiple clusters, a cluster that includes a predetermined number of data or more and has a certain ratio or more of touch events is selected, and the ratio of data in the cluster showing the lighting state of the touch panel display is calculated as the "predetermined ratio". This makes it possible to select a cluster in which the lighting state of the touch panel display is a predetermined ratio or more even if the presence or absence of a touch event is unknown.

[0039] (S4) The range in the vector space of the selected cluster is set as a "predetermined range." Specifically, the "predetermined range" is set as a range a predetermined distance from the "center of gravity" in the vector space of the selected cluster, which is calculated. Of course, the present invention is not limited to this, and the predetermined range may be expressed as the range of each dimension of the vector.

[0040] 2 and 3 described above, in order to determine the "predetermined range," clusters are formed by clustering a group of past data. Of course, this is not limited to this, and the predetermined range may be determined, for example, by general supervised learning based on a regression algorithm. According to the present invention, the "predetermined range" may be set by any method, and may be arbitrarily set manually.

[0041] FIG. 4 is an explanatory diagram of how a touch event is determined on a mobile device in a stay state.

[0042] FIG. 4 shows an example of a stay state, in which the lighting state of the lighting detection unit 11 and the measurement values ​​of each element of the motion sensor 102 are shown in chronological order. Touch event determination unit 12 determines that a touch event by the user has occurred on touch panel display 101 in the following cases. The output from the lighting detection unit 11 is in a lighting state, and The current measurement value of each element of the motion sensor 102 is within a "predetermined range" At least when the lighting detection unit 11 detects the off state, it is determined that no touch event has occurred by the user.

[0043] FIG. 5 is a flow chart showing the process of the present invention.

[0044] (S11) If the output from lighting detection unit 11 is “lighted”, it is assumed that the user is possibly operating touch panel display 101, and the process proceeds to S12. If the output is “off”, it is assumed that “no touch event” has occurred by the user on touch panel display 101. (S12, S13) If the current measurement values ​​of each element of motion sensor 102 are within the "predetermined range" (YES), it is deemed that a "touch event has occurred" by the user on touch panel display 101, and the process proceeds to S14. If the current measurement values ​​of each element of motion sensor 102 are within the "predetermined range" (NO), it is deemed that a "touch event has not occurred" by the user on touch panel display 101. (S14) If "a touch event has occurred", the duration of the event is regarded as the user's "gaze time" and this time is accumulated.

[0045] Here, a problem occurs in the accuracy of determining whether or not a touch event has occurred with respect to the touch event determination unit 12. The biggest problem is that if the "predetermined range" (distance from the center of gravity) selected using the above-mentioned Fig. 2 and Fig. 3 is calculated as data from a past time point, the statistical range varies greatly depending on the staying state or the moving state, and the accuracy of determining whether or not a touch event has occurred decreases. For this purpose, the "predetermined range" in S13 of FIG. 5 is changed depending on the stay state or movement state determined by the movement state determination unit 13.

[0046] FIG. 6 is an explanatory diagram showing the process of step S4 in the mobile device in a moving state. FIG. 7 is an explanatory diagram of how a touch event is determined in a mobile device in a moving state.

[0047] Depending on the stay state or movement state of the mobile device 1, the measurement value output from the motion sensor 102 is classified as follows. - Measurements of the motion sensor on the mobile device during the stay (see Figures 2 to 4) - Measurement values ​​of the motion sensor in a mobile device while moving (see Figures 6 and 7) The touch event determination unit 12 stores in advance a "predetermined range" in the vector space for each of the stay state and the movement state of the mobile device 1. Then, the touch event determination unit 12 determines the presence or absence of a touch event by the user by applying the predetermined range according to the current stay state or the movement state.

[0048] S4 in Figure 6 shows the distribution of data in a moving state, and the "predetermined range" (center of gravity and distance from the center of gravity) is different from S4 in Figure 3 described above, which shows the distribution of data in a staying state.

[0049] FIG. 7, in comparison with FIG. 4, shows an example of a moving state, in which the lighting state of the lighting detection unit 11 and the measurement values ​​of each element of the motion sensor 102 are shown in time series.

[0050] In another embodiment, touch event determination unit 12 may store in advance a predetermined range in a vector space according to the "position" of mobile device 1. When moving state determination unit 13 is currently in a stay state, a "predetermined range" according to the "stay position" is applied. For example, by applying different predetermined ranges depending on whether the user is staying at home or at work, the accuracy of determination of the user's touch event can be improved.

[0051] [Movement state determination unit 13] The moving state determination unit 13 receives the position information (latitude and longitude) from the positioning unit 103 in chronological order. Then, the moving state determination unit 13 determines the state as "moving state" when the distance traveled to positions during a predetermined period is equal to or greater than a predetermined distance, and determines the state as "staying state" when the distance traveled to positions is shorter than the predetermined distance. The movement state determination unit 13, for example, arranges the location information in chronological order, and determines that the log from the first log as a starting point to the log immediately preceding the log that is away from the starting point by a predetermined threshold (distance m) or more is the same stay location. The period from the first time determined to be the same stay location to the last time is determined to be a "stay state," and the remaining time is determined to be a "moving state."

[0052] This allows touch event judging unit 12 to distinguish between a stay state and a movement state and make the following estimation. As the target data, when the mobile device 1 is in a "stay state", if the measurement value actually output from the motion sensor 102 is within the first predetermined range, it is regarded as "there is a touch event". On the other hand, if it is not within the first predetermined range, it is regarded as "there is no touch event". Alternatively, when the mobile device 1 is in a "moving state", if the measurement value currently output from the motion sensor 102 is within the second predetermined range, it is deemed that "a touch event has occurred." On the other hand, if it is not within the second predetermined range, it is deemed that "no touch event has occurred."

[0053] [Gaze time derivation part 14] The gaze time derivation unit 14 derives the gaze time of the user by accumulating the time during which the touch event determination unit 12 determines that a "touch event has occurred." Here, the gaze time is accumulated assuming that the gaze state continues until the touch event is determined to be absent, even if no separate event occurs. Furthermore, the gaze time derivation unit 14 may calculate a "gaze ratio" for a predetermined period. Gaze rate = time with touch event / predetermined period

[0054] FIG. 8 is a flowchart showing the process of the movement state determination unit.

[0055] When determining that the user is in a moving state, the moving state determination unit 13 determines the transportation medium that the user is riding on, depending on the distance of the position traveled during a predetermined period. The touch event determination unit 12 pre-stores a predetermined range in the vector space according to the movement medium, and when the movement state determination unit 13 is currently in a moving state, it applies the predetermined range according to the movement state and the movement medium.

[0056] According to FIG. 8, the moving state determination unit 13 performs the following process. (S131) ​​Using a unit time period from t0 to t1 (for example, 5 minutes), a position at time t0 and a position at time t1 are obtained from positioning unit 103. Then, the travel distance between the positions at the two times is calculated. (S132) Next, it is determined whether the movement distance is longer than the stay distance (for example, 10 m). If the movement distance is longer than the stay distance, it is determined to be a "moving state", and if not, it is determined to be a "staying state". (S133) Next, if the state is moving, it is determined whether the moving distance is longer than the walking distance (for example, 50 m). If the moving distance is within the walking distance, it is determined to be in a "walking (moving) state". (S134) Next, if the travel distance is longer than the walking distance (e.g., 50 m), it is determined whether the travel distance is longer than the car distance (e.g., 500 m). If the travel distance is within the car distance, it is determined to be a "car boarding (moving) state." If not, it may be determined to be, for example, a "railroad car boarding (moving) state."

[0057] According to the same applicant as the present application, there is a technology for estimating the necessity of two-way transportation between places of stay based on the time-series position information of multiple mobile terminals as a user's transportation medium (see, for example, Patent Document 3). There is also a technology for estimating with high accuracy the route between places of stay on a map from the movement trajectory of a mobile terminal with a small amount of position information and a small amount of calculation (see, for example, Patent Document 4).

[0058] As described above in detail, according to the mobile device, program, and method of the present invention, a user's touch event on the touch panel display can be determined using the lighting state of the touch panel display and the measurement value of the motion sensor.

[0059] According to the present invention, since only the motion sensor mounted on the mobile device is used, no separate device is required. Also, a touch event can be determined without depending on the application used by the user. Furthermore, by using a positioning unit, vibration of the motion sensor in a moving state can be taken into consideration, and a touch event can be determined with high accuracy in a staying state and a moving state.

[0060] Furthermore, this will make it possible, for example, to "detect the amount of time a user is looking at a smartphone display," which will contribute to Goal 3 of the United Nations-led Sustainable Development Goals (SDGs), which is to "Ensure healthy lives and promote well-being for all at all ages."

[0061] Regarding the various embodiments of the present invention described above, various changes, modifications, and omissions within the scope of the technical idea and perspective of the present invention can be easily made by those skilled in the art. The above description is merely an example and is not intended to be restrictive in any way. The present invention is limited only by the scope of the claims and their equivalents. [Explanation of symbols]

[0062] 1. Mobile devices 101 Touch Panel Display 102 Motion Sensor 103 Positioning unit 11 Lighting detection unit 12 Touch event detection section 13. Movement state determination unit 14. Eye gaze time derivation section

Claims

1. In a mobile device having a touch panel display and a motion sensor, A lighting detection means for detecting lighting or extinction of the touch display; a touch event determination means for determining that a user's touch event has occurred on the touch panel display when the touch display is turned on and the current measured values ​​of each element of the motion sensor are within a predetermined range; A portable device comprising:

2. The motion sensor is any one of an acceleration sensor, a gravity sensor, and an angular velocity sensor, or a combination thereof; The measurement of each element of the motion sensor may be a measurement of multiple elements of one motion sensor, or a measurement of each element of each of multiple motion sensors.

2. The portable device according to claim 1 .

3. The touch event determination means includes: Each element is placed in a vector space with dimensions, and each past data point is placed in correspondence with the measured value. Cluster multiple data in vector space. Select one or more clusters from among the plurality of clusters, in which the data of the lighting of the touch panel display for all the data satisfies a predetermined condition or more; The range of the selected cluster in the vector space is set as a predetermined range.

2. The portable device according to claim 1 .

4. The touch event determination means calculates a center of gravity in the vector space of the selected cluster, and sets a range of a predetermined distance from the center of gravity as a predetermined range.

4. The mobile device according to claim 3.

5. The touch event determination means selects, as a predetermined condition, one or more clusters that include a predetermined number of data or more and in which the ratio of data indicating lighting of the touch panel display to all data is a predetermined ratio or more.

4. The mobile device according to claim 3.

6. The portable device further includes a positioning unit, a moving state determination means for determining a moving state when a distance between positions moved during a predetermined period is equal to or greater than a predetermined distance, and determining a staying state when the distance is shorter than the predetermined distance, The touch event determination means stores in advance a predetermined range in the vector space for each of the moving state and the staying state of the portable device, and applies the predetermined range according to the moving state or the staying state at the current time.

3. The mobile device according to claim 1 or 2.

7. The touch event determination means stores in advance a predetermined range in the vector space according to the position, and applies the predetermined range according to the stay position when the movement state determination means is currently in a stay state.

7. The mobile device according to claim 6.

8. the moving state determination means, when determining that the user is in a moving state, determines a transportation medium that the user will board in accordance with a distance to a location traveled during a predetermined period; The touch event determination means stores in advance a predetermined range in the vector space according to the moving medium, and when the moving state determination means is currently in a moving state, applies the predetermined range according to the moving state.

7. The mobile device according to claim 6.

9. a gaze time deriving means for deriving a gaze time of the user by accumulating a time during which the touch event determining means determines that a touch has occurred; 3. The mobile device according to claim 1, further comprising:

10. A program for causing a computer installed in a mobile device having a touch panel display and a motion sensor to function, A lighting detection means for detecting lighting or extinction of the touch display; a touch event determination means for determining that a user's touch event has occurred on the touch panel display when the touch display is turned on and the current measured values ​​of each element of the motion sensor are within a predetermined range; A program for causing a computer to function.

11. A touch event determination method for a portable device having a touch panel display and a motion sensor, comprising: The mobile device is A first step of detecting whether a touch display is on or off; a second step of determining that a user's touch event has occurred on the touch panel display when the touch display is turned on and the current measured values ​​of each element of the motion sensor are within a predetermined range; 4. A touch event determination method for a mobile device, comprising:

Images