Mobile terminal, exercise support method and program

Abstract

To provide a movement locus detection program and the like for acquiring and evaluating diagram information drawn by a movement locus of the body of a user who walks and runs.SOLUTION: A movement locus detection program causes an information terminal 1 which has a screen 160 and movement information acquisition means to execute the steps of: displaying an example image 300 and an example starting point 601; acquiring movement information of an information terminal 1 by using the movement information acquisition means; calculating a locus image 421 on the basis of the movement information; calculating a locus center 410 by means of the same calculation method as an example center 310; overlapping the example center 310 and the locus center 410 with each other; calculating the rotation angle of a locus starting point 611 viewed from the locus center 410 with respect to the example starting point 601 viewed from the example center 310; performing rotation correction based on a rotation angle θ with respect to a locus image 421; and displaying the example image 300 and a locus image 400 in a comparable manner.SELECTED DRAWING: Figure 11

Description

[Technical field]

[0001] The present invention relates to Mobile terminal, exercise support method and program Regarding. [Background technology]

[0002] 2. Description of the Related Art Conventionally, techniques for acquiring a movement trajectory of a terminal equipped with an acceleration sensor have been known and are applied to games and the like. For example, Patent Document 1 discloses a handwriting input pen device that has two acceleration sensors and corrects the acceleration signals obtained from the acceleration sensors to obtain two-dimensional handwriting information that eliminates inaccuracies caused by how the pen is held. Furthermore, Patent Document 2 discloses an information processing device that has two motion sensors and synthesizes the posture of the operator's head and operating unit on a preset world coordinate system based on a basic posture of the operator's head and operating unit on a local coordinate system and a specific absolute orientation direction of the head and operating unit. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 7-110738 [Patent Document 2] Patent No. 5944600 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, there has been concern about lack of exercise due to the development of transportation and the abundance of electronic toys, and there is a demand for games that allow full-body exercise outdoors or in large spaces. For children who need exercise for their development, it is particularly beneficial to have them exercise their whole body outdoors. The inventions described in Patent Documents 1 and 2 are inventions that acquire the trajectories of the head, arms, and pen held by the fingers of a user at a fixed point, and since they are mainly used while sitting, they cannot encourage the user to exercise the whole body. stomach.

[0005] The present invention has been made in view of the above circumstances. While users enjoy Walking and running To be able to To do so. [Means for solving the problem]

[0006] In order to solve the above problems, a mobile terminal according to the present invention has a display unit capable of displaying predetermined information, and is capable of acquiring a movement trajectory of the mobile terminal based on output information from a predetermined sensor, and is configured to display a trajectory that a player holding the mobile terminal should trace by moving the player. Example Movement trajectory The model start point and model end point match, forming a continuous a question display control means for displaying the question on the display unit as a line diagram; and a player holding the mobile terminal so as to draw the line diagram. Return to the starting point of the movement The present invention is provided with an acquisition means for acquiring a movement trajectory when the user moves as an actual trajectory based on output information from the sensor, and a result display control means for displaying a drawn figure based on the actual trajectory acquired by the acquisition means on the display unit, the result display control means comprising: The angle of the direction of the movement start point as seen from the center relative to the direction of the example start point as seen from the center when the center of the actual trajectory is superimposed on the center of the line diagram is derived as a rotational deviation angle of the actual trajectory with respect to the line diagram, and the calculated rotational deviation angle is The actual trajectory of Generated by correcting rotational misalignment did The correction trajectory is displayed on the display unit as the drawing figure. Further, an exercise support method according to the present invention is an exercise support method executed by a mobile device having a display unit capable of displaying predetermined information and capable of acquiring a movement trajectory of the mobile device based on output information from a predetermined sensor, the method comprising: acquiring a trajectory that a player holding the mobile device should trace by the player's movement; Example Movement trajectory The model start point and model end point match, forming a continuous a question display control process for displaying the question on the display unit as a line diagram; and a process for allowing a player holding the mobile terminal to draw the line diagram. Return to the starting point of the movement The method includes: an acquisition process for acquiring a movement trajectory when the user moves as an actual trajectory based on output information from the sensor; and a result display control process for displaying a drawing figure based on the actual trajectory acquired by the acquisition process on the display unit, the result display control process including: The angle of the direction of the movement start point as seen from the center relative to the direction of the example start point as seen from the center when the center of the actual trajectory is superimposed on the center of the line diagram is derived as a rotational deviation angle of the actual trajectory with respect to the line diagram, and the calculated rotational deviation angle is The actual trajectory of Generated by correcting rotational misalignment did The correction trajectory is displayed on the display unit as the drawing figure. The program according to the present invention includes a computer of a portable terminal having a display unit capable of displaying predetermined information and capable of acquiring a movement trajectory of the portable terminal based on output information from a predetermined sensor, the computer being configured to display a trajectory that should be drawn by the movement of a player holding the portable terminal. Example Movement trajectory The model start point and model end point match, forming a continuous a question display control means for displaying the question on the display unit as a line diagram; Return to the starting point of the movement The display control means functions as an acquisition means for acquiring a movement trajectory when the robot moves as an actual trajectory based on output information from the sensor, and a result display control means for displaying a drawing figure based on the actual trajectory acquired by the acquisition means on the display unit, the result display control means being configured to: The angle of the direction of the movement start point as seen from the center relative to the direction of the example start point as seen from the center when the center of the actual trajectory is superimposed on the center of the line diagram is derived as a rotational deviation angle of the actual trajectory with respect to the line diagram, and the calculated rotational deviation angle is The actual trajectory of Generated by correcting rotational misalignment did The correction trajectory is displayed on the display unit as the drawing figure. Effect of the Invention

[0007] The present invention According to the company, users can enjoy Walking and running It is possible. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a system diagram showing an example of a configuration of an information terminal. [Figure 2A] FIG. 13 is a schematic diagram of a movement start screen in the first embodiment. [Figure 2B] FIG. 13 is a schematic diagram of a screen during acquisition of trajectory information in the first embodiment. [Figure 2C] FIG. 1 is a schematic diagram of a result screen of the first embodiment. [Diagram 3] 11 is a flowchart showing the process from when the CPU displays a movement start screen to when it displays a result screen in the first embodiment. [Figure 4]6A to 6C are schematic diagrams illustrating a correction for matching a start point and an end point of a trajectory image according to the first embodiment. [Diagram 5] FIG. 13 is a schematic diagram of a movement start screen in a comparative example. [Figure 6A] 13 is a schematic diagram of a trajectory image before rotation correction in a comparative example. FIG. [Figure 6B] 13 is a schematic diagram of a trajectory image before rotation correction in a comparative example. FIG. [Figure 7] 13 is a schematic diagram of a trajectory image after rotation correction in a comparative example and an image superimposed thereon. FIG. [Figure 8] 11A and 11B are schematic diagrams illustrating an example of a failure of a rotation correction method of a comparative example. [Figure 9A] FIG. 4 is a schematic diagram showing the angle of the example start point as viewed from the image center of the first embodiment. [Figure 9B] 4 is a schematic diagram showing the angle of the starting point of a trajectory as viewed from the center of the trajectory in the first embodiment. FIG. [Figure 9C] FIG. 4 is a schematic diagram illustrating rotation correction according to the first embodiment. [Figure 9D] FIG. 11 is a schematic diagram showing rotation correction according to Modification 2. [Figure 10A] 4 is a schematic diagram showing a method of approximating an image in the first embodiment with an approximation circle and calculating the center of the approximation circle as the image center. FIG. [Figure 10B] 4 is a schematic diagram showing a method of approximating an image in the first embodiment with an approximation polygon and calculating the center of gravity of the approximation polygon as the center of the image. FIG. [Figure 10C] 13 is a schematic diagram showing a method for calculating the center of gravity of a closed region of an image as the image center in Modification 1. FIG. [Figure 10D] FIG. 11 is a schematic diagram showing a method for calculating the center of a circumscribing circle of an image in Modification 1 as the image center. [Figure 11] 13 is a flowchart showing the process from when the CPU displays a movement start screen to when it displays a result screen in the second embodiment. [Figure 12] 13 is a model information database that stores the correspondence between images and center calculation methods, etc. according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] The users of the present invention are assumed to be an operator who operates an information terminal and a player who draws a trajectory. The operator and the player may be the same person, or may be different people. For example, in a case where a parent lets a small child play, the parent may operate the information terminal as the operator, and the child may draw a trajectory as the player. If the child is of school age, the child may act as both the operator and the player.

[0010] The operator or player checks a model image (hereinafter also referred to as a model image) displayed on the screen (display unit) of the information terminal. The operator operates the information terminal to start acquiring a trajectory, and the player moves while holding the information terminal equipped with sensors such as an acceleration sensor so as to draw the same figure as the image. When the player returns to the point where the path acquisition started, the operator performs an operation to end the path acquisition on the information terminal. The information terminal that has ended the path acquisition provides the player with gameplay by displaying the image and the path so that the matching rate between them can be visually confirmed, or by converting the matching rate into a score.

[0011] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. Note that each drawing is merely a schematic illustration to allow a sufficient understanding of the present invention. Therefore, the present invention is not limited to the illustrated examples. In addition, in each drawing, common or similar components are given the same reference numerals, and duplicated explanations thereof will be omitted.

[0012] <Embodiment 1> (Information terminal configuration) FIG. 1 is a system diagram showing an example of the configuration of an information terminal 1. As shown in FIG. The information terminal 1 of this embodiment includes a CPU (Central Processing Unit) 100, a ROM (Read Only Memory) 110, an acceleration sensor 120, an angular acceleration sensor 130, a geomagnetic sensor 140, a speaker 150, a touch panel display (screen, display unit) 160, a RAM (Random Access Memory) 170, and a flash memory 180. These configurations are known configurations that are generally included in information terminals.

[0013] The CPU 100 executes programs stored in a flash memory 180 or a ROM 110 which is a read-only non-volatile memory, and reads and writes data using a RAM 170 which is a volatile memory that can be read and written at high speed as a working area. The flash memory 180 is a readable / writable non-volatile memory, and stores a movement trajectory detection program 181. Details of the movement trajectory detection program 181 will be described later with reference to FIG.

[0014] The acceleration sensor 120, the angular acceleration sensor 130, and the geomagnetic sensor 140 are movement information acquisition means (movement information acquisition section) of the information terminal 1. The acceleration sensor 120 is a sensor that measures the three-axis acceleration of the information terminal 1, and can measure not only the acceleration due to the movement of the player holding the information terminal 1, but also the gravitational acceleration. The angular acceleration sensor 130 is a type of inertial sensor, and measures the three-axis angular acceleration of the information terminal 1. The geomagnetic sensor 140 detects the geomagnetism to measure the direction in which the information terminal 1 is facing. Since the movement information acquisition means can acquire changes in the position information of the information terminal 1, the movement information acquisition means is also referred to as position information acquisition means.

[0015] The speaker 150 operates as a notification means for notifying the operator or player of information by sound. The touch panel display 160 is the screen of the information terminal 1, and is, for example, a transparent touch panel laminated on a liquid crystal display or an organic EL display, and operates as a display operation means. Note that this embodiment can operate without using the angular acceleration sensor 130 and the speaker 150 of the above configuration.

[0016] However, if angular acceleration information is obtained using angular acceleration sensor 130, more accurate movement information can be obtained. Information terminal 1 may be equipped with a sensor other than the above as a movement information acquisition means to obtain more accurate movement information. Also, if information is notified using speaker 150, it is possible to attract the user's attention more than if the information is notified only by a change in screen 160.

[0017] In this way, by equipping the information terminal 1 with a movement information acquisition means, the operator or player does not need to prepare a terminal equipped with the movement information acquisition means separately from the information terminal 1, and can easily draw a trajectory.

[0018] (Screen transition) FIG. 2A is a schematic diagram of a movement start screen 500 in this embodiment. 2A on the touch panel display 160 of the information terminal 1. The movement start screen 500 displays the example image 300, an initial message 501, an acquisition start button 201, a start point icon 600, and an example start point 601.

[0019] The model image 300 is drawn based on data acquired from a network or data stored in the flash memory 180 or the like. In all the following embodiments, the model image 300 is a continuous figure with the start point and end point coinciding. The CPU 100 may have an image change function for changing the model image 300 to be displayed when the operator or player desires to use a different image. With the image change function, the operator can select an image with a level of difficulty according to the player's ability. The image change function may display images randomly or may allow the operator to select an image from a plurality of candidate images. The start point icon 600 is an icon indicating the start point for drawing the model image 300.

[0020] The initial message 501 displays a message encouraging the user to start measuring the movement trajectory according to the expected age of the operator or player. Since the expected age of the player is a young child, the initial message 501 displays the text "Let's draw this picture on the ground."

[0021] When the operator taps the acquisition start button 201 at a certain point, the CPU 100 (trajectory information acquisition unit) transitions the screen 160 to a trajectory information acquisition screen 510 (see FIG. 2B ) and starts acquiring trajectory information with the point as the starting point. While holding the information terminal 1, the player moves so that the movement trajectory draws the figure of the model image 300.

[0022] FIG. 2B is a schematic diagram of a trajectory information acquisition screen 510 according to this embodiment. On the trajectory information acquisition screen 510, the example image 300, a trajectory information acquisition message 511, the acquisition end button 202, a start point icon 600, and an example start point 601 are displayed. The message 511 indicates that a path is being acquired, and is displayed according to the expected age of the operator or player. Since the expected age of the player is a young child, the message 511 indicates that the path is being acquired.

[0023] When the player finishes drawing the trajectory and returns to the starting point, the operator taps the acquisition end button 202. Upon detecting the tap of the acquisition end button 202, the CPU 100 ends the acquisition of the trajectory information and calculates (derives) the trajectory image 400 based on the acquired trajectory information. After the calculation (derivation) of the trajectory image 400 is completed, the CPU 100 (result display unit) transitions the screen 160 to a result screen 520 (see FIG. 2C).

[0024] 2C is a schematic diagram of the result screen 520 of the present embodiment. The result screen 520 displays the model image 300, the trajectory image 400, the score 521, the button 203, the start point icon 600, and the model start point 601. Note that the result screen 520 only needs to display the model image 300, the trajectory image 400, and the button 203 at the very least, and may have a simple mode in which the score 521 is not displayed.

[0025] The model image 300 and the trajectory image 400 are displayed in a manner that allows them to be distinguished from each other so that the matching rate between the two can be easily recognized visually. To achieve this, for example, the two images may be displayed with different colors, thicknesses, or types of lines. The model image 300 and the trajectory image 400 may be displayed overlapping each other or side by side.

[0026] After the calculation (derivation) of the trajectory image 400 is completed, the CPU 100 (determination unit) determines the matching rate between the model image 300 and the trajectory image 400 and converts it into a score. The CPU 100 (score display unit) displays this score as a score 521 on a result screen 520. By converting the matching rate into a score, it is possible to provide the player with a way of playing, such as aiming for a high score.

[0027] The button 203 transitions to the movement start screen 500 to start drawing the trajectory again. The button 203 is not limited to this, and may be a button for terminating the movement trajectory detection program 181, or may have other functions, or may be a plurality of buttons.

[0028] (Processing flow) 3 is a flowchart showing the process from when the CPU 100 of this embodiment displays the movement start screen 500 on the touch panel display 160 of the information terminal 1 to when the CPU 100 displays the result screen 520. First, the CPU 100 displays the movement start screen 500 (step S10). When the CPU 100 detects a tap on the acquisition start button 201 (step S11: Yes), it displays the trajectory information acquisition screen 510 (step S12). Specifically, in step S10, when the operator taps the acquisition start button 201 on the movement start screen 500, the screen transitions to the trajectory information acquisition screen 510. The player is handed the information terminal 1 on which the acquisition start button 201 has been tapped by the operator and starts moving. At this time, the player moves while fixing the orientation of the information terminal 1 by, for example, putting the information terminal 1 in a pocket and holding it.

[0029] CPU 100 continues to acquire the player's movement information and acquire trajectory information based on the movement information until it detects a tap on acquisition end button 202 (step S13). Specifically, CPU 100 acquires acceleration information from acceleration sensor 120 and geomagnetic information from geomagnetic sensor 140 of information terminal 1 held by the player with its orientation fixed. CPU 100 continues to acquire information on changes over time in the player's moving direction, step count information, and stride length information based on the geomagnetic information and acceleration information. At this time, CPU 100 may acquire angular acceleration information from angular acceleration sensor 130, or information obtained from other sensors. By using these pieces of information in combination, more accurate trajectory information can be obtained.

[0030] When a tap on the acquisition end button 202 is detected (step S14: Yes), the CPU 100 ends acquisition of the trajectory information, and calculates (derives) a pre-correction trajectory image 420 (see FIG. 4) based on the trajectory information (step S15). A specific flow of the game is assumed to be that the operator who receives the information terminal 1 from the player who has finished drawing the trajectory and returned to the starting point taps the acquisition end button 202 on the trajectory information acquisition screen 510.

[0031] The acquisition of trajectory information may end not only when a tap of the acquisition end button 202 is detected, but also when a predetermined time (time limit) has elapsed since a tap of the acquisition start button 201 was detected (step S11: Yes). If the acquisition end button 202 is not tapped until the time limit has elapsed, it is preferable to display an error screen indicating that time has expired. By setting a time limit in this way, the difficulty of the game can be increased, providing the player with more interest.

[0032] When the acquisition end button 202 is tapped, the CPU 100 calculates (derives) a pre-correction trajectory image 420 based on the trajectory information acquired in step S13. In this embodiment, the pre-correction trajectory image 420 is calculated (derived) by drawing a line in the moving direction of the player, the line being a moving distance based on the stride information and step count information of the player, based on information on a change over time in the moving direction of the player.

[0033] Because the pre-correction trajectory image 420 may be calculated (derived) in a shape in which the start point and the end point do not match due to the accumulation of measurement errors, the CPU 100 performs a correction on the pre-correction trajectory image 420 to match the start point and the end point (step S16). The details of the correction to match the start point and the end point will be described later with reference to FIG. 4. In this manner, steps S11 to S16 obtain a trajectory image (trajectory image before rotation correction) 421 in which the start point and the end point match. The CPU 100 performs rotation correction on the pre-rotation correction trajectory image 421 in steps S17A to S20.

[0034] The CPU 100 calculates (derives) the model center 310 of the model image 300 shown in Fig. 9A (step S17A). Furthermore, the CPU 100 calculates (derives) the trajectory center 410 of the trajectory image 421 before rotation correction shown in Fig. 9B (step S17B). The CPU 100 moves the trajectory image 421 before rotation correction so that the trajectory center 410 coincides with the model center 310 (step S18). In other words, in step S18, the CPU 100 aligns the trajectory center 410 with the model center 310.

[0035] In order to align the orientations of the model image 300 and the trajectory image 400, the CPU 100 calculates (derives) the angle (see FIG. 9B) of the reference point of the trajectory image 421 before rotation correction as viewed from the trajectory center 410 with respect to the reference point of the model image 300 as viewed from the model center 310, that is, the rotation angle θ (step S19A). In this embodiment, the reference point of the model image 300 is the model start point 601, and the reference point of the trajectory image 421 before rotation correction is the trajectory start point 611. The CPU 100 performs rotation correction of the trajectory image 421 before rotation correction based on the rotation angle θ, specifically, rotates the trajectory image 421 before rotation correction in the opposite direction by the rotation angle θ with respect to the trajectory center 410, to calculate (derive) the trajectory image 400 (step S20). At this time, the trajectory image 400 may be calculated (derived) by rotating the trajectory image 421 before the rotation correction in the forward direction by the angle -θ about the trajectory center 410. Details of the rotation correction in steps S17A to S20 will be described later with reference to Figs. 5 to 10D.

[0036] After completing the rotation correction of the trajectory image 400, the CPU 100 corrects the size of the trajectory image 400 (step S21). Specifically, the trajectory image 400 is enlarged or reduced so that the distance from the model center 310 to the model start point 601 matches the distance from the trajectory center 410 to the trajectory start point 611. By correcting the size of the trajectory image 400 in this way, the player can freely enjoy drawing without being conscious of the size of the trajectory he or she is drawing.

[0037] Note that the size of the trajectory image 400 may be included in the evaluation of the matching rate described later in step S22 without correcting the size in step S21. If the size of the trajectory image 400 is included in the evaluation, it becomes possible to increase the difficulty of the game or encourage the player to exercise according to the player's athletic ability.

[0038] The CPU 100 evaluates and scores the matching rate between the example image 300 and the trajectory image 400 (step S22). In this embodiment, tens to hundreds of patterns of correct images that can be drawn by machine learning are stored in a server or the like on a network, and the CPU 100 compares the correct images with the trajectory image 400 and evaluates the matching rate of the shapes.

[0039] When the size of the trajectory image 400 is not corrected in step S20 and the matching rate between the sizes of the trajectory image 400 and the model image 300 is added to the scoring factors, the CPU 100 may display scale information indicating the correspondence between the model image 300 and the actual movement distance on the movement start screen 500 in FIG. 2A and the trajectory information acquisition screen 510 in FIG. 2B. By displaying the scale information, the player can be encouraged to perform a predetermined whole-body exercise. For example, it is possible to make the player move around in a wide range to increase the amount of exercise, or to move around in a narrow range according to the athletic ability.

[0040] After the matching rate has been scored, the CPU 100 displays an image in which the model image 300 and the corrected trajectory image 400 are superimposed on the result screen 520, as well as the scoring results (step S23). The CPU 100 may simply display the model image 300 and the corrected trajectory image 400 for comparison, without scoring the pass rate in step S21.

[0041] If it takes time to calculate (derive) the trajectory image 400 or to score the matching rate, a transition to a screen informing the progress of background processing such as "Scoring" may be made, or a message with the same content may be displayed, before displaying the result screen 520. By informing the progress of background processing, it is possible to eliminate anxiety of the operator or player that the program may have frozen.

[0042] As described above, the movement trajectory detection program of the present embodiment can provide the player with a gaming experience by evaluating the matching rate between the image and the player's movement trajectory, thereby encouraging the player to exercise the whole body.

[0043] (Correction to match start and end points) Next, the correction process for matching the start point and end point of the pre-correction trajectory image 420 in step S16 in FIG. 3 will be described. Fig. 4 is a schematic diagram showing a correction for matching the start point and end point of a trajectory image 420 before correction. Fig. 4 shows a trajectory image 420 before correction, a trajectory image after correction (trajectory image before rotation correction) 421, a trajectory start point 611, and a trajectory end point 612. The arrows in the figure indicate the movement amount (hereinafter also referred to as the correction length) for transforming the trajectory image 420 before correction into the trajectory image 421 before rotation correction. The reason why such a correction may be beneficial will be explained below.

[0044] The start point and end point of the model image 300 match, and the acquisition end button 202 is tapped when the player returns to the movement start point. However, when the pre-correction trajectory image 420 is calculated (derived) based on information on the change over time of the player's moving direction as in step S15, there is a risk that measurement errors will accumulate in the information on the change over time as the player moves forward. If measurement errors accumulate, there is a risk that the start point and end point of the pre-correction trajectory image 420 will no longer match, even though the acquisition end button 202 was tapped at the movement start point. In such a case, it is beneficial to perform a correction to match the start point and end point as in step S16.

[0045] It is considered that the deviation between the actual player's movement trajectory and the trajectory image 420 before correction accumulates as the player's movement distance increases. Therefore, as shown in Fig. 4, the overall shape of the trajectory image 420 before correction is corrected so that the correction length becomes longer as it approaches the trajectory end point 612 from the trajectory start point 611. By performing the correction in this manner, it is possible to obtain a trajectory image 421 before rotation correction that is similar to the actual player's movement trajectory.

[0046] (Rotation correction) Next, the details of the rotation correction method in steps S17A to S20 in Fig. 3 will be described in comparison with a comparative example. The rotation correction method of the comparative example will be described with reference to Figs. 5 to 8, and the rotation correction method of this embodiment will be described with reference to Figs. 9A to 10D.

[0047] The reason for performing the rotation correction is as follows. When the trajectory image 421 before the rotation correction is calculated (derived) based on the information on the change over time of the moving direction of the player as in this embodiment, the deviation between the direction in which the player starts walking from the trajectory start point 611 and the starting direction of the model image 300 is detected as the rotation of the entire trajectory image 421 before the rotation correction. For example, in a figure having a diagonal starting direction such as the model image 300 of "Fox" shown in FIG. 2A, it is difficult to start walking in an accurate direction by eye, and in many cases the trajectory image 421 before the rotation correction can be calculated (derived) as a rotated shape. In this way, the matching rate between the trajectory image 421 before the rotation correction and the model image 300 tends to decrease due to rotation, and if the trajectory image 421 before the rotation correction is used as the trajectory image 400 as it is, there is a risk that the player will be dissatisfied with the evaluation result of the matching rate. In this way, rotation correction is performed to prevent a decrease in the matching rate between the model image 300 and the trajectory image 400 due to rotation from ruining the player's interest.

[0048] (Rotation correction for comparison) A rotation correction method of the comparative example will be described. In the rotation correction method of the comparative example, the trajectory image 400 is obtained by rotating the trajectory image 421 before rotation correction by the rotation angle Φ between the player's walking direction and the writing direction 602 of the example image 300. In other words, the trajectory image 400 is obtained by aligning the player's walking direction with the writing direction 602.

[0049] Fig. 5 is a schematic diagram of a movement start screen 500 of a comparative example. The difference from Fig. 2A described above is that the shape of the example image 300 is a rectangle for ease of explanation, and the example image 300 has a writing direction 602. In the comparative example, the angle of the writing direction 602 is defined as 0 degrees.

[0050] 6A and 6B show schematic diagrams of trajectory image 421 before rotation correction in a comparative example. The rotation angle Φ with respect to writing direction 602 in FIG. 6A is 315 degrees. Therefore, CPU 100 rotates trajectory image 421 before rotation correction in FIG. 6A by 315 degrees to obtain trajectory image 400. The rotation angle Φ with respect to writing direction 602 in FIG. 6B is 45 degrees. Therefore, CPU 100 rotates trajectory image 421 before rotation correction in FIG. 6B by 315 degrees to obtain trajectory image 400. The results are shown in FIG. 7. FIG. 7 is a schematic diagram in which trajectory image 400 after rotation correction and model image 300 are superimposed.

[0051] In this way, the rotation correction method of the comparative example can perform appropriate rotation correction for a figure that is made up of a combination of straight lines. However, in the rotation correction method of the comparative example, since the rotation angle Φ is determined by the direction in which the player starts walking, when the model image 300 has a curved beginning, etc., and it is difficult to start walking in the correct direction by eye, the rotation correction may not be performed correctly.

[0052] FIG. 8 shows an example of a failed rotation correction method of the comparative example. The model image 300 in FIG. 8 has a model start point 601 in the "chin" of the model image 300 imitating a "fox". FIG. 8 shows a case where the "chin" of the trajectory image 421 before rotation correction drawn by the player draws a gentler curve than the model image 300 for this model image 300. In this case, the rotation angle Φ calculated (derived) from the starting direction of the player's walk is smaller than the rotation angle actually required, and an inclined trajectory image 400 is obtained. In this way, in the model image 300 with a curved start, as shown in FIG. 8, even though the outline of the trajectory image 400 drawn by the player is similar to the model image 300, the matching rate between the two may be evaluated as low. Therefore, such a rotation correction method may cause dissatisfaction among players.

[0053] In addition, in the method of rotation correction of the comparative example in which the angle of the writing direction 602 is defined as 0 degrees, if the player draws a trajectory in the reverse order of the strokes indicated by the writing direction 602, an upside-down trajectory image 400 is calculated (derived). In the spirit of the game, which is to enjoy drawing by the trajectory of movement, the stroke order is not an essential element, and if the score is significantly reduced due to the stroke order, it may dampen the interest of the player.

[0054] (Rotation correction in this embodiment) In order to solve the problem in the comparative example, in this embodiment, the model center 310 and the trajectory center 410 are calculated (derived) as in steps S17A to S20 in Fig. 3, and the angle of the trajectory start point 611 seen from the trajectory center 410 with respect to the model start point 601 seen from the model center 310 is calculated (derived) as the rotation angle θ. Then, the trajectory image 421 before rotation correction is rotated in the opposite direction by the rotation angle with respect to the trajectory center 410 to obtain the trajectory image 400.

[0055] The calculation (derivation) of the model center 310 and the calculation (derivation) of the angle θ1 of the model starting point 601 viewed from the model center 310 in step S17A of FIG. 3 will be described. The model center 310 and the trajectory center 410 are calculated (derived) by a common predetermined center calculation method (center derivation method). In this embodiment, the predetermined center calculation method (center derivation method) can be changed from the settings. The center calculation method (center derivation method) can be various methods as long as the model center 310 and the trajectory center 410 that do not seem strange to the operator or player are calculated (derived) as the centers of the model image 300 and the trajectory image 421 before rotation correction, which are the objects of the center calculation (derivation). Various specific examples of the center calculation method (center derivation method) will be described later with reference to FIG. 10A to FIG. 10D as modified examples of this embodiment.

[0056] Based on the calculated (derived) model center 310, the CPU 100 calculates (derives) the angle θ1 of the model starting point 601 as viewed from the model center 310. Fig. 9A is a schematic diagram showing the angle θ1. The angle θ1 can be calculated by the following formula (1) when the coordinates of the model center 310 are (xa, ya) and the coordinates of the model starting point 601 are (xb, yb).

[0057]

number

[0058] Next, the calculation (derivation) of trajectory center 410 in step S17B of FIG. 3 and the calculation (derivation) of angle θ2 of trajectory starting point 611 viewed from trajectory center 410 will be described with reference to FIG. 9B. The trajectory center 410 is calculated (derived) in the same manner as the example center 310 in step S17A of Fig. 3. Based on the calculated (derived) trajectory center 410, the CPU 100 calculates (derives) the angle θ2 of the trajectory start point 611 as viewed from the trajectory center 410. Fig. 9B is a schematic diagram showing the angle θ2. The angle θ2 can be calculated by the following formula (2) when the coordinates of the trajectory center 410 are (xc, yc) and the coordinates of the trajectory start point 611 are (xd, yd).

[0059]

number

[0060] 9C is a schematic diagram of rotation correction using a rotation angle θ, which is the difference between angle θ2 and angle θ1. CPU 100 calculates (derives) a rotation angle θ of trajectory image 421 before rotation correction using the following formula (3). Then, trajectory image 421 before rotation correction is rotated in the opposite direction by the rotation angle θ about trajectory center 410 to obtain trajectory image 400.

[0061]

number

[0062] In the method of rotation correction of this embodiment, the rotation angle θ is calculated (derived) based on the angle of the reference point as seen from the center of the figure, so that even when a model image 300 with a curved beginning is used, the path image 400 with the same direction as the model image 300 can be calculated (derived). Since the model image 300 with a curved beginning can be adopted, the player can select model images 300 of various shapes, which further increases the interest of the player. In addition, according to the method of rotation correction of this embodiment, the rotation correction can be performed regardless of the stroke order of the player. Furthermore, the size correction process after the rotation correction process can be easily performed using the relationship between the model center 310 and the model start point 601 and the relationship between the path center 410 and the path start point 611 calculated (derived) for the rotation correction. In addition, since there is no need to additionally register information about the model image 300 in order to perform the rotation correction, the model image 300 can be easily additionally implemented.

[0063] <Variation 1> Four specific examples will be described as modified examples of the center calculation method (center derivation method). Fig. 10A is a schematic diagram showing a method of approximating the model image 300 of "Fox" as in the first embodiment with an approximation circle 3000 and calculating (deriving) the center of the approximation circle 3000 as the model center 310. Fig. 10B is a schematic diagram showing a method of approximating the model image 300 of "Fox" with an approximation polygon 3001 and calculating (deriving) the center of gravity of the approximation polygon 3001 as the model center 310. According to the methods shown in Figs. 10A and 10B, the amount of calculation can be reduced, especially when the model image 300 is a complex figure.

[0064] Fig. 10C is a schematic diagram showing a method for calculating (deriving) the center of gravity of the closed area of ​​the "cherry" model image 301 as the model center 311. If the model image 300 is mostly made up of closed areas, it is considered that the center of gravity of the closed area of ​​the model image 300 and the geometric center of the model image 300 are almost the same, so that an appropriate model center 310 can be calculated (derived) by the method shown in Fig. 10C.

[0065] FIG. 10D is a schematic diagram showing a method of calculating (deriving) the center of a circumscribing circle of a "cherry" model image 301 as a model center 312. Note that the model image 301 may be approximated by a circumscribing polygon instead of a circumscribing circle. The method shown in FIG. 10D enables correction in consideration of the direction in which the string-like portion extends, even for a model image 301 such as the "cherry" in FIG. 10D, in which a feature point is a string-like portion extending long from a closed region. According to the method shown in FIG. 10D, a model center 312 that does not seem strange to an operator or player can be calculated (derived) even for a figure such as the figure "8".

[0066] According to the rotation correction method of this embodiment, a center calculation method (center derivation method) can be set according to the purpose. Setting a center calculation method (center derivation method) according to the purpose means, for example, when most of the model images 300 are figures that are mostly occupied by closed regions, calculation (deriving) is performed with the center of gravity of the closed region of the center calculation target image as the center, and when it is desired to reduce the amount of calculation for rotation correction, calculation (deriving) is performed with the center of the polygon or circle approximating the target of center calculation.

[0067] <Variation 2> A modified example of the rotation correction will be described. FIG. 9D is a schematic diagram of the rotation correction for rotating the model image 300. In this modified example, the angle θ1 (see FIG. 9A) of the model start point 601 seen from the model center 310 and the angle θ2 (see FIG. 9B) of the trajectory start point 611 seen from the trajectory center 410 are calculated (derived) in the same manner as in the first embodiment, and then θ2-θ1 is set as the rotation angle θ. That is, in this modified example, the model image 300 is rotated, so that the rotation direction is opposite to that of the first embodiment. After calculating the rotation angle θ, the CPU 100 rotates the model image 300 in the reverse direction by the rotation angle θ, or rotates it in the forward direction by the angle -θ, thereby performing the rotation correction of the model image 300 and calculating (deriving) the model image 302 after the rotation. In this modified example, the model image 302 after the rotation and the trajectory image 421 before the rotation correction are displayed on the result screen in a manner that allows comparison.

[0068] The rotation correction of this modified example allows the operator and the player to visually see how the trajectory of the player's movement is acquired by the movement trajectory detection program by displaying the trajectory image 421 before rotation correction without applying any rotation correction, while the rotation correction applied to the model image 300 makes it possible to evaluate the matching rate independent of the player's starting angle, etc.

[0069] <Embodiment 2> 11 is a flowchart showing the process from when the CPU 100 of the second embodiment displays the movement start screen 500 on the touch panel display 160 of the information terminal 1 to when the CPU 100 displays the result screen 520. The main difference from the first embodiment is that the process of step S17 in FIG. 3 in the second embodiment, that is, the calculation (deriving) process of the model center 310 and the angle θ1 of the model start point 601 viewed from the model center 310, is not performed in the movement trajectory detection program. In this embodiment, the model center 310 is calculated (derived) in advance by a center calculation method (center derivation method) suitable for the model image 300, and the angle θ1 of the model start point 601 viewed from the model center 310 is also calculated (derived) in advance based on the calculated (derived) model center 310, and is stored in the model information database 700 that stores the correspondence between the model image 300 and the center calculation method (center derivation method), etc.

[0070] Model information database 700 is shown in Fig. 12. Model information database 700 stores image name 701, center calculation method (center derivation method) 702, and central angle (angle of the starting point seen from the center) 703. The image name 701 stores the name of the model image 300, the center calculation method (center derivation method) 702 stores the name of the center calculation method (center derivation method) corresponding to the model image 300, and the central angle 703 stores the angle θ1 of the model starting point 601 seen from the model center 310. For example, the center calculation method (center derivation method) suitable for the image name "Fox" is "center of gravity of closed area," and the angle of the starting point seen from the center is "90 degrees" (see Fig. 9A). The center calculation method (center derivation method) suitable for the example image 300 with the image name "cherry" is "center of circumscribing circle," and the angle of the starting point as viewed from the center is "120 degrees" (see FIG. 10D).

[0071] In this embodiment, the rotation correction is performed by referring to the model information database 700. A specific flow is shown below. After calculating (deriving) the trajectory image 421 before the rotation correction as in the first embodiment (steps S10 to S16), the CPU 100 reads the center calculation method (center derivation method) 702 linked to the model image 300 from the model information database 700, and calculates (derives) the trajectory center 410 by the center calculation method (center derivation method) (step S17). Next, the CPU 100 aligns the trajectory center 410 with the model center 310 as in the first embodiment (step S18).

[0072] The CPU 100 calculates (derives) the angle θ2 of the trajectory start point 611 as viewed from the trajectory center 410, and for the angle θ1 of the model start point 601 as viewed from the model center 310, acquires the central angle 703 from the model information database 700, and calculates (derives) the rotation angle θ from the difference between the angle θ1 and the angle θ2 (step S19). The method of calculating (deriving) the angle θ2 is the same as in the first embodiment. Thereafter, the processes from the rotation of the trajectory image 421 before rotation correction to the display of the result screen are the same as steps S20 to S23 in the first embodiment.

[0073] According to the method of this embodiment, a center calculation method (center derivation method) suitable for the shape of each model image 300 is adopted, and rotation correction that is more natural for the player can be realized. In addition, since the angle θ1 of the model start point 601 viewed from the model center 310 is not calculated (derived) during the movement trajectory detection program, the amount of calculation of the movement trajectory detection program can be reduced.

[0074] <Modification 3> As a modified example of the first and second embodiments, a movement information acquiring means such as the acceleration sensor 120 and the geomagnetic sensor 140 is mounted on a terminal separate from the information terminal 1, and the player moves while holding the separate terminal. In this manner, in which the movement information acquiring means is held by the player as a separate terminal, the player does not need to hold the information terminal 1, and it is possible to prevent a player of an assumed age of a small child from falling or dropping the information terminal 1 and damaging the information terminal 1.

[0075] [Note] 《Claim 1》 A computer that is an information terminal equipped with a screen and a movement information acquisition means, A step of displaying a sample image and a starting point of the sample image on the screen; A step of acquiring trajectory information using the movement information acquisition means; calculating a two-dimensional trajectory image based on the trajectory information; A step of calculating the center of the trajectory image by the same center calculation method as the center calculation method of the example image; A step of superimposing a center of the example image and a center of the trajectory image; A step of calculating an angle of a start point of the trajectory as viewed from the center of the trajectory image with respect to a start point of the example image as viewed from the center of the example image; performing a rotation correction on the trajectory image based on the angle; a step of displaying the example image and the trajectory image on the screen so as to be comparable; A movement trajectory detection program for executing the above. 《Claim 2》 2. The movement trajectory detection program according to claim 1, further comprising a step of causing a computer to execute a procedure of reading out the correspondence between the example image and the center calculation method from a storage unit. 《Claim 3》 The movement trajectory detection program according to claim 1 or 2, characterized in that the program causes a computer to execute a procedure of enlarging or reducing the trajectory image so that the distance from the center of the example image to the starting point matches the distance from the center of the trajectory image to the starting point. 《Claim 4》 4. The trajectory detection program according to claim 1, wherein the center calculation method is a method of calculating a center of gravity of a closed area of ​​an image as a center of the image. 《Claim 5》 4. The movement trajectory detection program according to claim 1, wherein the center calculation method is a method of approximating an image with a polygon or a circle and calculating the center of the polygon or the circle as the center of the image. 《Claim 6》 4. The trajectory detection program according to claim 1, wherein the center calculation method is a method of calculating a center of a circumscribing polygon or a circumscribing circle of an image as the center of the image. 《Claim 7》 In an information terminal equipped with a screen, a movement information acquisition means, and a control unit, a step of the control unit displaying a model image and a starting point of the model image on the screen; The control unit acquires trajectory information of the information terminal that has moved together with the user's body, using the movement information acquisition means; a step of the control unit calculating a two-dimensional trajectory image based on the trajectory information; The control unit calculates the center of the trajectory image by a center calculation method that is the same as the center calculation method of the example image; The control unit causes a center of the example image and a center of the trajectory image to overlap with each other; a step of the control unit calculating an angle of a start point of the trajectory as viewed from a center of the trajectory image with respect to a start point of the example image as viewed from a center of the example image; a step of the control unit performing a rotation correction on the trajectory image based on the angle; a step of the control unit displaying the example image and the trajectory image on the screen so as to be comparable; A movement trajectory detection method comprising the steps of: 《Claim 8》 An information terminal that moves with a user's body, A display unit for displaying an image; A movement information acquisition unit that acquires movement information of the information terminal; a control unit which, after displaying a model image and a starting point of the model image on the display unit, acquires trajectory information based on the movement information, calculates a trajectory image based on the trajectory information, calculates the center of the trajectory image using a center calculation method identical to the center calculation method of the model image, superimposes the center of the model image and the center of the trajectory image, calculates the angle of the starting point of the trajectory as viewed from the center of the trajectory image relative to the starting point of the model image as viewed from the center of the model image, and performs rotation correction on the trajectory image based on the angle to display the model image and the trajectory image on the display unit so that they can be compared; An information terminal comprising: 《Claim 9》 A computer that is an information terminal equipped with a display unit, Steps to display example images: A step of acquiring a two-dimensional trajectory image representing a trajectory of a user within a predetermined time from a movement information acquisition means; a step of superimposing a center of the example image and a center of the trajectory image to derive an angle of a reference point of either the trajectory image or the example image as viewed from the center with respect to a reference point of the other image as viewed from the center; a step of rotating one of the trajectory image and the example image by the angle with respect to the center of superposition; a step of displaying the example image and the trajectory image on the display unit so as to be comparable; A movement trajectory detection program for executing the above. 《Claim 10》 The reference point of the example image is a starting point indicating a position where drawing of the example image begins, 10. The movement trajectory detection program according to claim 9, wherein a reference point of the trajectory image is a starting point of the user's trajectory. 《Claim 11》 11. The movement trajectory detection program according to claim 9, further comprising a step of causing a computer to execute a procedure for deriving the center of the trajectory image by the same center deriving method as the center deriving method of the example image. 《Claim 12》 12. The trajectory detection program according to claim 11, wherein the center derivation method is a method of deriving a center of gravity of a closed area of ​​an image as the center of the image. 《Claim 13》 12. The program according to claim 11, wherein the center deriving method is a method of approximating an image with a polygon or a circle, and deriving a center of the polygon or the circle as the center of the image. 《Claim 14》 12. The program according to claim 11, wherein the center derivation method is a method of deriving a center of a circumscribing polygon or a circumscribing circle of an image as the center of the image. [Explanation of symbols]

[0076] 1 Information terminal 100 CPU 110 ROM 120 Acceleration sensor (movement information acquisition means) (movement information acquisition unit) 130 Angular acceleration sensor (movement information acquisition means) (movement information acquisition unit) 140 geomagnetic sensor (movement information acquisition means) (movement information acquisition unit) 150 speakers 160 Touch panel display (screen) (display unit) 170 RAM 180 Flash Memory 181 Movement trajectory detection program 201 Start Acquisition Button 202 Acquisition end button 203 Button 204 Back button 300,301,302 Sample images 310,311,312 Model-centered 400 trajectory images 410 Locus center 420 Trajectory image before correction 421 Trajectory image before rotation correction 500 Movement start screen 501 Initial Message 510 Trajectory information acquisition screen 511 Message: Getting track information 520 Results screen 521 points 600 Start Icon 601 Sample starting point (S) 611 Starting point of the trajectory 612 End of track 700 Example information database (storage section) θ,Φ Rotation angle

Claims

1. A mobile terminal having a display unit capable of displaying predetermined information and capable of acquiring a movement trajectory of the mobile terminal based on output information from a predetermined sensor, a question display control means for displaying on the display unit a model movement trajectory that should be drawn by the player's movement while holding the mobile terminal, as a continuous line diagram in which the model start point and the model end point coincide; an acquisition means for acquiring a movement trajectory of a player holding the portable terminal as the actual trajectory when the player moves back to the movement start point in order to draw the line diagram, based on output information from the sensor; a result display control means for causing a drawn figure based on the actual trajectory acquired by the acquisition means to be displayed on the display unit; Equipped with the result display control means derives an angle of a direction of the movement start point seen from the center relative to a direction of the example start point seen from the center when the center of the actual trajectory is superimposed on the center of the line diagram as a rotational deviation angle of the actual trajectory with respect to the line diagram, and displays a corrected trajectory generated by correcting the rotational deviation of the actual trajectory by the derived rotational deviation angle on the display unit as the drawn figure. A mobile terminal characterized by:

2. when the start point of movement of the player and the end point of movement of the player are separated from each other on the actual trajectory when correcting the rotational deviation, the result display control means performs a correction so that the end point of movement is connected to the start point of movement, and then corrects the rotational deviation.

2. The mobile terminal according to claim 1 .

3. When correcting the movement so that the movement end point is connected to the movement start point, the result display control means corrects the movement so that the amount of correction becomes larger as the movement end point approaches.

3. The mobile terminal according to claim 2.

4. An exercise support method executed by a mobile device having a display unit capable of displaying predetermined information and capable of acquiring a movement trajectory of the mobile device based on output information from a predetermined sensor, comprising: a question display control process for displaying on the display unit a model movement trajectory that should be drawn by the player's movement while holding the mobile device, as a continuous line diagram in which the model start point and the model end point coincide; an acquisition process for acquiring a movement trajectory of a player holding the portable device as the actual trajectory when the player moves back to the movement start point in order to draw the line diagram, based on output information from the sensor; a result display control process for displaying on the display unit a drawn figure based on the actual trajectory acquired by the acquisition process; Including, The result display control process derives an angle of a direction of the movement start point seen from the center relative to a direction of the example start point seen from the center when the center of the actual trajectory is superimposed on the center of the line diagram as a rotational deviation angle of the actual trajectory with respect to the line diagram, and displays a corrected trajectory generated by correcting the rotational deviation of the actual trajectory by the derived rotational deviation angle on the display unit as the drawn figure.

13. An exercise support method comprising:

5. A computer of a mobile terminal having a display unit capable of displaying predetermined information and capable of acquiring a movement trajectory of the mobile terminal based on output information from a predetermined sensor, a question display control means for displaying on the display unit a model movement trajectory that should be traced by the player while holding the mobile terminal, as a continuous line diagram in which the model start point and the model end point coincide; an acquisition means for acquiring, as an actual trajectory, a movement trajectory when a player holding the portable terminal moves so as to return to a movement starting point in order to draw the line diagram, based on output information from the sensor; a result display control means for causing a drawn figure based on the actual trajectory acquired by the acquisition means to be displayed on the display unit; Function as a the result display control means derives an angle of a direction of the movement start point seen from the center relative to a direction of the example start point seen from the center when the center of the actual trajectory is superimposed on the center of the line diagram as a rotational deviation angle of the actual trajectory with respect to the line diagram, and displays a corrected trajectory generated by correcting the rotational deviation of the actual trajectory by the derived rotational deviation angle on the display unit as the drawn figure. A program characterized by:

Images