Information processing program, information processing method, and information processing system

Abstract

In the present invention, a processor of an information processing device is caused to guide a user to place a mouse on a floor, cause the user to take an initial posture, and cause the user to change posture by causing the user who has taken the initial posture to move, on the floor, the mouse which was placed on the floor. In addition, the processor is also caused to receive first data relating to movements of the mouse, the first data being output from the mouse. Then, the processor is caused to evaluate the posture change by the user on the basis of the received first data.

Description

Information processing program, information processing method, and information processing system

[0001] The present disclosure relates to information processing that utilizes output from a mouse.

[0002] Conventionally, game processing using a mouse has been known (for example, see Patent Document 1).

[0003] Japanese Patent Application Laid-Open No. 2001-62145

[0004] The above technology leaves room for new uses for the mouse.

[0005] In view of the above, the following configuration example can be given.

[0006] (Configuration 1) Configuration 1 causes a processor of an information processing device to perform the following processes: placing a mouse on the floor, having the user assume an initial posture, and having the user, once in the initial posture, move the mouse placed on the floor across the floor to perform a posture change. Next, first data relating to the movement of the mouse output from the mouse is received. Then, the posture change performed by the user is evaluated based on the received first data.

[0007] According to the above configuration example, a predetermined posture of a user and a change in the posture can be evaluated using a mouse, thereby providing a new way of using a mouse that has not been seen before.

[0008] (Configuration 2) In Configuration 2, in Configuration 1, the processor may evaluate the posture change action based on the first data received after the user, who has assumed the initial posture, starts moving the mouse until it is determined based on the first data that the mouse has stopped.

[0009] According to the above configuration example, the target data for evaluating posture change actions is determined when the mouse stops, which eliminates the need for a separate operation such as pressing a specific button, thereby simplifying user operations.

[0010] (Configuration 3) Configuration 3 is the configuration 2, in which the processor may notify the user by making a predetermined sound that it has been determined that the mouse has stopped.

[0011] According to the above configuration example, it is possible to improve the convenience for the user. For example, depending on the user's posture, the user may be facing the floor, making it difficult to see the screen. Even in such a case, the user can be notified by sound, for example, to let the user know that the evaluation has ended.

[0012] (Configuration 4) In Configuration 4, in any one of Configurations 1 to 3, the mouse may output second data relating to the mouse's posture, and the processor may receive the second data and evaluate the posture change operation based on the received second data and the first data.

[0013] According to the above configuration example, it is possible to evaluate posture changes that cannot be evaluated by mouse movement alone. Alternatively, since data on the mouse posture can be used in combination, the accuracy of the evaluation of posture changes can be improved.

[0014] (Configuration 5) Configuration 5 may be the configuration in which the processor terminates evaluation of the posture change action when it is determined that the mouse has stopped based on the first data and the second data.

[0015] According to the above configuration example, it is possible to improve the accuracy of determining whether the mouse has stopped.

[0016] (Configuration 6) In Configuration 6, in any one of Configurations 1 to 5, the initial posture may be a sitting posture with legs spread on the floor. The processor may then instruct the user to perform, as posture change actions, a first action of moving the mouse forward from the user's crotch along one of the user's right and left legs, a second action of moving the mouse from the position where the mouse was moved forward along one leg toward the other leg, and a third action of moving the mouse from the position where the mouse was moved in the second action toward the user's crotch along the other leg. Furthermore, at least one of the initial posture and the posture change actions may be evaluated based on the first data.

[0017] According to the above configuration example, it is possible to measure the posture and posture change of a user with their legs spread apart, or to measure the size of the area formed on the inside of the legs of a user with their legs spread apart.

[0018] (Configuration 7) Configuration 7 may be any of configurations 1 to 6, in which the processor executes game processing based on the result of the evaluation.

[0019] According to the above configuration example, it is possible to make it interesting for the user to take a predetermined posture or to perform a posture change action.

[0020] According to the present disclosure, it is possible to provide information processing using a new method of using a mouse, such as using a mouse to evaluate a user's posture or an action that changes that posture.

[0021] A block diagram showing an example of the hardware configuration of the information processing device 2. An example of the appearance of the mouse 40. A diagram for explaining the first embodiment. An example of various data stored in the storage unit 22 of the information processing device 2. A flowchart showing details of the processing. A flowchart showing details of the processing. A diagram for explaining the second embodiment. A diagram for explaining the second embodiment. A diagram for explaining the third embodiment.

[0022] [Hardware Configuration of Information Processing Device 2] FIG. 1 is a block diagram showing an example of the hardware configuration of an information processing device 2 according to this embodiment. In FIG. 1, the information processing device 2 includes a processor 21. The processor 21 is an information processing unit that executes various information processes executed by the information processing device 2. In this embodiment, the processor 21 is configured as a System-on-a-Chip (SoC) that includes at least a Central Processing Unit (CPU) function and a Graphics Processing Unit (GPU) function. In other embodiments, the CPU and the GPU may be separate components. The processor 21 executes various information processes by executing an information processing program (e.g., a game program) stored in a storage unit 22. The storage unit 22 may be an internal storage medium such as a flash memory or a Dynamic Random Access Memory (DRAM), or may be configured to use an external storage medium inserted into a slot (not shown). The information processing device may be, for example, a game device, a personal computer, or a server.

[0023] The information processing device 2 also includes a communication unit 23 for communicating with other information processing devices and a predetermined server.

[0024] The information processing device 2 also includes an input device communication unit 24 for wired or wireless communication between the information processing device 2 and various input devices. In this embodiment, a mouse 40 is used as an example of an input device.

[0025] Furthermore, a display unit 30 (e.g., a television) is connected to the information processing device 2 via an image / sound output unit 25. The processor 21 outputs, for example, images and sounds generated by executing the above-described information processing to the display unit 30 via the image / sound output unit 25.

[0026] Fig. 2 is a schematic diagram showing an example of the appearance of the mouse 40. As shown in Fig. 2, the mouse 40 has a plate shape with the y-axis direction as the longitudinal direction (a rectangular parallelepiped or a shape similar thereto, in which the thickness in the x-axis direction is smaller than the thickness in the y-axis direction and the z-axis direction, and the thickness in the z-axis direction is smaller than the thickness in the y-axis direction).

[0027] The mouse 40 includes a sensor (hereinafter referred to as a mouse sensor) that detects operations such as the user sliding the mouse 40 on a work surface (the work surface that the bottom surface contacts in FIG. 2 ). The mouse sensor is provided, for example, so as to be exposed from an opening 43 provided on the bottom surface of the mouse 40. The mouse sensor acquires data for calculating the movement (movement direction, movement distance, movement speed, etc.) of the mouse 40 on the work surface, which is placed with its bottom surface facing the work surface. The mouse sensor is, for example, an optical sensor or a laser sensor. The data acquired by the mouse sensor of the mouse 40 is repeatedly transmitted to the input device communication unit 24 at appropriate timing.

[0028] The mouse 40 also includes an attitude sensor. Specifically, the mouse 40 includes an acceleration sensor (not shown) and an angular velocity sensor (not shown). The acceleration sensor detects the magnitude of acceleration along three predetermined axes (x, y, and z axes shown in FIG. 2). The acceleration sensor may detect acceleration along one or two axes. The angular velocity sensor detects angular velocity around the three predetermined axes (x, y, and z axes shown in FIG. 2). The angular velocity sensor may detect angular velocity around one or two axes. The detection results of the acceleration sensor and the angular velocity sensor are repeatedly transmitted to the input device communication unit 24 at appropriate timing.

[0029] The orientation sensor may be any of a variety of sensors capable of detecting orientation, such as a geomagnetic sensor, or a combination of several sensors. Alternatively, a combination of multiple optical sensors may be used as an orientation sensor. For example, it may be possible to detect whether the mouse has been rotated based on the difference in the detection values ​​of the optical sensors (such as differences in the direction of movement).

[0030] 2, the mouse 40 has a button 41 on its top surface opposite to its bottom surface. The button 41 is located at the end of the top surface, which has its longitudinal direction in the y-axis direction. The user can use the button 41 as a click button. That is, the user can operate the mouse 40 by placing their hand on the top surface of the mouse 40 with their fingers along the y-axis direction. Data indicating the operation state of the button 41 is repeatedly transmitted to the input device communication unit 24 at appropriate times.

[0031] The mouse 40 may also be provided with a vibration device (not shown) that vibrates the mouse 40 .

[0032] First Example Next, a first example of the present disclosure will be described. In the first example, a process will be described in which a user is instructed to assume a predetermined posture (hereinafter, initial posture) on the floor, perform a posture change action (hereinafter, posture change action), and evaluate the posture change action and the posture after the change. A stretching action is one example of such a posture change action. In this embodiment, an example of a stretching action will be described in which the initial posture is a long sitting posture and the upper body is bent forward from this posture (hereinafter, forward bending action). This process then evaluates the degree of forward bending, i.e., the flexibility of the user. The "evaluation" may, for example, simply measure the degree of forward bending (forward bending distance). It may also, for example, evaluate the flexibility level based on the measurement results. Specific examples of this process include not only a simple display of the measurement results of the forward bending distance, but also, for example, a process of calculating a score based on the forward bending distance, or a process of determining parameters based on the forward bending distance and playing a game using the parameters.

[0033] In this process, the user is asked to assume a sitting position as the initial position. FIG. 3 is a top view of the user in the sitting position. Note that the user's torso and hands are omitted from FIG. 3 . Then, in this process, the mouse 40, which is positioned horizontally as seen from the user's perspective, is placed in front of the user's legs, as shown in FIG. 3 . This position is hereinafter referred to as the "initial placement position." The user then places both hands (the fingertips) on the mouse 40. In this state, if the user performs a forward bending motion, the mouse 40, while still in the horizontal position, moves horizontally in the forward direction of the user (the positive x-axis direction in FIG. 3 ), using the floor as a work surface. In other words, the forward bending motion and the movement of the mouse 40 are linked. In this example, the forward bending motion is evaluated based on data related to the movement of the mouse 40. Specifically, the movement distance of the mouse 40 from the initial placement position (forward bending distance, in units of cm, for example) is measured and evaluated.

[0034] [Example of Data Used] Next, a detailed description will be given of an example of processing in Example 1. Fig. 4 is a memory map showing an example of various data stored in the storage unit 22 of the information processing device 2. The storage unit 22 stores a program 601, operation data 602, measurement operation data 606, image data 607, etc.

[0035] The information processing program 601 is a program for executing the above-mentioned processing.

[0036] The operation data 602 is data indicating the operation content performed on the mouse 40. The operation data 602 includes mouse sensor data 603, attitude sensor data 604, and button data 605. The mouse sensor data 603 is data output from the mouse sensor of the mouse 40. The mouse sensor data 603 includes data indicating the amount and direction of movement of the mouse 40 on the work surface. The attitude sensor data 604 is data output from the attitude sensor. In this example, the attitude sensor data 604 includes acceleration data and angular velocity data about three predetermined axes. The button data 605 is data indicating the press state of each of the buttons on the mouse 40.

[0037] The measurement task data 606 is data used to measure the forward bending distance. Specifically, the measurement task data 606 is data for temporarily storing the measurement values ​​output from the start of measurement to the end of measurement (measurement period). In the following explanation of "measurement value," a distinction is made between the total measurement value from the start of measurement to a certain point in time and a so-called instantaneous measurement value measured during a very short period of time, for example, one to several frames. In the following, the total measurement value is referred to as the "total measurement value," and the instantaneous measurement value is referred to as the "instantaneous measurement value." Furthermore, when simply referring to "measurement value," both are collectively referred to.

[0038] The measurement operation data 606 is not limited to directly storing the measurement values, but may store, for example, the mouse sensor data 603 output within the measurement period. In this case, the measurement values ​​may be calculated based on the mouse sensor data 603 within the measurement period.

[0039] The image data 607 is data that is the basis of various images to be displayed on the display unit 30 in the above processing.

[0040] [Flowchart Example] Next, an example of a flowchart of the process in this example will be described. Note that in this example, the flowchart shown below is realized by one or more processors reading and executing a program stored in one or more memories. Furthermore, this flowchart is merely an example of the processing process. Therefore, the processing order of each step may be changed as long as the same results are obtained. Furthermore, the values ​​of variables and thresholds used in the determination steps are merely examples, and other values ​​may be used as necessary.

[0041] 5 and 6 are flowcharts showing the details of the above process. In Fig. 5, first, in step S1, the processor 21 displays a guide screen. The guide screen displays an image instructing the user to assume the initial posture described above and an image instructing the user to place the mouse 40 in the initial placement position. An announcement may be made using sound, including voice.

[0042] Next, in step S2, the processor 21 acquires the operation data 602.

[0043] Next, in step S3, the processor 21 determines, based on the operation data 602, whether or not preparations are complete to start measuring the movement distance of the mouse 40 associated with the forward bending motion (hereinafter, "measurement preparation"). The method for determining measurement preparation is not limited. As an example, measurement preparation may be determined to be complete when the mouse 40 has been stationary for a predetermined period of time or longer since the guide screen was displayed. As another example, measurement preparation may be determined to be complete when a predetermined button is operated after the guide screen is displayed. Note that, when the predetermined button operation is used for the determination, control may be performed such that measurement is started when the predetermined button is pressed and ended when the button is released. In other words, control may be performed such that measurement is performed while the predetermined button is pressed. Note that the following description will discuss an example of control in which measurement is started and ended based on the detection results of the movement of the mouse 40, without using button operation.

[0044] If the result of the above determination is that the measurement is not ready (NO in step S3), the process returns to step S1 and repeats. On the other hand, if the measurement is ready (YES in step S3), then in step S4, the processor 21 displays an image instructing the user to perform a posture change operation. For example, an instruction such as "Bend your upper body forward" is displayed. At this time, an image showing the total measurement value up to the current point in time (hereinafter referred to as the provisional measurement value) is also displayed. The initial value of the provisional measurement value is 0 cm.

[0045] Next, in step S5, the processor 21 acquires the operation data 602.

[0046] Next, in step S6, processor 21 determines whether or not a condition for starting measurement (hereinafter referred to as the measurement start condition) has been met. That is, processor 21 determines, based on mouse sensor data 603, whether or not some movement has occurred from a state in which mouse 40 is stationary (a state in which measurement preparation is complete). In other words, it determines whether or not some input has occurred to the mouse sensor after measurement preparation is complete. If the result of this determination is that the measurement start condition is not met, that is, if mouse 40 remains stationary (NO in step S6), the process returns to step S4 and is repeated.

[0047] On the other hand, if the measurement start condition is met (YES in step S6), processing begins to measure the movement distance of the mouse 40. Specifically, first, in step S7, the processor 21 acquires operation data 602. Next, in step S8, the processor 21 calculates the movement amount of the mouse 40 based on the mouse sensor data 603. Then, the processor 21 calculates the provisional measurement value based on the movement amount. Furthermore, the processor 21 stores the provisional measurement value in the measurement operation data 606.

[0048] Next, in step S9, the processor 21 performs processing to display the provisional measurement value. This allows the user to check the distance traveled from the initial placement position in real time. Displaying the provisional measurement value in this manner also makes it easier for the user to understand what is being measured. It also provides the user with an operating experience similar to that of operating a real measuring instrument, in this case, the sensation of "pressing a measuring instrument."

[0049] Next, in step S10, the processor 21 determines whether a condition for ending measurement (hereinafter, the measurement end condition) has been satisfied. In this example, if the mouse 40 remains stationary for a predetermined period of time or longer, it is assumed that the user has fully extended their hand, and the measurement end condition is determined to have been satisfied. Here, the "mouse stopped state" may be, for example, processed as the mouse being stopped when the average movement amount over a predetermined period of time is equal to or less than a predetermined value. Alternatively, the timing when the instantaneous measurement value falls within a certain range may be considered as the timing when the mouse 40 has stopped. This is because the timing when the instantaneous measurement value falls within a certain range is considered to indicate that the mouse 40 is stationary or close to being stationary. In other embodiments, the following methods may be used to determine whether the measurement end condition has been satisfied. For example, the measurement end condition may be determined to have been satisfied when a predetermined button operation is performed. Alternatively, the measurement end condition may be determined to have been satisfied when it is detected that the mouse 40 has been lifted from the work surface.

[0050] If the measurement termination condition is not satisfied (NO in step S10), the process returns to step S7 and repeats. On the other hand, if the measurement termination condition is satisfied (YES in step S10), in step S11 of FIG. 6 , the processor 21 outputs a predetermined sound indicating the end of measurement. Depending on the user's posture when bending forward, it may be difficult for the user to see the screen. Therefore, by outputting a predetermined sound when measurement ends, the user can easily understand that measurement has ended, even when the user cannot see the screen. Such a sound notification is particularly useful when control is performed to end measurement by determining that the mouse 40 has stopped, without button operation. The end of measurement may be notified via the screen. Furthermore, sound notification may be provided at the start of measurement or during measurement, in addition to or instead of the screen display. For example, during measurement, a sound that becomes higher-pitched may be output as the movement distance increases.

[0051] Next, in step S12, the processor 21 performs a process to determine a final total measurement value (hereinafter, the determined measurement value) based on the measurement operation data 606. In this example, the maximum value of the provisional measurement values ​​during the measurement period (the distance bent forward the furthest) is determined to be the determined measurement value. This assumes, for example, a case where the user bends forward to the highest point and then returns to their original position slightly. Note that in other embodiments, the last provisional measurement value measured may be determined as the determined measurement value.

[0052] Next, in step S13, the processor 21 performs a comparison process based on the final measurement value. This comparison process may, for example, be a process of determining whether the final measurement value is higher or lower than a predetermined value. An example of the predetermined value is a comparison with the average movement distance (forward bending distance) of the mouse 40 for the user's age. For example, in step S9, by displaying the predetermined value together with the provisional measurement value, the user can be presented with an element that can be used as a target for the predetermined value when performing a forward bending movement. Alternatively, a sound may be output to indicate whether the provisional measurement value has exceeded the predetermined value.

[0053] In this way, in the first embodiment, the user is made to assume an initial posture and then change the posture from there. At this time, the movement of this posture change is linked to the movement of the mouse 40. Then, a process is performed to evaluate the changes in the user's posture. This allows the user to use the mouse 40 to evaluate the changes in the user's posture, which is a new way of using the mouse 40 that has not been seen before.

[0054] Second Example Next, a second example of the present disclosure will be described. In the second example, a processing example will be described in which a user is made to assume a certain posture and the posture is evaluated. As an example of a posture to be evaluated in the second example, a leg-spread posture will be described as an example. That is, the user is made to assume a posture in which both legs are spread apart while sitting. Then, this leg-spread angle is evaluated. In other words, this is a process of evaluating the initial posture itself.

[0055] In the second embodiment, the leg spread angle is calculated using the mouse 40 as follows: (1) First, the user places the mouse 40 in front of their crotch (at the base of both legs) with their legs spread apart. (2) Next, the user bends forward while aligning the right side of the mouse 40 along their right leg. As a result, the mouse 40 moves forward along their right leg, as shown in FIG. 7. (3) Next, while still in the forward-bending position, the mouse 40 is moved horizontally from their right leg to their left leg, as shown in FIG. 8. (4) Next, as shown in FIG. 9, the mouse 40 is moved toward the front of their crotch while aligning the left side of the mouse 40 along their left leg. As a result, the mouse 40 moves along their left leg to the front of their crotch. By having the user perform these movements, (A) the distance from the front of the crotch (the base of the foot) to the forward bending position of the right leg (first distance), (B) the distance from the forward bending position of the right leg to the forward bending position of the left leg (second distance), and (C) the distance from the forward bending position of the left leg to the front of the crotch (third distance) can be measured based on the output of the mouse sensor.The leg spread angle is then calculated based on these distances.

[0056] 7 to 9, forward bending as well as the leg spread may be measured simultaneously, or only forward bending may be measured. As an example, forward bending along the right foot and forward bending along the left foot may be measured.

[0057] Furthermore, when performing processing using the triangulation technique, the output data of the posture sensor may be used in combination. For example, based on the output data of the posture sensor, the rotation angle of the mouse 40 around the z-axis when placed along the right leg (right leg angle) and the rotation angle of the mouse 40 around the z-axis when placed along the left leg (left leg angle) are calculated. The rotation angle of the mouse 40 when placed along each leg is considered to approximate the angle at which each leg is spread. Therefore, the leg spread angle may be calculated from these angles. The final leg spread angle may then be calculated from the leg spread angle calculated using the above technique and the leg spread angle calculated based on the posture sensor. For example, the average of the leg spread angles calculated using each technique may be adopted. In this way, using the angle based on the mouse sensor and the angle based on the posture sensor in combination improves measurement accuracy. Furthermore, it becomes possible to evaluate posture changes that are difficult to evaluate based on the movement of the mouse 40 alone. In other embodiments, the leg spread angle may be calculated using only the output of the posture sensor.

[0058] When using a posture sensor, the output data of the posture sensor may be used to detect the "mouse stopped state" that is used as the trigger for starting and stopping the measurement described above. For example, in addition to the mouse not moving, the condition for determining the "stopped state" may be that the posture has not changed for a certain period of time, or if it has changed, the change is very small. This allows for more accurate determination of the start and end timing of the measurement.

[0059] Furthermore, in other embodiments, when a mouse sensor and a posture sensor are used together, the following method may be used to evaluate the user's spread-leg posture. For example, the mouse 40 is placed along the tip of the right leg when the user is in a spread-legged position, and then the mouse 40 is moved from here to the tip of the left leg so that the mouse 40 is placed along the left leg. The leg-spread angle is calculated based on the change in the posture of the mouse 40 at this time. Furthermore, the distance between the right leg and the left leg is calculated based on the movement distance of the mouse at this time. The user's spread-leg posture may then be evaluated based on both of these.

[0060] When only the posture sensor is used, the user may move the mouse 40 in the following manner, for example. First, the mouse 40 is placed in a vertical position as an initial placement position, approximately in the center of the spread legs (e.g., approximately in the center of the line connecting the knees). Next, the mouse 40 is moved toward the right leg and brought into contact with the right leg along the line. Next, the mouse 40 is moved toward the left leg and brought into contact with the left leg along the line. By initially placing the mouse 40 approximately in the center of the spread legs and bringing the mouse 40 into contact with the right leg in this manner, the user can more clearly understand what movement to make. When measuring the leg spread angle using this movement, the measurement may start, for example, when the mouse 40 comes into contact with the right leg (when the mouse temporarily stops). Alternatively, the measurement may start when the mouse starts to move from the initial placement position toward the right leg.

[0061] Furthermore, during the measurement, the movement of the mouse 40 may be displayed on the screen. For example, a screen may be displayed in which the mouse object moves between two leg objects. For example, as the mouse 40 moves toward the right leg, the mouse object may move toward the right leg object. At this time, even though the mouse object touches the right leg object, the actual mouse 40 may still be moving toward the right leg. At this time, in accordance with the movement of the mouse 40, the right leg object and the mouse object in contact with the right leg object may be rotated in a direction that further spreads the legs, i.e., toward the right. The same applies to the left leg object. This allows the user to feel like they are actually doing the leg spread, thereby increasing their motivation to do so. Note that, conversely, if the actual mouse 40 touches the right leg before the mouse object touches the right leg object and stops moving further, the user may feel uncomfortable. Therefore, the leg spread angle of both leg objects on the screen may be set to a relatively small angle so that the mouse objects come into contact with each other when the mouse 40 moves slightly. For example, the mouse object is set at an angle that assumes it will come into contact with the right leg object, and if the movement (angle change) of the mouse 40 stops before the mouse object comes into contact with the right leg object during measurement, it may be determined that there is a measurement error.

[0062] Third Example Next, a third example of the present disclosure will be described. This example is an example of game processing using the leg-spread posture as shown in the second example above. More specifically, this is an example of game processing using a substantially triangular area (hereinafter, triangular area) derived from the leg-spread posture as shown in FIG. 10 . This triangular area can be derived using the method described in the second example above. That is, it is a triangular area with vertices at the crotch position, the forward bending position of the right leg, and the forward bending position of the left leg. Furthermore, because the leg-spread angle and forward bending distance can be different values ​​for each user, the size and shape of the triangular area can also be different for each user. Note that, for example, a fan shape or a trapezoid shape is also included in the substantially triangular shape.

[0063] In this game, before play begins, a process is performed in which the shape and size of the triangular area are determined by having the user move the mouse 40 as shown in Figures 7 to 9. In other words, a process is performed to measure the movable range of the mouse 40. Furthermore, a process is performed in which the triangular area is associated with a portion of the virtual space. For example, the larger the triangular area, the larger the associated area in the virtual space. This association may use the entire triangular area, or only a portion of it. Then, during game play, the user moves the mouse 40 within the associated triangular area to move a virtual object within the area of ​​virtual space corresponding to the triangular area. At this time, the user may be required to perform the forward bending motion described above as an operation to move the mouse 40. In this case, game processing using a spread-leg posture and a forward bending motion can be provided. Note that the shape and size of the associated area in the virtual space may be constant regardless of the shape and size of the triangular area. However, the amount of movement of the virtual object within that area may be changed in response to the amount of movement of the mouse 40 so as to correspond to the measured triangular area or the movable range of the mouse. For example, when the size of the triangular area is large, the movement amount of the virtual object relative to the movement amount of the mouse 40 may be smaller than when the size of the triangular area is small. This allows the virtual object to be moved to every corner of a certain area, regardless of the user's flexibility, for example.

[0064] As a specific example of a game, for example, a user plays the role of a goalkeeper and blocks incoming shots. In this case, the triangular area corresponds to a goal frame in a virtual space. When a shot is coming toward a virtual position within the goal frame in the virtual space, the user moves the mouse 40 to a real position within the triangular area that corresponds to the virtual position, thereby moving a hand object in the virtual space and blocking the shot.

[0065] In such games, depending on the user's posture when bending forward as described above, it may be difficult for the user to see the screen. Therefore, the situation in the game may be notified by sound. For example, the direction of the incoming shot may be notified by sound, or whether or not the shot was caught or blocked may be notified by sound. By using such sound guidance in combination, the enjoyment of the game can be more effectively improved.

[0066] Furthermore, although the shape and size of the corresponding area in the virtual space are changed according to the shape and size of the triangular area in the above description, the shape and size of the area may be constant. In this case, the amount of movement of the virtual object within the area relative to the amount of movement of the mouse 40 may be changed so as to correspond to the measured triangular area or the movable range of the mouse. For example, if the size of the triangular area is large, the amount of movement of the virtual object relative to the amount of movement of the mouse 40 may be smaller than if the size of the triangular area is small. This allows, for example, the virtual object to be moved to every corner of a specified area in the virtual space regardless of the user's flexibility.

[0067] In addition, in this embodiment, the game processing is performed using a triangular area based on the evaluation result, but it is also possible to use an area of ​​another shape, or a range or trajectory, instead of a triangular area. For example, the game processing may be performed using the movement distance and movement range of the mouse 40 based on the user's forward bending motion in the first embodiment.

[0068] [Modifications] In the above embodiment, the mouse sensor detects mouse movement and outputs the direction and amount of movement. In other embodiments, the mouse sensor may output only data related to reflected light from the work surface, and the information processing device 2 may output whether the mouse has moved, the direction and amount of movement, etc. based on the data. In the above example, the information processing device 2 calculates the current position of the mouse in the mouse coordinate system. However, the mouse sensors may calculate the current positions of their respective mice and transmit data related to this to the information processing device 2. Furthermore, neither the information processing device 2 nor the mouse sensor may calculate the current position of the mouse 40. The same applies to the attitude sensor; either the information processing device 2 or the mouse 40 may calculate the actual attitude.

[0069] The shape of the mouse 40 in the above embodiment is merely an example. For example, the mouse 40 may be provided with a grip that allows the user to easily grasp and lift it. As an example, the mouse 40 may be used like a general game controller. In other words, a game controller having a mouse sensor is included in the scope of the mouse 40 of the present disclosure. The mouse 40 may also be attachable to and detachable from other devices.

[0070] As another example of a method for simultaneously measuring the forward bending distance and leg-spread posture as described above, for example, a method may be used in which the user sequentially bends forward with the right leg and then the left leg. Specifically, with the user in a leg-spread state, the user first bends forward by placing the mouse 40 along the right leg. Next, the user (after temporarily returning to the original position) bends forward by placing the mouse 40 along the left leg. With this method as well, the forward bending distance can be measured based on the amount of movement of the mouse 40 during the forward bending, and the leg-spread angle can be calculated based on the position of the mouse 40 when placed along each leg.

[0071] Furthermore, although the above example illustrates the use of only one mouse 40, two mice 40 may be used. In this case, one value may be evaluated using two mice, or each mouse may evaluate a different value. For example, one value, the opening of the hand during forward bending, may be evaluated using two mice, or forward bending along the right leg may be evaluated using one mouse and forward bending along the left leg may be evaluated using the other mouse, either simultaneously or individually.

[0072] Alternatively, the mouse 40 may be provided with a vibrator that is vibrated. In this case, the vibrator may be vibrated at the start and end of measurement of the posture change. Alternatively, the vibrator may be vibrated continuously during measurement and stopped when measurement ends. This allows the user to easily know when measurement has started or ended.

[0073] Furthermore, in the above embodiment, a bending forward motion is given as an example of a posture change motion, but this is not limiting, and the above processing can also be applied to other posture change motions that can be linked with the movement of the mouse 40.

[0074] Furthermore, the leg spread angle measurement process shown in the second embodiment is not limited to evaluating the leg spread angle of the user, but can also be used to measure the interior angle of two objects arranged to form a triangular area as described above, which can be used when determining the placement positions of two predetermined objects, etc.

[0075] In the above embodiment, the above-described processing is performed by a single information processing device 2. The information processing device 2 may include multiple storage devices and processors. The processing may be performed by sharing the processing among these devices. The information processing device may also be a server, and the processing may be performed in a distributed system consisting of multiple information processing devices including the server.

[0076] In other embodiments, the user may place and move the mouse on a location other than the floor. For example, the user may be asked to assume a predetermined posture by placing and moving the mouse on the surface of the user's body.

[0077] The information processing program, information processing method, and information processing system according to the present disclosure can provide a novel way of using a mouse.

[0078] 2 Information processing device 21 Processor 22 Storage unit 24 Input device communication unit 25 Image / sound output unit 30 Display unit 40 Mouse

Claims

1. An information processing program that guides a user to place a mouse on the floor, assume an initial posture, and perform a posture change operation by moving the mouse placed on the floor by the user who has assumed the initial posture, receives first data regarding the movement of the mouse output from the mouse, and evaluates the posture change operation performed by the user based on the received first data.

2. The information processing program according to claim 1, wherein the processor evaluates the posture change operation based on the first data received after the user who has assumed the initial posture starts moving the mouse until it is determined based on the first data that the mouse has stopped.

3. The information processing program according to claim 2, wherein the processor notifies the user of the determination that the mouse has stopped by a predetermined sound.

4. The second data regarding the posture of the mouse is output from the mouse, and the information processing program according to any one of claims 1 to 3, wherein the processor receives the second data and evaluates the posture change operation based on the received second data and the first data.

5. The information processing program according to claim 4, wherein the processor ends the evaluation of the posture change operation when it is determined based on the first data and the second data that the mouse has stopped.

6. The initial posture is a posture of sitting straddling on the floor, and the processor instructs the user to perform, as the posture change operation, a first operation of moving the mouse forward along one leg of the right or left leg of the user from the user's crotch, a second operation of moving the mouse from the position moved forward along one leg toward the other leg, and a third operation of moving the mouse from the position moved in the second operation along the other leg toward the user's crotch, and evaluates at least one of the initial posture or the posture change operation based on the first data.

7. The information processing program according to any one of claims 1 to 6, which causes the processor to execute game processing based on the result of the evaluation.

8. An information processing method, which guides the user to: place a mouse on the floor; assume an initial posture; and perform a posture change operation by moving the mouse placed on the floor by the user who has assumed the initial posture on the floor, receives first data regarding the movement of the mouse output from the mouse, and evaluates the posture change operation performed by the user based on the received first data.

9. An information processing system including a mouse having an optical sensor and a processor, wherein the mouse transmits first data regarding the movement of the mouse on a work surface based on the output of the optical sensor, and the processor guides the user to: place the mouse on the floor; assume an initial posture; and perform a posture change operation by moving the mouse placed on the floor by the user who has assumed the initial posture on the floor, receives the first data from the mouse, and evaluates the posture change operation performed by the user based on the received first data.

Images