Game processing methods, game programs, and game systems

Abstract

The present invention determines, on the basis of first data outputted from a mouse in which a light guide path in communication with a mouse operation sensor opens to a bottom surface, that the mouse is in a first posture in which the bottom surface is exposed. When the first posture is determined, first game processing is executed on the basis of second data outputted from the mouse operation sensor in response to approaching of a detection object to the opening.

Description

Technical Field

[0001] The present invention relates to a game processing method, a game program, and a game system, and particularly, for example, to a game processing method, a game program, and a game system that perform processing using a mouse.

Background Art

[0002] Conventionally, there is a video game device that executes a game using a pointing device such as a mouse as an input device (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the video game device described in Patent Document 1 above had room for improving the interestingness regarding the operation method using a mouse.

[0005] Therefore, an object of the present invention is to provide a game processing method, a game program, and a game system that can provide an unprecedented operation experience and interestingness regarding the operation of a mouse.

Means for Solving the Problems

[0006] In order to achieve the above object, the present invention can adopt, for example, the following configurations (1) to (18).

[0007] (1) One example of the game processing method of the present invention determines that the mouse is in a first posture in which its bottom surface is exposed, based on first data output from a mouse in which a light guide path communicating with a mouse operation sensor opens on the bottom surface. If the first posture is determined to be in place, the first game processing is executed based on second data output from the mouse operation sensor when an object to be detected approaches the opening.

[0008] (2) In the configuration of (1) above, the second data may include data corresponding to the direction of movement of the object being detected as it moves across the opening. The first game processing may include processing corresponding to the direction of movement.

[0009] (3) In the configuration of (1) above, the second data may include data corresponding to the movement speed of the detected object as it moves across the opening. The first game processing may include processing corresponding to the movement speed.

[0010] (4) In any one of the configurations (1) to (3) above, the first game processing may be performed in response to the output of the second data from a state in which the second data is not output.

[0011] (5) In any one of the configurations (1) to (3) above, the first game processing may be executed in response to the state in which the second data is outputting ceasing to be output.

[0012] (6) In any one of the configurations (1) to (5) above, it may be further determined, based on the first data, that the mouse is in a second posture different from the first posture. If it is determined that the mouse is in a second posture, the first game processing may be performed based on third data output from an operating means different from the mouse operation sensor provided on the mouse.

[0013] (7) In any one of the configurations (1) to (6) above, the mouse may be equipped with a posture sensor for detecting the mouse's posture. The first data may include data based on the output of the posture sensor.

[0014] (8) In any one of the configurations (1) through (7) above, the first game processing may be processing based on the first data.

[0015] (9) In any one of the configurations (1) to (8) above, the first game processing may be a process that determines a first parameter of a virtual object in the virtual space based on first data, determines a second parameter of the virtual object based on second data, and controls the operation of the virtual object in the virtual space based on the determined first and second parameters.

[0016] (10) In any one of the configurations (1) to (9) above, the first posture may be a posture in which the bottom surface of the mouse faces upward. The second data may include data corresponding to the direction of movement, which is the direction in which the detected object moves over the opening. If the forward, backward, left, and right directions of the mouse are defined based on the posture of the mouse when the mouse's light guide path is placed on a mounting surface and operated, the first game processing may, based on the second data, perform processing based on the direction to the front right in the virtual space in response to the detection of the defined direction to the front left as the direction of movement, and also perform processing based on the direction to the front left in the virtual space in response to the detection of the defined direction to the front right as the direction of movement, based on the second data.

[0017] (11) In any one of the configurations (1) to (10) above, the first posture may be a posture in which the bottom surface of the mouse faces upward. The second data may include data corresponding to the moving operation direction in which the detected object moves above the opening. When the optical path of the mouse is placed on the placement surface and operated, based on the posture of the mouse in this case, when the up-down, front-back, left-right directions of the mouse are defined, the first game process is determined based on the first data to be a first posture tilted upward with the front direction of the bottom surface defined as the upward direction side. In response to obtaining the second data in this state, a process based on the diagonally downward front direction in the virtual space is performed. In response to obtaining the second data in a state determined based on the first data to be a first posture tilted downward with the front direction of the bottom surface defined as the downward direction side, a process based on the diagonally upward front direction in the virtual space may be performed.

[0018] (12) In any one of the configurations (1) to (11) above, the mouse may include a direction input unit on its side surface. The first game process may move a virtual object in the virtual space based on fourth data output in response to an operation on the direction input unit.

[0019] (13) In the configuration of (12) above, the first game process may control the action of the virtual object based on the second data.

[0020] (14) In any one of the configurations (1) to (13) above, based on the first data, it may be further determined that the mouse is in a second posture in which the bottom surface is placed on the placement surface. In the case where it is determined to be the second posture, based on the second data output from the mouse operation sensor when the mouse moves on the placement surface, the third game process may be further executed.

[0021] (15) In any one of the configurations (1) to (14) above, on the bottom surface, the first button and the second button may be provided such that openings are located between them in the longitudinal direction of the mouse. When it is determined that the first posture is adopted, further, based on the fifth data output in response to an operation on the first button, the fourth game process may be executed, and based on the sixth data output in response to an operation on the second button, the fifth game process may be executed.

[0022] (16) In the configuration (15) above, the opening may be formed on the first button side rather than the second button side in the longitudinal direction. When the fifth data and the second data are received simultaneously, only one of the first game process and the fourth game process may be executed, or neither may be executed. When the sixth data and the second data are received simultaneously, both the first game process and the fifth game process may be executed, or a game process different from the first game process and the fifth game process may be executed.

[0023] (17) In the configuration (1) above, the second data may include data corresponding to the moving operation direction in which the detected object moves over the opening. Based on the posture of the mouse when the light guide path of the mouse is placed on the placement surface and operated, when the front, rear, left, and right directions of the mouse are defined, the first game process may perform a process based on the front - rear direction or the up - down direction in the virtual space in response to the detection that the defined left - right direction is the moving operation direction based on the second data.

[0024] (18) In the configuration (1) above, the second data may include data corresponding to the moving operation direction in which the detected object moves over the opening. Based on the posture of the mouse when the light guide path of the mouse is placed on the placement surface and operated, when the front, rear, left, and right directions of the mouse are defined, the first game process may perform a process based on the left - right direction in the virtual space in response to the detection that the defined front - rear direction is the moving operation direction based on the second data.

[0025] Furthermore, the present invention may be implemented in the form of a game program and a game system. [Effects of the Invention]

[0026] According to the present invention, the mouse can be operated using a novel method, providing a new level of entertainment. [Brief explanation of the drawing]

[0027] [Figure 1] Block diagram showing an example of the configuration of the information processing system 1a according to the first embodiment of the present invention. [Figure 2] A diagram showing an example of the appearance of the input device 3. [Figure 3] This diagram shows an example of reverse operation of the input device 3. [Figure 4] This figure shows an example of a game image displayed in response to an operation on the input device 3 in the game processing example of the first embodiment. [Figure 5] This figure shows another example of a game image displayed in response to an operation on the input device 3 in the game processing example of the first embodiment. [Figure 6] This diagram illustrates an example where the reference direction changes vertically in a virtual space. [Figure 7] This figure shows an example of the main data and programs stored in the storage unit 22 of the information processing device 2 in the first embodiment. [Figure 8] A flowchart showing an example of processing performed in the information processing device 2 according to the first embodiment. [Figure 9] A subroutine showing a detailed example of the object motion control process in step S55 of Figure 8. [Figure 10] A diagram showing an example of the appearance of the input device 9. [Figure 11] This diagram shows an example of the horizontal operation of the input device 9. [Figure 12] This diagram shows an example of closing the opening during the horizontal operation of the input device 9. [Figure 13]This figure shows an example of a game image displayed in response to a directional instruction operation on the input device 9 in a game processing example of the second embodiment. [Figure 14] This figure shows an example of a game image displayed in response to the operation of closing the opening of the input device 9 in the game processing example of the second embodiment. [Figure 15] A diagram showing an example of the appearance of the input device 9a. [Figure 16] This figure shows an example of the main data and programs stored in the storage unit 22 of the information processing device 2 in the second embodiment. [Figure 17] A flowchart showing an example of processing performed in the information processing device 2 according to the second embodiment. [Figure 18] A subroutine showing a detailed example of the object motion control process in step S104 of Figure 17. [Modes for carrying out the invention]

[0028] (First embodiment) Referring to Figure 1, an information processing system 1a according to a first embodiment of the present invention will be described. As shown in Figure 1, the information processing system 1a is constructed by connecting an information processing device 2, an input device 3, and a display device 4 via wired or wireless connections. For example, the information processing system 1a performs processing in the information processing device 2 based on the output from the input device 3 operated by the user, and displays the result of the execution on the display device 4. The information processing system 1a may have multiple input devices 3 connected to the information processing device 2 via wired or wireless connections. In this case, the multiple input devices 3 may be operated by the same user, or each may be operated by a different user.

[0029] The information processing device 2 may be configured to connect to a network using wireless or wired communication and to communicate with other devices (e.g., a server or other information processing device 2). The information processing device 2 is capable of executing a predetermined application (e.g., a game application). For example, the information processing device 2 can execute information processing programs stored in a storage medium such as a replaceable memory card or optical disc, or received from other devices. The information processing device 2 may be a general-purpose personal computer, a home game console, a smartphone, a portable game console, or other device.

[0030] The information processing device 2 comprises a control unit 21, a storage unit 22, a program storage unit 23, and a communication unit 24. The information processing device 2 may also be composed of one or more devices, including an information processing device with at least a control unit 21 and other devices.

[0031] The control unit 21 is an information processing means (computer) for performing various information processing, such as a CPU. For example, the control unit 21 has the function of executing the above-mentioned applications as various information processing, and performing game processing and data transmission / reception processing with other devices, which will be described later. The CPU executes a predetermined program, thereby realizing each function of the control unit 21.

[0032] The memory unit 22 stores various types of data used by the control unit 21 when it performs the above-mentioned information processing. The memory unit 22 is, for example, a memory accessible by the CPU (control unit 21).

[0033] The program storage unit 23 stores (stores) the program. The program storage unit 23 can be any storage device (storage medium) that is accessible to the control unit 21, such as non-volatile memory. Alternatively, the program storage unit 23 may be a storage device (such as a server) connected to the control unit 21 via a network.

[0034] The communication unit 24 is composed of a predetermined communication module and transmits and receives data to and from other devices (e.g., a server or other information processing device 2) via a network, or transmits and receives data directly to and from other information processing devices 2 (e.g., local communication).

[0035] The display device 4 is configured separately from the information processing device 2 when the information processing device 2 is composed of a stationary game device or a personal computer. In other embodiments, the display device 4 may be integrated into the main body of the information processing device 2.

[0036] As shown in Figure 2, the input device 3 has a mouse function. In this disclosure, an input device having a mouse function is referred to as a mouse. Here, the mouse function has at least the function of outputting operation data indicating the direction and distance of movement in response to the movement of the input device 3 body on the mounting surface, when the input device 3 is placed on the mounting surface with its bottom surface facing the mounting surface. The information processing device 2 may move, for example, a cursor displayed on the display device 4 based on the operation data.

[0037] The input device 3 includes a mouse sensor 34 as a configuration for realizing the mouse function described above. The mouse sensor 34 is, for example, an optical sensor using an LED or the like, and may be the same as the sensor used in conventional mice. The mouse sensor 34 may also be, for example, a sensor using laser light or a sensor using infrared light. In this embodiment, the mouse sensor 34 is positioned inside the main body of the input device 3 so as to be exposed to the outside through a through hole formed in the bottom surface. That is, the through hole forms a light guide path that communicates with the mouse sensor 34 and is a hole that opens in a part of the bottom surface. When the input device 3 is placed on the mounting surface with the bottom surface of the input device 3 facing the mounting surface, the mouse sensor 34 irradiates the mounting surface with light, detects the reflected light from the mounting surface, and performs image processing to calculate parameters related to the movement of the input device 3 (for example, direction of movement and distance of movement). The calculation of the above parameters based on the detection results of the reflected light may be performed in the input device 3, or it may be performed in the information processing device 2 that receives information on the detection results of the reflected light from the input device 3.

[0038] Furthermore, the input device 3 may, based on the detection result of the reflected light by the mouse sensor 34, calculate parameters relating to the current position of the input device 3 relative to a reference position, in addition to or instead of parameters relating to the direction and distance of movement of the input device 3, and output these parameters to the information processing device 2.

[0039] Furthermore, the input device 3 may calculate parameters relating to the orientation of the input device 3, in place of or in addition to the parameters relating to the direction and distance of movement of the input device 3 and the parameters relating to its position, based on the detection results of the reflected light by the mouse sensor 34, and output these parameters to the information processing device 2. For example, the calculation of the parameters relating to the orientation of the input device 3 may be performed based on the detection results of inertial sensors such as the angular velocity sensor 35 and acceleration sensor 36, which will be described later, or based on the detection results of reflected light by one or more mouse sensors 34. The calculation of the position and / or orientation parameters may also be performed in the input device 3, or it may be performed in the information processing device 2, which receives information regarding the detection results of the inertial sensors and the detection results of reflected light from the input device 3. By performing the calculation of the position and / or orientation parameters in the input device 3, accurate processing can be performed on the information processing device 3 side even if the data transmitted from the input device 3 to the information processing device 2 is temporarily interrupted.

[0040] Furthermore, when the parameters relating to the movement of the input device 3 (parameters relating to the direction of movement, distance, position, orientation, etc. of the input device 3) are calculated by the information processing device 2, these parameters may be calculated by executing a game application as part of the game processing described later, or they may be calculated by processing separate from the processing that uses the game application.

[0041] The input device 3 is equipped with at least one operation button. For example, the input device 3 shown in Figure 2 is equipped with two operation buttons 31 and 32 on its top surface. Operation buttons 31 and 32 output operation data corresponding to the pressing operation to the control unit 21, respectively.

[0042] In this embodiment, to make the directions of the input device 3 easier to understand, the longitudinal direction of the top surface of the input device 3 is defined as the front-to-back direction, the short direction of the top surface is defined as the left-to-right direction, and the direction perpendicular to the top surface is defined as the up-and-down direction. Then, as shown in Figure 2, three axes (x, y, and z axes) are defined for the input device 3. Specifically, the upward direction of the input device, from the bottom surface of the input device 3 which is grounded and operated facing the aforementioned surface, toward the top surface is defined as the positive z-axis, the forward direction toward the front (the side on the top surface of the input device 3 where the operation buttons 31 and 32 are provided) in the longitudinal direction perpendicular to the up-and-down direction is defined as the positive y-axis, and the left direction, which is the short direction perpendicular to the up-and-down direction and is to the left with respect to the up and forward directions, is defined as the positive x-axis. In other words, in this embodiment, in the posture in which the bottom surface of the input device 3 is placed on the aforementioned surface and operated, the direction from the top surface to the bottom surface is defined as the down direction, and the direction toward the side on the top surface where the operation buttons 31 and 32 are provided is defined as the forward direction, defining the up, down, left, right, and front-and-back directions.

[0043] In addition to the operation buttons 31 and 32 and the mouse sensor 34 described above, the input device 3 includes an angular velocity sensor 35 and an acceleration sensor 36. The input device 3 may also include only one of the angular velocity sensor 35 or the acceleration sensor 36. The angular velocity sensor 35 and the acceleration sensor 36 are inertial sensors that detect the posture and movement of the input device 3. The angular velocity sensor 35 and the acceleration sensor 36 are connected to the control unit 21, and the detection results of the angular velocity sensor 35 and / or the acceleration sensor 36 are output to the control unit 21. Based on the detection results of the angular velocity sensor 35 and / or the acceleration sensor 36, the control unit 21 can calculate information regarding the movement and / or posture of the input device 3.

[0044] The input device 3 may be any input device configured to be operable by the user. For example, the input device 3 may be in the form of a game controller that can be lifted and held by the user with both hands or one hand. The input device 3 may be detachable from the information processing device 2 or the display device 4. The input device 3 may be integrated with the information processing device 2 or the display device 4. In addition, the input device 3 may be provided with other input means such as other operation buttons, a stick, or a touch panel in place of or in addition to the operation buttons 31 and 32. If the input device 3 is configured to be integrated in any manner, the surface on which the mouse sensor 34 is provided may be configured to face the mating member and not be exposed. The input device 3 may be configured to allow switching the mouse function ON / OFF.

[0045] As shown in Figure 3, in this embodiment, processing based on an operation in which the input device 3 is lifted from the mounting surface and its bottom and top surfaces are reversed (hereinafter referred to as the reverse operation) is also possible. In the reverse operation, the input device 3 is operated in a position where the bottom surface of the input device 3 is facing upward and the top surface is facing downward (a position where the positive z-axis direction is in the direction of gravity). As shown in Figure 3, when the bottom surface of the input device 3 is lifted from the mounting surface and the bottom surface is facing upward, it may be determined whether or not the reverse operation is being performed using the movement and posture of the input device 3 calculated based on the detection results of inertial sensors such as the angular velocity sensor 35 and the acceleration sensor 36. For example, the output range of the angular velocity sensor 35 when the bottom surface of the input device 3 is facing upward may be set in advance, and it may be determined that the reverse operation is being performed if the output falls within that range. This determination may be performed in the input device 3, or it may be performed in the information processing device 2 that receives information regarding the detection results of the inertial sensors from the input device 3. Furthermore, if the above determination is performed in the information processing device 2, the determination may be performed by executing a game application as part of the game processing described later, or it may be performed by a process separate from the processing that uses the game application. By performing attitude determination based on the output from the inertial sensor of the input device 3 in this way, it is possible to accurately determine whether the input device 3 is being operated in the reverse direction.

[0046] The reverse operation of the input device 3 described above may be detected by other methods. As shown in Figure 3, when the bottom surface of the input device 3 is lifted from the mounting surface and the bottom surface is facing in a direction other than downward, the mouse sensor 34 will no longer be able to detect reflected light, and an output indicating that sufficient reflected light has been detected will not be obtained from the mouse sensor 34. Therefore, by detecting such an output from the mouse sensor 34, it can be determined that the bottom surface of the input device 3 is exposed and lifted from the mounting surface. In other embodiments, based on the above output in which the mouse sensor 34 can no longer detect sufficient reflected light, it may be determined that the bottom surface of the input device 3 is exposed and facing upward while being operated in reverse. Note that the above determination may be performed in the input device 3, or it may be performed in the information processing device 2 that receives information regarding the reflected light detection result from the input device 3.

[0047] Furthermore, in other embodiments, if the input device 3 is equipped with a distance measuring sensor capable of detecting the distance between the bottom surface of the input device 3 and the surface on which it is placed, the determination of whether or not the reverse operation described above has been performed may be made using the distance calculated based on the detection result of the distance measuring sensor.

[0048] In the reverse operation using the input device 3 in this embodiment, it is possible to move an object, such as a part of the user's body (e.g., a finger), along the exposed bottom surface of the input device 3. For example, even when the bottom surface of the mouse sensor 34, through which the communicating light guide path is open, is exposed upwards, the mouse sensor 34 can output a result indicating that it has detected an object when the user's finger approaches the opening as the object to be detected. As an example, the mouse sensor 34 outputs data even when the bottom surface is exposed upwards, and the result indicating that the object to be detected has been output based on this data, which indicates that the intensity of the reflected light is above a predetermined threshold. Note that the data output by the mouse sensor 34 when the bottom surface is exposed upwards may include other data unrelated to the intensity of the reflected light. As another example, the mouse sensor 34 may not output data when it has not detected an object when the bottom surface is exposed upwards, and the result indicating that it has detected an object may be output based on the data output when it detects reflected light from the object to be detected. Furthermore, the mouse sensor 34 can calculate parameters related to the movement of the detected object along the bottom surface of the input device 3 (for example, the direction and distance of movement of the detected object). As an example, as shown in Figure 3, when a user's finger moves over the opening of the mouse sensor 34, the direction and distance of movement of the finger can be calculated.

[0049] Next, with reference to Figures 4 and 5, an overview of the game processing example in the first embodiment will be described. Note that in the following description, a game is used as an example of an application executed in the information processing device 2, but other applications may be executed in the information processing device 2.

[0050] In Figure 4, in the game processing example described above, the first object OBJ1 and the second object OBJ2 in the virtual space displayed on the display device 4 move in response to the reverse operation input to the input device 3. For example, in the game processing example described above, the orientation of the first object OBJ1 is changed to a direction in the virtual space corresponding to the direction of movement operation in the reverse operation of the input device 3, and the second object OBJ2 is moved in a direction based on the orientation of the first object OBJ1 at a movement speed corresponding to the movement speed of the movement operation in the reverse operation.

[0051] For example, in the reverse operation of the input device 3 illustrated in Figure 4, the input device 3 is held by the user with its bottom surface facing upwards and its front surface facing forward (i.e., the positive z-axis direction is aligned with the direction of gravity in the real world, and the positive y-axis direction is aligned forward). The user then performs a reverse operation in which their fingers move forward along the bottom surface of the input device 3 over the opening of the mouse sensor 34 (i.e., an operation in which the fingers move along the bottom surface in the positive y-axis direction) (operation in the direction of the arrows shown in the figure).

[0052] When the user slides their finger forward over the opening, the information processing device 2 calculates the forward (positive y-axis) movement direction of the input device 3 and the movement speed based on the amount of movement per unit time the finger is slid. In the game processing example above, when the mouse sensor 34 changes from a state where it has not detected an object to a state where it has detected an object (for example, when the finger has not reached the opening and begins to touch a part of the opening), the orientation of the first object OBJ1 is changed so that it faces the direction in the virtual space corresponding to the calculated movement direction. In the example in Figure 4, since the forward (positive y-axis) movement direction of the input device 3 has been calculated, the orientation of the first object OBJ1 is adjusted so that it faces the front direction in the virtual space corresponding to that movement direction (for example, the line of sight direction of the virtual camera that is generating the virtual space image). Subsequently, in the game processing example described above, when the mouse sensor 34 changes from detecting an object to not detecting it (for example, when a finger is placed over a part of the opening and then passes over the opening and is no longer in contact with it), the second object OBJ2 is launched from the tip of the first object OBJ1 in the direction of movement based on the orientation of the first object OBJ1, at a movement speed corresponding to the calculated movement operation speed, and begins to move in the virtual space.

[0053] On the other hand, in the reverse operation of the input device 3 illustrated in Figure 5, the input device 3 is held by the user in the same posture as illustrated in Figure 4. The user then performs a reverse operation in which their fingers move along the bottom surface of the input device 3 and across the opening of the mouse sensor 34 in a forward and diagonal direction to the right (for example, moving their fingers at a 45° angle from the positive y-axis direction to the positive x-axis direction along the bottom surface) (operation in the direction of the arrows shown in the figure).

[0054] By performing the operation of sliding a finger diagonally forward and to the right over the opening described above, the orientation of the first object OBJ1 is adjusted so that it faces the front right direction in the virtual space (for example, a direction 45° diagonally to the right from the line of sight of the virtual camera in the virtual space), which corresponds to the calculated diagonal forward and to the right direction (a direction 45° diagonally from the positive y-axis to the positive x-axis). Subsequently, in the example in Figure 5, the second object OBJ2 is launched in the direction of movement based on the orientation of the first object OBJ1, at a movement speed corresponding to the calculated movement speed.

[0055] In this game processing example, it is detected that the input device 3 is being operated in the reverse direction based on the orientation of the input device 3 based on the detection results of the inertial sensor and the output of the mouse sensor 34. When the input device 3 is being operated in the reverse direction, the direction in which the first object OBJ1 in the virtual space faces is controlled based on the direction in which the detected object contacts and slides against the bottom surface of the input device 3, and the second object OBJ2 is moved in the direction of movement based on the sliding direction at a speed based on the amount of movement of the detected object sliding.

[0056] In the reverse operation illustrated in Figure 5, the movement direction that is diagonally forward and to the right corresponds to the diagonally forward and to the left in the input device 3 when replaced with the up, down, left, right, forward, and backward directions defined for the input device 3 in this embodiment. Similarly, the movement direction that is diagonally forward and to the left in the reverse operation corresponds to the diagonally forward and to the right in the input device 3 when replaced with the up, down, left, right, forward, and backward directions defined above. In other words, in the above game processing example, in the normal operating position of the input device 3 with its bottom surface placed on the mounting surface, the operation direction to the left becomes an operation instruction to the right in the virtual space, and the operation direction to the right becomes an operation instruction to the left in the virtual space. Therefore, in the above game processing example, the left and right directions in the normal operating position of the input device 3 are reflected in the virtual space in reverse, with the left and right directions being reversed in the reverse operation position. This correspondence of left and right directions allows for operation instructions in the virtual space to be given in a direction that is intuitive when operating in reverse.

[0057] In the above game processing example, the direction that the first object OBJ1 faces is set by shifting it to the left or right by the angle at which the movement operation direction is shifted to the left or right in the input device 3, with the front direction in the virtual space as the reference direction. In other embodiments, the movement operation direction may be calculated by adding a change due to the orientation of the input device 3, in addition to the change due to the direction in which the detected object slides as it comes into contact with the bottom surface of the input device 3. For example, the reference direction in the virtual space may change based on the orientation of the input device 3 calculated based on the detection result of the inertial sensor.

[0058] As shown in Figure 6, the reference direction may change in the vertical direction in the virtual space in accordance with the change in the pitch direction of the input device 3 when it is being operated in the reverse direction. For example, as shown in the upper part of Figure 6, when the bottom surface of the input device 3 is in a horizontal position in real space (i.e., both the x-axis and y-axis directions of the input device 3 are horizontal), the reference direction is set to the horizontal direction in the virtual space. Then, when an operation is performed in which a finger is slid in contact with the bottom surface of the input device 3 in this state, the movement operation direction D1 by the sliding finger becomes a horizontal movement operation direction in the virtual space that is shifted by that angle to the left or right of the reference direction, based on the angle of the left or right shift of the input device 3.

[0059] On the other hand, as shown in the lower diagram of Figure 6, if the bottom surface of the input device 3 is tilted from the horizontal in the pitch direction in real space (for example, the bottom surface is tilted downwards by an angle θ, and the positive y-axis direction of the input device 3 is angled downwards by an angle θ), then the reference direction is set to the direction tilted in the pitch direction in virtual space (for example, the downward angle direction relative to the horizontal direction in virtual space). As an example, if the reference direction is changed by the same angle as the change in the posture of the input device 3, the reference direction is set to a direction that is downwards by an angle θ in virtual space, corresponding to the input device 3's forward direction (positive y-axis direction) being tilted downwards by an angle θ. Then, if an operation is performed in which a finger is slid against the bottom surface of the input device 3 in this state, the movement direction D2 by the sliding finger becomes a downward angle movement direction in virtual space that is shifted by that angle to the left or right of the reference direction, based on the angle of the left or right shift of the input device 3.

[0060] Furthermore, the change in the attitude of the input device 3 applied to the above-mentioned movement operation direction may be applied not only to the pitch direction as described above, but also to the yaw and roll directions in real space, in order to set the above-mentioned reference direction.

[0061] Furthermore, the direction in the virtual space based on the direction in which the detected object contacts and slides against the bottom surface of the input device 3 and the direction in the virtual space based on the orientation of the input device 3 may be controlled to affect different parameters. For example, the orientation of the first object OBJ1 may be changed based on the direction in the virtual space based on the orientation of the input device 3 to control the initial movement direction when the second object OBJ2 starts moving, and the movement direction of the second object OBJ2 may be changed to curve after the start of movement based on the direction in the virtual space based on the direction in which the detected object slides. As a second example, the orientation of the first object OBJ1 may be changed based on the direction in the virtual space based on the direction in which the detected object slides to control the initial movement direction when the second object OBJ2 starts moving, and the movement direction of the second object OBJ2 may be changed to curve after the start of movement based on the direction in the virtual space based on the orientation of the input device 3.

[0062] Furthermore, in other embodiments, the above game processing example may also enable control of the operation of the first object OBJ1 and the second object OBJ2 not only through the reverse operation described above, but also through operation in a normal position (referred to as normal position operation) where the bottom surface of the input device 3 is placed on the mounting surface.

[0063] For example, the orientation of the first object OBJ1 may be changed according to the movement and orientation of the input device 3 on the mounting surface, and the second object OBJ2 may be launched according to the operation of the operation button 31. In the above reverse operation, the direction of movement and the direction in virtual space were associated in opposite directions, but in normal orientation operation, they may be associated in the forward direction.

[0064] Furthermore, this embodiment may be applied to a game in which the player draws a bow in a direction corresponding to the direction of movement of the detected object, and the arrow flies in the opposite direction. Alternatively, it may be applied to a game in which the player draws a bow in the opposite direction to the direction of movement of the detected object, and the arrow flies in the direction corresponding to the direction of movement. Moreover, arrows may be loaded based on the direction of movement, and the loaded arrows may be fired in response to the operation of the operation button 31.

[0065] Furthermore, in a virtual space where multiple options are displayed, the cursor may be moved in the calculated direction of movement, and the information processing may be applied to select the option displayed in that direction.

[0066] As a fourth example, a position in the virtual space may be set based on the orientation of the input device 3, and a predetermined process may be performed with respect to the set position when an object to be detected is detected.

[0067] Next, we will describe the details of the processing performed in the information processing device 2 in the first embodiment. First, with reference to Figure 7, we will describe the main data used in the processing performed in the information processing device 2.

[0068] As shown in Figure 7, the data storage area of ​​the memory unit 22 stores operation data Da, object data Db, posture data Dc, movement operation direction data Dd, movement operation speed data De, virtual camera data Df, and image data Dg, etc. In addition to the data shown in Figure 7, the memory unit 22 also stores data necessary for processing, such as data used by the application being executed. Furthermore, the program storage area of ​​the memory unit 22 stores various program groups Pa that constitute information processing programs (game programs), etc.

[0069] Operation data Da is data that indicates the operation information of the user operating the input device 3. For example, operation data indicating that the input device 3 has been operated (data indicating operations on operation buttons 31 and 32, data based on detection results from the mouse sensor 34) is acquired at each time unit processed by the information processing device 2 (e.g., 1 / 60 second), and is stored and updated in operation data Da accordingly. In addition, operation data detected by the inertial sensors (angular velocity sensor 35, acceleration sensor 36) due to operations that move the input device 3 is also acquired at each time unit processed by the information processing device 2, and is stored and updated in operation data Da accordingly.

[0070] Object data Db is data that indicates the position, orientation, movement, state, display mode, etc., of objects displayed on the display device 4 (for example, the first object OBJ1, the second object OBJ2).

[0071] The posture data Dc is data that indicates the posture of input device 3 in the real world and the reference direction in the virtual space that is set based on that posture.

[0072] The movement direction data Dd is data indicating the movement direction calculated based on the direction of movement in which the detected object slides in contact with the bottom surface of the input device 3 and the orientation of the input device 3. The movement speed data De is data indicating the movement speed calculated based on the amount of movement in which the detected object slides in contact with the bottom surface of the input device 3.

[0073] The virtual camera data Df is data that indicates the position and orientation of the virtual camera.

[0074] Image data Dg is data for displaying an image from a virtual space on the display device 4.

[0075] Next, with reference to Figures 8 and 9, the details of the processing performed in the information processing device 2 according to the first embodiment will be described.

[0076] In this embodiment, the series of processes shown in Figures 8 to 9 are performed by the control unit 21 (CPU) executing a game program or the like stored in the program storage unit 23.

[0077] The processing steps in the flowcharts shown in Figures 8 and 9 are merely examples. Some or all of the steps in the flowchart may be executed by a processor other than the CPU of the control unit 21 or by a dedicated circuit.

[0078] In Figure 8, the control unit 21 performs initial setup (step S51) and then proceeds to the next step.

[0079] Next, the control unit 21 acquires operation data from the input device 3 and updates the operation data Da (step S52), and proceeds to the next step.

[0080] Next, the control unit 21 performs attitude calculation processing (step S53) and proceeds to the next step. For example, the control unit 21 refers to the operation data Da to acquire detection result data output by the inertial sensors (angular velocity sensor 35 and acceleration sensor 36), calculates the attitude of the input device 3 in the real world based on the said detection result data, and updates the attitude data Dc.

[0081] Next, the control unit 21 determines whether the input device 3 is being operated in the reverse direction (step S54). For example, the control unit 21 refers to the attitude data Dc and determines in step S54 that the upward direction (positive z-axis direction) of the input device 3 is within a predetermined range where it is downward in real space (for example, within a predetermined angular range with respect to the direction of gravity).

[0082] In step S55, the control unit 21 performs object motion control processing and proceeds to step S57. The object motion control processing in step S55 will be described below with reference to Figure 9.

[0083] In Figure 9, the control unit 21 adjusts the orientation of the first object OBJ1 based on the reference direction (step S60) and proceeds to the next step. For example, the control unit 21 refers to the attitude data Dc and sets the direction in the virtual space corresponding to the direction in which the input device's forward direction (positive y-axis direction) faces as the reference direction. Then, the control unit 21 adjusts the orientation of the first object OBJ1 so that it faces the reference direction in the virtual space and updates the object data Db.

[0084] Next, the control unit 21 determines whether or not the mouse sensor 34 has detected an object (step S61). For example, if the control unit 21 refers to the operation data Da and outputs a detection result indicating that the mouse sensor 34 has detected reflected light from the object being detected, it makes an affirmative determination in step S61.

[0085] In step S62, the control unit 21 calculates the direction of movement, updates the movement direction data Dd, and proceeds to the next step.

[0086] Next, the control unit 21 calculates the movement speed and updates the movement speed data De (step S63), and proceeds to the next step.

[0087] Next, the control unit 21 adjusts the orientation of the first object OBJ1 based on the movement operation direction (step S64) and proceeds to step S65. For example, the control unit 21 calculates the angular difference between the movement operation direction calculated in step S62 and the forward direction (positive y-axis direction) of the input device 3, and adjusts the orientation of the first object OBJ1 so that it faces a direction in the virtual space that is shifted by the same angular difference from the reference direction set in step S60, and updates the object data Db. The object data Db may be updated in a direction corresponding to the calculated movement operation direction, or it may be updated in a direction closer to the direction corresponding to the calculated movement operation direction compared to the current object data Db.

[0088] In step S65, the control unit 21 determines whether the mouse sensor 34 has changed from a state in which it has detected an object to a state in which it has not detected an object.

[0089] In step S68, the control unit 21 starts moving the second object OBJ2 based on the direction and movement speed of the first object OBJ1, updates the object data Db, and terminates the processing by the subroutine.

[0090] In step S70, the control unit 21 determines whether the second object OBJ2 is moving within the virtual space.

[0091] In step S71, the control unit 21 performs second object movement control processing and terminates the processing by the subroutine. For example, the control unit 21 moves the second object OBJ2 based on the position, direction of movement, and speed of movement of the second object OBJ2 indicated by the object data Db and physical calculations in the virtual space, and updates the object data Db using the position, direction of movement, and speed of movement of the second object OBJ2 after the movement.

[0092] Returning to Figure 8, if the control unit 21 determines in step S54 that no reverse operation has been performed, it performs other processing (step S56) and proceeds to step S57. As an example, if the control unit 21 is performing a normal orientation operation in which the input device 3 moves on the mounting surface with its bottom surface placed on the mounting surface, it performs processing according to the output data output from the input device 3 by the normal orientation operation. In step S56, as described above, the operation of the first object OBJ1 and / or the second object OBJ2 can be controlled by the normal orientation operation, and this operation control may be performed as one of the other processing steps.

[0093] In step S57, the control unit 21 performs drawing processing and proceeds to the next step.

[0094] Next, the control unit 21 determines whether or not to terminate the game processing (step S58).

[0095] Thus, according to the information processing system 1a of the first embodiment, it is determined that the input device 3 having mouse functionality is being operated in the reverse direction, and when this is the case, the object's movement is controlled when the detected object approaches the opening forming the light guide path of the mouse sensor 34. Therefore, it is possible to provide an unprecedented operating experience and level of interest with respect to the operation of the input device 3.

[0096] (Second embodiment) An information processing system 1b according to a second embodiment of the present invention will now be described. In the information processing system 1b, instead of the input device 3 in the information processing system 1a of the first embodiment, an input device 9 is connected to the information processing device 2 by wire or wireless connection. The information processing device 2 and display device 4 in the second embodiment are the same as in the first embodiment, so the same reference numerals are used and a detailed description is omitted.

[0097] As shown in Figure 10, the input device 9 has mouse functionality, similar to the input device 3 described above.

[0098] In the second embodiment, the input device 9 is shaped like a controller (e.g., a game controller) that can be lifted and grasped by the user with both hands or one hand. For example, the input device 9 has a roughly rectangular prism-shaped housing that can be grasped by the user with one hand or both hands. For example, the input device 9 shown in Figure 10 has an analog stick 91 and operation buttons 92-93 on one side of the housing. The analog stick 91 is provided on the rear side of the above-mentioned side and can be used as a direction input unit that can input direction. The user can input direction according to the direction of tilt (and input magnitude according to the angle of tilt) by tilting the analog stick 91. The input device 9 may also be equipped with a directional pad or a slide stick that allows slide input instead of an analog stick as the direction input unit. In this embodiment, it may also be possible to input by pressing the analog stick 91. The operation buttons 92 and 93 are arranged front to back on the front side of the analog stick 91 on the above-mentioned side and are configured to be pressable from one side to the other. Furthermore, the input device 9 may also be equipped with other input means, similar to the input device 3, or it may be detachable from the information processing device 2 or the display device 4. The information processing device 2 or the display device 4 may have two detachable input devices 9 (which may have different shapes).

[0099] A rectangular parallelepiped-shaped protrusion 97 is formed on the bottom surface of the input device 9, with the front-to-back direction as its longitudinal direction, in the center of the bottom surface, allowing it to be inserted into and detached from other devices such as the game main unit. For example, the protrusion 97 may be provided with a suitable mechanism such as a mechanical structure or magnetism that enables attachment and detachment to the other devices. The protrusion 97 may be formed along the entire longitudinal direction of the bottom surface of the input device 9, or it may be formed on only a part of it, excluding both ends.

[0100] Operation buttons 94 and 95 are provided on the top surface of the protrusion 97 (the surface formed on the bottom side (downward) of the input device 9), and an opening for the mouse sensor 96 is formed at a position sandwiched between operation buttons 94 and 95. Operation buttons 94 and 95 are provided near the front end and rear end of the top surface of the protrusion 97, respectively, and are configured to be pressable from the bottom to the top. The pressing surfaces of operation buttons 94 and 95 are positioned at the same position (flush) as the top surface of the protrusion 97 or recessed from the top surface, so that they do not become pressed when the top surface of the protrusion 97 is in contact with a mounting surface, and so that they do not become pressed when mounted on the other device.

[0101] The input device 9 includes a mouse sensor 96 to realize the mouse function described above. The mouse sensor 96 may have the same configuration as the mouse sensor 34 described above. The opening of the mouse sensor 96 is formed on the side of the operation button 95 in the longitudinal direction (front-to-back direction) of the top surface of the protrusion 97, but it may also be formed in the center of the two operation buttons 94 and 95. The output data output from the mouse sensor 96 may be handled in the same way as the output data output from the mouse sensor 34 described above.

[0102] In this embodiment as well, in order to make the direction of the input device 9 easier to understand, the longitudinal direction of the side and bottom surfaces of the input device 9 is defined as the front-to-back direction, the short direction of the bottom surface perpendicular to the side surface is defined as the left-to-right direction, and the direction perpendicular to the bottom surface is defined as the up-and-down direction. Then, as shown in Figure 10, the three-axis (x, y, and z axes) directions relative to the input device 9 are defined.

[0103] As shown in Figure 11, in this embodiment, processing is also possible based on an operation in which the user lifts the input device 9 from the mounting surface and grasps the input device 9 with its longitudinal direction facing the user's left or right (hereinafter referred to as the lateral grip operation). In the above lateral grip operation, the bottom surface of the input device 9 is facing forward or upward of the user, the side of the input device 9 on which the analog stick 91 is provided is facing upward or towards the user, and the input device 9 is operated in a posture in which the front side of the input device 9 is grasped with the right hand and the rear side of the input device 9 is grasped with the left hand.

[0104] The method for determining whether the input device 9 is being held horizontally is not limited. In the first example, the method for determining whether the input device 9 is being held horizontally may be based on the fact that both operation buttons 94 and 95 are pressed simultaneously. Even if the operation buttons 94 and 95 are no longer pressed after it has been determined that the horizontal holding operation is occurring, the determination of horizontal holding will be maintained. Furthermore, even if the bottom surface of the input device 9 is placed on the mounting surface after it has been determined that the horizontal holding operation is occurring, the determination of horizontal holding will be maintained. In the second example, the method for determining whether the horizontal holding operation is occurring may be based on an output indicating that the mouse sensor 96 is no longer able to properly detect reflected light. In the third example, the method for determining whether the horizontal holding operation is occurring may be based on the detection result of the inertial sensor built into the input device 9. As an example, the methods described in the first to third examples may be combined as appropriate.

[0105] The determination that the above-mentioned horizontal grip operation is being performed does not necessarily have to indicate that the input device 9 is actually being operated while being held horizontally. Based on the determination that the above-mentioned horizontal grip operation is being performed, a predetermined process is executed in the game processing for a predetermined input.

[0106] In the horizontal operation using the input device 9 in this embodiment, the analog stick 91 and operation buttons 92-93 provided on the side of the input device 9, and the operation buttons 94-95 provided on the bottom surface, can be operated by the user's fingers or the like. Furthermore, in the horizontal operation described above, the user can cover, uncover, or move over the opening of the mouse sensor 96 formed on the exposed bottom surface of the input device 9 with a part of their body (for example, a finger). As an example, as shown in Figure 12, if the opening of the mouse sensor 96 is covered by the user's finger, a detection result can be obtained in which the covering finger is detected as the object to be detected.

[0107] Next, an overview of the game processing example in the second embodiment will be described with reference to Figures 13 and 14. Note that in the following description, a game is used as an example of an application executed in the information processing device 2, but other applications may be executed in the information processing device 2.

[0108] In Figure 13, in the game processing example described above, the third object OBJ3 changes its orientation and moves within the virtual space in response to a directional operation (for example, tilting the analog stick 91) during the horizontal operation of the input device 9. Then, in response to an operation to close the opening during the horizontal operation, an action is performed in which the fourth object OBJ4 is ejected in a direction based on the orientation of the third object OBJ3.

[0109] For example, in the horizontal operation of the input device 9 illustrated in Figure 13, the user performs a directional instruction operation by tilting the analog stick 91 using, for example, their left thumb (operation in the direction of the arrow shown). When such a directional instruction operation is performed, the information processing device 2 receives output data from the analog stick 91 indicating the tilt direction and amount, and accordingly changes the orientation of the third object OBJ3 in the direction corresponding to the tilt direction and moves it in that direction at a speed corresponding to the tilt amount. In the example in Figure 13, a directional instruction operation to the right (positive y-axis direction) is performed on the input device 9, so the third object OBJ3 faces to the right in the virtual space corresponding to the directional instruction operation (for example, to the right from the line of sight of the virtual camera generating the virtual space image), and moves at a speed corresponding to the tilt amount. For example, if the analog stick 91 is tilted upward (negative z-axis direction) in Figure 13, the first object OBJ1 faces forward (upwards on the display screen) in the virtual space and moves forward. In this game processing example, the orientation of the third object OBJ3 is changed to the left or right in the virtual space in response to left or right directional input during the horizontal grip operation described above. Furthermore, the orientation of the third object OBJ3 is changed to the upward direction on the display screen in response to forward directional input (negative z-axis direction) during the horizontal grip operation, and the orientation of the third object OBJ3 is changed to the downward direction on the display screen in response to backward directional input (positive z-axis direction) during the horizontal grip operation. Note that in Figure 13, the opening of the mouse sensor 96 is open.

[0110] On the other hand, in the horizontal operation of the input device 9 illustrated in Figure 14, the user performs an operation to cover the opening of the mouse sensor 96 with their finger (for example, the index finger of their left hand). While this operation to cover the opening of the mouse sensor 96 is being performed, the fourth object OBJ4 is ejected from the tip of the third object OBJ3 in the direction of movement based on the set direction of the third object OBJ3.

[0111] Thus, in the above game processing example, when the input device 9 is held horizontally, the analog stick 91 provided on the side of the input device 9 can be used as a directional input unit to enable precise directional input, and the mouse sensor 96 can also be used as an input means.

[0112] In this embodiment, the left-right direction (y-axis direction) in the horizontal operation illustrated in Figures 11 to 14 corresponds to the front-back direction of the input device 9 when replaced with the up-down, left-right, front-back directions defined for the input device 9. Furthermore, the forward direction (negative z-axis direction) in the horizontal operation corresponds to the downward direction of the input device 9 when replaced with the up-down, left-right, front-back directions defined above, and the backward direction (positive z-axis direction) in the horizontal operation corresponds to the upward direction of the input device 9 when replaced with the up-down, left-right, front-back directions defined above. In other words, in the above game processing example, in the normal operating position of the input device 9 with its bottom surface placed on the mounting surface, forward and backward operation instructions correspond to left-right operation instructions in the virtual space. Also, in the above game processing example, in the normal operating position, downward operation instructions correspond to upward operation instructions in the virtual space, and upward operation instructions correspond to downward operation instructions in the virtual space. Therefore, in the above game processing example, the input device 9 reflects the front-to-back direction in the normal operating posture as a left-to-right correspondence in the horizontal operating posture, and the input device 9 reflects the up-to-down direction in the normal operating posture as an inverted up-to-down correspondence in the horizontal operating posture. This directional correspondence allows for operation instructions in the virtual space to be given in a direction that is intuitive when operating horizontally. Note that the input direction to the input device 9 may be mapped to the up-to-down, left-to-right directions relative to the operation object (the third object OBJ3 in the second embodiment) instead of the up-to-down, left-to-right directions in the virtual space.

[0113] The game processing in the above embodiment is just one example. For example, the third object OBJ3 may be controlled only in position or only in orientation in response to the operation of the analog stick 91. Alternatively, the fourth object OBJ4 may be fired once when the opening of the mouse sensor 96 is closed.

[0114] In other embodiments, game processing may be performed based on the direction of movement of a finger moving over the opening of the mouse sensor 96. In this case, the movement of the detected object in the left-right direction (y-axis direction) in the horizontal operation illustrated in Figures 11 to 14 corresponds to a left-right operation instruction in the virtual space. However, in this embodiment, if this is replaced with the up-down, left-right, front-back directions defined for the input device 9, it becomes movement in the front-back direction of the input device 9. Similarly, the movement of the detected object in the up-down direction (x-axis direction) in the horizontal operation can be associated with an up-down or front-back operation instruction in the virtual space. However, if this is replaced with the up-down, left-right, front-back directions defined above, it becomes movement in the left-right direction of the input device 9. Furthermore, if a direction indicator operation unit is provided on the top, front, rear, or bottom surface of the input device 9, a direction indicator in the up-down direction (x-axis direction) in the horizontal operation using the direction indicator operation unit corresponds to a left-right direction indicator in the input device 9 when using the up-down, left-right, front-back directions defined above. Thus, in other embodiments, the input device 9 is reflected in the virtual space in a way that corresponds to the left-right direction in the normal operating posture, and to the up-down or front-back direction in the side-holding operating posture. This direction correspondence in other embodiments also allows for operation instructions in the virtual space to be given in a direction that is intuitive when the device is held sideways.

[0115] In other embodiments, the orientation and movement direction of the third object OBJ3 may also take into account the orientation of the input device 9, in addition to the direction indication operation described above.

[0116] Furthermore, in other embodiments, game processing may be added to the horizontal holding operation by further controlling the movement of objects by pressing the operation buttons 94 and / or 95 of the input device 9. The processing performed when operation button 94 is operated and the processing performed when operation button 95 is operated may be the same or different. In this case, while holding the mouse sensor 96 horizontally with both hands so that the opening is exposed, the operation buttons 94 and 95 that sandwich the opening can be pressed with the fingers of the right and left hands. That is, even though the bottom surface of the input device 9 is not in contact with the mounting surface, the output of the mouse sensor 96 can be used for game control, and because there are two operation buttons 94 and 95 on the bottom surface where the opening of the mouse sensor 96 is formed, the operation buttons 94 and / or 95 can also be pressed. Note that since the opening is formed between the operation buttons 94 and 95, it is possible to prevent the user from unintentionally blocking the opening when pressing operation buttons 94 or 95.

[0117] Furthermore, the opening of the mouse sensor 96 is formed on the operation button 95 side in the longitudinal direction (front-to-back direction) of the top surface of the protrusion 97. With this arrangement, it is assumed that the operation of pressing the operation button 95 and the operation of closing the opening will be performed by the same finger of the user. Therefore, in game processing that further uses operations on operation buttons 94 and 95, if output data from the operation of pressing operation button 95 and output data from the operation of closing the opening are obtained simultaneously from the input device 9, only one of the controls based on the operation of pressing operation button 95 or the control based on the operation of closing the opening (for example, only the one that was input first) may be performed, or neither control may be performed. In other words, game processing does not need to include processing that requires both the operation of pressing operation button 95 and the operation of closing the opening. On the other hand, it is assumed that the operation of pressing operation button 94 and the operation of closing the opening will be performed by fingers of different hands of the user. Therefore, in game processing that further uses operations on operation buttons 94 and 95, if output data resulting from pressing operation button 94 and output data resulting from closing the opening are obtained simultaneously from the input device 9, the system may be configured to perform both control based on pressing operation button 94 and control based on closing the opening, or to perform different control from these operations, so that both operations can be performed simultaneously.

[0118] Furthermore, in other embodiments, the above game processing example may also enable control of the operation of the third object OBJ3 not only through the horizontal gripping operation but also through operation in a normal posture (referred to as normal posture operation) where the bottom surface of the input device 9 is placed on the mounting surface. In this case, the game processing corresponding to the operation performed in the horizontal gripping operation (for example, tilting the analog stick 91 or pressing the operation buttons 92-95) may be controlled differently from the game processing corresponding to the operation performed in the normal posture operation. For example, in the information processing system 1b, instead of operating the analog stick 91, the orientation and / or movement of the third object OBJ3 may be controlled based on the detection result output from the mouse sensor 96. As an example, when the object moves by direction indication operation by tilting the analog stick 91 in the horizontal gripping operation, the direction of movement of the object is indicated by the tilting direction, and the speed at which the object moves is indicated by the amount of tilting. On the other hand, in the above-mentioned normal posture operation, when an object is moved by a direction indication operation by moving the input device 9 on the mounting surface, the direction in which the input device 9 moves indicates the direction in which the object moves, and the distance and speed at which the object moves are indicated by the amount by which the input device 9 moves. In addition, in this case, some processing other than the movement of the object may be performed in response to the operation of the analog stick 91, or no processing may be performed at all.

[0119] Furthermore, in other embodiments, the above game processing example may also enable control of object movement by both the horizontal gripping operation and the operation in which the user grasps the input device 9 with its longitudinal direction facing the user's front-to-back direction (hereinafter referred to as the vertical gripping operation). In the vertical gripping operation, the input device 9 is operated with the front of the input device 9 facing forward of the user, the side of the input device 9 on which the analog stick 91 is provided facing upward, the top side of the input device 9 grasped with the right hand, and the bottom side of the input device 9 grasped with the left hand. For example, the information processing system 1b may determine whether the input device 9 is being operated horizontally or vertically based on the orientation of the input device 9 in real space calculated based on the output from the inertial sensor of the input device 9, or it may be determined based on whether some operation button is pressed. Even when the input device 9 is being operated vertically, the object may be controlled in accordance with the tilting operation of the analog stick 91 or the operation of closing the opening of the mouse sensor 96. However, unlike the horizontal grip operation described above, the operation of tilting the analog stick 91 in the left-right direction (z-axis direction) in the vertical grip operation corresponds to the up-down direction in the input device 9 when replaced with the up-down, left-right, forward-backward directions defined in the input device 9 in this embodiment. Also, the forward direction (positive y-axis direction) in the vertical grip operation corresponds to the forward direction in the input device 9 when replaced with the up-down, left-right, forward-backward directions defined above, and the backward direction (negative y-axis direction) in the vertical grip operation corresponds to the backward direction in the input device 9 when replaced with the up-down, left-right, forward-backward directions defined above. Therefore, in this embodiment, by associating different directions in the virtual space depending on whether the input device 9 is being used for horizontal or vertical grip operation, it is possible to provide operation instructions in the virtual space in a direction that is intuitive for each operation.

[0120] Furthermore, the input device 9 may be a controller of another form. Hereinafter, with reference to Figure 15, an example of an input device 9a used in the second embodiment will be described.

[0121] The input device 9a differs from the input device 9 in the shape of its bottom surface and the positions of the openings and operation buttons formed on that bottom surface. On the bottom surface of the input device 9a, a rectangular parallelepiped-shaped protrusion 97a is formed on one side of the bottom surface (for example, the side on which the analog stick 91 is provided), with the front-to-back direction as its longitudinal direction. An opening for the mouse sensor 96a is formed on the top surface of the protrusion 97a (the surface formed on the bottom surface side (downward: negative z-axis direction side) of the input device 9a). Operation buttons 94a and 95a are provided on the bottom surface of the input device 9 in a part where the protrusion 97a is not formed (i.e., a part one step down from the top surface on the upper side (positive z-axis direction side)). Operation buttons 94a and 95a are provided near the front end and rear end of the aforementioned part, respectively, such that the opening is located between them in the longitudinal direction of the input device 9a. Furthermore, since the operation buttons 94a and 95a are not positioned to contact the mounting surface when the bottom surface of the input device 9a is grounded on the mounting surface, and since the input device 9a is not designed to be mounted on another device, their pressing surfaces can be positioned to protrude from the above-mentioned parts.

[0122] Next, we will describe the details of the processing performed in the information processing device 2 in the second embodiment. Below, we will explain the points that differ particularly from the processing shown in Figures 7 to 9.

[0123] As shown in Figure 16, the data storage area of ​​the memory unit 22 stores operation data Dp, object data Dq, virtual camera data Dr, and image data Ds, etc. The program storage area of ​​the memory unit 22 stores various program groups Pb that constitute information processing programs (game programs), etc.

[0124] Operation data Dp is data that indicates the operation information of the user operating the input device 9.

[0125] Object data Dq is data that indicates the position, orientation, injection position, injection direction, display mode, etc., of the objects displayed on the display device 4 (for example, the third object OBJ3 and the fourth object OBJ4).

[0126] Next, with reference to Figures 17 and 18, the details of the processing performed in the information processing device 2 according to the second embodiment will be described.

[0127] In Figure 17, the control unit 21 performs initial setup (step S101) and proceeds to the next step. For example, the control unit 21 initializes the third object OBJ3 in the initial position and initial orientation in the virtual space and updates the object data Dq.

[0128] Next, the control unit 21 acquires operation data from the input device 9 and updates the operation data Dp (step S102), and proceeds to the next step.

[0129] Next, the control unit 21 determines whether the input device 9 is being held horizontally (step S103). The control unit 21 may maintain the determination result until it is determined that the input device 9 is being operated in another orientation during the processing in step S103 that follows the affirmative determination.

[0130] In step S104, the control unit 21 performs object motion control processing and proceeds to step S106. The object motion control processing in step S104 will be described below with reference to Figure 18.

[0131] In Figure 18, the control unit 21 refers to the operation data Dp to determine whether or not an operation to tilt the analog stick 91 is being performed (step S111).

[0132] In step S112, the control unit 21 changes the orientation of the third object OBJ3 based on the tilt direction and amount of the analog stick 91, and proceeds to step S113. For example, the control unit 21 obtains the tilt direction and amount of the analog stick 91 indicated by the operation data Dp, and changes the orientation of the third object OBJ3 in the virtual space in the direction in the virtual space corresponding to the tilt direction, at a speed corresponding to the tilt amount, and moves it in the direction corresponding to the orientation, and updates the object data Dq.

[0133] In step S113, the control unit 21 determines whether or not the mouse sensor 96 has detected an object.

[0134] In step S114, the control unit 21 calculates the injection position and injection direction based on the position and orientation of the third object OBJ3 in the virtual space, updates the object data Dq, and proceeds to the next step.

[0135] Next, the control unit 21 updates the object data Dq by injecting the fourth object OBJ4 based on the injection position and injection direction calculated in step S114 (step S115), and terminates the processing by the subroutine.

[0136] Returning to Figure 17, if the control unit 21 determines in step S103 that no lateral lifting operation has been performed, it performs other processing (step S105) and proceeds to step S106. As an example, the control unit 21 performs processing according to the output data output from the input device 9 by the normal posture operation.

[0137] Thus, according to the information processing system 1b of the second embodiment, it is determined that the input device 9 having mouse functionality is being held horizontally, and when this is the case, the object's movement is controlled when the object to be detected approaches the opening that forms the light guide path of the mouse sensor. Therefore, it is possible to provide an unprecedented operating experience and level of interest with respect to the operation of the input device. Furthermore, in the game processing example of the second embodiment, when a detection result indicating that the state has changed from one in which no object was detected to one in which an object was detected is obtained from the mouse sensor, a predetermined action of the object is performed. Therefore, it becomes possible to perform operations similar to operation buttons using the opening of the mouse sensor, and a novel operating sensation using the mouse sensor can be obtained.

[0138] Furthermore, whether the input device is being operated in a reversed or sideways position may be determined or estimated by other means. For example, in the information processing system 1, guidance processing that outputs images or sounds to guide the user to operate the input device in a reversed or sideways position may be performed, thereby estimating that the input device is being operated by the guided user in a reversed or sideways position. The above estimation may be determined based on the user operating a specific operation button or covering the opening for the mouse sensor in response to the guidance processing.

[0139] Each object in the first and second embodiments described above is merely an example, and any other object may be used. Similarly, the actions performed by each object in response to the operation of the input device are also merely examples, and other actions may be performed. For example, in the second embodiment, the third object OBJ3 is a hand, and the action of touching the hand at that location may be performed by the operation of closing the opening. In this case, depending on whether there is another object at that location, or depending on the location of that other object, a reaction by that other object may be performed. Also, in the first embodiment, the game processing may consist of only one of the first object OBJ1 and the second object OBJ2, or it may consist of further objects operated by the input device.

[0140] Furthermore, in the first and second embodiments described above, the input device does not have an inertial sensor (e.g., an angular velocity sensor and / or an acceleration sensor), and the output from the inertial sensor does not have to be used for game processing. Even if the input device is equipped with an inertial sensor, its output does not have to be used for game processing.

[0141] Furthermore, although the above explanation used an example in which information processing is performed by the information processing device 2, at least a portion of the processing steps in the above process may be performed by other devices. In addition, the above process can be executed by cooperation between multiple processors included in an information processing system consisting of at least one information processing device.

[0142] Although the present invention has been described in detail above, the above description is merely illustrative in all respects and is not intended to limit its scope. Needless to say, various improvements and modifications can be made without departing from the scope of the present invention. It is understood that the scope of the present invention should be interpreted solely by the claims. Furthermore, it is understood that those skilled in the art can implement an equivalent scope based on the description of the specific embodiments of the present invention and common technical knowledge. Furthermore, it should be understood that terms used herein are used in the sense commonly used in the art unless otherwise specified. Accordingly, unless otherwise defined, all technical terms used herein have the same meaning as commonly understood by those skilled in the art to which the present invention pertains. In case of any conflict, this specification (including definitions) shall prevail. [Industrial applicability]

[0143] As described above, the present invention is useful, for example, as a game processing method, a game program, and a game system, with the aim of providing an unprecedented user experience and level of entertainment. [Explanation of Symbols]

[0144] 1… Information processing system 2…Information Processing Devices 21... Control Unit 22...Storage section 23...Program storage unit 24... Communications Department 3, 9... Input devices 31, 32, 92-95... Operation buttons 34, 96… Mouse sensor 35...Angular velocity sensor 36…Accelerometer 4...Display device 91... Analog stick

Claims

1. A game processing method implemented by a computer, Based on the inertial sensor data output from the mouse's inertial sensor, it is determined that the mouse is in a first posture with its bottom surface exposed. A game processing method that, when it is determined that the first posture is present, executes a first game process based on the inertial sensor data and mouse sensor data output from a mouse sensor provided on the bottom surface of the mouse that detects light incident on it from an opening on the bottom surface.

2. The game processing method according to claim 1, wherein the first game processing includes processing to manipulate a first object based on the inertial sensor data and the mouse sensor data.

3. The first game process is, A process to determine the first parameter of the first object based on the inertial sensor data, The game processing method according to claim 2, further comprising the process of determining a second parameter of the first object based on the mouse sensor data.

4. The first parameter is the orientation of the first object in a first direction, The game processing method according to claim 3, wherein the second parameter is the orientation of the first object in a second direction.

5. The first game process is, A process to set the position in the virtual space based on the inertial sensor data, The game processing method according to claim 1, further comprising a first processing step relating to the set position based on the mouse sensor data.

6. The first game process is, A process to manipulate the orientation of the first object based on the inertial sensor data, The game processing method according to claim 2, further comprising: a first processing based on the orientation of the first object manipulated by the inertial sensor data.

7. The game processing method according to claim 6, wherein the first processing is the process of ejecting a second object from the first object.

8. The game processing method according to claim 7, wherein the second object is ejected based on the mouse sensor data indicating that the object detected by the mouse sensor is no longer detected.

9. moreover, Based on the inertial sensor data, it is determined that the mouse is in a second posture, which is different from the first posture, and has its bottom surface exposed. If it is determined that the second posture is present, the second game process is executed. The first game processing includes a first operation processing that manipulates a first object based on the mouse sensor data, The second game process includes a second operation process that manipulates the first object based on the mouse sensor data, The game processing method according to claim 1, wherein the second operation process is a process different from the first operation process.

10. The computer of the information processing device, A means for determining that the mouse is in a first posture in which its bottom surface is exposed, based on inertial sensor data output from the mouse's inertial sensor, A game program that, when it is determined that the first posture is present, is configured to function as a means for executing a first game process based on the inertial sensor data and mouse sensor data output from a mouse sensor provided on the bottom surface of the mouse that detects light incident on it from an opening on the bottom surface.

11. The game program according to claim 10, wherein the first game processing includes processing to manipulate a first object based on the inertial sensor data and the mouse sensor data.

12. The first game process is, A process to determine the first parameter of the first object based on the inertial sensor data, The game program according to claim 11, further comprising the process of determining a second parameter of the first object based on the mouse sensor data.

13. The first parameter is the orientation of the first object in a first direction, The game program according to claim 12, wherein the second parameter is the orientation of the first object in a second direction.

14. The first game process is, A process to set the position in the virtual space based on the inertial sensor data, The game program according to claim 10, further comprising a first process relating to the set position based on the mouse sensor data.

15. The first game process is, A process to manipulate the orientation of the first object based on the inertial sensor data, The game program according to claim 11, further comprising: a first process based on the orientation of the first object manipulated by the inertial sensor data.

16. The game program according to claim 15, wherein the first process is the process of ejecting a second object from the first object.

17. The game program according to claim 16, wherein the second object is ejected based on the mouse sensor data indicating that the object detected by the mouse sensor is no longer detected.

18. Means for determining, based on the inertial sensor data, that the mouse is in a second posture, which is different from the first posture, and in which the bottom surface is exposed. If it is determined that the second posture is present, the computer is further activated as a means for executing the second game process. The first game processing includes a first operation processing that manipulates a first object based on the mouse sensor data, The second game process includes a second operation process that manipulates the first object based on the mouse sensor data, The game program according to claim 10, wherein the second operation process is a process different from the first operation process.

19. A game system comprising at least a processor and a mouse, The aforementioned processor, A means for determining that the mouse is in a first posture in which its bottom surface is exposed, based on inertial sensor data output from an inertial sensor provided by the mouse, A game system that, when it is determined that the first posture is present, functions as a means for executing a first game process based on the inertial sensor data and mouse sensor data output from a mouse sensor provided on the bottom surface of the mouse that detects light incident on it from an opening on the bottom surface.

Images