Information processing program, information processing system, and information processing method

Abstract

The present invention involves, in a mouse operation mode, moving a first display indicating a displayed item according to first mouse operation data of a first input device gripped by the left hand of a user and second mouse operation data of a second input device gripped by the right hand of the user. The present invention further involves, in a direction input operation mode, moving a second display indicating the item according to first direction input unit operation data of the first input device, and avoiding moving the second display according to second direction input unit operation data of the second input device. The present invention further involves executing either the mouse operation mode or the direction input operation mode.

Description

Information processing program, information processing system, and information processing method

[0001] The present disclosure relates to information processing for games and the like.

[0002] 2. Description of the Related Art Input devices equipped with a pointing device and a non-pointing device have been known in the past (see, for example, Patent Document 1).

[0003] JP 2010-097429 A

[0004] There was a need for a new way to control the display of objects using input devices.

[0005] Therefore, it is an object of the present invention to provide a new method for controlling the display of an object using an input device.

[0006] To achieve the above object, the following configuration examples can be given.

[0007] One configuration example is an information processing program that causes a processor of an information processing device to acquire, from a first input device that has a first directional input unit and a first mouse sensor and is held in the user's left hand, first directional input unit operation data in response to an operation of the first directional input unit by the user and first mouse operation data in response to movement of the first input device by the user, and acquire, from a second input device that has a second directional input unit and a second mouse sensor and is held in the user's right hand, second directional input unit operation data in response to an operation of the second directional input unit by the user and second mouse operation data in response to movement of the second input device by the user, and in a mouse operation mode, move a first display that points to a displayed item in response to the first mouse operation data and the second mouse operation data, and in a directional input operation mode, move a second display that points to a displayed item in response to the first directional input unit operation data and do not move the second display in response to the second directional input unit operation data, and execute either the mouse operation mode or the directional input operation mode.

[0008] According to the above configuration example, in the mouse operation mode, the first display can be operated as a mouse using either the first input device operated with the left hand or the second input device operated with the right hand, thereby improving operability. Furthermore, when a user generally holds an input device with both hands (e.g., when one input device is held with both hands, or when two input devices are held in each hand), directional input operations are often performed with the thumb of the left hand. Therefore, according to the above configuration example, the second display is moved by a directional input operation to the first input device held in the left hand, while the second display is not moved by a directional input operation to the second input device held in the right hand, thereby providing operation without discomfort or confusion.

[0009] As another example configuration, the processor may execute a game mode in which the first display and the second display are not displayed and the game mode progresses according to the first mouse operation data and the second mouse operation data, and a menu mode in which the game mode is transitioned to and either the mouse operation mode or the directional input operation mode is executed.

[0010] According to the above configuration example, when transitioning from game mode, in which operations are performed using both the first input device and the second input device, to menu mode, operations can be performed using both the first input device and the second input device in the menu mode, thereby improving operability.

[0011] As another example of configuration, the processor may be configured to display the first display and the second display differently, not display the second display in the mouse operation mode, not display the first display in the directional input operation mode, and switch to the mouse operation mode when transitioning from the game mode to the menu mode.

[0012] According to the above configuration example, one of the first display and the second display is displayed depending on the operation mode, and the other is not displayed, making it easy to recognize which operation mode you are currently in. Furthermore, when transitioning from game mode, which is progressed in response to mouse operation, to menu mode, the mouse operation mode is entered, so the user can move the first display by operating the mouse as in game mode, providing smooth operability when transitioning to menu mode.

[0013] As another configuration example, the processor may be caused to execute a mouse operation mode when first mouse operation data indicating movement of the first input device or second mouse operation data indicating movement of the second input device is acquired, and to execute a directional input operation mode when first directional input unit operation data indicating an operation input to the first directional input unit is acquired.

[0014] According to the above configuration example, there is no need to perform an additional operation to switch between the mouse operation mode and the direction input operation mode, thereby improving operability.

[0015] As another configuration example, the processor may be caused to execute the mouse operation mode when at least one of the first mouse operation data and the second mouse operation data and the first directional input unit operation data are acquired together.

[0016] In order to operate the mouse, the user needs to place the surface of the input device equipped with the mouse sensor on the work surface. Therefore, when a mouse operation is performed, it is highly likely that the user intends to operate the mouse, and not to perform a directional input operation. Therefore, the above configuration example can provide the operation mode that matches the user's intention.

[0017] As another configuration example, the first input device may have a first directional input unit on the front, a first button on the top or left side, and a first mouse sensor on the right side, while the second input device may have a second directional input unit and a second button on the front, a third button on the top or right side, and a second mouse sensor on the left side, and the processor may be configured such that in mouse operation mode, the first and third buttons have a decision function and the second button does not have the decision function, and in directional input operation mode, the second button has the decision function and the first and third buttons do not have the decision function.

[0018] According to the above configuration example, it is easy to perform the decision operation in the mouse operation mode, and it is also easy to perform the decision operation in the direction input operation mode.

[0019] As another configuration example, the processor may have a function of switching items with the first button and the third button in the direction input operation mode.

[0020] According to the above configuration example, by differentiating the functions of the first button and the third button between the mouse operation mode and the direction input operation mode, it is possible to effectively utilize the buttons and provide a natural operability.

[0021] As another configuration example, the first representation may be a first object, and the second representation may be a second object different from the first object.

[0022] According to this embodiment, a new method for controlling object display using an input device can be provided.

[0023] FIG. 1 is a diagram showing an example of a state in which the left controller 3 and the right controller 4 are attached to the main unit 2; A six-sided diagram showing an example of the left controller 3; A six-sided diagram showing an example of the right controller 4; A block diagram showing an example of the internal configuration of the main unit 2; A block diagram showing an example of the internal configuration of the main unit 2, the left controller 3, and the right controller 4; A diagram for explaining a screen in game mode; A diagram for explaining how to hold and operate the controller in game mode; A diagram for explaining a screen in mouse operation mode in menu mode; A diagram for explaining a screen in mouse operation mode in menu mode; A diagram for explaining how to hold and operate the controller in mouse operation mode; A diagram for explaining a screen in directional input operation mode in menu mode; A diagram for explaining a screen in directional input operation mode in menu mode; A diagram for explaining how to hold and operate the controller in directional input operation mode; A diagram showing an example of various data stored in DRAM 85; An example of a flowchart for information processing; An example of a flowchart for information processing; An example of a flowchart for information processing

[0024] An embodiment will be described below.

[0025] [Hardware configuration of information processing system]

[0026] A game system, which is an example of an information processing system according to this embodiment, will be described below. The example of the game system 1 according to this embodiment includes an information processing device (sometimes referred to as a "main unit") 2, a left controller 3, and a right controller 4. The left controller 3 and the right controller 4 are each detachable from the main unit 2.

[0027] FIG. 1 is a diagram showing an example of a state in which a left controller 3 and a right controller 4 are attached to a main unit 2. As shown in FIG. 1, the left controller 3 and the right controller 4 are each attached to the main unit 2 and integrated together. The main unit 2 is a device that executes various processes (e.g., game processes) in the game system 1. The main unit 2 includes a display 12. The left controller 3 and the right controller 4 include operation units that allow the user to perform input. Note that, below, the left controller 3 and the right controller 4 may be collectively referred to as "controllers." The left controller 3 may also be referred to as the "first input device," and the right controller 4 may also be referred to as the "second input device."

[0028] The main device 2 includes a display 12. The display 12 displays an image generated by the main device 2. The display 12 is, for example, a liquid crystal display (LCD). A touch panel is provided on the screen of the display 12. The touch panel is, for example, of a type that allows multi-touch input (e.g., a capacitance type).

[0029] FIG. 2 is a six-sided view showing an example of the left controller 3. As shown in FIG. 2, the left controller 3 has a vertically long shape, that is, a shape that is long in the z-axis direction shown in FIG. 2. The left controller 3 has a protrusion 40 that fits into a recess (not shown) of the main unit 2 when attached to the main unit 2. The left controller 3 can also be held in a vertically long orientation when detached from the main unit 2. The left controller 3 has a shape and size that allows it to be held in one hand, particularly the left hand, when held in a vertically long orientation. The left controller 3 can also be held in a horizontally long orientation, and when held in a horizontally long orientation, it may be held with both hands.

[0030] The left controller 3 is equipped with a left analog stick (sometimes referred to as a "left stick") 32, which is an example of a directional input device. As shown in FIG. 2 , the left stick 32 is provided on the front surface of the left controller 3. The left stick 32 can be used as a directional input unit that can input directions. By tilting the left stick 32, the user can input a direction that corresponds to the tilt direction, and the input size can correspond to the tilt angle.

[0031] The left controller 3 is equipped with various operation buttons. The left controller 3 is equipped with a right direction button 33, a down direction button 34, an up direction button 35, a left direction button 36, a record button 37, and a - (minus) button 47 on the front surface. The left controller 3 is equipped with an L button 38 and a ZL button 39 on both the top and left surfaces. The L button 38 and ZL button 39 may be equipped only on the top surface of the left controller 3, or only on the left surface. The left controller 3 is equipped with a button 43 and a button 44 on a protrusion 40 on the right surface.

[0032] The left controller 3 has a mouse sensor opening 70 in the protrusion 40 on its right surface. The mouse sensor opening 70 is an opening that guides light to the mouse sensor 71 placed inside it. The mouse sensor 71 is, for example, a general mouse sensor (e.g., an optical or laser mouse sensor), and acquires data used to calculate movement on the work surface (movement direction, movement distance, movement speed, etc.) of the left controller 3, which is placed with its right surface (i.e., the upper surface of the protrusion 40) facing the work surface.

[0033] In addition, the left controller 3 has a terminal 72 on the protrusion 40 on the right surface, which allows the left controller 3 to communicate with the main unit 2 via a wired connection.

[0034] FIG. 3 is a six-sided view showing an example of the right controller 4. As shown in FIG. 3, the right controller 4 has a vertically long shape, that is, a shape that is long in the z-axis direction shown in FIG. 3. The right controller 4 has a protrusion 62 that fits into a recess (not shown) of the main unit 2 when attached to the main unit 2. The right controller 4 can also be held in a vertically long orientation when detached from the main unit 2. The right controller 4 has a shape and size that allows it to be held in one hand, particularly the right hand, when held in a vertically long orientation. The right controller 4 can also be held in a horizontally long orientation, and when held in a horizontally long orientation, it may be held with both hands.

[0035] The right controller 4 is equipped with a right analog stick (sometimes referred to as the "right stick") 52 on the front surface as a directional input unit. In this embodiment, the right stick 52 has the same configuration as the left stick 32 of the left controller 3. The right controller 4 is equipped with an A button 53, a B button 54, an X button 55, a Y button 56, a + (plus) button 57, and a home button 58 on the front surface. The right controller 4 is equipped with an R button 60 and a ZR button 61 on both the top and right surfaces. The R button 60 and the ZR button 61 may be equipped only on the top surface of the right controller 4, or only on the right surface. The right controller 4 is equipped with a button 65 and a button 66 on a protrusion 62 on the left surface.

[0036] The right controller 4 has a mouse sensor opening 73 in the protrusion 62 on its left surface. The mouse sensor opening 73 is an opening that guides light to a mouse sensor 74 placed inside it. The mouse sensor 74 is, for example, a general mouse sensor (e.g., an optical or laser mouse sensor), and acquires data used to calculate movement on the work surface (movement direction, movement distance, movement speed, etc.) of the right controller 4, which is placed with its left surface (i.e., the upper surface of the protrusion 62) facing the work surface.

[0037] In addition, the right controller 4 has a terminal 75 on the protrusion 62 on the left surface, which allows the right controller 4 to communicate with the main unit 2 via a wired connection.

[0038] 4 is a block diagram showing an example of the internal configuration of the main unit 2. The main unit 2 includes a processor 81. The processor 81 is an information processing unit that executes various types of information processing executed in the main unit 2, and may be composed of, for example, one or more CPUs (Central Processing Units), or may be composed of a SoC (System-on-a-chip) that includes multiple functions such as a CPU function and a GPU (Graphics Processing Unit) function. The processor 81 executes various types of information processing by executing an information processing program (e.g., a game program) stored in a storage unit (specifically, an internal storage medium such as flash memory 84, or an external storage medium inserted into slot 23, etc.).

[0039] The main unit 2 includes, as examples of internal storage media, a flash memory 84 and a DRAM (Dynamic Random Access Memory) 85. The flash memory 84 is a memory used primarily for storing various data (which may be programs) saved in the main unit 2. The DRAM 85 is a memory used for temporarily storing various data used in information processing. The processor 81 reads and writes data from and to storage media such as the flash memory 84 and the DRAM 85 as appropriate to perform various information processing.

[0040] Furthermore, the main device 2 has various components as shown in Figure 4. A brief description is given below. A slot interface (sometimes referred to as "slot I / F") 91 reads and writes data from a predetermined type of storage medium (e.g., a dedicated memory card) inserted into the slot 23 in response to instructions from the processor 81. A network communication unit 82 communicates with external devices via a network (e.g., Internet communication).

[0041] The controller communication unit 83 performs wireless communication (for example, communication according to the Bluetooth (registered trademark) standard) with the left controller 3 and / or right controller 4. The left side terminal 17 is a terminal for performing data communication between the processor 81 and the left controller 3. The right side terminal 21 is a terminal for performing data communication between the processor 81 and the right controller 4. The lower side terminal 27 is a terminal for outputting data (for example, image data or audio data) to a stationary monitor or the like via the cradle when the lower side terminal 27 is attached to the cradle.

[0042] The touch panel controller 86 generates data indicating, for example, the position at which a touch input has been made based on a signal from the touch panel 13 arranged on the display surface of the display 12, and outputs the data to the processor 81. The display 12 displays images generated by the processor 81 and / or images acquired from an external device. The codec circuit 87 controls the input and output of audio data to the speaker 88 and the audio input / output terminal 25. The power control unit 97 controls the power supply from the battery 98 to each unit of the main unit 2 (i.e., each unit that receives power from the battery 98) based on instructions from the processor 81, and also starts or stops the power supply in response to pressing of the power button 28.

[0043] 5 is a block diagram showing an example of the internal configuration of the main unit 2, left controller 3, and right controller 4. Note that details of the internal configuration of the main unit 2 are omitted in FIG. 5 because they are shown in FIG. 4.

[0044] The left controller 3 is equipped with a communication control unit 101 that communicates with the main unit 2. As shown in Figure 5, the communication control unit 101 is connected to each component, including the terminal 42. When the left controller 3 is attached to the main unit 2, the communication control unit 101 communicates with the main unit 2 via the terminal 42, and when the left controller 3 is detached from the main unit 2, the communication control unit 101 communicates wirelessly with the main unit 2.

[0045] The left controller 3 includes a memory 102, such as a flash memory. The communication control unit 101 is configured by a microcomputer (also called a microprocessor), for example, and executes firmware stored in the memory 102 to perform various processes.

[0046] The left controller 3 includes buttons 103 (specifically, buttons 33 to 36, etc.) and a left stick 32. Each button 103 and left stick 32 repeatedly outputs information relating to operations performed on them to the communication control unit 101 at appropriate timing.

[0047] The left controller 3 is equipped with an inertial sensor. Specifically, the left controller 3 is equipped with an acceleration sensor 104 and an angular velocity sensor 105. In this embodiment, the acceleration sensor 104 detects the magnitude of acceleration along three predetermined axes (for example, the x, y, and z axes shown in FIG. 2 ). The acceleration sensor 104 may detect acceleration along one or two axes. In this embodiment, the angular velocity sensor 105 detects angular velocity around three predetermined axes (for example, the x, y, and z axes shown in FIG. 2 ). The angular velocity sensor 105 may detect angular velocity around one or two axes. The acceleration sensor 104 and the angular velocity sensor 105 are each connected to the communication control unit 101. The detection results of the acceleration sensor 104 and the angular velocity sensor 105 are repeatedly output to the communication control unit 101 at appropriate timing.

[0048] The left controller 3 is equipped with a mouse sensor 71. The mouse sensor 71 acquires data for calculating the movement of the left controller 3 on the work surface (movement direction, movement distance, movement speed, etc.). This data can also be used to determine whether the right surface of the left controller 3 is in contact with the work surface or close to being in contact (for example, a state in which the gap between the right surface and the work surface is a predetermined distance (for example, 1 mm) or less). The data acquired by the mouse sensor 71 is repeatedly output to the communication control unit 101 at appropriate timing.

[0049] The communication control unit 101 acquires information about inputs (specifically, information about operations or detection results by the sensors) from each input unit (specifically, each button 103, left stick 32, and each sensor 104, 105, and 71). The communication control unit 101 transmits operation data including the acquired information or information obtained by performing predetermined processing on the acquired information to the main unit 2. The operation data is repeatedly transmitted once every predetermined time.

[0050] By transmitting the operation data to the main unit 2, the main unit 2 can obtain inputs made to the left controller 3. That is, the main unit 2 can determine operations made to the buttons 103 and the left stick 32 based on the operation data. The main unit 2 can also calculate information about the movement and / or attitude of the left controller 3 based on the operation data (specifically, the detection results of the acceleration sensor 104 and the angular velocity sensor 105). The main unit 2 can also calculate information about mouse operations made to the left controller 3 based on the operation data (specifically, the detection results of the mouse sensor 71).

[0051] The left controller 3 includes an amplifier 106 and a vibrator 107. The amplifier 106 amplifies the control signal received from the communication control unit 101 and generates a drive signal. The vibrator 107 performs a vibration operation in response to the drive signal generated by the amplifier 106, causing the left controller 3 to vibrate.

[0052] The left controller 3 is equipped with a power supply unit 108. The power supply unit 108 has a battery and a power control circuit. The power control circuit is connected to the battery and to each part of the left controller 3 (specifically, each part that receives power from the battery).

[0053] 5 , the right controller 4 is equipped with a communication control unit 111 that communicates with the main unit 2. The right controller 4 is equipped with a memory 112 that is connected to the communication control unit 111. The communication control unit 111 is connected to each component, including the terminal 64. The communication control unit 111 and memory 112 have the same functions as the communication control unit 101 and memory 102 of the left controller 3. Therefore, the communication control unit 111 can communicate with the main unit 2 both via wired communication via the terminal 64 and via wireless communication that does not use the terminal 64 (specifically, communication in accordance with the Bluetooth (registered trademark) standard), and controls the communication that the right controller 4 performs with the main unit 2.

[0054] The right controller 4 has input sections similar to those of the left controller 3. Specifically, it has buttons 113 (A button 53, B button 54, X button 55, Y button 56, etc.), a right stick 52, inertial sensors (acceleration sensor 114 and angular velocity sensor 115), and a mouse sensor 74. Each of these input sections has the same function as the input sections of the left controller 3, and operates in the same way.

[0055] The right controller 4 includes an amplifier 116, a vibrator 117, and a power supply unit 118. The amplifier 116, the vibrator 117, and the power supply unit 118 have the same functions as the amplifier 106, the vibrator 107, and the power supply unit 108 of the left controller 3, respectively, and operate in the same manner.

[0056] The right controller 4 includes a processing unit 121 and an NFC communication unit 122. The processing unit 121 controls the NFC communication unit 122 in response to commands from the main unit 2 via the communication control unit 111. The NFC communication unit 122 performs short-range wireless communication based on the NFC (Near Field Communication) standard.

[0057] [Game Assumed in This Embodiment] Next, an overview of the game processing executed by the game device (game system) 1 according to this embodiment will be described. The game assumed in this embodiment is, as an example, a wheelchair basketball game in which three players play multiplayer games against three other players. Specifically, the wheelchair basketball game is played by moving player objects (objects each representing a person in a wheelchair; sometimes referred to as "PO") that operate in response to the operations of each player within a virtual space in which the court and goals of the wheelchair basketball game are arranged. Note that some of the POs may be automatically controlled non-player objects. The game may also be a game featuring a single PO. The game is not limited to a wheelchair basketball game and may be other games. For example, the game may be a boat game in which a person sits in a boat and uses their left hand to operate an oar that rows the left side of the boat and their right hand to operate an object that rows the right side of the boat.

[0058] This game has a Game Mode and a Menu Mode. The user plays the wheelchair basketball game in Game Mode and can configure various settings for the game in Menu Mode. The user can switch between Game Mode and New Mode in response to user operations.

[0059] [Outline of Game Processing of the Present Embodiment] Next, an outline of the processing executed by the game device 1 according to the present embodiment will be described. Fig. 6 is an example of a display screen of a game mode. In Fig. 6, a PO 200 operated by a user on this game device 1, a PO 211 operated by another user on another game device 1, a ball 210, a goal 212, etc. are displayed.

[0060] [Regarding Game Mode] Figure 7 is a diagram illustrating operations performed by a user in game mode, such as moving a PO 200 in a virtual space. As shown in Figure 7, in game mode, a user can hold the left controller 3 between the thumb, ring finger, and little finger of their left hand 280, place the index finger on the L button 38, and place the middle finger on the ZL button 39. Similarly, a user can hold the right controller 4 between the thumb, ring finger, and little finger of their right hand 281, place the index finger on the R button 60, and place the middle finger on the ZR button 61.

[0061] 7, the user can place the right face of the left controller 3 (see FIG. 2) on the work surface to move the left controller 3, and can also place the left face of the right controller 4 (see FIG. 3) on the work surface to move the right controller 4. In this way, the user can perform mouse operations (sometimes called "mouse input operations") on the left controller 3 and the right controller 4, operating them as a mouse. Furthermore, while performing mouse operations, the user can press the L button 38 and ZL button 39 on the left controller 3, and the R button 60 and ZR button 61 on the right controller 4.

[0062] In the game mode, the user can use the left controller 3 and / or the right controller 4 as a mouse to rotate the wheels of the wheelchair of the PO 200, thereby moving and changing the direction of the PO 200. This will be explained in detail below.

[0063] When a mouse operation is performed on the work surface to move the left controller 3 in the positive direction of the z axis (see FIGS. 2 and 7), the left wheel 201 of the wheelchair rotates in the direction in which the PO 200 moves forward. When a mouse operation is performed on the work surface to move the right controller 4 in the positive direction of the z axis (see FIGS. 3 and 7), the right wheel 202 of the wheelchair rotates in the direction in which the PO 200 moves forward. When a mouse operation is performed on the work surface to move the left controller 3 in the negative direction of the z axis (see FIGS. 2 and 7), the left wheel 201 of the wheelchair rotates in the direction in which the PO 200 moves backward. When a mouse operation is performed on the work surface to move the right controller 4 in the negative direction of the z axis (see FIGS. 3 and 7), the right wheel 202 of the wheelchair rotates in the direction in which the PO 200 moves backward.

[0064] For this reason, when a mouse operation to move the left controller 3 in the positive direction of the z-axis (see FIGS. 2 and 7) and a mouse operation to move the right controller 4 in the positive direction of the z-axis (see FIGS. 3 and 7) are performed simultaneously, as shown in Fig. 6 (1), both wheels of the wheelchair rotate in the direction in which the PO 200 moves forward, causing the PO 200 to move forward. In this case, for example, if the moving speed of the right controller 4 in the positive direction of the z-axis is slower than the moving speed of the left controller 3 in the positive direction of the z-axis, the PO 200 will move forward while turning right.

[0065] When a mouse operation to move the left controller 3 in the negative z-axis direction (see FIGS. 2 and 7) and a mouse operation to move the right controller 4 in the negative z-axis direction (see FIGS. 3 and 7) are performed simultaneously, both wheels of the wheelchair rotate in a direction that moves the PO 200 backward, causing the PO 200 to move backward. In this case, for example, if the moving speed of the right controller 4 in the negative z-axis direction is slower than the moving speed of the left controller 3 in the negative z-axis direction, the PO 200 will move backward while turning left.

[0066] When a mouse operation to move the left controller 3 in the positive direction of the z axis (see FIGS. 2 and 7) and a mouse operation to move the right controller 4 in the negative direction of the z axis (see FIGS. 3 and 7) are performed simultaneously, the PO 200 rotates to the right, as shown in Figure 6 (2). When a mouse operation to move the left controller 3 in the negative direction of the z axis (see FIGS. 2 and 7) and a mouse operation to move the right controller 4 in the positive direction of the z axis (see FIGS. 3 and 7) are performed simultaneously, the PO 200 rotates to the left.

[0067] As described above, in game mode, the user can play the wheelchair basketball game by moving the PO 200 by performing mouse operations on the work surface using the left controller 3 and the right controller 4. In this case, no object, such as a mouse cursor, is displayed or moved in conjunction with the mouse operations on each controller (3, 4). Note that the rotation of each wheel is merely an animation, and the direction and speed of movement of the PO 200 may be calculated independently of the calculation of the wheel rotation pattern. Furthermore, the user can shoot the ball 210 toward the goal 212 or steal the ball 210 from another PO 211 by performing predetermined operations on the left controller 3 and / or the right controller 4.

[0068] [Regarding Menu Mode] Next, the menu mode of this embodiment will be described. When the plus button 57 on the right controller 4 is pressed in game mode, the mode transitions to menu mode. Furthermore, when the plus button 57 on the right controller 4 is pressed in menu mode, the mode transitions to game mode. Menu mode is a mode in which the user makes settings related to the game. Menu mode includes a mouse operation mode and a directional input operation mode. The mouse operation mode and the directional input operation mode are switched between in response to user operations. A specific description will be given below.

[0069] 8 and 9 are examples of display screens in the mouse operation mode. As shown in FIG. 8(1), in the menu mode, a menu 270 is displayed. The menu 270 consists of a menu sheet 220 with tab A, a menu sheet 221 with tab B, and a menu sheet 222 with tab C. In FIG. 8(1), the menu sheet 220 with tab A is displayed in the foreground, and the other menu sheets are hidden except for the tabs. The menu sheet 220 has setting items 230 to 235. For example, the menu sheet 220 is a sheet for the user to set the abilities of the PO. In this game, three POs belong to the same team. For example, the setting item 230 is a button for setting whether the control tendency of each PO during automatic control is to emphasize defense, and the setting items 231 to 233 are buttons for setting the special skills of each PO.

[0070] When the mode is switched from game mode to menu mode, a menu 270 is displayed, and the mouse operation mode is entered, in which the mouse cursor 250 is displayed (see FIG. 8(1)). The mouse cursor 250 is not displayed in game mode or directional input operation mode. When the mode is switched from game mode to menu mode, the mouse cursor 250 is displayed at a predetermined initial position, as shown in FIG. 8(1). In this embodiment, this initial position is the center of the screen. In other embodiments, this initial position may be at another position on the screen.

[0071] In the mouse operation mode, the mouse cursor 250 moves in accordance with mouse operations performed on the left controller 3 or the right controller 4. A specific explanation will be given below. Figure 10 is a diagram for explaining mouse operations performed on the left controller 3 and the right controller 4 in the mouse operation mode. As shown in Figure 10, in the mouse operation mode, the user can hold the controller in the same way as in the game mode (see Figure 7).

[0072] When the left controller 3 is operated in the mouse operation mode, the mouse cursor 250 moves in a direction and at a speed corresponding to the mouse operation. Specifically, when the left controller 3 moves in the positive direction of the z axis on the work surface (see FIGS. 2 and 10), the mouse cursor 250 moves in the positive direction of the y axis in FIG. 8(1). When the left controller 3 moves in the negative direction of the z axis on the work surface, the mouse cursor 250 moves in the negative direction of the y axis in FIG. 8(1). When the left controller 3 moves in the positive direction of the y axis on the work surface (see FIGS. 2 and 10), the mouse cursor 250 moves in the negative direction of the x axis in FIG. 8(1). When the left controller 3 moves in the negative direction of the y axis on the work surface, the mouse cursor 250 moves in the positive direction of the x axis in FIG. 8(1). In this way, the movement of the mouse operation performed on the left controller 3 is reflected as the movement of the mouse cursor 250.

[0073] Similarly, when the right controller 4 is operated in mouse operation mode, the mouse cursor 250 moves in a direction and at a speed corresponding to the mouse operation. Specifically, when the right controller 4 moves in the positive z-axis direction on the work surface (see FIGS. 3 and 10), the mouse cursor 250 moves in the positive y-axis direction in FIG. 8(1). When the right controller 4 moves in the negative z-axis direction on the work surface, the mouse cursor 250 moves in the negative y-axis direction in FIG. 8(1). When the right controller 4 moves in the positive y-axis direction on the work surface (see FIGS. 3 and 10), the mouse cursor 250 moves in the positive x-axis direction in FIG. 8(1). When the right controller 4 moves in the negative y-axis direction on the work surface, the mouse cursor 250 moves in the negative x-axis direction in FIG. 8(1). In this way, the movement of the mouse operation performed on the right controller 4 is reflected as the movement of the mouse cursor 250.

[0074] When mouse operations are performed simultaneously with both the left controller 3 and the right controller 4, the mouse cursor 250 moves according to the mouse operation of the controller that moves the greater amount per given time (i.e., the movement speed). In this way, even if the controller not intended for mouse operation moves to a certain extent on the work surface, the mouse cursor 250 can be moved appropriately by the controller intended for mouse operation.

[0075] As shown in Fig. 8(2), when the mouse cursor 250 is moved and the tip of the mouse cursor 250 overlaps one of the setting items, that setting item is designated. In Fig. 8(2), the tip of the mouse cursor 250 overlaps the setting item 230, and the setting item 230 is designated and changes color.

[0076] As shown in Figure 8 (3), when the L button 38 of the left controller 3 or the R button 60 of the right controller 4 is pressed with the tip of the mouse cursor 250 over a setting item (see Figure 10), the execution of a process corresponding to the setting item over which the tip of the mouse cursor 250 is over is determined. In Figure 8 (3), when the L button 38 of the left controller 3 or the R button 60 of the right controller 4 is pressed with the tip of the mouse cursor 250 over the setting item 230, the process corresponding to the setting item 230 (i.e., setting the PO to emphasize defense) is executed, and a check mark is displayed on the setting item 230. Furthermore, for example, when the L button 38 of the left controller 3 or the R button 60 of the right controller 4 is pressed with the tip of the mouse cursor 250 over each of the setting items 231 to 233, the text displayed in each setting item 231 to 233 may be changed to the name of the special technique currently set for that PO.

[0077] As shown in Figures 9(1) to 9(3), when the tip of the mouse cursor 250 overlaps one of the tabs, that tab enters a designated state. In Figure 9(1), the tip of the mouse cursor 250 overlaps tab A of the menu sheet 220 displayed in the foreground, and tab A enters a designated state and changes color. In Figure 9(2), the tip of the mouse cursor 250 overlaps tab B of the menu sheet 221 that is not displayed in the foreground, and tab B enters a designated state and changes color.

[0078] As shown in Figure 9(3), when the L button 38 of the left controller 3 or the R button 60 of the right controller 4 is pressed with the tip of the mouse cursor 250 over one of the tabs (see Figure 10), the menu sheet including the tab over which the tip of the mouse cursor 250 is over is displayed in the foreground. In Figure 9(3), when the L button 38 of the left controller 3 or the R button 60 of the right controller 4 is pressed with the tip of the mouse cursor 250 over tab B, the menu sheet 221 is displayed in the foreground. Note that the menu sheet 221 has setting items 240 to 245 arranged for configuring settings related to the game stage.

[0079] In the mouse operation mode, as described above, pressing the L button 38 or the R button 60 determines whether to execute a process corresponding to a setting item or a process for displaying a menu sheet in the foreground, but the execution of these processes is not determined by the operation of any other button on the controller, etc. However, in other embodiments, the execution of these processes may be determined by the operation of any other button on the controller, etc.

[0080] In the mouse operation mode described above, when a direction is input by operating the left stick 32 or the direction buttons (right button 33, down button 34, up button 35, left button 36) of the left controller 3, the mode switches to a direction input operation mode. The direction input operation mode will be described in detail below.

[0081] When switching from the mouse operation mode to the directional input operation mode, a frame cursor 260 is displayed surrounding the setting item (see FIG. 11(1)). The frame cursor 260 is not displayed in the game mode or the mouse operation mode. When switching from the mouse operation mode to the directional input operation mode, the frame cursor 260 is displayed on a predetermined setting item, as shown in FIG. 11(1). In this embodiment, the frame cursor 260 is displayed on the setting item 230 located in the upper left of the screen. In other embodiments, the frame cursor 260 may be displayed on a setting item in another position.

[0082] In the directional input operation mode, the frame cursor 260 moves in response to a directional input operation of the left controller 3. Note that the frame cursor 260 does not move in response to a directional input operation of the right controller 4. A specific explanation will be given below. Figure 13 is a diagram for explaining operations performed on the left controller 3 and the right controller 4 in the directional input operation mode. In the directional input operation mode, the user can hold the left controller 3 and the right controller 4 as shown in Figure 13.

[0083] In the directional input operation mode, when the left controller 3 is operated to input a direction, the frame cursor 260 moves to the setting item in the direction corresponding to this directional input operation. Specifically, when a positive z-axis direction (see FIGS. 2 and 13) is input using the left stick 32 of the left controller 3 or the up button 35 (see FIG. 2) is pressed, the frame cursor 260 moves to the upper setting item. When a negative z-axis direction is input using the left stick 32 of the left controller 3 or the down button 34 (see FIG. 2) is pressed, the frame cursor 260 moves to the lower setting item. When a positive x-axis direction (see FIGS. 2 and 13) is input using the left stick 32 of the left controller 3 or the right button 33 (see FIG. 2) is pressed, the frame cursor 260 moves to the setting item on the right. When a negative x-axis direction is input using the left stick 32 of the left controller 3 or the left button 36 (see FIG. 2) is pressed, the frame cursor 260 moves to the setting item on the left. If there is no setting item in the direction of the directional input operation, for example, the frame cursor 260 does not move. Also, the setting item displayed with the frame cursor 260 is in a designated state and changes color.

[0084] In Figure 11 (2), when an input is made to the left stick 32 of the left controller 3 in the positive x-axis direction (see Figures 2 and 13) or the right direction button 33 (see Figure 2) is pressed, the frame cursor 260 moves to the setting item 231 on the right and the setting item 231 changes color.

[0085] When one of the buttons 53 to 56 on the front of the right controller 4, for example the A button 53, is pressed (see FIG. 13), execution of a process corresponding to the setting item displayed by the frame cursor 260 is decided. In FIG. 11 (3), the A button 53 is pressed, and the process corresponding to the setting item 231 displayed by the frame cursor 260 (i.e., setting the PO special technique) is executed, and a check mark is displayed on the setting item 231.

[0086] In the directional input operation mode, each time the L button 38 of the left controller 3 or the R button 60 of the right controller 4 (see FIG. 13 ) is pressed, the menu sheet displayed at the forefront is switched in order. Specifically, when the R button 60 is pressed with the menu sheet 220 at the forefront as shown in FIG. 12 (1), the menu sheet 221 is displayed at the forefront as shown in FIG. 12 (2). When the R button 60 is pressed with the menu sheet 221 at the forefront, the menu sheet 222 is displayed at the forefront. When the R button 60 is pressed with the menu sheet 222 at the forefront, the state returns to one in which the menu sheet 220 is displayed at the forefront. In this way, each time the R button 60 is pressed, the menu sheets are switched in order and displayed at the forefront. Furthermore, each time the L button 38 is pressed, the menu sheets are switched and displayed at the forefront in the reverse order to when the R button 60 is pressed.

[0087] In the above-described directional input operation mode, the mode switches to mouse operation mode when a mouse operation is performed on the left controller 3 or the right controller 4. As already explained, in menu mode (i.e., mouse operation mode or directional input operation mode), pressing the plus button 57 on the right controller 4 switches the mode to game mode.

[0088] In the directional input operation mode, the execution of a process corresponding to a setting item is determined by pressing the A button 53 as described above, but the execution of this process is not determined by the operation of any other button on the controller, etc. However, in other embodiments, the execution of this process may be determined by the operation of any other button on the controller, etc.

[0089] [Details of Information Processing in This Embodiment] Next, the information processing in this embodiment will be described in detail with reference to FIGS.

[0090] [Regarding Data Used] Various types of data used in this game processing will now be described. Fig. 14 shows an example of data stored in the DRAM 85 of the game device (game system) 1. As shown in Fig. 14, the DRAM 85 is provided with at least a program memory area 301 and a data memory area 302. The program memory area 301 stores a game program 401. The data memory area 302 stores game control data 402, image data 408, virtual camera control data 409, operation data 410, etc. The game control data 402 includes object data 403.

[0091] The game program 401 is a game program for executing the processing of this game.

[0092] The object data 403 is data on objects to be placed in the virtual space, such as the PO (PO 200, 211, etc.), the court (ground), the ball 210, the goal 212, the menu 270, the mouse cursor 250, and the frame cursor 260. The object data 403 also includes data on the coordinates, direction, posture, state, etc. of the object.

[0093] The image data 408 is image data such as an animation image of the rotating wheel of the PO 200, background, virtual effects, and the like.

[0094] The virtual camera control data 409 is data for controlling the movement of a virtual camera that is placed in a virtual space and captures images of the virtual space.

[0095] The operation data 410 is data that indicates the content of operations performed on the left controller 3 and the right controller 4. The operation data 410 includes, for example, data that indicates the input status of the movements of the left controller 3 and the right controller 4 (including movements due to mouse operation), changes in posture, operations on the sticks, and the press status of various buttons. The content of the operation data is updated at a predetermined cycle based on signals from the left controller 3 and the right controller 4.

[0096] In addition, the DRAM 85 stores various data as needed for the game mode processing of this game process, the menu mode processing, and the drawing processing.

[0097] [Details of Game Processing] Next, the processing according to this embodiment will be described with reference to a flowchart. Figures 15 to 18 are examples of flowcharts showing the processing according to this embodiment. Note that the following mainly describes the processing that is characteristic of this embodiment, and other descriptions of the drawing processing and the like will be omitted.

[0098] When the processing of this game is started and the wheelchair basketball game begins, the processing shown in Figures 15 to 18 begins. The following processing is executed at predetermined intervals (for example, for each drawing frame).

[0099] 15, processor 81 executes a game mode in which a wheelchair basketball game is played. In the game mode, processor 81 controls the operation of PO 200 to proceed with the wheelchair musketball game based on operation data 410. Thereafter, the process proceeds to step S101.

[0100] In step S101, the processor 81 determines whether or not the plus button 57 of the right controller 4 has been pressed, based on the operation data 410. If the determination is YES, the processing proceeds to step S102, and if the determination is NO, the processing proceeds to step S103.

[0101] In step S102, the processor 81 transitions from the game mode to the menu mode and executes the menu mode.

[0102] In step S103, processor 81 determines whether or not an end condition for the game has been met. This end condition is the end of the wheelchair musketball match, etc. Then, the process returns to step S100.

[0103] FIG. 16 is an example of a detailed flowchart of the menu mode in step S102 shown in FIG.

[0104] 16, processor 81 determines whether the current menu mode processing is processing in which the menu mode is entered from the game mode. If the determination is YES, the processing proceeds to step S203, and if the determination is NO, the processing proceeds to step S201.

[0105] In step S201, the processor 81 determines whether or not a mouse input operation has been performed on the left controller 3 and / or the right controller 4, based on the operation data 410. If the determination is YES, the processing proceeds to step S203, and if the determination is NO, the processing proceeds to step S202.

[0106] In step S202, the processor 81 determines whether or not a directional input operation has been performed on the left controller 3, based on the operation data 410. If the determination is YES, the processing proceeds to step S204, and if the determination is NO, the processing proceeds to step S205.

[0107] In step S203, the processor 81 executes the mouse operation mode, and then the process proceeds to step S206.

[0108] In step S204, the processor 81 executes the directional input operation mode, and then the process proceeds to step S206.

[0109] In step S205, the processor 81 executes the operation mode (mouse operation mode or directional input operation mode) executed in the previous process, and then the process proceeds to step S206.

[0110] In step S206, the processor 81 determines whether or not the plus button 57 of the right controller 4 has been pressed, based on the operation data 410. If the determination is YES, the processing proceeds to step S103 in Figure 15, and if the determination is NO, the processing returns to step S200.

[0111] FIG. 17 is an example of a detailed flowchart of the mouse operation mode executed in step S203 or S205 shown in FIG.

[0112] In step S300 of Fig. 17, the processor 81 determines whether the current mouse operation mode processing is the processing of "maintaining the previous operation mode" in step S205 of Fig. 16. In other words, the processor 81 determines whether the current mouse operation mode processing is the processing of executing the mouse operation mode in step S205 of Fig. 16. If the determination is YES, the processing proceeds to step S301, and if the determination is NO, the processing proceeds to step S302.

[0113] In step S301, the processor 81 maintains the display position of the mouse cursor 250 without moving it. Then, the process proceeds to step S308.

[0114] In step S302, processor 81 determines whether the current mouse operation mode processing is a processing in which the mouse operation mode is entered from the game mode or the directional input operation mode. If the determination is YES, the processing proceeds to step S304, and if the determination is NO, the processing proceeds to step S303.

[0115] In step S303, the processor 81 moves the mouse cursor 250 from its previous position in response to the mouse input operation in step S201 of Fig. 16 (see Fig. 8(2)), after which the process proceeds to step S308.

[0116] In step S304, processor 81 determines whether the current mouse operation mode processing is processing in which the mouse operation mode is entered from the game mode. If the determination is YES, the processing proceeds to step S305, and if the determination is NO, the processing proceeds to step S306.

[0117] In step S305, the processor 81 determines whether or not a mouse input operation has been performed on the left controller 3 and / or the right controller 4, based on the operation data 410. If the determination is YES, the processing proceeds to step S306, and if the determination is NO, the processing proceeds to step S307.

[0118] In step S306, processor 81 moves mouse cursor 250 from the center of the screen in response to a mouse input operation based on operation data 410 (see (1) and (2) in FIG. 8). As a result of this processing, if a mouse input operation is performed on the controller at the same time as switching from game mode to mouse operation mode (YES in S200, NO in S300, YES in S302, YES in S304, YES in S305), mouse cursor 250 moves from the center of the screen in response to the mouse input operation in step S305. Also, as a result of this processing, if a mouse input operation is performed from the directional input operation mode to the mouse operation mode in response to a mouse input operation (NO in S200, YES in S201, NO in S300, YES in S302, NO in S304), mouse cursor 250 moves from the center of the screen in response to the mouse input operation in step S201 in FIG. 16. Then, the processing proceeds to step S308.

[0119] In step S307, processor 81 displays mouse cursor 250 at the center of the screen (see FIG. 8(1)). This processing causes mouse cursor 250 to be displayed at the center of the screen when switching from game mode to mouse operation mode. Thereafter, processing proceeds to step S308.

[0120] In step S308, the processor 81 determines whether the tip of the mouse cursor 250 is overlapping with a setting item or a tab. If the determination is YES, the process proceeds to step S309, and if the determination is NO, the process proceeds to step S206 in FIG. 16.

[0121] In step S309, processor 81 designates the setting item or tab that was determined to be overlapped by the tip of mouse cursor 250 in step S308 (see FIG. 8(2) and FIG. 9). Then, the process proceeds to step S310.

[0122] In step S310, the processor 81 determines whether or not the L button 38 of the left controller 3 or the R button 60 of the right controller 4 has been pressed, based on the operation data 410. If this determination is YES, the processing proceeds to step S311, and if this determination is NO, the processing proceeds to step S206 in FIG.

[0123] In step S311, processor 81 executes processing according to the designated setting item or tab. The processing according to the designated setting item is, for example, a setting process to emphasize defense in PO. The processing according to the designated tab is, for example, a process to bring the menu sheet including that tab to the foreground (see (2) and (3) in FIG. 9). Then, the process proceeds to step S206 in FIG. 16.

[0124] FIG. 18 is an example of a detailed flowchart of the direction input operation mode executed in step S204 or S205 shown in FIG.

[0125] In step S400 of Fig. 18, the processor 81 determines whether the current processing of the directional input operation mode is the processing of "maintaining the previous operation mode" in step S205 of Fig. 16. In other words, the processor 81 determines whether the current processing of the directional input operation mode is the processing of executing the directional input operation mode in step S205 of Fig. 16. If the determination is YES, the processing proceeds to step S401, and if the determination is NO, the processing proceeds to step S402.

[0126] In step S401, the processor 81 maintains the display position of the frame cursor 260 without moving it, and then the process proceeds to step S405.

[0127] In step S402, the processor 81 determines whether the current direction input operation mode processing is a processing in which the direction input operation mode is entered from the mouse operation mode. If the determination is YES, the processing proceeds to step S404, and if the determination is NO, the processing proceeds to step S403.

[0128] In step S403, processor 81 moves frame cursor 260 in response to the directional input operation in step S202 of Fig. 16 (see Fig. 11 (2)). Processor 81 also sets the setting item surrounded by frame cursor 260 after the movement to a specified state. Thereafter, the process proceeds to step S405.

[0129] In step S404, the processor 81 displays the frame cursor 260 at an initial position surrounding a predetermined setting item (see FIG. 11 (1)). This processing results in the frame cursor 260 being displayed at the initial position when the directional input operation mode is switched from the mouse operation mode in response to a directional input operation. The processing then proceeds to step S405. Note that in another embodiment, when the directional input operation mode is switched from the mouse operation mode in response to a directional input operation, the frame cursor 260 may not be displayed at the initial position, but may be displayed at a setting item in the direction corresponding to the directional input operation (e.g., see setting item 231 in FIG. 11 (2)) relative to the initial position, or an animation may be displayed in which the frame cursor 260 is momentarily displayed at the initial position and then transitions to a setting item in the direction corresponding to the directional input operation.

[0130] In step S405, the processor 81 determines whether or not the A button 53 or the like (see FIG. 13 ) of the right controller 4 has been pressed, based on the operation data 410. If the determination is YES, the processing proceeds to step S406, and if the determination is NO, the processing proceeds to step S407.

[0131] In step S406, the processor 81 executes a process according to the setting item in the designated state, and then the process proceeds to step S407.

[0132] In step S407, the processor 81 determines whether or not the L button 38 of the left controller 3 or the R button 60 of the right controller 4 has been pressed, based on the operation data 410. If the determination is YES, the processing proceeds to step S408, and if the determination is NO, the processing proceeds to step S206 in FIG.

[0133] In step S408, the processor 81 switches the menu sheet to be displayed at the forefront in the menu 270 (see FIG. 12). Thereafter, the process proceeds to step S206 in FIG.

[0134] As described above, according to this embodiment, in the mouse operation mode, the user can operate the mouse cursor 250 by performing mouse input operations using either the left controller 3 or the right controller 4 (see the descriptions of FIGS. 8 to 10 ). This makes it easier for both right-handed and left-handed users to operate the mouse cursor 250.

[0135] Furthermore, according to this embodiment, in mouse operation mode, when mouse input operations are performed simultaneously using the left controller 3 and the right controller 4, the mouse cursor 250 moves based on the mouse input operation of the controller with the faster movement speed, which is presumed to be the controller intended by the user (see the descriptions of Figures 8 to 10, etc.). This makes it possible to move the mouse cursor appropriately in accordance with the user's intentions.

[0136] Furthermore, according to this embodiment, when the game mode (see FIGS. 6 and 7), in which the game is played by performing mouse input operations using a controller, is switched to the menu mode, the mode changes to the mouse operation mode (see FIGS. 8 to 10), in which mouse input operations are similarly performed, so the user can continue to perform mouse input operations, improving operability.

[0137] Furthermore, according to this embodiment, when switching from the game mode or the directional input operation mode to the mouse operation mode, the mouse cursor 250, which is not displayed in the game mode or the directional input operation mode, is displayed in a predetermined position, for example, in the center of the display screen (see FIG. 8(1)), thereby preventing the user from losing sight of the mouse cursor 250.

[0138] Furthermore, according to this embodiment, when switching from the mouse operation mode to the directional input operation mode, the frame cursor 260 is displayed at a predetermined position (see FIG. 11 (1) etc.), thereby preventing the user from losing sight of the frame cursor 260.

[0139] Furthermore, when a user holds and operates a controller with both hands, it is generally thought that directional input operations are performed with the thumb of the left hand. However, according to this embodiment, in the directional input operation mode, directional input operations can be performed with the left controller 3 but not with the right controller 4 (see the explanations in Figures 11 to 13, etc.), so operations can be performed without any sense of discomfort.

[0140] Furthermore, according to this embodiment, when a directional input operation is performed in the mouse operation mode, the mode transitions to the directional input operation mode, and when a mouse input operation is performed in the directional input operation mode, the mode transitions to the mouse operation mode (see FIG. 16 ). Therefore, no additional operation is required to switch the operation mode, improving operability.

[0141] Furthermore, according to this embodiment, when a mouse input operation and a directional input operation are performed simultaneously, it is highly likely that the user intended to perform the mouse input operation, which requires placing and moving the surface of the controller on which the mouse sensor is located on the work surface, and therefore processing is performed in accordance with the mouse input operation (see FIG. 16 ). This allows processing to be performed in line with the user's intention.

[0142] [Modification] In the above-described embodiment, an example has been given in which the frame cursor 260, which is an object pointing to a setting item, moves in response to a directional input operation in the directional input operation mode (see FIG. 11 ). However, in the directional input operation mode, an indicator pointing to a setting item may move in response to a directional input operation. For example, in the directional input operation mode, instead of the frame cursor 260, a color-changing indicator (see the setting item 230 in FIG. 11(1) or the setting item 231 in FIG. 11(2)) that indicates a setting item that is in a designated state may move in response to a directional input operation.

[0143] In the above-described embodiment, the shape of the cursor 260 (see FIG. 11) that points to the setting item in the direction input operation mode is not limited to a frame shape. For example, the shape of the cursor may be an arrow shape.

[0144] In the above-described embodiment, the mouse cursor 250 is displayed at its initial position, the center of the screen, when the mode is changed from the game mode or the directional input operation mode to the mouse operation mode (see FIG. 8(1)). However, the position of the mouse cursor 250 when the mode is changed from the mouse operation mode to the game mode or the directional input operation mode may be stored, and when the mode is changed back from the game mode or the directional input operation mode to the mouse operation mode, the mouse cursor 250 may be displayed at the stored position.

[0145] Furthermore, in the above-described embodiment, when transitioning from the directional input operation mode to the mouse operation mode, the mouse cursor 250 may be displayed at a position indicating the setting item that was surrounded by the frame cursor 260 in the directional input operation mode (for example, a position where the tip of the mouse cursor 250 is at the center position of this setting item).

[0146] In the above-described embodiment, an example has been given in which the frame cursor 260 is displayed at a predetermined initial position when the operation mode is changed from the mouse operation mode to the directional input operation mode (see FIG. 11(1)). However, the position of the frame cursor 260 when the operation mode is changed from the directional input operation mode to the mouse operation mode may be stored, and the frame cursor 260 may be displayed at the stored position when the operation mode is changed back from the mouse operation mode to the directional input operation mode.

[0147] Furthermore, in the above-described embodiment, when transitioning from the mouse operation mode to the directional input operation mode, a frame cursor 260 may be displayed on the setting item that was designated by the tip of the mouse cursor 250 overlapping it in the mouse operation mode.

[0148] In the above-described embodiment, the same cursor may be displayed and operated in both the direction input operation mode and the mouse operation mode, and this cursor may be, for example, a mouse cursor (see FIG. 8).

[0149] Furthermore, in the above-described embodiment, when switching modes among the game mode, mouse operation mode, and directional input operation mode, the left controller 3 and / or the right controller 4 may be vibrated by operating the vibrators (107, 117 in FIG. 5).

[0150] In the above-described embodiment, an example was given in which, in the menu mode, the cursor (250) is moved in response to a mouse input operation, and the cursor (260) is moved in response to a directional input operation (see FIGS. 8 to 13 ). However, in the game mode, the first cursor may be moved in response to a mouse input operation, and the second cursor may be moved in response to a directional input operation. For example, in the game mode, there may be a scene in which a cursor is used to point to a predetermined object (predetermined item). In this scene, the first cursor may be moved in response to a mouse input operation, and the second cursor may be moved in response to a directional input operation, thereby pointing to the predetermined object. The first cursor and the second cursor may be the same or different. Furthermore, only one of the first cursor and the second cursor may be displayed, or both may be displayed. Furthermore, in information processing other than game processing, the cursor may be moved in response to a mouse input operation, and the cursor may be moved in response to a directional input operation, thereby pointing to the predetermined object.

[0151] In the above-described embodiment, the cursor (250, 260) is operated in response to a mouse input operation and a directional input operation. However, for example, an object other than a cursor (e.g., a player object) may be operated in response to a mouse input operation and a directional input operation.

[0152] Furthermore, in the above-described embodiment, an example has been given in which mouse input operations can be performed using the left controller 3, and mouse input operations can be performed using the right controller 4. However, a configuration may also be adopted in which mouse input operations cannot be performed using the left controller 3, but mouse input operations can be performed using the right controller 4.

[0153] In addition, in the above-described embodiment, in the directional input operation mode, the right directional button 33, the down directional button 34, the up directional button 35, and the left directional button 36 (see Figure 2) on the left controller 3 may be configured not to be able to perform directional input operations.

[0154] The controller and the information processing device in the above-described embodiment are merely examples, and their structures and shapes are not limited. For example, the information processing device may be a personal computer or a smartphone. The controller and the information processing device do not have to be detachable.

[0155] In the above-described embodiment, the mouse sensors (71, 74) detect the movement of the controllers (3, 4) on the work surface and output the direction and amount of movement. However, the mouse sensors may output only data related to the light reflected from the work surface, and the main unit 2 may use this data to calculate whether the controller has moved on the work surface, as well as the direction and amount of movement. Alternatively, the main unit 2 or the controller may calculate the current position of the controller in the controller coordinate system and perform various processes based on this. The same applies to the inertial sensor provided in the controller; either the main unit 2 or the controller may calculate the actual attitude, etc.

[0156] Furthermore, in the above-described embodiment, the method of switching between the mouse operation mode and the directional input operation mode is not limited. For example, this switching may be performed in response to a specific button operation, or in response to the operation of a physical mode change switch (not shown) provided on at least one of the controllers.

[0157] In addition, although an analog stick is used as an example of a directional input unit in the above-described embodiment (see FIG. 2, etc.), instead of an analog stick, a slidable stick or a cross-shaped button may be provided on the controller and function as a directional input unit.

[0158] Furthermore, in the above-described embodiment, a game program has been described as an example of an information processing program (see FIG. 14 ), but the information processing program is not limited to a game program. The information processing program may be, for example, a program related to a system menu in an information processing system. The system menu may be, for example, a menu for selecting a game application to be executed in the information processing system, or a menu for setting various functions of the information processing system.

[0159] In the above-described embodiment, a series of processes related to game processing is executed by a single game device 1. In other embodiments, the series of processes may be executed in an information processing system including multiple information processing devices. For example, in an information processing system including a terminal device and a server device capable of communicating with the terminal device via a network, some of the series of processes may be executed by the server device. Furthermore, in an information processing system including a terminal device and a server device capable of communicating with the terminal device via a network, main processes of the series of processes may be executed by the server device, and some processes may be executed by the terminal device. In the above-described information processing system, the server system may be composed of multiple information processing devices, and the processes to be executed on the server side may be shared and executed by the multiple information processing devices. A so-called cloud gaming configuration may also be employed. For example, the game device 1 may be configured to send operation data indicating user operations to a predetermined server, and various game processes may be executed on the server, with the execution results being streamed to the game device 1 as video and audio.

[0160] The information processing program, information processing system, and information processing method according to the present disclosure can provide a new method for controlling object display using an input device.

[0161] 1 Game device 3, 4 Controller 12 Display 32, 52 Stick 71, 74 Mouse sensor 81 Processor 84, 85 Storage unit (memory) 250, 260 Cursor

Claims

1. In the processor of the information processing device, A first input device, which is held in the user's left hand and includes a first directional input unit and a first mouse sensor, acquires first directional input unit operation data corresponding to the user's operation of the first directional input unit and first mouse operation data corresponding to the user's movement of the first input device. A second input device, which is held in the user's right hand and includes a second directional input unit and a second mouse sensor, acquires second directional input unit operation data corresponding to the user's operation of the second directional input unit and second mouse operation data corresponding to the user's movement of the second input device. In mouse operation mode, the first display pointing to the displayed item is moved according to the first mouse operation data and the second mouse operation data. In the direction input operation mode, the second display pointing to the displayed item is moved according to the operation data of the first direction input unit, and the second display is not moved according to the operation data of the second direction input unit. An information processing program that executes either the mouse operation mode or the directional input operation mode.

2. The aforementioned processor, A game mode in which the first and second displays are not shown, and the game progresses according to the first mouse operation data and the second mouse operation data, The information processing program according to claim 1, which is transitioned from the game mode to execute a menu mode in which either the mouse operation mode or the directional input operation mode is executed.

3. The aforementioned processor, The first display and the second display are made to be different displays. In the mouse operation mode, the second display is not shown, and in the directional input operation mode, the first display is not shown. The information processing program according to claim 2, which, when transitioning from the game mode to the menu mode, causes the program to switch to the mouse operation mode.

4. The aforementioned processor, When the first mouse operation data indicating the movement of the first input device or the second mouse operation data indicating the movement of the second input device is acquired, the mouse operation mode is executed. The information processing program according to claim 1, which, when operation data for the first direction input unit indicating an operation input to the first direction input unit is acquired, causes the direction input operation mode to be executed.

5. The aforementioned processor, The information processing program according to claim 4, which executes the mouse operation mode when at least one of the first mouse operation data and the second mouse operation data and the first direction input unit operation data are both acquired.

6. The first input device includes the first directional input section on the front, the first button on the top or left side, and the first mouse sensor on the right side. The second input device is equipped with the second directional input section and second button on the front, a third button on the top or right side, and the second mouse sensor on the left side. The aforementioned processor, In the mouse operation mode described above, the first button and the third button are assigned a confirmation function, while the second button is not assigned a confirmation function. The information processing program according to claim 1, wherein in the direction input operation mode, the second button is given a confirmation function, and the first button and the third button are not given a confirmation function.

7. The aforementioned processor, The information processing program according to claim 6, wherein in the directional input operation mode, the first button and the third button are provided with a function to switch the items.

8. The first representation is the first object, The information processing program according to any one of claims 1 to 7, wherein the second display is a second object different from the first object.

9. An information processing system equipped with a processor, The aforementioned processor, A first input device, which is held in the user's left hand and includes a first directional input unit and a first mouse sensor, acquires first directional input unit operation data corresponding to the user's operation of the first directional input unit and first mouse operation data corresponding to the user's movement of the first input device. The system acquires second directional input unit operation data corresponding to the user's operation of the second directional input unit and second mouse operation data corresponding to the user's movement of the second input device from a second input device held in the user's right hand, which includes a second directional input unit and a second mouse sensor. In mouse operation mode, the first display pointing to the displayed item is moved according to the first mouse operation data and the second mouse operation data. In the direction input operation mode, the second display pointing to the displayed item is moved according to the operation data of the first direction input unit, and the second display is not moved according to the operation data of the second direction input unit. An information processing system that performs either the mouse operation mode or the directional input operation mode.

10. The aforementioned processor, A game mode in which the first and second displays are not shown, and the game progresses according to the first mouse operation data and the second mouse operation data, The information processing system according to claim 9, which is transitioned from the game mode to execute a menu mode in which either the mouse operation mode or the directional input operation mode is executed.

11. The aforementioned processor, The first and second displays are different displays. In the mouse operation mode, the second display is not shown, and in the directional input operation mode, the first display is not shown. The information processing system according to claim 10, wherein when transitioning from the game mode to the menu mode, the system switches to the mouse operation mode.

12. The aforementioned processor, When the first mouse operation data indicating the movement of the first input device or the second mouse operation data indicating the movement of the second input device is acquired, the mouse operation mode is executed. The information processing system according to claim 9, which executes the direction input operation mode when operation data for the first direction input unit, indicating an operation input to the first direction input unit, is acquired.

13. The aforementioned processor, The information processing system according to claim 12, wherein the mouse operation mode is executed when at least one of the first mouse operation data and the second mouse operation data and the first direction input unit operation data are acquired together.

14. The first representation is the first object, The information processing system according to any one of claims 9 to 13, wherein the second display is a second object different from the first object.

15. An information processing method to be executed by the processor of an information processing device, The aforementioned processor, A first input device, which is held in the user's left hand and includes a first directional input unit and a first mouse sensor, acquires first directional input unit operation data corresponding to the user's operation of the first directional input unit and first mouse operation data corresponding to the user's movement of the first input device. A second input device, which is held in the user's right hand and includes a second directional input unit and a second mouse sensor, acquires second directional input unit operation data corresponding to the user's operation of the second directional input unit and second mouse operation data corresponding to the user's movement of the second input device. In mouse operation mode, the first display pointing to the displayed item is moved according to the first mouse operation data and the second mouse operation data. In the direction input operation mode, the second display pointing to the displayed item is moved according to the operation data of the first direction input unit, and the second display is not moved according to the operation data of the second direction input unit. An information processing method that causes either the mouse operation mode or the directional input operation mode to be executed.

16. The aforementioned processor, A game mode in which the first and second displays are not shown, and the game progresses according to the first mouse operation data and the second mouse operation data, The information processing method according to claim 15, which is transitioned from the game mode to execute a menu mode in which either the mouse operation mode or the directional input operation mode is executed.

17. The aforementioned processor, The first display and the second display are made to be different displays. In the mouse operation mode, the second display is not shown, and in the directional input operation mode, the first display is not shown. The information processing method according to claim 16, wherein when transitioning from the game mode to the menu mode, the system is switched to the mouse operation mode.

18. The aforementioned processor, When the first mouse operation data indicating the movement of the first input device or the second mouse operation data indicating the movement of the second input device is acquired, the mouse operation mode is executed. The information processing method according to claim 15, wherein when operation data for the first direction input unit indicating an operation input to the first direction input unit is acquired, the direction input operation mode is executed.

19. The aforementioned processor, The information processing method according to claim 18, wherein the mouse operation mode is executed when at least one of the first mouse operation data and the second mouse operation data and the first direction input unit operation data are acquired together.

20. The first representation is the first object, The information processing method according to any one of claims 15 to 19, wherein the second representation is a second object different from the first object.