Information processing program, information processing system, and information processing method

Abstract

The present invention involves, in a mouse operation mode, moving a first display indicating a displayed item according to first mouse operation data of a first input device gripped by the left hand of a user and second mouse operation data of a second input device gripped by the right hand of the user. The present invention further involves, in a direction input operation mode, moving a second display indicating the item according to first direction input unit operation data of the first input device, and avoiding moving the second display according to second direction input unit operation data of the second input device. The present invention further involves executing either the mouse operation mode or the direction input operation mode.

Description

Technical Field

[0007] ,

[0001] The present disclosure relates to information processing such as games.

Background Art

[0002] Conventionally, an input device including a pointing device and a non-pointing device has been known (for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] A new control method for object display using an input device has been demanded.

[0005] Therefore, an object of the present invention is to provide a new control method for object display using an input device.

Means for Solving the Problems

[0006] In order to achieve the above object, for example, the following configuration examples can be cited. <{\displaystyle 0000035}> One example configuration is an information processing program that causes the processor of an information processing device to acquire first direction input operation data and first mouse operation data corresponding to the user's movement of the first input device, which is held in the user's left hand and is equipped with a first direction input unit and a first mouse sensor; acquire second direction input unit operation data and second mouse operation data corresponding to the user's movement of the second input device, which is equipped with a second direction input unit and a second mouse sensor and is held in the user's right hand; move a first display that points to a displayed item in mouse operation mode according to the first mouse operation data and second mouse operation data; move a second display that points to a displayed item in direction input operation mode according to the first direction input unit operation data; and execute either mouse operation mode or direction input operation mode, without moving the second display, in accordance with the second direction input unit operation data.

[0008] According to the above configuration example, in mouse operation mode, the first display can be operated with the mouse using either the first input device operated with the left hand or the second input device operated with the right hand, thereby improving usability. In addition, when an input device is generally held with both hands by the user (for example, when one input device is held with both hands, or when two input devices are held with the left and right hands respectively), directional input is often performed with the left thumb. Therefore, according to the above configuration example, by controlling the system so that the second display is moved by directional input to the first input device held in the left hand, while the second display is not moved by directional input to the second input device held in the right hand, it is possible to provide operation without discomfort or confusion.

[0009] As another configuration example, the processor may be instructed to execute a game mode in which the first and second displays are not shown and the game progresses according to the first and second mouse operation data, and a menu mode which is transitioned from the game mode and in which either the mouse operation mode or the directional input operation mode is executed.

[0010] According to the above configuration example, when transitioning from game mode, which uses both the first and second input devices for operation, to menu mode, operation can continue using both the first and second input devices in menu mode, thereby improving usability.

[0011] Another possible configuration is to have the processor display different information for the first and second displays, with the second display not being shown in mouse operation mode, the first display not being shown in directional input operation mode, and the system switching to mouse operation mode when transitioning from game mode to menu mode.

[0012] According to the above configuration example, depending on the operation mode, either the first or second display will be shown while the other is not, making it easy to recognize which operation mode is currently active. Furthermore, when transitioning from game mode, which progresses according to mouse operation, to menu mode, the system switches to mouse operation mode. As a result, the user can continue to operate the mouse in the same way as in game mode to move the first display, providing smooth operation when transitioning to menu mode.

[0013] As another example of configuration, the processor may be instructed to execute a mouse operation mode when it receives first mouse operation data indicating movement of the first input device or second mouse operation data indicating movement of the second input device, and to execute a direction input operation mode when it receives first direction input unit operation data indicating operation input to the first direction input unit.

[0014] According to the above configuration example, no additional operations are required to switch between mouse operation mode and directional input operation mode, thus improving usability.

[0015] As another configuration example, the processor may be instructed to execute a mouse operation mode when at least one of the first mouse operation data and the second mouse operation data, along with the first directional input unit operation data, are acquired.

[0016] To perform mouse operations, the user must place the side of the input device equipped with the mouse sensor on the work surface. Therefore, when a mouse operation is performed, it is highly likely that the user intended to perform a mouse operation, and not a directional input operation. Thus, the above configuration example allows for providing an operation mode that aligns with the user's intent.

[0017] As another example of configuration, the first input device may be equipped with a first directional input section on the front, a first button on the top or left side, and a first mouse sensor on the right side, and the second input device may be equipped with a second directional input section and a second button on the front, a third button on the top or right side, and a second mouse sensor on the left side, and the processor may be configured to assign confirmation functions to the first and third buttons and not to the second button in mouse operation mode, and to assign confirmation functions to the second button and not to the first and third buttons in directional input operation mode.

[0018] According to the above configuration example, it is easy to perform a decision operation in mouse operation mode, and also easy to perform a decision operation in directional input operation mode.

[0019] Another possible configuration is to provide the processor with a function to switch items using the first and third buttons in directional input mode.

[0020] According to the above configuration example, by differentiating the functions of the first and third buttons in mouse operation mode and directional input operation mode, it is possible to make effective use of the buttons while providing a natural and intuitive user experience.

[0021] Another possible configuration is that the first representation is the first object, and the second representation is a second object that is different from the first object. [Effects of the Invention]

[0022] According to this embodiment, a new method for controlling object display using an input device can be provided. [Brief explanation of the drawing]

[0023] [Figure 1] A diagram showing an example of the state where the left controller 3 and the right controller 4 are attached to the main body device 2 [Figure 2] A six-sided view showing an example of the left controller 3 [Figure 3] A six-sided view showing an example of the right controller 4 [Figure 4] A block diagram showing an example of the internal configuration of the main body device 2 [Figure 5] A block diagram showing an example of the internal configurations of the main body device 2, the left controller 3, and the right controller 4 [Figure 6] A diagram for explaining the screen of the game mode [Figure 7] A diagram for explaining the way of holding and operating the controller in the game mode [Figure 8] A diagram for explaining the screen of the mouse operation mode in the menu mode [Figure 9] A diagram for explaining the screen of the mouse operation mode in the menu mode [Figure 10] A diagram for explaining the way of holding and operating the controller in the mouse operation mode [Figure 11] A diagram for explaining the screen of the direction input operation mode in the menu mode [Figure 12] A diagram for explaining the screen of the direction input operation mode in the menu mode [Figure 13] A diagram for explaining the way of holding and operating the controller in the direction input operation mode [Figure 14] A diagram showing an example of various data stored in the DRAM 85 [Figure 15] An example of a flowchart of information processing [Figure 16] An example of a flowchart of information processing [Figure 17] An example of a flowchart of information processing [Figure 18] An example of a flowchart of information processing [Modes for carrying out the invention]

[0024] One embodiment will be described below.

[0025] [Hardware configuration of the information processing system]

[0026] The following describes a game system, which is an example of the information processing system of this embodiment. An example of the game system 1 in this embodiment includes an information processing device (sometimes referred to as the "main unit") 2, a left controller 3, and a right controller 4. The left controller 3 and the right controller 4 are detachable from the main unit 2.

[0027] Figure 1 shows an example of the main unit 2 with the left controller 3 and right controller 4 attached. As shown in Figure 1, the left controller 3 and right controller 4 are attached to the main unit 2 and integrated together. The main unit 2 is a device that performs various processes (e.g., game processing) in the game system 1. The main unit 2 is equipped with a display 12. The left controller 3 and right controller 4 are equipped with operation parts for user input. In the following, the left controller 3 and right controller 4 may be collectively referred to as "controllers". Alternatively, the left controller 3 may be called the "first input device" and the right controller 4 may be called the "second input device".

[0028] The main unit 2 includes a display 12. The display 12 displays images generated by the main unit 2. The display 12 is, for example, a liquid crystal display (LCD). The screen of the display 12 is equipped with a touch panel. The touch panel is, for example, a multi-touch input type (e.g., capacitive type).

[0029] Figure 2 is a six-view drawing showing an example of the left controller 3. As shown in Figure 2, the left controller 3 has a vertically elongated shape, that is, a shape that is long in the z-axis direction as shown in Figure 2. When the left controller 3 is attached to the main unit 2, it has a protrusion 40 that fits into a recess (not shown) of the main unit 2. When the left controller 3 is removed from the main unit 2, it can also be held in a vertically elongated orientation. When the left controller 3 is held in a vertically elongated orientation, it has a shape and size that allows it to be held with one hand, especially the left hand. The left controller 3 can also be held in a horizontally elongated orientation, and when held in a horizontally elongated orientation, it may be held with both hands.

[0030] The left controller 3 is equipped with a left analog stick (sometimes referred to as the "left stick") 32, which is an example of a directional input device. As shown in Figure 2, the left stick 32 is located on the front of the left controller 3. The left stick 32 can be used as a directional input unit that can input directions. The user can input directions according to the direction of tilt by tilting the left stick 32, and can input an amount of force according to the angle of tilt.

[0031] The left controller 3 is equipped with various operation buttons. On its front, the left controller 3 is equipped with a right direction button 33, a down direction button 34, an up direction button 35, a left direction button 36, a record button 37, and a minus button 47. The left controller 3 is equipped with an L button 38 and a ZL button 39 on its top and left sides. Note that the L button 38 and ZL button 39 may be provided only on the top side of the left controller 3, or only on the left side. The left controller 3 is equipped with buttons 43 and 44 on a protrusion 40 on its right side.

[0032] The left controller 3 is provided with a mouse sensor aperture 70 on a protrusion 40 on its right side. The mouse sensor aperture 70 is an aperture that guides light to a mouse sensor 71 located inside it. The mouse sensor 71 is, for example, a general mouse sensor (e.g., an optical or laser mouse sensor), and acquires data for calculating the movement (direction of movement, distance of movement, speed of movement, etc.) of the left controller 3 on the work surface, which is positioned with its right side (i.e., the upper surface of the protrusion 40) facing the work surface.

[0033] Furthermore, the left controller 3 is equipped with a terminal 72 on the protrusion 40 on its right side for wired communication between the left controller 3 and the main unit 2.

[0034] Figure 3 is a six-view drawing showing an example of the right controller 4. As shown in Figure 3, the right controller 4 has a vertically elongated shape, that is, a shape that is long in the z-axis direction as shown in Figure 3. The right controller 4 has a protrusion 62 that fits into a recess (not shown) of the main unit 2 when it is attached to the main unit 2. When the right controller 4 is removed from the main unit 2, it can also be held in a vertically elongated orientation. When the right controller 4 is held in a vertically elongated orientation, it has a shape and size that allows it to be held with one hand, especially the right hand. The right controller 4 can also be held in a horizontally elongated orientation, and when held in a horizontally elongated orientation, it may be held with both hands.

[0035] The right controller 4 has a right analog stick (sometimes referred to as the "right stick") 52 on its front as a directional input. In this embodiment, the right stick 52 has the same configuration as the left stick 32 of the left controller 3. The right controller 4 has an A button 53, a B button 54, an X button 55, a Y button 56, a + (plus) button 57, and a home button 58 on its front. The right controller 4 has an R button 60 and a ZR button 61 on its top and right sides. Note that the R button 60 and ZR button 61 may be provided only on the top surface of the right controller 4, or only on the right side. The right controller 4 has buttons 65 and 66 on a protrusion 62 on its left side.

[0036] The right controller 4 is provided with a mouse sensor aperture 73 on a protrusion 62 on its left side. The mouse sensor aperture 73 is an aperture that guides light to a mouse sensor 74 located inside it. The mouse sensor 74 is, for example, a general mouse sensor (e.g., an optical or laser mouse sensor), and acquires data for calculating the movement (direction of movement, distance of movement, speed of movement, etc.) of the right controller 4 on the work surface, which is positioned with its left side (i.e., the upper surface of the protrusion 62) facing the work surface.

[0037] Furthermore, the right controller 4 is equipped with a terminal 75 on a protrusion 62 on its left side for wired communication between the right controller 4 and the main unit 2.

[0038] Figure 4 is a block diagram showing an example of the internal configuration of the main unit 2. The main unit 2 includes a processor 81. The processor 81 is an information processing unit that performs various information processing operations in the main unit 2, and may consist of, for example, one or more CPUs (Central Processing Units), or it may consist of a SoC (System-on-a-chip) that includes multiple functions such as CPU function and GPU (Graphics Processing Unit) function. The processor 81 performs various information processing operations by executing information processing programs (for example, game programs) stored in a storage unit (specifically, an internal storage medium such as flash memory 84, or an external storage medium installed in slot 23).

[0039] The main unit 2 includes a flash memory 84 and a DRAM (Dynamic Random Access Memory) 85 as examples of internal storage media. The flash memory 84 is a memory primarily used to store various types of data (which may be programs) stored in the main unit 2. The DRAM 85 is a memory used to temporarily store various types of data used in information processing. The processor 81 performs various information processing by appropriately reading and writing data to and from storage media such as the flash memory 84 and the DRAM 85.

[0040] Furthermore, the main unit 2 has various configurations as shown in Figure 4. These are briefly explained below. The slot interface (sometimes referred to as "slot I / F") 91 reads and writes data to a predetermined type of storage medium (e.g., a dedicated memory card) installed in slot 23, according to instructions from the processor 81. The network communication unit 82 communicates with external devices via the network (e.g., internet communication).

[0041] The controller communication unit 83 communicates wirelessly with the left controller 3 and / or the right controller 4 (for example, communication in accordance with the Bluetooth® standard). The left terminal 17 is a terminal for data communication between the processor 81 and the left controller 3. The right terminal 21 is a terminal for data communication between the processor 81 and the right controller 4. The lower terminal 27 is a terminal for outputting data (for example, image data or audio data) to a stationary monitor or the like via the cradle when the lower terminal 27 is mounted in the cradle.

[0042] The touch panel controller 86 generates data indicating, for example, the location where a touch input was performed, based on signals from the touch panel 13 located on the display surface of the display 12, and outputs it to the processor 81. The display 12 displays images generated by the processor 81 and / or images acquired from an external source. The codec circuit 87 controls the input and output of audio data to the speaker 88 and the audio input / output terminal 25. The power control unit 97 controls the power supply from the battery 98 to each part of the main unit 2 (i.e., each part that receives power from the battery 98) based on commands from the processor 81, and also starts or stops the power supply in response to the pressing of the power button 28.

[0043] Figure 5 is a block diagram showing an example of the internal configuration of the main unit 2, left controller 3, and right controller 4. Note that the details of the internal configuration of the main unit 2 are shown in Figure 4 and are therefore omitted in Figure 5.

[0044] The left controller 3 includes a communication control unit 101 that communicates with the main unit 2. As shown in Figure 5, the communication control unit 101 is connected to each component, including terminal 42. When the left controller 3 is attached to the main unit 2, the communication control unit 101 communicates with the main unit 2 via terminal 42, and when the left controller 3 is detached from the main unit 2, it performs wireless communication with the main unit 2.

[0045] The left controller 3 includes a memory 102, such as flash memory. The communication control unit 101 is composed of a microcontroller (also called a microprocessor) and performs various processes by executing firmware stored in the memory 102.

[0046] The left controller 3 is equipped with buttons 103 (specifically, buttons 33 to 36, etc.) and a left stick 32. Each button 103 and the left stick 32 repeatedly outputs information about the operation performed on them to the communication control unit 101 at appropriate intervals.

[0047] The left controller 3 is equipped with an inertial sensor. Specifically, the left controller 3 is equipped with an acceleration sensor 104 and an angular velocity sensor 105. In this embodiment, the acceleration sensor 104 detects the magnitude of acceleration along a predetermined three-axis direction (for example, the x, y, and z axes shown in Figure 2). Note that the acceleration sensor 104 may also detect acceleration in one axis direction or two axis directions. In this embodiment, the angular velocity sensor 105 detects angular velocity around a predetermined three-axis direction (for example, the x, y, and z axes shown in Figure 2). Note that the angular velocity sensor 105 may also detect angular velocity around one axis direction or two axis directions. The acceleration sensor 104 and the angular velocity sensor 105 are each connected to the communication control unit 101. The detection results from the acceleration sensor 104 and the angular velocity sensor 105 are repeatedly output to the communication control unit 101 at appropriate timings.

[0048] The left controller 3 is equipped with a mouse sensor 71. The mouse sensor 71 acquires data to calculate the movement of the left controller 3 on the work surface (direction of movement, distance of movement, speed of movement, etc.). Using this data, it is also possible to determine whether the right side of the left controller 3 is in contact with the work surface or close to contacting it (for example, whether the gap between the right side and the work surface is less than or equal to a predetermined distance (e.g., 1 mm)). The data acquired by the mouse sensor 71 is repeatedly output to the communication control unit 101 at appropriate intervals.

[0049] The communication control unit 101 acquires information related to input (specifically, information related to operation or detection results from sensors) from each input unit (specifically, each button 103, the left stick 32, and each sensor 104, 105, and 71). The communication control unit 101 transmits operation data, which includes the acquired information or information that has been processed in a predetermined manner, to the main unit 2. The operation data is transmitted repeatedly at a rate of once every predetermined time.

[0050] When the above operation data is transmitted to the main unit 2, the main unit 2 can obtain input from the left controller 3. That is, the main unit 2 can determine the operation of each button 103 and the left stick 32 based on the operation data. The main unit 2 can also calculate information about the movement and / or posture of the left controller 3 based on the operation data (specifically, the detection results of the acceleration sensor 104 and the angular velocity sensor 105). The main unit 2 can also calculate information about mouse operations performed on the left controller 3 based on the operation data (specifically, the detection results of the mouse sensor 71).

[0051] The left controller 3 includes an amplifier 106 and a vibrator 107. The amplifier 106 amplifies the control signal received from the communication control unit 101 and generates a drive signal. The vibrator 107 vibrates in response to the drive signal generated by the amplifier 106, causing the left controller 3 to vibrate.

[0052] The left controller 3 includes a power supply unit 108. The power supply unit 108 has a battery and a power control circuit. The power control circuit is connected to the battery and to each part of the left controller 3 (specifically, each part that receives power from the battery).

[0053] As shown in Figure 5, the right controller 4 includes a communication control unit 111 that communicates with the main unit 2. The right controller 4 also includes a memory 112 connected to the communication control unit 111. The communication control unit 111 is connected to each component, including the terminal 64. The communication control unit 111 and the memory 112 have the same functions as the communication control unit 101 and memory 102 of the left controller 3. Therefore, the communication control unit 111 can communicate with the main unit 2 both by wired communication via the terminal 64 and by wireless communication without the terminal 64 (specifically, communication according to the Bluetooth® standard), and controls the communication that the right controller 4 makes to the main unit 2.

[0054] The right controller 4 is equipped with the same inputs as the left controller 3. Specifically, it includes buttons 113 (A button 53, B button 54, X button 55, Y button 56, etc.), a right stick 52, inertial sensors (accelerometer 114 and angular velocity sensor 115), and a mouse sensor 74. Each of these inputs has the same function and operates in the same way as the inputs of the left controller 3.

[0055] The right controller 4 comprises an amplifier 116, a vibrator 117, and a power supply unit 118. The amplifier 116, vibrator 117, and power supply unit 118 have the same functions and operate in the same manner as the amplifier 106, vibrator 107, and power supply unit 108 of the left controller 3, respectively.

[0056] The right controller 4 comprises a processing unit 121 and an NFC communication unit 122. The processing unit 121 controls the NFC communication unit 122 in response to commands from the main unit 2 via the communication control unit 111. The NFC communication unit 122 performs short-range wireless communication based on the NFC (Near Field Communication) standard.

[0057] [Regarding the game envisioned in this embodiment] Next, an overview of the game processing performed by the game device (game system) 1 according to this embodiment will be described. The game envisioned in this embodiment is, as an example, a wheelchair basketball game played by 3 players against 3 players. Specifically, a wheelchair basketball game is played by player objects (objects with people in wheelchairs; sometimes referred to as "POs") that operate according to the operations of each player, moving around in a virtual space where a wheelchair basketball court and goals are arranged. Some of the POs may be automatically controlled non-player objects. Furthermore, this game may feature only one PO. Moreover, this game is not limited to wheelchair basketball; it may be any other game. For example, it may be a boat game in which a person sits in a boat and operates an object that moves an oar on the left side of the boat with their left hand and an oar on the right side of the boat with their right hand.

[0058] This game has two modes: Game Mode and Menu Mode. Users can play wheelchair basketball in Game Mode and configure various settings in Menu Mode. Game Mode and New Mode can be switched between depending on the user's input.

[0059] [Overview of the game processing in this embodiment] Next, an overview of the processing performed by the game device 1 according to this embodiment will be described. Figure 6 is an example of a display screen for game mode. In Figure 6, the PO200 operated by the user in this game device 1, the PO211 operated by another user in another game device 1, the ball 210, the goal 212, etc. are displayed.

[0060] [About game modes] Figure 7 is a diagram illustrating the operation of moving PO200 in the virtual space in game mode. As shown in Figure 7, in game mode, the user can grip the left controller 3 between the thumb, ring finger, and little finger of the left hand 280, place the index finger on the L button 38, and place the middle finger on the ZL button 39. Similarly, the user can grip the right controller 4 between the thumb, ring finger, and little finger of the right hand 281, place the index finger on the R button 60, and place the middle finger on the ZR button 61.

[0061] As shown in Figure 7, the user can move the left controller 3 by placing its right side (see Figure 2) on the work surface, and move the right controller 4 by placing its left side (see Figure 3) on the work surface. In this way, the user can perform mouse operations (sometimes called "mouse input operations") on the left controller 3 and the right controller 4 as if they were a mouse. In addition, while performing mouse operations, the user can press the L button 38 and ZL button 39 on the left controller 3, and the R button 60 and ZR button 61 on the right controller 4.

[0062] In game mode, the user can move and change direction of PO200 by rotating the wheels of PO200's wheelchair using the left controller 3 and / or right controller 4 with the mouse. A detailed explanation follows.

[0063] When the left controller 3 is moved in the positive z-axis direction (see Figures 2 and 7) on the work surface, the left wheel 201 of the wheelchair rotates in the direction that PO200 moves forward. Similarly, when the right controller 4 is moved in the positive z-axis direction (see Figures 3 and 7) on the work surface, the right wheel 202 of the wheelchair rotates in the direction that PO200 moves forward. When the left controller 3 is moved in the negative z-axis direction (see Figures 2 and 7) on the work surface, the left wheel 201 of the wheelchair rotates in the direction that PO200 moves backward. Similarly, when the right controller 4 is moved in the negative z-axis direction (see Figures 3 and 7) on the work surface, the right wheel 202 of the wheelchair rotates in the direction that PO200 moves backward.

[0064] Therefore, when a mouse operation is performed simultaneously to move the left controller 3 in the positive z-axis direction (see Figures 2 and 7) and the right controller 4 in the positive z-axis direction (see Figures 3 and 7), both wheels of the wheelchair rotate in the direction in which the PO200 moves forward, as shown in Figure 6(1), causing the PO200 to move forward. In this case, for example, if the movement speed of the right controller 4 in the positive z-axis direction is less than the movement speed of the left controller 3 in the positive z-axis direction, the PO200 will move forward while turning to the right.

[0065] When the mouse operation moves the left controller 3 in the negative z-axis direction (see Figures 2 and 7) and the right controller 4 in the negative z-axis direction (see Figures 3 and 7) simultaneously, both wheels of the wheelchair rotate in the direction that causes the PO200 to move backward, causing the PO200 to move backward. In this case, for example, if the movement speed of the right controller 4 in the negative z-axis direction is less than the movement speed of the left controller 3 in the negative z-axis direction, the PO200 will move backward while turning to the left.

[0066] When the left controller 3 is moved in the positive z-axis direction (see Figures 2 and 7) and the right controller 4 is moved in the negative z-axis direction (see Figures 3 and 7) simultaneously, the PO200 rotates to the right, as shown in Figure 6(2). When the left controller 3 is moved in the negative z-axis direction (see Figures 2 and 7) and the right controller 4 is moved in the positive z-axis direction (see Figures 3 and 7) simultaneously, the PO200 rotates to the left.

[0067] As described above, in game mode, the user can play a wheelchair basketball game by moving the PO200 using the left controller 3 and right controller 4 to operate the mouse on the work surface. At this time, no objects such as a mouse cursor are displayed or moved in conjunction with the mouse operations on each controller (3, 4). Note that the rotation of each wheel is merely an animation, and the direction and speed of movement of the PO200 may be determined independently of the calculation of the wheel rotation pattern. In addition, the user can shoot the ball 210 towards the goal 212 or steal the ball 210 from another PO211 by performing predetermined operations on the left controller 3 and / or the right controller 4.

[0068] [About Menu Mode] Next, the menu mode of this embodiment will be described. When the plus button 57 on the right controller 4 is pressed in game mode, the system switches to menu mode. Conversely, when the plus button 57 on the right controller 4 is pressed in menu mode, the system switches back to game mode. Menu mode is the mode in which the user makes settings related to this game. Menu mode has two modes: mouse operation mode and directional input operation mode. The system switches between mouse operation mode and directional input operation mode according to the user's operation. This will be explained in detail below.

[0069] Figures 8 and 9 show examples of the display screen in mouse operation mode. As shown in Figure 8(1), menu mode displays menu 270. Menu 270 consists of menu sheet 220 with tab A, menu sheet 221 with tab B, and menu sheet 222 with tab C. In Figure 8(1), menu sheet 220 with tab A is displayed in the foreground, and the other menu sheets are hidden except for the tabs. Menu sheet 220 contains setting items 230 to 235. For example, menu sheet 220 is a sheet for the user to set the abilities of the POs. In this game, there are three POs on the same team. For example, setting item 230 is a button to set whether or not to prioritize defense in the control tendency when each PO is automatically controlled, and setting items 231 to 233 are buttons to set each PO's special moves.

[0070] When switching from game mode to menu mode, menu 270 is displayed, and the mouse operation mode is activated with the mouse cursor 250 displayed (see Figure 8(1)). The mouse cursor 250 is not displayed in game mode or directional input operation mode. Also, when switching from game mode to menu mode, as shown in Figure 8(1), the mouse cursor 250 is displayed at a predetermined initial position. In this embodiment, this initial position is the center of the screen. In other embodiments, this initial position may be at a different location on the screen.

[0071] In mouse operation mode, the mouse cursor 250 moves in response to mouse operations performed on the left controller 3 or the right controller 4. This will be explained in detail below. Figure 10 is a diagram illustrating mouse operations performed on the left controller 3 and the right controller 4 in mouse operation mode. As shown in Figure 10, in mouse operation mode, the user can grasp the controllers in the same way as in game mode (see Figure 7).

[0072] When the left controller 3 is operated in mouse operation mode, the mouse cursor 250 moves in a direction and speed corresponding to this mouse operation. Specifically, when the left controller 3 moves in the positive z-axis direction on the work surface (see Figures 2 and 10), the mouse cursor 250 moves in the positive y-axis direction in Figure 8(1). When the left controller 3 moves in the negative z-axis direction on the work surface, the mouse cursor 250 moves in the negative y-axis direction in Figure 8(1). When the left controller 3 moves in the positive y-axis direction on the work surface (see Figures 2 and 10), the mouse cursor 250 moves in the negative x-axis direction in Figure 8(1). When the left controller 3 moves in the negative y-axis direction on the work surface, the mouse cursor 250 moves in the positive x-axis direction in Figure 8(1). In this way, the movement of the mouse operation performed on the left controller 3 is reflected as the movement of the mouse cursor 250.

[0073] Similarly, in mouse operation mode, when the right controller 4 is operated, the mouse cursor 250 moves in a direction and speed corresponding to this mouse operation. Specifically, when the right controller 4 moves in the positive z-axis direction on the work surface (see Figures 3 and 10), the mouse cursor 250 moves in the positive y-axis direction in Figure 8(1). When the right controller 4 moves in the negative z-axis direction on the work surface, the mouse cursor 250 moves in the negative y-axis direction in Figure 8(1). When the right controller 4 moves in the positive y-axis direction on the work surface (see Figures 3 and 10), the mouse cursor 250 moves in the positive x-axis direction in Figure 8(1). When the right controller 4 moves in the negative y-axis direction on the work surface, the mouse cursor 250 moves in the negative x-axis direction in Figure 8(1). In this way, the movement of the mouse operation performed on the right controller 4 is reflected as the movement of the mouse cursor 250.

[0074] When mouse operations are performed simultaneously on both the left controller 3 and the right controller 4, the mouse cursor 250 moves according to the mouse operation that has a larger movement amount (i.e., movement speed) per unit of time. In this way, even if the controller that is not intended to be used for mouse operations moves to some extent on the work surface, the mouse cursor 250 can be appropriately moved by the controller intended for mouse operations.

[0075] As shown in Figure 8(2), when the mouse cursor 250 is moved and its tip aligns with any setting item, that setting item becomes selected. In Figure 8(2), the tip of the mouse cursor 250 aligns with setting item 230, and setting item 230 changes color to indicate it is selected.

[0076] As shown in Figure 8(3), when the tip of the mouse cursor 250 is over a setting item and the L button 38 of the left controller 3 or the R button 60 of the right controller 4 is pressed (see Figure 10), the execution of the process corresponding to the setting item over which the tip of the mouse cursor 250 is over is determined. In Figure 8(3), when the tip of the mouse cursor 250 is over setting item 230 and the L button 38 of the left controller 3 or the R button 60 of the right controller 4 is pressed, the process corresponding to setting item 230 (i.e., setting PO to prioritize defense) is executed, and a check mark is displayed next to setting item 230. Alternatively, for example, when the tip of the mouse cursor 250 is over each of the setting items 231 to 233 and the L button 38 of the left controller 3 or the R button 60 of the right controller 4 is pressed, the text displayed in each of the setting items 231 to 233 may be changed to the name of the special move currently set for each PO.

[0077] As shown in Figures 9(1) to (3), when the tip of the mouse cursor 250 hovers over any tab, that tab becomes selected. In Figure 9(1), the tip of the mouse cursor 250 hovers over tab A of the menu sheet 220 which is displayed in the foreground, and tab A changes color to indicate that it is selected. In Figure 9(2), the tip of the mouse cursor 250 hovers over tab B of the menu sheet 221 which is not displayed in the foreground, and tab B changes color to indicate that it is selected.

[0078] As shown in Figure 9(3), when the tip of the mouse cursor 250 is over any tab and the L button 38 of the left controller 3 or the R button 60 of the right controller 4 is pressed (see Figure 10), the menu sheet containing the tab over which the tip of the mouse cursor 250 is over will be brought to the front. In 9(3), with the tip of the mouse cursor 250 over tab B, the L button 38 of the left controller 3 or the R button 60 of the right controller 4 is pressed, and the menu sheet 221 is brought to the front. The menu sheet 221 contains setting items 240 to 245 for configuring game stage settings.

[0079] In mouse operation mode, as described above, pressing the L button 38 or R button 60 determines whether to execute a process corresponding to the setting item or to bring the menu sheet to the foreground. However, the execution of these processes is not determined by the operation of other buttons on the controller. In other embodiments, however, the execution of these processes may be determined by the operation of any of the other buttons on the controller.

[0080] In the mouse operation mode described above, when the left stick 32 or the directional buttons (right direction button 33, down direction button 34, up direction button 35, left direction button 36) of the left controller 3 are operated to input a direction, the system switches to the directional input operation mode. The directional input operation mode will be explained in detail below.

[0081] When switching from mouse operation mode to directional input operation mode, a frame cursor 260 surrounding the setting item is displayed (see Figure 11(1)). The frame cursor 260 is not displayed in game mode or mouse operation mode. Also, when switching from mouse operation mode to directional input operation mode, as shown in Figure 11(1), the frame cursor 260 is displayed for a predetermined setting item. In this embodiment, the frame cursor 260 is displayed for the setting item 230 located in the upper left of the screen. In other embodiments, the frame cursor 260 may be displayed for a setting item at a different location.

[0082] In directional input mode, the frame cursor 260 moves in response to the directional input of the left controller 3. However, the frame cursor 260 does not move in response to the directional input of the right controller 4. This will be explained in detail below. Figure 13 is a diagram illustrating the operations performed on the left controller 3 and the right controller 4 in directional input mode. In directional input mode, the user can grasp the left controller 3 and the right controller 4 as shown in Figure 13.

[0083] In directional input mode, when the left controller 3 is operated with a directional input, the frame cursor 260 moves to the setting item corresponding to that directional input. Specifically, when the left stick 32 of the left controller 3 is input in the positive z-axis direction (see Figures 2 and 13) or when the up direction button 35 (see Figure 2) is pressed, the frame cursor 260 moves to the upper setting item. When the left stick 32 of the left controller 3 is input in the negative z-axis direction or when the down direction button 34 (see Figure 2) is pressed, the frame cursor 260 moves to the lower setting item. When the left stick 32 of the left controller 3 is input in the positive x-axis direction (see Figures 2 and 13) or when the right direction button 33 (see Figure 2) is pressed, the frame cursor 260 moves to the setting item on the right. When the left stick 32 of the left controller 3 is input in the negative x-axis direction or when the left direction button 36 (see Figure 2) is pressed, the frame cursor 260 moves to the setting item on the left. Note that if there are no setting items in the direction of the input, for example, the frame cursor 260 will not move. Also, the setting item that the frame cursor 260 displays will change color to indicate that it is selected.

[0084] In Figure 11(2), when the left stick 32 of the left controller 3 receives input in the x-axis positive direction (see Figures 2 and 13) or the right direction button 33 (see Figure 2) is pressed, the frame cursor 260 moves to the setting item 231 on the right side and the setting item 231 changes color.

[0085] Then, when one of the buttons 53-56 on the front of the right controller 4, for example, button A 53, is pressed (see Figure 13), the execution of the process corresponding to the setting item displayed by the frame cursor 260 is determined. In Figure 11(3), button A 53 is pressed, and the process corresponding to the setting item 231 displayed by the frame cursor 260 (i.e., the setting for PO's special move) is executed, and a check mark is displayed next to setting item 231.

[0086] In directional input mode, each time the L button 38 on the left controller 3 or the R button 60 on the right controller 4 (see Figure 13) is pressed, the menu sheet displayed at the forefront switches sequentially. Specifically, as shown in Figure 12(1), when menu sheet 220 is at the forefront and the R button 60 is pressed, menu sheet 221 is displayed at the forefront as shown in Figure 12(2). When menu sheet 221 is at the forefront and the R button 60 is pressed, menu sheet 222 is displayed at the forefront. When menu sheet 222 is at the forefront and the R button 60 is pressed, the display returns to menu sheet 220. In this way, each time the R button 60 is pressed, the menu sheet switches sequentially and is displayed at the forefront. Also, each time the L button 38 is pressed, the menu sheet switches and is displayed at the forefront in the reverse order compared to when the R button 60 is pressed.

[0087] In the directional input mode described above, if mouse operation is performed on the left controller 3 or the right controller 4, the game switches to mouse operation mode. As previously explained, if the plus button 57 on the right controller 4 is pressed in menu mode (i.e., mouse operation mode or directional input mode), the game switches to game mode.

[0088] In the directional input operation mode, as described above, pressing button A 53 determines the execution of a process corresponding to the setting item, but the execution of this process is not determined by the operation of other buttons on the controller. However, in other embodiments, the execution of this process may be determined by the operation of any of the other buttons on the controller.

[0089] [Details of the information processing in this embodiment] Next, the information processing of this embodiment will be described in detail with reference to Figures 14 to 18.

[0090] [About the data used] This section explains the various types of data used in the game processing. Figure 14 shows an example of data stored in the DRAM 85 of the game device (game system) 1. As shown in Figure 14, the DRAM 85 is provided with at least a program storage area 301 and a data storage area 302. The program storage area 301 stores the game program 401. The data storage area 302 stores game control data 402, image data 408, virtual camera control data 409, operation data 410, etc. The game control data 402 includes object data 403.

[0091] Game program 401 is a game program for executing the processes of this game.

[0092] Object data 403 is data for objects placed in the virtual space, including PO (PO200, 211, etc.), court (ground), ball 210, goal 212, menu 270, mouse cursor 250, frame cursor 260, and other object data. Object data 403 also includes data such as the object's coordinates, orientation, posture, and state.

[0093] Image data 408 includes an animated image of the PO200's wheels rotating, as well as background and virtual effects.

[0094] Virtual camera control data 409 is data used to control the movement of a virtual camera that is placed in a virtual space and takes pictures of that virtual space.

[0095] The operation data 410 is data indicating the content of operations performed on the left controller 3 and the right controller 4. The operation data 410 includes, for example, data indicating the movement of the left controller 3 and the right controller 4 (including movement due to mouse operation), changes in posture, operations on the sticks, and input states such as the pressed state of various buttons. The content of this operation data is updated at a predetermined interval based on signals from the left controller 3 and the right controller 4.

[0096] In addition, DRAM85 stores various data used in the game mode processing, menu mode processing, and drawing processing of this game, as needed.

[0097] [Details about game processing] Next, the processing according to this embodiment will be described with reference to the flowchart. Figures 15 to 18 are examples of flowcharts showing the processing according to this embodiment. In the following, we will mainly describe the processing that is characteristic of this embodiment, and other descriptions such as drawing processing will be omitted.

[0098] Once the game processing begins and the wheelchair basketball game starts, the processes shown in Figures 15 to 18 begin. The following processes are executed at predetermined intervals (for example, every drawing frame).

[0099] In step S100 of Figure 15, the processor 81 executes a game mode in which a wheelchair basketball game is played. In game mode, the processor 81 controls the operation of the PO200 based on the operation data 410 to advance the wheelchair musketball game. After that, the process moves to step S101.

[0100] In step S101, the processor 81 determines, based on the operation data 410, whether or not the plus button 57 of the right controller 4 has been pressed. If the determination is YES, the process moves to step S102; if the determination is NO, the process moves to step S103.

[0101] In step S102, the processor 81 transitions from game mode to menu mode and executes the menu mode.

[0102] In step S103, the processor 81 determines whether the termination condition for this game has been met. This termination condition is the end of the wheelchair musketball match, for example. After that, the process returns to step S100.

[0103] Figure 16 is an example of a detailed flowchart of the menu mode in step S102 shown in Figure 15.

[0104] In step S200 of Figure 16, the processor 81 determines whether the current menu mode process is a process of entering menu mode from game mode. If the determination is YES, the process moves to step S203; if the determination is NO, the process moves to step S201.

[0105] In step S201, the processor 81 determines, based on the operation data 410, whether or not there has been a mouse input operation on the left controller 3 and / or the right controller 4. If the determination is YES, the process moves to step S203; if the determination is NO, the process moves to step S202.

[0106] In step S202, the processor 81 determines, based on the operation data 410, whether or not a directional input operation has been performed on the left controller 3. If the determination is YES, the process moves to step S204; if the determination is NO, the process moves to step S205.

[0107] In step S203, the processor 81 executes the mouse operation mode. Then, the process moves to step S206.

[0108] In step S204, the processor 81 executes the direction input operation mode. After that, the process moves to step S206.

[0109] In step S205, the processor 81 executes the operation mode (mouse operation mode or directional input operation mode) that was executed in the previous process. After that, the process moves to step S206.

[0110] In step S206, the processor 81 determines, based on the operation data 410, whether or not the plus button 57 of the right controller 4 was pressed. If the determination is YES, the process moves to step S103 in Figure 15; if the determination is NO, the process returns to step S200.

[0111] Figure 17 is an example of a detailed flowchart of the mouse operation mode performed in step S203 or S205 shown in Figure 16.

[0112] In step S300 of Figure 17, the processor 81 determines whether the current mouse operation mode process is the "maintain previous operation mode" process in step S205 of Figure 16. In other words, the processor 81 determines whether the current mouse operation mode process is the process that executes the mouse operation mode in step S205 of Figure 16. If this determination is YES, the process moves to step S301; if this determination is NO, the process moves to step S302.

[0113] In step S301, the processor 81 maintains the display position of the mouse cursor 250 without moving it. Then, the process moves to step S308.

[0114] In step S302, the processor 81 determines whether the current mouse operation mode process is a process that entered the mouse operation mode from game mode or directional input mode. If the determination is YES, the process moves to step S304; if the determination is NO, the process moves to step S303.

[0115] In step S303, the processor 81 moves the mouse cursor 250 from its previous position in response to the mouse input operation in step S201 in Figure 16 (see Figure 8(2)). After that, the process moves to step S308.

[0116] In step S304, the processor 81 determines whether the current mouse operation mode process is a process of switching from game mode to mouse operation mode. If the determination is YES, the process moves to step S305; if the determination is NO, the process moves to step S306.

[0117] In step S305, the processor 81 determines, based on the operation data 410, whether or not there has been a mouse input operation on the left controller 3 and / or the right controller 4. If the determination is YES, the process moves to step S306; if the determination is NO, the process moves to step S307.

[0118] In step S306, the processor 81 moves the mouse cursor 250 from the center of the screen in response to the mouse input operation based on the operation data 410 (see Figures 8(1) and 8(2)). This process ensures that if the game mode is switched from game mode to mouse operation mode and a mouse input operation is performed on the controller at the same time (YES in S200, NO in S300, YES in S302, YES in S304, and YES in S305), the mouse cursor 250 will move from the center of the screen in response to the mouse input operation in step S305. Also, if the game mode is switched from directional input mode to mouse operation mode in response to a mouse input operation (NO in S200, YES in S201, NO in S300, YES in S302, and NO in S304), the mouse cursor 250 will move from the center of the screen in response to the mouse input operation in step S201 in Figure 16. The process then proceeds to step S308.

[0119] In step S307, the processor 81 displays the mouse cursor 250 in the center of the screen (see Figure 8(1)). This process ensures that the mouse cursor 250 is displayed in the center of the screen when switching from game mode to mouse operation mode. The process then proceeds to step S308.

[0120] In step S308, the processor 81 determines whether the tip of the mouse cursor 250 is overlapping a setting item or tab. If the determination is YES, the process moves to step S309; ​​if the determination is NO, the process moves to step S206 in Figure 16.

[0121] In step S309, the processor 81 sets the setting item or tab that the tip of the mouse cursor 250 determined to be overlapping in step S308 to the specified state (see Figures 8(2) and 9). After that, the process moves to step S310.

[0122] In step S310, the processor 81 determines, based on the operation data 410, whether the L button 38 on the left controller 3 or the R button 60 on the right controller 4 has been pressed. If the determination is YES, the process moves to step S311; if the determination is NO, the process moves to step S206 in Figure 16.

[0123] In step S311, the processor 81 executes processing according to the setting item or tab of the specified state. Processing according to the setting item of the specified state is, for example, setting PO to prioritize defense. Processing according to the tab of the specified state is, for example, displaying the menu sheet containing that tab at the forefront (see Figures 9(2)(3)). After that, the process moves to step S206 in Figure 16.

[0124] Figure 18 is an example of a detailed flowchart of the direction input operation mode performed in step S204 or S205 shown in Figure 16.

[0125] In step S400 of Figure 18, the processor 81 determines whether the current directional input operation mode is the process of "maintaining the previous operation mode" in step S205 of Figure 16. In other words, the processor 81 determines whether the current directional input operation mode is the process of executing the directional input operation mode in step S205 of Figure 16. If this determination is YES, the process moves to step S401; if this determination is NO, the process moves to step S402.

[0126] In step S401, the processor 81 maintains the display position of the frame cursor 260 without moving it. Then, the process moves to step S405.

[0127] In step S402, the processor 81 determines whether the current directional input operation mode is a process that transitions from mouse operation mode to directional input operation mode. If the determination is YES, the process moves to step S404; if the determination is NO, the process moves to step S403.

[0128] In step S403, the processor 81 moves the frame cursor 260 in response to the direction input operation in step S202 in Figure 16 (see Figure 11(2)). The processor 81 also sets the setting item enclosed by the moved frame cursor 260 to the specified state. After that, the process moves to step S405.

[0129] In step S404, the processor 81 displays the frame cursor 260 at an initial position surrounding a predetermined setting item (see Figure 11(1)). This process ensures that when the user switches from mouse operation mode to direction input mode in response to a direction input operation, the frame cursor 260 is displayed at its initial position. The process then proceeds to step S405. In other embodiments, when the user switches from mouse operation mode to direction input mode in response to a direction input operation, the frame cursor 260 may not be displayed at its initial position, but rather at a setting item corresponding to the direction input operation (for example, see setting item 231 in Figure 11(2)), or an animation may be displayed that briefly shows the cursor at its initial position before transitioning to the setting item corresponding to the direction input operation.

[0130] In step S405, the processor 81 determines, based on the operation data 410, whether or not the A button 53 of the right controller 4 (see Figure 13) has been pressed. If the determination is YES, the process moves to step S406; if the determination is NO, the process moves to step S407.

[0131] In step S406, the processor 81 executes processing according to the setting item of the specified state. After that, the process moves to step S407.

[0132] In step S407, the processor 81 determines, based on the operation data 410, whether the L button 38 on the left controller 3 or the R button 60 on the right controller 4 has been pressed. If the determination is YES, the process moves to step S408; if the determination is NO, the process moves to step S206 in Figure 16.

[0133] In step S408, the processor 81 switches the menu sheet to be displayed at the forefront in menu 270 (see Figure 12). After that, the process moves to step S206 in Figure 16.

[0134] As described above, according to this embodiment, in mouse operation mode, the user can operate the mouse cursor 250 using either mouse input operations by the left controller 3 or mouse input operations by the right controller 4 (see explanations of Figures 8 to 10, etc.). This makes it easier for both right-handed and left-handed users to operate the mouse cursor 250.

[0135] Furthermore, according to this embodiment, in mouse operation mode, if mouse input operations are performed simultaneously by the left controller 3 and the right controller 4, the mouse cursor 250 moves based on the mouse input operation of the controller with the faster movement speed, which is presumed to be the controller the user intended to operate (see explanations of Figures 8 to 10, etc.). This allows the mouse cursor to be moved appropriately according to the user's intention.

[0136] Furthermore, according to this embodiment, when transitioning from a game mode (see Figures 6 and 7) where the user plays using mouse input via a controller to a menu mode, the user enters a mouse operation mode (see Figures 8 to 10) where the user performs mouse input operations in the same way. This allows the user to continue using the mouse, improving operability.

[0137] Furthermore, according to this embodiment, when switching from game mode or directional input operation mode to mouse operation mode, the mouse cursor 250, which is not displayed in game mode or directional input operation mode, is displayed at a predetermined position, for example, in the center of the display screen (see Figure 8(1)), thus preventing the user from losing sight of the mouse cursor 250.

[0138] Furthermore, according to this embodiment, when the user switches from mouse operation mode to directional input operation mode, the frame cursor 260 is displayed at a predetermined position (see Figure 11(1), etc.), thus preventing the user from losing sight of the frame cursor 260.

[0139] Furthermore, when a user holds the controller with both hands, it is generally assumed that they would use their left thumb to perform directional input. However, according to this embodiment, in directional input mode, directional input can be performed with the left controller 3 but not with the right controller 4 (see explanations of Figures 11 to 13, etc.), allowing for operation without any discomfort.

[0140] Furthermore, according to this embodiment, the system switches to the directional input mode when a directional input operation is performed in the mouse operation mode, and switches back to the mouse operation mode when a mouse input operation is performed in the directional input mode (see Figure 16). Therefore, no additional operation is required to switch operation modes, improving usability.

[0141] Furthermore, according to this embodiment, when a mouse input operation and a directional input operation are performed simultaneously, it is highly likely that the user intends to perform the mouse input operation, which requires moving the controller with the mouse sensor positioned on the work surface. Therefore, processing corresponding to the mouse input operation is executed (see Figure 16). This allows for processing that aligns with the user's intentions.

[0142] [Differentiation] In the embodiment described above, an example was given in which, in the direction input operation mode, the frame cursor 260, which is an object that points to a setting item, moves in response to the direction input operation (see Figure 11). However, in the direction input operation mode, the display that points to the setting item may also move in response to the direction input operation. For example, in the direction input operation mode, instead of the frame cursor 260, a color-changing display that indicates that the setting item is in the specified state (see setting item 230 in Figure 11(1), setting item 231 in Figure 11(2), etc.) may be moved in response to the direction input operation.

[0143] Furthermore, in the embodiment described above, the shape of the cursor 260 that points to the setting item in the direction input operation mode (see Figure 11) is not limited to a frame shape. For example, the shape of this cursor may be an arrow shape.

[0144] Furthermore, in the embodiment described above, an example was given in which the mouse cursor 250 is displayed at the initial position, the center of the screen, when transitioning from game mode or directional input mode to mouse operation mode (see Figure 8(1)). However, the position of the mouse cursor 250 when transitioning from mouse operation mode to game mode or directional input mode may be memorized, and the mouse cursor 250 may be displayed at the memorized position when returning from game mode or directional input mode to mouse operation mode.

[0145] Furthermore, in the embodiment described above, when transitioning from directional input operation mode to mouse operation mode, the mouse cursor 250 may be displayed at a position that points to the setting item that was enclosed by the frame cursor 260 in directional input operation mode (for example, the position where the tip of the mouse cursor 250 is at the center of this setting item).

[0146] Furthermore, in the embodiment described above, an example was given in which the frame cursor 260 is displayed at a predetermined initial position when transitioning from mouse operation mode to directional input operation mode (see Figure 11(1)). However, the position of the frame cursor 260 when transitioning from directional input operation mode to mouse operation mode may be memorized, and the frame cursor 260 may be displayed at the memorized position when returning from mouse operation mode to directional input operation mode.

[0147] Furthermore, in the embodiment described above, when transitioning from mouse operation mode to directional input operation mode, a frame cursor 260 may be displayed on the setting item that was in a specified state when the tip of the mouse cursor 250 overlapped with it in mouse operation mode.

[0148] Furthermore, in the embodiment described above, the same cursor may be displayed and operated in both the directional input mode and the mouse operation mode, and this cursor may be, for example, a mouse cursor (see Figure 8).

[0149] Furthermore, in the above embodiment, when switching between game mode, mouse operation mode, and directional input operation mode, the left controller 3 and / or the right controller 4 may be vibrated by operating the vibrators (107 and 117 in Figure 5).

[0150] Furthermore, in the embodiment described above, an example was given in which, in menu mode, the cursor (250) is moved in response to mouse input and the cursor (260) is moved in response to directional input (see Figures 8 to 13). However, in game mode, the first cursor may be moved in response to mouse input and the second cursor may be moved in response to directional input. For example, in game mode, there may be a scene where a cursor is used to point to a predetermined object (a predetermined item), and in this scene, the first cursor may be moved in response to mouse input and the second cursor may be moved in response to directional input to point to the predetermined object. The first and second cursors may be the same or different. Also, only one of the first and second cursors may be displayed, or both may be displayed. In addition, in information processing other than game processing, the cursor may be moved in response to mouse input and the cursor may be moved in response to directional input to point to a predetermined object.

[0151] Furthermore, in the embodiment described above, an example was given in which the cursor (250, 260) is operated in response to mouse input and directional input. However, for example, other objects other than the cursor (e.g., a player object) may be operated in response to mouse input and directional input.

[0152] Furthermore, in the embodiment described above, an example was given in which mouse input operations can be performed using the left controller 3 and also using the right controller 4. However, it is also possible to configure the system so that mouse input operations cannot be performed using the left controller 3, but can be performed using the right controller 4.

[0153] Furthermore, in the embodiment described above, the left controller 3 may be configured so that directional input cannot be performed using the right direction button 33, down direction button 34, up direction button 35, and left direction button 36 (see Figure 2) in the direction input operation mode.

[0154] Furthermore, the controller and information processing device described above are merely examples, and their structure and shape are not limited. For example, the information processing device may be a personal computer or a smartphone. Also, the controller and information processing device do not necessarily have to be detachable.

[0155] Furthermore, in the embodiment described above, the mouse sensors (71, 74) detected the movement of the controllers (3, 4) on the work surface and output the direction and amount of movement. However, the mouse sensors may only output data related to reflected light from the work surface, and the main unit 2 may calculate whether or not the controller has moved on the work surface, as well as the direction and amount of movement, based on this data. Alternatively, the main unit 2 or the controller may calculate the current position of the controller in the controller coordinate system and perform various processes based on this. The same applies to the inertial sensors provided in the controller; the actual orientation, etc., may be calculated by either the main unit 2 or the controller.

[0156] Furthermore, the method for switching between the mouse operation mode and the directional input operation mode is not limited in the embodiment described above. For example, this switching may be performed in response to a specific button operation, or a physical mode switching switch (not shown) may be provided on at least one of the controllers and the switching may be performed in response to the operation of the mode switching switch.

[0157] Furthermore, although an analog stick was used as an example of the directional input unit in the embodiment described above (see Figure 2, etc.), a sliding stick or a cross-shaped button may be provided on the controller instead of an analog stick and function as the directional input unit.

[0158] Furthermore, although a game program was described as an example of an information processing program in the embodiment described above (see Figure 14), the information processing program is not limited to a game program. The information processing program may, for example, be a program relating to a system menu in an information processing system. The system menu may be, for example, a menu for selecting a game application to be executed in the information processing system, or a menu for setting various functions of the information processing system.

[0159] Furthermore, the above-described embodiment explained a case in which a series of processes related to game processing are executed by a single game device 1. In other embodiments, the above series of processes may be executed in an information processing system consisting of multiple information processing devices. For example, in an information processing system including a terminal-side device and a server-side device that can communicate with the terminal-side device via a network, some of the processes in the above series may be executed by the server-side device. Moreover, in an information processing system including a terminal-side device and a server-side device that can communicate with the terminal-side device via a network, the main processes in the above series may be executed by the server-side device, and some of the processes may be executed by the terminal-side device. In addition, in the above information processing system, the server-side system may be composed of multiple information processing devices, and the processes to be executed on the server side may be divided and executed by multiple information processing devices. Furthermore, a so-called cloud gaming configuration may also be used. For example, the game device 1 may send operation data indicating user operations to a predetermined server, where various game processes are executed, and the execution results are streamed to the game device 1 as video and audio. [Industrial applicability]

[0160] The information processing program, information processing system, and information processing method relating to this disclosure can provide a new method for controlling object display using an input device. [Explanation of symbols]

[0161] 1 Game device 3, 4 Controllers 12 displays 32, 52 sticks 71, 74 Mouse Recovery 81 processors 84, 85 Memory 250, 260 cursors

Claims

1. In the processor of the information processing device, A first input device, which is held in the user's left hand and includes a first directional input unit and a first mouse sensor, acquires first directional input unit operation data corresponding to the user's operation of the first directional input unit and first mouse operation data corresponding to the user's movement of the first input device. A second input device, which is held in the user's right hand and includes a second directional input unit and a second mouse sensor, acquires second directional input unit operation data corresponding to the user's operation of the second directional input unit and second mouse operation data corresponding to the user's movement of the second input device. In mouse operation mode, the first display pointing to the displayed item is moved according to the first mouse operation data and the second mouse operation data. In the direction input operation mode, the second display pointing to the displayed item is moved according to the operation data of the first direction input unit, and the second display is not moved according to the operation data of the second direction input unit. An information processing program that executes either the mouse operation mode or the directional input operation mode.

2. The aforementioned processor, A game mode in which the first and second displays are not shown, and the game progresses according to the first mouse operation data and the second mouse operation data, The information processing program according to claim 1, which is transitioned from the game mode to execute a menu mode in which either the mouse operation mode or the directional input operation mode is executed.

3. The aforementioned processor, The first display and the second display are made to be different displays. In the mouse operation mode, the second display is not shown, and in the directional input operation mode, the first display is not shown. The information processing program according to claim 2, which, when transitioning from the game mode to the menu mode, causes the program to switch to the mouse operation mode.

4. The aforementioned processor, When the first mouse operation data indicating the movement of the first input device or the second mouse operation data indicating the movement of the second input device is acquired, the mouse operation mode is executed. The information processing program according to claim 1, which, when operation data for the first direction input unit indicating an operation input to the first direction input unit is acquired, causes the direction input operation mode to be executed.

5. The aforementioned processor, The information processing program according to claim 4, which executes the mouse operation mode when at least one of the first mouse operation data and the second mouse operation data and the first direction input unit operation data are both acquired.

6. The first input device includes the first directional input section on the front, the first button on the top or left side, and the first mouse sensor on the right side. The second input device is equipped with the second directional input section and second button on the front, a third button on the top or right side, and the second mouse sensor on the left side. The aforementioned processor, In the mouse operation mode described above, the first button and the third button are assigned a confirmation function, while the second button is not assigned a confirmation function. The information processing program according to claim 1, wherein in the direction input operation mode, the second button is given a confirmation function, and the first button and the third button are not given a confirmation function.

7. The aforementioned processor, The information processing program according to claim 6, wherein in the directional input operation mode, the first button and the third button are provided with a function to switch the items.

8. The first representation is the first object, The information processing program according to any one of claims 1 to 7, wherein the second display is a second object different from the first object.

9. An information processing system equipped with a processor, The aforementioned processor, A first input device, which is held in the user's left hand and includes a first directional input unit and a first mouse sensor, acquires first directional input unit operation data corresponding to the user's operation of the first directional input unit and first mouse operation data corresponding to the user's movement of the first input device. The system acquires second directional input unit operation data corresponding to the user's operation of the second directional input unit and second mouse operation data corresponding to the user's movement of the second input device from a second input device held in the user's right hand, which includes a second directional input unit and a second mouse sensor. In mouse operation mode, the first display pointing to the displayed item is moved according to the first mouse operation data and the second mouse operation data. In the direction input operation mode, the second display pointing to the displayed item is moved according to the operation data of the first direction input unit, and the second display is not moved according to the operation data of the second direction input unit. An information processing system that performs either the mouse operation mode or the directional input operation mode.

10. The aforementioned processor, A game mode in which the first and second displays are not shown, and the game progresses according to the first mouse operation data and the second mouse operation data, The information processing system according to claim 9, which is transitioned from the game mode to execute a menu mode in which either the mouse operation mode or the directional input operation mode is executed.

11. The aforementioned processor, The first and second displays are different displays. In the mouse operation mode, the second display is not shown, and in the directional input operation mode, the first display is not shown. The information processing system according to claim 10, wherein when transitioning from the game mode to the menu mode, the system switches to the mouse operation mode.

12. The aforementioned processor, When the first mouse operation data indicating the movement of the first input device or the second mouse operation data indicating the movement of the second input device is acquired, the mouse operation mode is executed. The information processing system according to claim 9, which executes the direction input operation mode when operation data for the first direction input unit, which indicates an operation input to the first direction input unit, is acquired.

13. The aforementioned processor, The information processing system according to claim 12, wherein the mouse operation mode is executed when at least one of the first mouse operation data and the second mouse operation data and the first direction input unit operation data are acquired together.

14. The first representation is the first object, The information processing system according to any one of claims 9 to 13, wherein the second display is a second object different from the first object.

15. An information processing method to be executed by the processor of an information processing device, The aforementioned processor, A first input device, which is held in the user's left hand and includes a first directional input unit and a first mouse sensor, acquires first directional input unit operation data corresponding to the user's operation of the first directional input unit and first mouse operation data corresponding to the user's movement of the first input device. A second input device, which is held in the user's right hand and includes a second directional input unit and a second mouse sensor, acquires second directional input unit operation data corresponding to the user's operation of the second directional input unit and second mouse operation data corresponding to the user's movement of the second input device. In mouse operation mode, the first display pointing to the displayed item is moved according to the first mouse operation data and the second mouse operation data. In the direction input operation mode, the second display pointing to the displayed item is moved according to the operation data of the first direction input unit, and the second display is not moved according to the operation data of the second direction input unit. An information processing method that causes either the mouse operation mode or the directional input operation mode to be executed.

16. The aforementioned processor, A game mode in which the first and second displays are not shown, and the game progresses according to the first mouse operation data and the second mouse operation data, The information processing method according to claim 15, which is transitioned from the game mode to execute a menu mode in which either the mouse operation mode or the directional input operation mode is executed.

17. The aforementioned processor, The first display and the second display are made to be different displays. In the mouse operation mode, the second display is not shown, and in the directional input operation mode, the first display is not shown. The information processing method according to claim 16, wherein when transitioning from the game mode to the menu mode, the system is switched to the mouse operation mode.

18. The aforementioned processor, When the first mouse operation data indicating the movement of the first input device or the second mouse operation data indicating the movement of the second input device is acquired, the mouse operation mode is executed. The information processing method according to claim 15, wherein when operation data for the first direction input unit indicating an operation input to the first direction input unit is acquired, the direction input operation mode is executed.

19. The aforementioned processor, The information processing method according to claim 18, wherein the mouse operation mode is executed when at least one of the first mouse operation data and the second mouse operation data and the first direction input unit operation data are acquired together.

20. The first representation is the first object, The information processing method according to any one of claims 15 to 19, wherein the second representation is a second object different from the first object.

Images