Information processing system, game program, and information processing method

Abstract

In the present invention, a first input device: includes a first mouse sensor and a first stick which is operated by a user; and outputs first stick operation data related to an operation on the first stick and / or first mouse operation data corresponding to a movement of the first input device. A second input device: includes a second mouse sensor and a second stick which is operated by a user; and outputs second stick operation data related to an operation on the second stick and / or second mouse operation data corresponding to a movement of the second input device. A first operation mode includes changing at least the position of a virtual camera in accordance with the second stick operation data, and changing at least the direction of the virtual camera in accordance with the first mouse operation data, among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data.

Description

Information processing system, game program, and information processing method

[0001] The present disclosure relates to an information processing system, a game program, and an information processing method.

[0002] Japanese Patent Application Laid-Open Publication No. 2017-000757 (Patent Document 1) discloses a game controller.

[0003] JP 2017-000757 A

[0004] The present disclosure provides a system including a novel input device, a game program that uses input from the novel input device, and an information processing method that uses the novel input device.

[0005] (Configuration 1) An information processing system according to one embodiment includes a first input device held in one hand of a user, a second input device held in the other hand of the user, and at least one processor. The first input device includes a first mouse sensor and a first stick operated by the user, and outputs at least one of first stick operation data relating to an operation on the first stick or first mouse operation data corresponding to movement of the first input device. The second input device includes a second mouse sensor and a second stick operated by the user, and outputs at least one of second stick operation data relating to an operation on the second stick or second mouse operation data corresponding to movement of the second input device. The at least one processor executes game processing including positioning a virtual camera in a virtual space and executing a first operation mode. The first operation mode includes changing at least the position of the virtual camera in accordance with the second stick operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data, and changing at least the orientation of the virtual camera in accordance with the first mouse operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data.

[0006] According to configuration 1, when controlling the position and orientation of the virtual camera, the first input device and the second input device both have a mouse sensor and a stick, and the position of the virtual camera can be controlled by output in response to operation of the stick of the second input device, thereby facilitating continuous movement of the virtual camera. Since the orientation of the virtual camera can be controlled by output of the mouse sensor of the first input device, it is possible to facilitate operation of pointing the virtual camera in the direction intended by the user. Although the first input device has a stick and the second input device has a mouse sensor, they are not used to control the position and orientation of the virtual camera, thereby reducing confusion in operation and erroneous inputs.

[0007] (Configuration 2) In Configuration 1, the game processing may include executing one of a plurality of operation modes including a first operation mode and a second operation mode. The second operation mode may include changing at least the position of the virtual camera in accordance with second stick operation data among first stick operation data, first mouse operation data, second stick operation data, and second mouse operation data, and changing at least the orientation of the virtual camera in accordance with first stick operation data among the first stick operation data, first mouse operation data, second stick operation data, and second mouse operation data.

[0008] (Configuration 3) In configuration 1 or 2, the game processing may include executing one of a plurality of operation modes including a first operation mode and a third operation mode. The third operation mode may include changing at least the position of the virtual camera in accordance with the first stick operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data, and changing at least the orientation of the virtual camera in accordance with the second mouse operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data.

[0009] (Configuration 4) In any of configurations 1 to 3, the first input device may include a first sensor for detecting an attitude of the first input device or an acceleration occurring in the first input device. The second input device may include a second sensor for detecting an attitude of the second input device or an acceleration occurring in the second input device. The first operation mode may further include generating a predetermined in-game effect in response to the second sensor data of first sensor data output by the first sensor and second sensor data output by the second sensor.

[0010] (Configuration 5) In any of configurations 1 to 4, the first input device may be held in the user's right hand. The first input device may include a first stick and a first button above the first stick, provided on a first front surface that is the front face of the first input device; a first opening that is connected to the first mouse sensor, provided on a first left side surface that is connected to the first front surface; and a second button, provided on a first top surface that is connected to the first front surface and the first left side surface. The second input device may be held in the user's left hand. The second input device may include a second stick and a third button below the second stick, provided on a second front surface that is the front face of the second input device; a second opening that is connected to the second mouse sensor, provided on a second right side surface that is connected to the second front surface; and a fourth button, provided on a second top surface that is connected to the second front surface and the second right side surface.

[0011] (Configuration 6) In any of configurations 1 to 5, the information processing system may further include a main unit having at least one processor. The first input device and the second input device may be attachable to the main unit. The first input device may be attached to the main unit so that the first left side is not exposed. The second input device may be attached to the main unit so that the second right side is not exposed.

[0012] (Configuration 7) In any of configurations 1 to 6, the first input device may output first button operation data related to an operation on the first button. The first operation mode may include generating a predetermined in-game effect in response to the first button operation data, out of the first stick operation data and the first button operation data.

[0013] According to configuration 7, even when the first input device is used as a mouse, operation with the first button is possible, thereby increasing the variety of operations using the first input device. On the other hand, operation of the stick of the first input device operated as a mouse is not used to generate in-game effects, thereby reducing operational errors.

[0014] (Configuration 8) In any of configurations 1 to 7, the first input device may further include a fifth button provided on the first top surface and rearward of the second button. The second input device may further include a sixth button provided on the second top surface and rearward of the fourth button.

[0015] (Configuration 9) In any of configurations 1 to 8, the first input device may output second button operation data related to an operation on the second button, and fifth button operation data related to an operation on the fifth button. The first operation mode may further include producing an in-game effect, in response to the fifth button operation data, that is different from the in-game effect produced in response to the second button operation data.

[0016] (Configuration 10) In any of Configurations 1 to 9, the first input device may be configured to be self-standing when placed on a placement surface with the first left side surface facing down. The first left side surface may be longer in the up-down direction than in the front-to-back direction. The length of the first left side surface in the front-to-back direction may be 12.6 to 15.4 mm.

[0017] (Configuration 11) In any of configurations 1 to 9, the first left side surface may include a first left surface, a second left surface connected to the first left surface and extending leftward from the first left surface, and a third left surface spaced apart from the first left surface and connected to the second left surface. The first opening may be provided in the third left surface. The first input device may be configured to be self-standing when placed on a placement surface with the third left surface facing down. The third left surface may be longer in the up-down direction than in the front-to-back direction. The length of the third left surface in the front-to-back direction may be 7.2 to 8.8 mm.

[0018] According to configuration 10 or 11, the first input device is thin and can be easily lifted up and used as a game controller. When used as a mouse, it can be easily used in a place such as on the thigh.

[0019] (Configuration 12) In any of configurations 1 to 9, the first input device may be configured to be self-standing when placed on a placement surface with the first left side surface facing down. The first left side surface may be longer in the up-down direction than in the front-to-back direction. The first opening may be provided in the first left side surface. The length of the first opening in the front-to-back direction may be 23 to 35% of the length of the first left side surface in the front-to-back direction.

[0020] (Configuration 13) In any of configurations 1 to 9, the first left side surface may include a first left surface, a second left surface connected to the first left surface and extending leftward from the first left surface, and a third left surface spaced apart from the first left surface and connected to the second left surface. The first opening may be provided in the third left surface. The first input device may be configured to be self-standing when placed on a placement surface with the third left surface facing down. The third left surface may be longer in the up-down direction than in the front-to-back direction. The first opening may be provided in the third left surface. The length of the first opening in the front-to-back direction may be 41 to 61% of the length of the third left surface in the front-to-back direction.

[0021] According to configuration 12 or 13, when the first input device is used as a mouse, even when it is placed on the thigh, for example, the opening (i.e., the mouse sensor) is likely to face the placement surface, and user operations are likely to be reflected as intended.

[0022] (Configuration 14) In any of configurations 1 to 13, the information processing system may further include a main unit having a display. The first input device may be detachable from at least one side of the main unit. The second input device may be detachable from at least the other side of the main unit.

[0023] (Configuration 15) In configurations 2 or 3, the information processing system may further include a main unit having a display. The first input device may be detachable from at least one side of the main unit. The second input device may be detachable from at least the other side of the main unit. The second operation mode may be executed with the first input device and the second input device attached to the main unit.

[0024] (Configuration 16) The first input device may be attached to the main unit so that the first mouse sensor is not exposed. The second input device may be attached to the main unit so that the second mouse sensor is not exposed.

[0025] (Configuration 17) The first operation mode may include changing the position of a virtual character in the virtual space in accordance with the first stick operation data, and changing at least the position of the virtual camera in accordance with the change in the position of the virtual character.

[0026] According to configuration 17, the position and orientation of the virtual camera can be appropriately controlled in a first-person perspective (FPS: First Person Shooter) game or a third-person perspective (TPS: Third Person Shooter) game.

[0027] (Configuration 18) A game program according to another embodiment causes at least one processor to execute the steps of: acquiring, from a first input device held in one hand of a user and having a first mouse sensor and a first stick operated by the user, at least one of first stick operation data relating to an operation on a first stick or first mouse operation data corresponding to movement of the first input device; acquiring, from a second input device held in the other hand of the user and having a second mouse sensor and a second stick operated by the user, at least one of second stick operation data relating to an operation on a second stick or second mouse operation data corresponding to movement of the second input device; and executing game processing including positioning a virtual camera in a virtual space and executing a first operation mode. The first operation mode includes changing at least the position of the virtual camera in accordance with the second stick operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data, and changing at least the orientation of the virtual camera in accordance with the first mouse operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data.

[0028] (Configuration 19) In configuration 18, the game processing may include executing one of a plurality of operation modes including a first operation mode and a second operation mode. The second operation mode may include changing at least the position of the virtual camera in accordance with second stick operation data among first stick operation data, first mouse operation data, second stick operation data, and second mouse operation data, and changing at least the orientation of the virtual camera in accordance with first stick operation data among the first stick operation data, first mouse operation data, second stick operation data, and second mouse operation data.

[0029] (Configuration 20) In configuration 18 or 19, the first input device may further include a first stick and a first button above the first stick, both of which are provided on a first front surface that is a front surface of the first input device. The game program may further cause the at least one processor to execute a step of outputting first button operation data related to an operation on the first button. The first operation mode may include generating a predetermined in-game effect in response to the first button operation data of the first stick operation data and the first button operation data.

[0030] (Configuration 21) An information processing method according to yet another embodiment includes the steps of: acquiring, from a first input device held in one hand of a user and having a first mouse sensor and a first stick operated by the user, at least one of first stick operation data relating to an operation on a first stick or first mouse operation data corresponding to movement of the first input device; acquiring, from a second input device held in the other hand of the user and having a second mouse sensor and a second stick operated by the user, at least one of second stick operation data relating to an operation on a second stick or second mouse operation data corresponding to movement of the second input device; and executing game processing including positioning a virtual camera in a virtual space and executing a first operation mode. The first operation mode includes changing at least the position of the virtual camera in accordance with the second stick operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data, and changing at least the orientation of the virtual camera in accordance with the first mouse operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data.

[0031] (Configuration 22) In configuration 21, the game processing may include executing one of a plurality of operation modes including a first operation mode and a second operation mode. The second operation mode may include changing at least the position of the virtual camera in accordance with second stick operation data among first stick operation data, first mouse operation data, second stick operation data, and second mouse operation data, and changing at least the orientation of the virtual camera in accordance with first stick operation data among the first stick operation data, first mouse operation data, second stick operation data, and second mouse operation data.

[0032] (Configuration 23) In configuration 21 or 22, the first input device may further include a first stick and a first button above the first stick, both of which are provided on a first front surface of the first input device. The information processing method may further include outputting first button operation data related to an operation on the first button. The first operation mode may include generating a predetermined in-game effect in response to the first button operation data of the first stick operation data and the first button operation data.

[0033] 10 is a schematic front view showing an example of the configuration of an information processing system according to the present embodiment. FIG. 11 is a schematic front view showing a state in which each of the first game controller and the second game controller is detached from the main unit. FIG. 12 is a schematic front view showing an example of a state in which the first game controller and the second game controller are detached from the main unit. FIG. 13 is a schematic assembly perspective view showing the configuration of the right side of the main unit. FIG. 14 is a schematic six-sided view showing an example of the configuration of the first game controller. FIG. 15 is a schematic perspective view showing an example of a detailed configuration of the first game controller. FIG. 16 is a schematic cross-sectional view showing only the convex portion taken along line XII-XII of FIG. 10. FIG. 17 is a schematic six-sided view showing an example of the configuration of the second game controller. FIG. 18 is a block diagram showing an example of the internal configuration of the main unit 3. FIG. 19 is a block diagram showing an example of the internal configuration of an information processing system. FIG. 19 is a schematic view showing an example of a first-person perspective game screen. FIG. 19 is a schematic view showing an example of a process for changing the position of a virtual camera in the virtual space of a first-person perspective game. FIG. 19 is a schematic view showing an example of a process for changing the orientation of a virtual camera in the virtual space of a first-person perspective game. FIG. 19 is a diagram showing an example of an operation mode of the information processing system according to the present embodiment. FIG. 19 is a schematic view showing an example of the software configuration for executing processes according to the operation mode of the information processing system according to the present embodiment. Fig. 1 is a flowchart showing a processing procedure for setting the usage state of a game controller. Fig. 2 is a flowchart showing an execution procedure of game processing. Fig. 3 is a schematic diagram showing an example of processing for changing the position of a virtual camera in the virtual space of a game with a third-person perspective. Fig. 4 is a schematic diagram showing an example of processing for changing the orientation of a virtual camera in the virtual space of a game with a third-person perspective.

[0034] The present embodiment will be described in detail with reference to the drawings, in which the same or corresponding parts are designated by the same reference numerals and description thereof will not be repeated.

[0035] <Information Processing System> First, a configuration example of an information processing system 1000 according to this embodiment will be described. Fig. 1 is a schematic front view showing a configuration example of an information processing system 1000 according to this embodiment.

[0036] As shown in FIG. 1 , the information processing system 1000 according to this embodiment includes a first game controller 1, a second game controller 2, and a main unit 3. In the following description, the first game controller 1 or the second game controller 2 will be collectively referred to simply as a "game controller." Each of the first game controller 1 and the second game controller 2 is an input device. The main unit 3 is capable of executing game processing. The game processing is executed based on input to the game controller, which is an input device. The first game controller 1 and the second game controller 2 are detachable from the main unit 3. In the attached state shown in FIG. 1 , the first game controller 1 is attached to the right side of the main unit 3, and the second game controller 2 is attached to the left side of the main unit 3.

[0037] The information processing system 1000 according to the present embodiment is merely an example, and in another example, each game controller may not be detachable from the main unit 3. In another example, the information processing system may include a server or a main unit of another user as the entity that executes game processing, instead of the main unit 3.

[0038] <Usage> Next, an example of how the game controller according to this embodiment is used will be described.

[0039] As shown in FIG. 1 , the game controllers can be used while attached to the main unit 3. In this embodiment, as shown in FIG. 1 , the direction connecting the game controllers attached to the main unit 3 is defined as the left-right direction, the side facing the user when in use is defined as the front, and when viewed from the front, the direction in which the first game controller 1 is attached is defined as the right direction, and the direction in which the second game controller 2 is attached is defined as the left direction. The up-down direction will also be described based on the use state. In this embodiment, the up-down direction is the longitudinal direction of the controller. In this embodiment, the left-right direction is the longitudinal direction of the main unit 3. In this embodiment, the game controllers can take various positions, but the directions of the game controllers will be described based on the directions shown in FIG. 1 .

[0040] FIG. 2 is a schematic front view showing the first game controller 1 and the second game controller 2 detached from the main unit 3 .

[0041] As shown in FIG. 2, the game controller can be used even when detached from the main unit 3.

[0042] FIG. 3 is a diagram showing an example of a state in which the game controller and the main unit 3 are used together.

[0043] 4 is a diagram showing an example of a state in which a game controller is held and operated horizontally. As shown in FIG. 4, when the game controller is detached from the main unit 3, the longitudinal direction of the game controller is oriented left-to-right for the user. The game controller is held by one hand at one longitudinal end (one vertical end) and the other hand at the other longitudinal end. For example, the index fingers of both hands of the user are placed on the left side of the first game controller 1. In the example shown in FIG. 4, the first game controller 1 and the second game controller 2 are operated by different users.

[0044] In the following description, components operated by the user are also collectively referred to as the "input unit." The input unit is a component that accepts user input. The input unit includes, for example, a + button 33, a set of four buttons 32, a stick 31, and a home button 34 that are provided on the front face 15 of the first game controller 1, and a capture button 44, a set of four buttons 42, a stick 41, and a - button 43 that are provided on the front face 25 of the second game controller 2. The input unit also includes other buttons and the like that are provided on the game controllers.

[0045] FIG. 5 is a diagram showing an example of a state in which the game controller is held and operated vertically. As shown in FIG. 5, the game controller can also be used in a state in which, when detached from the main unit 3, the longitudinal direction of the game controller is the up-down or front-to-back direction for the user. In the example shown in FIG. 5, one user operates both the first game controller 1 and the second game controller 2. For example, the index finger of the user's right hand is placed on the upper side of the first game controller 1, and the index finger of the user's left hand is placed on the upper side of the second game controller 2. The first game controller 1 and the second game controller 2 may be operated by different users.

[0046] FIG. 6 is a schematic diagram showing an example of a state in which a game controller is used as a mouse. As will be described in detail later, the game controller can also be used as a mouse. As shown in FIG. 6 , the user's palm covers the underside of the first game controller 1. The user's right thumb is placed on the front surface 15 of the first game controller 1. The user's right thumb is placed on, for example, button 32. The user's right index finger is placed on the shoulder button (right) 130. The user's right middle finger is placed on the Z shoulder button (right) 140.

[0047] The user can operate the right shoulder button 130 with the index finger of his right hand. The user can operate the right Z shoulder button 140 with the middle finger of his right hand. The user may also operate the right Z shoulder button 140 with the index finger of his right hand. The user can operate the input section on the front surface 15 with the thumb of his right hand. For example, the user can operate the stick 31, the set of four buttons 32, and the + button 33 with his thumb.

[0048] The second game controller 2 may also be used as a mouse in the left hand. Fig. 7 is a schematic diagram showing an example of using two game controllers as a mouse. As shown in Fig. 7, the first game controller is used as a mouse in the right hand, and the second game controller 2 is used as a mouse in the left hand.

[0049] The first user may use the first game controller 1 as a mouse, and the second user may use the second game controller 2 as a mouse. The first game controller 1 may be operated as a mouse with the left hand. The second game controller 2 may be operated as a mouse with the right hand.

[0050] In this way, the user can use the input section on the front surface 15 of the game controller when using the game controller as a mouse. The user can also use the shoulder buttons and Z shoulder buttons of the game controller like the right-click and left-click buttons on a mouse.

[0051] In the following explanation, the usage state shown in Figure 3 will be referred to as the "integrated grip state," the usage state of each game controller shown in Figure 4 will be referred to as the "horizontal holding state," the usage state of each game controller shown in Figure 5 will be referred to as the "vertical holding state," and the usage state of each game controller shown in Figures 6 and 7 will be referred to as the "mouse usage state."

[0052] The user may use one of the first game controller 1 and the second game controller 2 as a mouse, and the other as a vertically held game controller.

[0053] 8 is a schematic diagram showing an example in which one game controller is used as a mouse and the other game controller is held vertically. In the example shown in FIG. 8, the first game controller 1 is used as a mouse with the right hand, and the second game controller 2, held vertically, is operated with the left hand, but the reverse is also possible.

[0054] The first user may use the first game controller 1 as a mouse, and the second user may hold the first game controller 1 vertically or horizontally and operate the second game controller 2. The first user may hold the first game controller 1 vertically or horizontally and operate the second game controller 2 as a mouse.

[0055] When detached from the main unit 3, the game controller can be used as a horizontally held game controller with the top surface facing upward (see FIG. 4), as a vertically held game controller with the top surface facing horizontally (see FIG. 5), or as a mouse with the top surface facing downward (see FIGS. 6 and 7). In other words, by changing the direction in which it is held, one game controller can be used in three different ways.

[0056] As shown in Figures 5 to 8, as an example, the first game controller 1 can be held in one hand (specifically, the right hand) of the user, and the second game controller 2 can be held in the other hand (specifically, the left hand) of the user.

[0057] <Main Unit> Next, a configuration example of the main unit 3 according to this embodiment will be described.

[0058] Referring again to FIG. 1 , a display 305 is provided on the main body front surface 315 of the main body device 3. The display surface of the display 305 is exposed through an opening provided in the main body front surface 315. The display 305 may be provided on the surface of the main body front surface 315. The display 305 may be any display device such as a liquid crystal display device or an OLED. The touch panel 2013 may employ any touch detection method. The display 305 displays, for example, an image acquired or generated by the main body device 3. The image may be a still image or a video.

[0059] The main body device 3 may have an audio input / output terminal 301 and a volume button 2026 (see Figure 14) on the upper surface 316 of the main body.

[0060] The main unit 3 has a lower terminal 303. The lower terminal 303 is provided on a lower surface 317 of the main unit 3. The lower terminal 303 is a terminal for communicating with, for example, an external device. The lower terminal 303 constitutes, for example, a USB (Universal Serial Bus) connector. The main unit 3 may receive power from an external source via the lower terminal 303. The main unit 3 may output an image to an external device via the lower terminal 303. When the main unit 3 is placed on a cradle with the lower surface of the main unit facing up, the lower terminal 303 may be connected to a terminal of the cradle.

[0061] These components of the main unit 3 are merely examples. These components may be provided on other sides of the main unit 3. Multiple of these components may be provided. The main unit 3 may not have these components. Furthermore, the main unit 3 may have other components in addition to or instead of these components. For example, the main unit 3 may have a power button 307 and a storage medium slot 304 on the upper side 316 of the main unit. The main unit 3 may execute game processing by running a game application stored on a storage medium inserted into the storage medium slot 304. The main unit 3 may also have a stand on the back of the main unit for supporting the main unit 3. The stand allows the main unit 3 to stand on a placement surface with the upper side 316 of the main unit facing upward.

[0062] FIG. 9 is a schematic assembly perspective view showing the configuration of the right side surface of the main unit 3. As shown in FIG. 9, a recess 310 is provided in the main unit right side surface 313 of the main unit 3. The recess 310 is a recessed portion in the main unit right side surface 313. The recess 310 has a bottom surface 3121 and an inner peripheral surface 3120 surrounding the bottom surface 3121. By disposing a cover 338 on the base surface, the surface of the cover 338 forms the bottom surface 3121 of the recess 310. Note that the cover 338 may be omitted, in which case the bottom surface formed by the main unit housing 306 may serve as the bottom surface 3121 of the recess 310.

[0063] The first plug connector 330 has a first tongue body 332 and a first main body terminal 331 provided along the surface of the first tongue body 332 .

[0064] The left side of the main unit 3 has the same configuration as in Fig. 9. <Game Controller> Next, an example of the configuration of the game controller according to this embodiment will be described.

[0065] Fig. 10 is a schematic six-sided diagram showing an example of the configuration of the first game controller 1. Fig. 11 is a schematic perspective view showing an example of the detailed configuration of the first game controller 1. The second game controller 2 will be described later.

[0066] As shown in FIGS. 10 and 11 , the front surface 15 of the housing 10 of the first game controller 1 has a stick 31, which is an example of a directional input unit, a set of four buttons 32, a + button 33, and a home button 34. The set of four buttons 32 is arranged in a cross shape, but may be arranged in other ways. The first game controller 1 also has a side button (up) 110, a side button (down) 120, a synchronization button 50, a shoulder button (right) 130, and a Z shoulder button (right) 140. These are examples of input units, and the first game controller 1 does not necessarily have to have all of them. The first game controller 1 may also have other input units, such as a touchpad or a pressure sensor, instead of or in addition to these input units.

[0067] When the first game controller 1 is attached to the main unit 3, operation data from the input unit is transmitted to the main unit first terminal 331 of the main unit 3 through the first terminal 160 described below, and information is processed by the processor of the main unit 3 in accordance with a program. In a usage mode in which the game controller is not attached to the main unit 3, operation data from the input unit is transmitted to the processor of the main unit 3 via a wireless chip in the game controller and a wireless chip in the main unit 3. The information processing system 1000 does not need to have the first terminal 160 and the main unit first terminal 331, in which case information is transmitted via the wireless chip even when the game controller is attached to the main unit 3.

[0068] On the front surface 15 of the first game controller, from top to bottom, a + button 33, a set of four buttons 32, a stick 31, and a home button 34 are provided. In this disclosure, "being provided" with buttons, etc., includes both being provided on the surface of a housing or the like, and being provided through a hole in the housing or the like. The set of four buttons 32 and the stick 31 are adjacent to each other. The set of four buttons 32 is located above the stick 31. In the left-right direction, the stick 31 is located between the right button and the left button of the set of four buttons 32. In the up-down direction, the stick 31 is located approximately on an extension of a straight line connecting the upper button and the lower button of the set of four buttons 32.

[0069] The stick 31 can be tilted in 360 degrees, and may be tilted in any direction including the first direction R1 to the fourth direction R4. The stick 31 may be tiltable in only some directions. The stick 31 may be pushable. Instead of tilting, the stick 31 may be slidable in each direction. The main unit 3 may perform processing in accordance with a signal indicating the operation direction in a program executed in response to a user's operation of the stick 31. Note that the game controller may have another input unit as a direction input unit instead of or in addition to the stick 31. For example, it may have a cross key or buttons arranged in a cross shape.

[0070] The right shoulder button 130 and the right Z shoulder button 140 are provided on the top surface 12 of the housing 10. The right shoulder button 130 and the right Z shoulder button 140 are adjacent to each other in the front-to-rear direction. The right Z shoulder button 140 is provided behind the right shoulder button 130.

[0071] In the executed program, the main unit 3 may perform a predetermined process in response to an input to the + button 33 and the set of four buttons 32. The main unit 3 may call up a home menu in response to an input to the home button 34.

[0072] The first game controller 1 has a protrusion 100 protruding from a left bottom surface 105. The left side surface 11 of the first game housing 10 includes the left bottom surface 105 and exposed surfaces of the protrusion 100 (top surface 106 and outer peripheral surface 107). More specifically, the left side surface 11 includes the left bottom surface 105, an outer peripheral surface 107 that is connected to the left bottom surface 105 and extends leftward from the left bottom surface 105, and a top surface 106 that is spaced apart from the left bottom surface 105 and is connected to the outer peripheral surface 107.

[0073] The vertical length of the left side surface 11 (or, from another perspective, the longitudinal length of the left side surface 11) is longer than the front-to-rear length of the left side surface 11 (or, from another perspective, the width of the left side surface 11). The vertical length of the left side surface 11 at its longest point is, for example, approximately 115 mm, and is between 103.5 and 126.5 mm. It may also be between 92 mm and 138 mm. The front-to-rear length of the left side surface 11 at its longest point is, for example, approximately 14.0 mm, and is between 12.6 and 15.4 mm. It may also be between 11.2 mm and 16.8 mm.

[0074] The vertical length of the top surface 106 (or, from another perspective, the longitudinal length of the top surface 106) is longer than the front-to-rear length of the top surface 106 (or, from another perspective, the width of the top surface 106). It is longer than the front-to-rear length of the top surface 106 (or, from another perspective, the width of the left side surface 11). The vertical length of the top surface 106 at its longest point is, for example, approximately 102 mm, and is 91.8 to 112.2 mm. It may also be 81.6 mm to 122.4 mm. The front-to-rear length of the top surface 106 at its longest point is, for example, approximately 8 mm, and is 7.2 to 8.8 mm. It may also be 6.4 mm to 9.6 mm.

[0075] By making the game controller thinner in this way, it can be lifted up and used more easily, and when the game controller is used as a mouse, it can be easily used in places such as on the thigh.

[0076] In the housing 10 of the first game, the left side surface 11, the top surface 12, and the front surface 15 may be connected to one another. The left side surface 11, the top surface 12, and the front surface 15 may be formed continuously with one another.

[0077] The side button (upper) 110 and the side button (lower) 120 are provided on the top surface 106 of the convex portion 100. The side button (upper) 110 and the side button (lower) 120 are buttons that are pressed by the user, and are components that move in the pressing direction when pressed.

[0078] The synchronization button 50 is provided on the top surface 106 of the convex portion 100. The synchronization button 50 is pressed by the user. The synchronization button 50 is provided between the side button (upper) 110 and the side button (lower) 120 in the longitudinal direction of the convex portion 100. More specifically, the synchronization button 50 is provided between the first terminal 160 and the side button (lower) 120 in the longitudinal direction of the convex portion 100. The synchronization button 50 may be used to instruct setting processing related to wireless communication between the first game controller 1 and the main unit 3.

[0079] As shown in Figures 10 and 11, in addition to the components already described, the first game controller 1 has a first terminal 160 connected to the main body first terminal 331 of the main body device 3, a light emitting unit 150 that notifies the identification number of the game controller, mouse soles 191, 192, a mouse sensor opening 170 that leads to a mouse sensor 174 described later, and an operation unit 182 that constitutes a removal mechanism for removing the convex portion 100 from the main body device 3.

[0080] The light-emitting unit 150 is provided on the outer peripheral surface 107 of the convex portion 100. More specifically, the light-emitting unit 150 is provided on the front side of the outer peripheral surface 107. From another perspective, the area of ​​the outer peripheral surface 107 where the light-emitting unit 150 is provided faces forward. When the user looks at the front surface 15 of the first game controller 1, the user can see the light from the light-emitting unit 150. The light-emitting unit 150 typically emits light emitted by an LED to the outside.

[0081] Mouse soles 191 and 192 are provided on the top surface 106 of the convex portion 100. The height of the top surface of the mouse soles 191 and 192 from the left bottom surface 105 is higher than the height of the top surface 106 of the convex portion 100 from the left bottom surface 105. From another perspective, the mouse soles 191 and 192 raise the height of the top surface 106 of the convex portion 100.

[0082] In this embodiment, the first game controller 1 can stand on its own when placed on a surface with the left side 11 facing down. The first game controller 1 can be used as a mouse by placing it so that the top surface 106 of the convex portion 100 faces a surface such as a desk. Even if the user lets go of the first game controller 1 in this state, the first game controller 1 will not tip over. Note that the mouse soles 191 and 192 themselves rest on the surface, preventing the non-mouse-sole portion of the top surface 106 of the convex portion 100 from directly contacting the surface. Furthermore, the top surfaces of the mouse soles 191 and 192 contact the bottom surface 3121 of the recess 310 when the first game controller 1 is attached to the main unit 3.

[0083] With respect to the height from the left bottom surface 105, the height of the top surfaces of the mouse soles 191 and 192 is equal to or higher than the maximum height of the top surface 106 of the convex portion 100. From another perspective, the top surfaces of the mouse soles 191 and 192 are located on the leftmost side of the first game controller 1. The shape of the mouse sole 191 is not particularly limited and may be any shape, such as a circle, an ellipse, or a rectangle. The mouse sole 191 may have a through hole. The mouse sole 191 and the mouse sole 192 may have the same shape or different shapes.

[0084] The mouse sensor opening 170 is provided between the side button (upper) 110 and the side button (lower) 120 in the longitudinal direction of the top surface 106 of the convex portion 100. More specifically, the mouse sensor opening 170 is provided between the first terminal 160 and the side button (upper) 110 in the longitudinal direction of the top surface 106 of the convex portion 100.

[0085] Fig. 12 is a schematic cross-sectional view showing only the protrusion taken along line XII-XII in Fig. 10. As shown in Figs. 10 to 12, a mouse sensor opening 170 is provided in the top surface 106 of the protrusion 100.

[0086] The length of the mouse sensor opening 170 in the vertical direction is, for example, approximately 4.0 mm, and may be 3.6 to 4.4 mm. Alternatively, it may be 3.2 to 4.8 mm.

[0087] The length of the mouse sensor opening 170 in the front-to-rear direction (or, from another perspective, the width of the mouse sensor opening 170) is, for example, approximately 4.0 mm, and is between 3.6 and 4.4 mm. Alternatively, it may be between 3.2 mm and 4.8 mm.

[0088] The length of the left side surface 11 in the front-to-rear direction is, for example, approximately 14.0 mm at its longest point, and is between 12.6 and 15.4 mm, so the length of the mouse sensor opening 170 in the front-to-rear direction relative to the length of the left side surface 11 in the front-to-rear direction is, for example, approximately 28.6%, or between 23 and 35%. Also, the length of the top surface 106 in the front-to-rear direction is, for example, approximately 8 mm at its longest point, and is between 7.2 and 8.8 mm, so the length of the mouse sensor opening 170 in the front-to-rear direction relative to the length of the top surface 106 in the front-to-rear direction is, for example, approximately 50%, or between 41 and 61%.

[0089] By employing such a mouse sensor opening 170, when the game controller is used as a mouse, even when it is placed on the thigh, for example, the mouse sensor opening 170 is likely to face the placement surface, and user operations are likely to be reflected as intended.

[0090] The first game controller 1 has a mouse sensor 174. The mouse sensor 174 may be disposed inside the convex portion 100. The mouse sensor 174 may be disposed in a housing portion that opens at a mouse sensor opening 170 provided in the top surface 106. The mouse sensor 174 is, for example, an optical mouse sensor. The mouse sensor 174 has, for example, a light source 171 and a light-receiving sensor 172. The first game controller 1 may have a lens for focusing the light emitted from the light source 171 and / or the light guided to the light-receiving sensor 172.

[0091] 12, the light source 171 emits light. The light may be, for example, red light, blue light, or laser light. There are no particular limitations on the wavelength of the light. The light from the light source 171 is irradiated onto the placement surface through the mouse sensor opening 170. The light receiving sensor 172 detects the reflected light from the placement surface of the light emitted from the light source 171, which enters through the mouse sensor opening 170 and changes in accordance with the relative movement of the first game controller 1 with respect to the placement surface. The second game controller 2 has a similar configuration.

[0092] The first game controller 1 can also be used as a mouse by having a mouse sensor 174. A mouse sensor opening 170 is provided on the top surface 106 of the protrusion 100 that protrudes from the left bottom surface 105. Therefore, when the first game controller 1 is placed on a mounting surface with the top surface 106 of the protrusion 100 facing the mounting surface, the mouse sensor opening 170 is positioned close to the mounting surface. Therefore, the mouse sensor opening 170 can effectively take in reflected light from the mounting surface.

[0093] Based on the detection result of the mouse sensor 174, the processor of the main unit 3 may calculate movement parameters (e.g., movement direction and movement distance) related to the movement of the first game controller 1 relative to the placement surface. Furthermore, the main unit 3 may execute a predetermined game process based on the movement parameters determined in the program being executed. The movement parameters may be calculated within the first game controller 1 (by the mouse sensor 174 or an information processing unit of the first game controller 1), and the calculated parameters may be transmitted to the main unit 3. When the first game controller 1 moves relative to the placement surface while spaced apart from the placement surface, the movement of the first game controller 1 relative to the placement surface may not be accurately measured. For example, the first game controller 1 may be configured such that reflected light from the placement surface, which is used to measure movement relative to the placement surface, cannot be properly detected when the top surface 106 of the convex portion 100 is spaced apart from the placement surface by 1 cm or more, 5 mm or more, or 1 mm or more. As an example, the mouse sensor 174 may be designed so that the distance from the surface on which the first game controller 1 is placed, at which the direction and distance of movement of the first game controller 1 relative to the surface can be accurately detected, is within 1 cm, or within 5 mm, or within 1 mm.

[0094] When the first game controller 1 is attached to the main unit 3, the protrusion 100 fits into the recess 310, so the top surface 106 of the protrusion 100 is not exposed to the outside. Therefore, in the integrated holding state where it is not used as a mouse, the mouse sensor opening 170 is not exposed, which makes it possible to prevent the user from touching it unnecessarily. Furthermore, in the integrated holding state, the mouse sensor 174, to which light is guided from the mouse sensor opening 170, and the mouse sensor 274, to which light is guided from the mouse sensor opening 270, are also not exposed.

[0095] 10 and 11 , the mouse sensor opening 170 is located between the side button (upper) 110 and the side button (lower) 120 in the longitudinal direction of the top surface 106 of the convex portion 100. In other words, it is located relatively close to the center in the longitudinal direction of the first game controller 1. This makes it easier for the user to operate the mouse as intended.

[0096] As shown in FIG. 11, when a user tries to operate the synchronization button 50, the mouse sensor opening 170 is located on the opposite side of the terminal opening 196, so the user's fingers are unlikely to touch the mouse sensor opening 170.

[0097] Up to this point, the explanation has focused on the configuration of the first game controller 1. The second game controller 2 also has the same basic configuration as the first game controller 1. Below, only an outline of the second game controller 2 will be shown.

[0098] FIG. 13 is a schematic diagram showing a six-sided configuration example of the second game controller 2. As shown in FIG. 13 , the second game controller 2 has, on its front surface 25, a stick 41, which is an example of a directional input unit, and a set of four buttons 42 arranged in a cross shape. While the first game controller 1 has a + button 33 and a home button 34, the second game controller 2 has a - button 43 and a capture button 44. The second game controller 2 also has a right side button 210, a left side button 220, a synchronization button 60, a left shoulder button 230, and a left Z shoulder button 240. The right side button 210, the left side button 220, and the synchronization button 60 are provided on the right side surface 21 (more specifically, the protrusion 200) of the second game controller 2. The left shoulder button 230 and the left Z shoulder button 240 are provided on the top surface 22 of the housing 20. The left shoulder button 230 and the left Z shoulder button 240 are adjacent to each other. The left Z shoulder button 240 is located behind the left shoulder button 230. Furthermore, the second game controller 2 has a second terminal 260 connected to the second main terminal 341 of the main unit 3, a light emitting unit 250 that notifies the identification number of the game controller, mouse soles 291 and 292, a mouse sensor opening 270 that communicates with the mouse sensor 274, and an operation unit 282 that constitutes a removal mechanism for removing the convex portion 200 from the main unit 3. The structure and function of each component are substantially the same as those of the first game controller 1. However, some functions may differ. For example, the capture button 44 may be used to save an image output to the display 305.

[0099] In the integrally held state and the vertically held state, the set of four buttons 32 on the first game controller 1 is located above the stick 31, while the set of four buttons 42 on the second game controller 2 is located below the stick 41. On the other hand, in the integrally held state and the vertically held state, the right shoulder button 130 and right Z shoulder button 140 on the first game controller 1 and the left shoulder button 230 and left Z shoulder button 240 on the second game controller 2 are both located above.

[0100] When held horizontally, the positional relationship between the stick 31 and the set of four buttons 32 on the first game controller 1 is the same as the positional relationship between the stick 41 and the set of four buttons 42 on the second game controller 2 .

[0101] In the integrally held state, the first game controller 1 is attached to the main unit 3 so that the left side surface 11 of the housing 10 is not exposed. The second game controller 2 is attached to the main unit 3 so that the right side surface 21 of the housing 20 is not exposed.

[0102] <Internal Configuration of Information Processing System> Next, an example of the internal configuration of the information processing system according to this embodiment will be described.

[0103] Fig. 14 is a block diagram showing an example of the internal configuration of the main device 3. The main device 3 has, as an example, the components shown in Fig. 14. These components are mounted on an electronic circuit board as electronic components and housed in the housing of the main device 3.

[0104] The main device 3 has a processor 2081. The processor 2081 is an information processing unit that executes various types of information processing executed in the main device 3. The processor 2081 may include multiple processors or multiple cores. The processor 2081 executes various types of information processing by executing an information processing program stored in a storage unit that it can access (specifically, an internal storage medium such as a flash memory 2084 or a DRAM (Dynamic Random Access Memory) 2085, or an external storage medium attached to the storage medium slot 304 or the second slot 2024).

[0105] In this specification, the term "processor" includes at least a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), and the like.

[0106] In this specification, "memory" includes at least flash memory 2084, DRAM 2085, external storage media, and the like.

[0107] The main body device 3 has a flash memory 2084 and a DRAM 2085 as examples of internal storage media built into it.

[0108] The main unit 3 has a storage medium slot 304 and a second slot 2024. A storage medium is inserted into each slot. The storage medium slot 304 is connected to the processor 2081 via a storage medium slot interface 2091. The second slot 2024 is connected to the processor 2081 via a second slot interface 2092. The processor 2081 reads and writes data from and to the flash memory 2084, the DRAM 2085, and the above storage media as appropriate, thereby executing the above information processing.

[0109] The main device 3 has a network communication unit 2082. The network communication unit 2082 is connected to the processor 2081. The network communication unit 2082 communicates with external devices via a network (specifically, wireless communication). In this embodiment, the network communication unit 2082 is, for example, a communication module that has received Wi-Fi authentication, and may have a function to connect to and communicate with a mobile communication network (in other words, a mobile phone communication network) in addition to (or instead of) the function to communicate with external devices via a wireless LAN. The communication module may include a wireless chip.

[0110] The main unit 3 has a controller communication unit 2083. The controller communication unit 2083 is connected to the processor 2081. The controller communication unit 2083 communicates wirelessly with the first game controller 1 and / or the second game controller 2. Any communication method may be used between the main unit 3 and each game controller, but in this embodiment, the controller communication unit 2083 communicates with each game controller in accordance with the Bluetooth (registered trademark) standard.

[0111] The processor 2081 is connected to the main body first terminal 331, the main body second terminal 341, and the lower terminal 303. When the processor 2081 performs wired communication with the first game controller 1, it transmits and receives data to and from the first game controller 1 via the main body first terminal 331. When the processor 2081 performs wired communication with the second game controller 2, it transmits and receives data to and from the second game controller 2 via the main body second terminal 341. When the processor 2081 communicates with the cradle, it transmits and receives data to and from the cradle via the lower terminal 303.

[0112] As described above, in this embodiment, the main unit 3 can perform both wired and wireless communication with each of the first game controller 1 and the second game controller 2 .

[0113] The display 305 is connected to the processor 2081. The processor 2081 displays on the display 305 an image generated (for example, by executing the above-mentioned information processing) and / or an image acquired from the outside.

[0114] The touch panel 2013 is provided on the display surface of the display 305. The touch panel controller 2086 detects a touch operation on the touch panel 2013 and outputs the detection result to the processor 2081.

[0115] The speaker 2088 generates sound in accordance with the audio signal from the codec circuit 2087. The codec circuit 2087 outputs the audio signal to an earphone or a microphone attached to the audio input / output terminal 301.

[0116] The main body device 3 has a power control unit 2097 and a battery 2098. The power control unit 2097 is connected to the battery 2098 and the processor 2081. Although not shown, the power control unit 2097 is also connected to each unit of the main body device 3 (specifically, each component that receives power from the battery 2098, the main body first terminal 331, and the main body second terminal 341). The power control unit 2097 controls the supply of power from the battery 2098 to each of the above units based on commands from the processor 2081 and a signal indicating that the power button 307 has been pressed.

[0117] The main body device 3 may have a cooling fan 2096 for cooling the inside of the main body device 3.

[0118] The main body device 3 may have various sensors. For example, the main body device 3 may have a magnetic sensor 2093, an ambient light sensor 2094, and a temperature sensor 2095. Information from the various sensors is output to the processor 2081.

[0119] Fig. 15 is a block diagram showing an example of the internal configuration of the information processing system 1000. Note that the details of the internal configuration of the main device 3 of the information processing system 1000 are omitted in Fig. 15 because they are shown in Fig. 14 .

[0120] The first game controller 1 has a communication control unit 2101 that communicates with the main unit 3. As shown in FIG. 15 , the communication control unit 2101 is connected to each component, including the first terminal 160. In this embodiment, the communication control unit 2101 can communicate with the main unit 3 both via wired communication via the first terminal 160 and via wireless communication without using the first terminal 160. The communication control unit 2101 may include a wireless chip. The communication control unit 2101 controls the communication method used by the first game controller 1 with the main unit 3. When the first game controller 1 is attached to the main unit 3, the communication control unit 2101 communicates with the main unit 3 via the first terminal 160. When the first game controller 1 is detached from the main unit 3, the communication control unit 2101 performs wireless communication with the main unit 3 (specifically, the controller communication unit 2083). Wireless communication between the controller communication unit 2083 and the communication control unit 2101 is performed in accordance with the Bluetooth (registered trademark) standard.

[0121] The first game controller 1 has a memory 2102 such as a flash memory. The communication control unit 2101 is formed by, for example, a microcomputer (also called a microprocessor), and performs various processes by executing firmware stored in the memory 2102. The communication control unit 2101 is also an example of a processor in the information processing system 1000.

[0122] The various buttons 2103 and sticks 31 repeatedly output information related to operations performed on them to the communication control unit 2101 at appropriate timing. The first game controller 1 may also have various other sensors. For example, the first game controller 1 may have an acceleration sensor 2104, an angular acceleration sensor 2105, and a mouse sensor 174. The acceleration sensor 2104 and the angular acceleration sensor 2105 detect accelerations occurring in the first game controller 1. The orientation of the first game controller 1 can be detected or calculated based on the detection results of the acceleration sensor 2104 and the angular acceleration sensor 2105. From another perspective, the acceleration sensor 2104 and the angular acceleration sensor 2105 can also be considered as gyro sensors for detecting the orientation of the first game controller 1 or the accelerations occurring in the first game controller 1. Information related to operations and information from the various sensors is output to the communication control unit 2101 and transmitted to the main unit 3 as operation data.

[0123] Commands may be transmitted to various sensors from the communication control unit 2101. For example, a communication LED 2109 disposed in the light emitting unit 150 is controlled by a command from the main device 3. The vibrator 2107 is driven by an amplifier 2106 that outputs a signal in accordance with a command from the main device 3.

[0124] The first game controller 1 has a power supply unit 2108. In this embodiment, the power supply unit 2108 has a battery and a power control circuit. Although not shown, the power control circuit is connected to the battery and to each unit of the first game controller 1 (specifically, each unit that receives power from the battery). The power control circuit controls the supply of power from the battery to each of the above units.

[0125] The battery is also connected to the first terminal 160. In this embodiment, when the first game controller 1 is attached to the main unit 3, the battery is charged by power supplied from the main unit 3 via the first terminal 160 under predetermined conditions.

[0126] The second game controller 2 has the same configuration as the first game controller 1, and therefore a description thereof will be omitted. The first game controller 1 may have an NFC antenna 2111. The second game controller 2 may not have an NFC antenna 2111. The first game controller 1 may have a processing unit 2110 that executes management processing for the NFC antenna 2111 in response to a command from the main unit 3. The processing unit 2110 is also an example of a processor in the information processing system 1000. The processing unit 2110 causes the NFC antenna 2111 to perform short-range wireless communication based on the NFC (Near Field Communication) standard.

[0127] <Game Processing According to the Usage State of the Game Controller> Next, an example of game processing according to the usage state of the game controller according to this embodiment will be described.

[0128] As an example, a first-person perspective game will be described. FIG. 16 shows an example of a first-person perspective game screen. As shown in FIG. 16, in a first-person perspective game, a virtual space as seen from a virtual character (hereinafter also referred to as a "player character") operated by a user is depicted. A virtual camera may be positioned near the eyes of the player character. Basically, the player character itself is not included in the field of view of the virtual camera, but a part of the player character, such as an arm, may be included in the field of view of the virtual camera.

[0129] In a first-person perspective game, for example, the position of the virtual camera is changed in response to the user moving the player character, and the orientation of the virtual camera is changed in response to the user changing the aim or line of sight. In this way, the position and orientation of the virtual camera are changed in response to user operation. From another perspective, changing the position and orientation of the virtual camera in response to user operation gives the user the feeling that they are moving the player character or changing the aim or line of sight.

[0130] The moving speed of the player character 520 may correspond to the degree to which the stick is tilted (tilt angle). The player character 520 may be moved continuously while the stick is tilted.

[0131] The amount of movement (or amount of rotation) and direction of the change in the aim or line of sight direction may be determined in accordance with a user operation (e.g., mouse operation data). When the aim is displayed during game processing, the aim may be constantly maintained at the center of the angle of view (or a predetermined position in the image). In other words, the imaging range of the virtual camera may change in accordance with a user operation while the aim is displayed at the center of the angle of view.

[0132] 17 and 18 are schematic diagrams illustrating an example of a process for changing the position and orientation of a virtual camera in a virtual space of a first-person perspective game.

[0133] 17 and 18 , images displayed during execution of game processing are generated, for example, by virtually capturing images using a virtual camera 510 placed in virtual space 500. Specifically, objects included in a field of view 512 of virtual camera 510 are rendered to generate images during game processing.

[0134] 17 and 18 show cross-sectional views (planes parallel to the X-axis and Y-axis) of a three-dimensional virtual space 500. The Z-axis of the virtual space 500 is perpendicular to the paper surface.

[0135] During execution of the game processing, the position or orientation of the virtual camera 510 is changed by the user operating the game controller.

[0136] As shown in Figure 17(A), a virtual camera 510 placed at a certain position in virtual space 500 moves to another position in virtual space 500 as shown in Figure 17(B) when the user operates the game controller.

[0137] The change in position of virtual camera 510 may include displacement in at least one of the X-axis, Y-axis, and Z-axis directions. The movement speed of virtual camera 510 may be determined according to the operation data. For example, when a signal indicating the operation direction from a stick is output, the movement speeds along each of the two axes (X-axis and Y-axis) may be calculated according to the output operation direction. In this case, the coordinates (X1, Y1, Z1) of virtual camera 510 may be changed to coordinates (X2, Y2, Z1) according to the movement distance per frame calculated from each movement speed. Mouse operation data output when a game controller is used as a mouse can also be processed in a similar manner.

[0138] As shown in Figure 18(A), virtual camera 510 is placed at a certain position in virtual space 500 and faces a certain direction. When the user operates the game controller, virtual camera 510 faces a different direction, as shown in Figure 18(B).

[0139] The change in orientation of virtual camera 510 may include rotation around an axis extending in at least one of the X-axis direction, the Y-axis direction, and the Z-axis direction. FIG. 18 shows a change in orientation of virtual camera 510 around an axis passing through the center of virtual camera 510 and extending in the Z-axis direction. Virtual camera 510 may rotate not only horizontally as shown in FIG. 18 but also vertically. As an example, when a signal indicating an operation direction (0 to 360°) from a stick is output, the horizontal rotation angle and the vertical rotation angle may each be determined in association with the operation direction. A similar process can also be performed when a signal indicating the operation direction is output when the game controller is used as a mouse.

[0140] Note that when the orientation of virtual camera 510 is changed in response to a user operation, the position of virtual camera 510 may also be changed. For example, when virtual camera 510 rotates horizontally around a point outside the virtual camera and located in the imaging direction of the virtual camera, the orientation and position of the virtual camera are changed at the same time. When the position of virtual camera 510 is changed in response to a user operation, the orientation may also be changed at the same time. In other words, in the present disclosure, when it is stated that "the orientation is changed," only the orientation may be changed, or the position may also be changed at the same time. The same applies to a change in position.

[0141] How the position and orientation of virtual camera 510 are changed in response to operation data can be designed arbitrarily according to the game processing, and therefore, various processing can be implemented, not limited to the processing for changing the position and orientation of virtual camera 510 described above.

[0142] In the information processing system 1000 according to this embodiment, a single game controller can be in a plurality of usage states. Furthermore, different usage states for the left and right controllers are also possible (see FIG. 8 ). Therefore, one or more operation modes may be provided depending on the usage state of the game controller by the user. A selected operation mode from the one or more operation modes is executed. Some examples of the operation modes are described below.

[0143] Fig. 19 is a diagram showing an example of operation modes of the information processing system 1000 according to this embodiment. Fig. 19 shows three operation modes as an example. Fig. 19 also shows how operation data output by a user operating a game controller is processed for each operation mode.

[0144] Of the operation data, the first operation data output by the first game controller 1 may include, for example, first stick operation data related to the user's operation of the stick 31 and first mouse operation data related to the movement of the first game controller 1 used as a mouse. The first mouse operation data is based on the detection result of the mouse sensor 174. The first operation data may include first button operation data related to the user's operation of the set of four buttons 32 and second button operation data related to the user's operation of the right shoulder button 130. The first operation data may include first sensor data output by the acceleration sensor 2104 and / or the angular acceleration sensor 2105 of the first game controller 1.

[0145] Similarly, the second operation data output by the second game controller 2 out of the operation data may include, for example, second stick operation data related to the user's operation of the stick 41 and second mouse operation data related to the movement of the second game controller 2 used as a mouse. The second mouse operation data is based on the detection result of the mouse sensor 274. The second operation data may include third button operation data related to the user's operation of the set of four buttons 42 and fourth button operation data related to the user's operation of the right shoulder button 230. The second operation data may include second sensor data output by the acceleration sensor 2104 and / or the angular acceleration sensor 2105 of the second game controller 2.

[0146] Each of the first button operation data and the third button operation data may include information for identifying which of the set of four buttons has been pressed.

[0147] The first operation data may include fifth button operation data related to a user operation on right Z shoulder button 140. The second operation data may include sixth button operation data related to a user operation on right Z shoulder button 240.

[0148] The first operation mode (row "1" in Figure 19) may be an operation mode suitable for a situation in which the first game controller 1 is used as a mouse in the right hand and the second game controller 2 is operated vertically with the left hand (see Figure 8).

[0149] In the first operation mode, operation of the stick 41 of the second game controller 2 is associated with processing for changing the position of the virtual camera 510, and operation of the mouse of the first game controller 1 is associated with processing for changing the orientation of the virtual camera 510. That is, the position of the virtual camera 510 is changed in accordance with second stick operation data among the operation data, and the orientation of the virtual camera 510 is changed in accordance with first mouse operation data among the operation data.

[0150] In the first operation mode, the position of the player character in the virtual space 500 is changed in accordance with the first stick operation data, and together with the change in the position of the player character, at least the position of the virtual camera 510 may also be changed.

[0151] As an example of the assignment of operation data and in-game effects in the first operation mode, "fire a normal shot" may be assigned to the right shoulder button 130 of the first game controller 1, and "fire a special shot" may be assigned to the right Z shoulder button 140. "Jump" may also be assigned to all four buttons 32 of the set of first game controller 1. Different in-game effects may also be assigned to each of the four buttons 32 of the set. On the other hand, "transform and switch from first-person to third-person perspective" may be assigned to the left shoulder button 230 of the second game controller 2, and "lock on" may be assigned to the left Z shoulder button 240.

[0152] In the first operation mode, operations on the stick 31 of the first game controller 1 and operations on the mouse of the second game controller 2 may not affect control of the position and orientation of the virtual camera 510. In other words, the first stick operation data and the second mouse operation data may not be used to control the position and orientation of the virtual camera 510. By employing such processing, it is possible to prevent operations unintended by the user. Note that the first stick operation data and the second mouse operation data may not be included in the operation data output by the game controller, or may be included in the operation data and then discarded by the main unit 3, or the main unit 3 may temporarily not discard the data but the game application may not acquire the data, or the game application may acquire the data but not use it. The same applies to cases in which specific operation data is not used in the present disclosure.

[0153] The second operation mode (row "2" in Figure 19) may be an operation mode suitable for a situation in which the first game controller 1 is operated vertically with the right hand and the second game controller 2 is operated vertically with the left hand (see Figure 5).

[0154] In the second operation mode, operations on the stick 41 of the second game controller 2 are associated with processing to change the position of the virtual camera 510, and operations on the stick 31 of the first game controller 1 are associated with processing to change the orientation of the virtual camera 510. That is, the position of the virtual camera 510 is changed in accordance with second stick operation data among the operation data, and the orientation of the virtual camera 510 is changed in accordance with first stick operation data among the operation data.

[0155] In the second operation mode, the mouse operations of the first game controller 1 and the second game controller 2 may not affect the control of the position and orientation of the virtual camera 510. In other words, the first mouse operation data and the second mouse operation data may not be used to control the position and orientation of the virtual camera 510. By employing such processing, it is possible to prevent operations unintended by the user from occurring.

[0156] The third operation mode (row "3" in Figure 19) may be an operation mode suitable for a situation in which the first game controller 1 is held vertically in the right hand and operated, and the second game controller 2 is used as a mouse in the left hand (a state in which Figure 8 is flipped horizontally).

[0157] In the third operation mode, operation of the stick 31 of the first game controller 1 is associated with processing for changing the position of the virtual camera 510, and operation of the mouse of the second game controller 2 is associated with processing for changing the orientation of the virtual camera 510. That is, the position of the virtual camera 510 is changed in accordance with first stick operation data among the operation data, and the orientation of the virtual camera 510 is changed in accordance with second mouse operation data among the operation data.

[0158] In the third operation mode, the mouse operation of the first game controller 1 and the operation of the stick 41 of the second game controller 2 may not affect the control of the position and orientation of the virtual camera 510. In other words, the first mouse operation data and the second stick operation data may not be used to control the position and orientation of the virtual camera 510. By employing such processing, it is possible to prevent operations unintended by the user from occurring.

[0159] In the first operation mode, the first mouse operation data used to change the orientation of the virtual camera 510 does not need to be used for game processing other than the operation of the virtual camera 510. The same applies to the second mouse operation data in the third operation mode.

[0160] In the first operation mode, the first stick operation data is not used to control the virtual camera 510, but may be used for game control, such as generating some kind of in-game effect. The in-game effect may be any effect, and may include, for example, the player character's jump, acceleration, braking, attack, use of an item, selection / confirmation / cancellation of an item, etc. The same applies to the second stick operation data in the third operation mode.

[0161] In any of the first to third operation modes, some in-game effect may be produced in accordance with the first button operation data of the first game controller 1 and the second button operation data of the second game controller 2 .

[0162] On the other hand, in any of the first to third operation modes, the operation data among the first stick operation data, the second stick operation data, the first mouse operation data, and the second mouse operation data that is not used to change the position or orientation of the virtual camera 510 may not be used to generate in-game effects.

[0163] Furthermore, in any of the first to third operation modes, some kind of in-game effect may be generated according to the first sensor data of the first game controller 1 and the second sensor data of the second game controller 2. The in-game effect associated with the sensor data may be of any type, and may include, for example, swinging a weapon, throwing an object, changing the posture of a handheld object, etc. However, the sensor data output by a game controller in a mouse-use state may not be used in processing the generation of the in-game effect.

[0164] Note that sensor data output by a game controller held vertically is used to generate in-game effects, but sensor data output by a game controller used in a mouse mode does not have to be used to generate in-game effects. When used in a mouse mode, sensor data corresponding to the movement of the game controller may be output, but by not using such sensor data to generate in-game effects, it is possible to prevent operations unintended by the user. On the other hand, when a game controller is held vertically, there are no restrictions imposed by the mouse mode, which increases the degree of freedom in operation.

[0165] In any of the first to third operation modes, the orientation of the virtual camera may be changed not only in accordance with mouse operation data output by a game controller in a mouse-used state but also in accordance with sensor data. Also, in any of the first to third operation modes, the position or orientation of the virtual camera may be changed not only in accordance with mouse operation data output by a game controller in a vertically held state but also in accordance with sensor data.

[0166] For example, in the second operation mode, the user can change the aim and line of sight not only by operating the stick 31, but also by changing the attitude of the first game controller 1.

[0167] When using a mouse, the user operates the right shoulder button 130 and the right Z shoulder button 140 with the index finger and middle finger, respectively. Therefore, a first in-game effect may be produced using second button operation data related to an operation on the right shoulder button 130, and a second in-game effect may be produced using fifth button operation data related to an operation on the right Z shoulder button 140. From another perspective, as with a typical mouse, different processes may be assigned to the right click (right Z shoulder button 140) and the left click (right shoulder button 130). Alternatively, the same process may be assigned to each. The same applies to the second game controller 2.

[0168] 19 does not necessarily have to be implemented in the information processing system 1000. One or more operation modes different from the operation modes shown in FIG.

[0169] For example, in the second operation mode, another operation mode may be prepared in which the correspondence between the processes of the first game controller 1 and the second game controller 2 is swapped. In this case, the position of the virtual camera 510 may be changed in accordance with the first stick operation data of the first game controller 1, and the orientation of the virtual camera 510 may be changed in accordance with the second stick operation data of the second game controller 2.

[0170] An operation mode may be provided in which the first game controller 1 is used as a mouse in the right hand and the second game controller 2 is used as a mouse in the left hand ( FIG. 7 ). In this case, for example, the position of the virtual camera 510 may be changed in accordance with one of the first mouse operation data and the second mouse operation data, and the orientation of the virtual camera 510 may be changed in accordance with the other.

[0171] FIG. 20 is a schematic diagram showing an example of the software configuration for executing processes according to the operation mode of the information processing system 1000 according to this embodiment.

[0172] 20 , system environment 350 of main device 3 includes operation data processing unit 360. System environment 350 may be realized by processor 2081 of main device 3 executing a system program. Operation data processing unit 360 may be realized by a specific program included in the system program.

[0173] The operation data processing unit 360 processes operation data from the first game controller 1 and operation data from the second game controller 2. The operation data processing unit 360 sets the usage state (one of integrally held state, horizontally held state, vertically held state, and mouse usage state) of each of the first game controller 1 and the second game controller 2. The determined usage state is stored in the usage state storage unit 362.

[0174] The operation data processing unit 360 has an operation data buffer 364 for temporarily storing operation data. Since the operation data is transmitted periodically, the operation data buffer 364 may be configured to store only the most recent operation data, or may store operation data for a predetermined number of transmissions.

[0175] The operation data buffer 364 may utilize a storage area of ​​the DRAM 2085 or the flash memory 2084. The operation data held in the operation data buffer 364 can be referenced by the game execution unit 370 and the like.

[0176] The game execution unit 370 executes game processing in accordance with operation data, etc. The game execution unit 370 may be realized by the processor 2081 of the main unit 3 executing a game program.

[0177] The game execution unit 370 selects an operation mode depending on the usage state of the game controller at the start of or during execution of game processing. The game execution unit 370 executes game processing using necessary data from the operation data held in the operation data buffer 364 depending on the selected operation mode.

[0178] The operation mode setting information 372 may be in a table format as shown in Fig. 19. The operation mode setting information 372 may be prepared for each game program, or may be provided from the system environment 350. In the former case, the distributed game program may include the operation mode setting information 372. In the latter case, a pre-installed system program may include the operation mode setting information 372. Furthermore, the operation mode setting information 372 may be updated as needed via an external server or the like.

[0179] 21 is a flowchart showing a processing procedure for setting the usage state of a game controller. Each step shown in FIG. 21 may be realized by, for example, the processor 2081 of the main unit 3 executing a system program.

[0180] 21 , the main unit 3 determines whether an operation to start a process for setting the usage status of the game controller has been received (step S100). The operation to start the process may be performed by the user during a game process that is currently being executed, or may be performed by the user from a home menu, etc. If the operation to start a process for setting the usage status of the game controller has not been received (NO in step S100), the process of step S100 is repeated.

[0181] When an operation to start processing for setting the usage state of the game controller is received (YES in step S100), the main unit 3 estimates and displays the usage state of the game controller based on the communication method with the game controller (wired communication or wireless communication) and information from various sensors included in the operation data output by the game controller (acceleration, angular acceleration, and the light reception state of the mouse sensor 174) (step S102).When an operation to end processing is received by the user (YES in step S104), the main unit 3 sets the estimated usage state as the usage state of the game controller (step S106).

[0182] The method for setting the usage state of the game controller is not limited to a specific method. For example, the user may select the connected game controller on the screen and select the usage state to be set from the displayed usage state candidates.

[0183] 22 is a flowchart showing the execution procedure of the game processing. Each step shown in FIG. 22 may be realized, for example, by the processor 2081 of the main unit 3 executing a game program. The game processing includes positioning the virtual camera 510 in the virtual space 500 (step S204) and executing the operation mode (steps S200 and S202).

[0184] 22 , the main unit 3 acquires the usage status of the connected game controller (step S200). The main unit 3 selects an operation mode based on the acquired usage status of the game controller (step S202). The operation mode may be selected by the user. At this time, the current usage status of the game controller may be taken into consideration. For example, depending on the current usage status of the controller, some operation modes may be made unselectable or may be preferentially selected.

[0185] The main unit 3 acquires operation data from the game controller (step S204). Based on the acquired operation data, the main unit 3 calculates the position and orientation of the virtual camera 510 in accordance with the selected operation mode (step S206). The main unit 3 may update one or more objects placed in the virtual space 500 based on at least a portion of the acquired operation data. The main unit 3 may also update the game situation by generating in-game effects or the like in accordance with the operation data.

[0186] The main device 3 generates an image during the game processing by capturing a virtual image using the virtual camera 510 positioned at the calculated position and orientation (step S208). The main device 3 displays the generated image (step S210).

[0187] The main device 3 may output background music (BGM) or sound effects in conjunction with the image display output, or may send a command to drive the vibrator 2107 of the game controller. These may be based on the position and orientation of the virtual camera.

[0188] The main device 3 determines whether an operation to end the game process has been received (step S212). If an operation to end the game process has not been received (NO in step S212), the process from step S204 onward is repeated.

[0189] When an operation to end the game processing is received (YES in step S212), the processing ends.

[0190] In step S200 shown in FIG. 22, the usage state of each game controller may be estimated or determined based on the posture detected based on the sensor data output by the game controller, the validity of the mouse operation data, and the like.

[0191] In step S204 shown in FIG. 22 , only the operation data necessary for the operation mode from the game controller is used. That is, operation data unnecessary for processing from the game controller is not used for processing and is essentially discarded. Instead of this processing example, the content of the operation data transmitted by the game controller may be varied depending on the selected operation mode. For example, the main unit 3 may transmit to the game controller a designation of data to be included in the operation data depending on the selected operation mode. The game controller transmits only the necessary data as operation data in accordance with the designation from the main unit 3. This allows for efficient use of communication resources between the main unit 3 and the game controller.

[0192] <Modifications> In the above operation modes, the position and orientation of the virtual camera are mainly changed with reference to the player character. However, the following modification may be adopted. For example, while the button 42 of the second game controller 2 is pressed, an object such as an enemy is "locked on." During this time, the position and orientation of the virtual camera are controlled so that the locked-on object is at the center of the angle of view. Here, when the player character moves in the virtual space in response to an operation on the stick 41 of the second game controller 2, the position and orientation of the virtual camera are changed in conjunction with the movement of the player character so that the locked-on object is at the center of the angle of view. At this time, the aim may be moved within the set angle of view by operating the first game controller 1 with a mouse.

[0193] Although the above description is directed to a first-person perspective game, it is also applicable to a third-person perspective game.

[0194] 23 and 24 are schematic diagrams showing an example of a process for changing the position and orientation of a virtual camera in a virtual space of a third-person perspective game.

[0195] In a third-person perspective game, the user operates the game controller to change the position and orientation of the player character 520. For example, a game process may be employed in which a virtual camera 510 takes a virtual image from behind the player character 520. In this case, the position and orientation of the virtual camera 510 are changed according to the position and orientation of the player character 520.

[0196] 23(A), a trajectory 530 of a virtual camera 510 is determined based on a player character 520 placed at a certain position in a virtual space 500. As shown in Fig. 23(B), as the user moves the player character 520, the virtual camera 510 moves in conjunction with the player character 520. Furthermore, as the player character 520 moves, the trajectory 530 of the virtual camera 510 also changes.

[0197] As shown in Figures 24(A) and 24(B), the virtual camera 510 moves to any position on the trajectory 530 in response to a change in the orientation of the player character 520 so as to continue virtual imaging from behind the player character 520.

[0198] For example, in response to a user changing the aim or line of sight, the orientation of the player character 520 is changed and the virtual camera 510 also moves behind the player character 520. As a result, the virtual camera 510 continues to virtually image the player character 520 from behind. At this time, the position of the virtual camera 510 is also changed.

[0199] It should be noted that the virtual camera 510 does not have to always capture an image of the player character 520 from behind. For example, when the player character 520 moves, the virtual camera 510 may face in the direction of the movement. Furthermore, when the player character 520 is stationary, the virtual camera 510 may be moved along the trajectory 530 in response to a user operation.

[0200] Note that the first-person perspective and the third-person perspective may be switched between by user operation or automatically during the same game.

[0201] The game controller according to this embodiment can also be used for various game processes. For example, a user may operate the second game controller 2 to change at least the orientation of the virtual camera, and operate the first game controller 1 as a mouse to move an object such as a crosshair within the imaging range of the virtual camera. Note that the second mouse operation data of the second game controller 2 is not used to control the virtual camera.

[0202] In another example, in a game (e.g., a top-down game) in which the position and orientation of the virtual camera are fixed or automatically determined, the user may operate the stick 41 of the second game controller 2 to move the player character, and operate the stick 31 of the first game controller 1 to control the ray of fire extending from the player character.

[0203] The information processing system 1000 according to the present embodiment is an example, and the explanation of the directions is also an example. For example, if the game controller is not configured to be attached to the main unit, the side of the game controller where the mouse sensor opening is located may be considered to be the bottom.

[0204] The mechanism for attaching and detaching the game controller to the main unit 3 is not limited, and may be, for example, magnetic force, engagement, press-fitting, or the like.

[0205] The components of the game controller according to this embodiment are merely examples, and may be located in different positions, may not be present, or other components may be added. For example, at least some of the side buttons, synchronization button, terminals, mouse feet, light-emitting section, and operation section may be absent. Furthermore, the convex section 100 may have a different shape or may be absent.

[0206] The mouse sensor may operate not only when the game controller is in mouse use mode but also when it is held vertically, and for example, the detection results of the mouse sensor may be transmitted to the main unit. The mouse sensor may also operate when the game controller is held horizontally or in a one-piece grip mode, and for example, may operate constantly while the game controller is turned on. Note that the mouse sensor may transition between multiple states, such as a sleep state, while in operation. For example, the mouse sensor may only operate when the controller is in mouse use mode. The game controller may include a physical switch that switches the mouse sensor on or off.

[0207] The in-game effect produced when a predetermined button is operated may differ depending on the operation mode. On the other hand, the in-game effect produced when a predetermined button is operated may be the same regardless of the operation mode, provided that the same usage state is maintained. For example, in the first operation mode and the second operation mode, the in-game effect produced when each button on the second game controller 2 is pressed may be the same, while the in-game effect produced when at least one button on the first game controller 1 is pressed may be different. As an example, in the first operation mode, the same in-game effect is produced when any of the four buttons 32 is pressed, while in the second operation mode, different effects may be produced for each button, and one of the effects may be the same as the effect produced when the four buttons 32 are pressed in the first operation mode.

[0208] The operation data processing unit that sets the usage state of each game controller may be realized by a specific program included in the game program, rather than by a system program. Note that the usage states in this embodiment (one of the integrally held state, horizontally held state, vertically held state, and mouse use state) are merely examples. Some states may be omitted, integrated, or other states may be added. For example, the mouse use state may not be included as a usage state. Another usage state may include a dual vertically held state in which both the right controller and the left controller are held vertically. In this case, the game program in this embodiment may enable the first operation mode to be executed by the user or automatically based on the dual vertically held state being the usage state.

[0209] The "usage state" does not have to be set. In this embodiment, the operation mode is selected according to the use state of the game controller, but the operation mode may also be selected by the user. The use state of the game controller and the operation mode do not have to be related. For example, even if the use state of the game controller is set by the operation data processing unit, the operation mode may be set independently according to a user selection or a specific program within the game program.

[0210] The embodiments disclosed herein should be considered to be illustrative in all respects and not restrictive. The scope of the present invention is defined by the claims, not by the above description, and is intended to include all modifications within the meaning and scope of the claims.

[0211] 1 First game controller, 2 Second game controller, 3 Main unit, 10, 20 Housing, 11 Left side, 12, 22 Top, 15, 25 Front, 21 Right side, 31, 41 Stick, 32, 42 Button, 33 + button, 34 Home button, 43 - button, 44 Capture button, 50, 60 Sync button, 100, 200 Convex portion, 105 Left bottom surface, 106 Top surface, 107 Outer surface, 150, 250 Light emitting portion, 160, 331 First terminal, 170, 270 Mouse sensor opening, 171 Light source, 172 Light receiving sensor, 174, 274 Mouse sensor, 182, 282 Operation unit, 191, 192, 291, 292 Mouse sole, 196 Terminal opening, 260, 341 Second terminal, 301 Audio input / output terminal, 302 Upper terminal, 303 Lower terminal, 304 Storage medium slot, 305 Display, 306 Main body housing, 307 Power button, 313 Right side of main body, 315 Front of main body, 316 Upper side, 317 Lower side, 330 First plug connector, 332 First tongue, 338 Cover, 350 System environment, 360 Operation data processing unit, 362 Usage status storage unit, 364 Operation data buffer, 370 Game execution unit, 372 Operation mode setting information, 500 Virtual space, 510 Virtual camera, 512 Field of view, 520 Player character, 530 Trajectory, 1000 Information processing system, 2013 Touch panel, 2024 Second slot, 2026 Volume button, 2081 Processor, 2082 Network communication unit, 2083 Controller communication unit, 2084 flash memory, 2085 RAM, 2086 touch panel controller, 2087 codec circuit, 2088 speaker, 2091 storage medium slot interface, 2092 second slot interface, 2093 magnetic sensor, 2094 ambient light sensor, 2095 temperature sensor, 2096 cooling fan, 2097 power control unit, 2098 battery, 2101 communication control unit, 2102 memory, 2103 various buttons, 2104 acceleration sensor, 2105 angular acceleration sensor, 2106 amplifier, 2107 vibrator, 2108 power supply unit, 2109 communication LED, 2110 processing unit, 2111 NFC antenna, 3120 inner surface, 3121 bottom surface.

Claims

1. An information processing system comprising: a first input device held in one hand of a user; a second input device held in the other hand of the user; and at least one processor, wherein the first input device comprises a first mouse sensor and a first stick operated by the user, and outputs at least one of first stick operation data relating to an operation on the first stick or first mouse operation data corresponding to movement of the first input device; the second input device comprises a second mouse sensor and a second stick operated by the user, and outputs at least one of second stick operation data relating to an operation on the second stick or second mouse operation data corresponding to movement of the second input device; and the at least one processor executes game processing including positioning a virtual camera in a virtual space and executing a first operation mode, wherein the first operation mode comprises: changing at least the position of the virtual camera in accordance with the second stick operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data; An information processing system including changing at least the orientation of the virtual camera in accordance with the first mouse operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data.

2. The information processing system of claim 1, wherein the game processing includes executing one of a plurality of operation modes including the first operation mode and the second operation mode, and the second operation mode includes: changing at least the position of the virtual camera in accordance with the second stick operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data; and changing at least the orientation of the virtual camera in accordance with the first stick operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data.

3. The information processing system of claim 1, wherein the game processing includes executing one of a plurality of operation modes including the first operation mode and a third operation mode, and the third operation mode includes: changing at least the position of the virtual camera in accordance with the first stick operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data; and changing at least the orientation of the virtual camera in accordance with the second mouse operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data.

4. The information processing system of claim 1, wherein the first input device comprises a first sensor for detecting an attitude of the first input device or an acceleration occurring in the first input device, the second input device comprises a second sensor for detecting an attitude of the second input device or an acceleration occurring in the second input device, and the first operation mode further includes generating a predetermined in-game effect according to the second sensor data of first sensor data output by the first sensor and second sensor data output by the second sensor.

5. The information processing system of claim 1, wherein the first input device is held in the user's right hand, and the first input device comprises: the first stick and a first button above the first stick, which are provided on a first front surface that is the front face of the first input device; a first opening, which is provided on a first left side surface connected to the first front surface and leads to the first mouse sensor; and a second button, which is provided on a first top surface connected to the first front surface and the first left side surface; and the second input device is held in the user's left hand, and the second input device comprises: the second stick and a third button below the second stick, which are provided on a second front surface that is the front face of the second input device; a second opening, which is provided on a second right side surface connected to the second front surface and leads to the second mouse sensor; and a fourth button, which is provided on a second top surface connected to the second front surface and the second right side surface.

6. An information processing system as described in claim 5, further comprising a main unit having the at least one processor, wherein the first input device and the second input device are attachable to the main unit, the first input device is attached to the main unit so that the first left side surface is not exposed, and the second input device is attached to the main unit so that the second right side surface is not exposed.

7. The information processing system of claim 5, wherein the first input device outputs first button operation data relating to an operation on the first button, and the first operation mode includes producing a predetermined in-game effect in accordance with the first button operation data, of the first stick operation data and the first button operation data.

8. An information processing system as described in claim 5, wherein the first input device further comprises a fifth button provided on the first top surface and behind the second button, and the second input device further comprises a sixth button provided on the second top surface and behind the fourth button.

9. The information processing system of claim 8, wherein the first input device outputs second button operation data relating to an operation on the second button, and outputs fifth button operation data relating to an operation on the fifth button, and the first operation mode further includes producing an in-game effect in accordance with the fifth button operation data that is different from an in-game effect produced in accordance with the second button operation data.

10. The information processing system of claim 6, wherein the first input device is configured to be self-supporting when placed on a placement surface with the first left side surface facing downwards, the first left side surface is longer in the up-down direction than in the front-to-back direction, and the length of the first left side surface in the front-to-back direction is 12.6 to 15.4 mm.

11. The information processing system of claim 6, wherein the first left side surface includes a first left surface, a second left surface connected to the first left surface and extending leftward from the first left surface, and a third left surface spaced apart from the first left surface and connected to the second left surface, the first opening is provided in the third left surface, the first input device is configured to be able to stand on its own when placed on a placement surface with the third left surface facing downwards, the third left surface is longer in the up-down direction than in the front-to-back direction, and the length of the third left surface in the front-to-back direction is 7.2 to 8.8 mm.

12. The information processing system of claim 6, wherein the first input device is configured to be self-supporting when placed on a placement surface with the first left side surface facing downwards, the first left side surface is longer in the up-down direction than in the front-to-back direction, the first opening is provided on the first left side surface, and the front-to-back length of the first opening is 23 to 35% of the front-to-back length of the first left side surface.

13. The information processing system of claim 6, wherein the first left side surface includes a first left surface, a second left surface connected to the first left surface and extending leftward from the first left surface, and a third left surface spaced apart from the first left surface and connected to the second left surface, the first opening is provided in the third left surface, the first input device is configured to be able to stand on its own when placed on a placement surface with the third left surface facing downwards, the third left surface is longer in the up-down direction than in the front-to-back direction, the first opening is provided in the third left surface, and the front-to-back length of the first opening is 41 to 61% of the front-to-back length of the third left surface.

14. An information processing system as described in claim 1, further comprising a main unit having a display, wherein the first input device is detachable from at least one side of the main unit, and the second input device is detachable from at least the other side of the main unit.

15. An information processing system as described in claim 2, further comprising a main unit having a display, wherein the first input device is detachable from at least one side of the main unit, and the second input device is detachable from at least the other side of the main unit, and wherein the second operation mode is executed when the first input device and the second input device are attached to the main unit.

16. An information processing system as described in claim 15, wherein the first input device is attached to the main unit so that the first mouse sensor is not exposed, and the second input device is attached to the main unit so that the second mouse sensor is not exposed.

17. The information processing system of claim 1, wherein the first operation mode includes: changing the position of a virtual character in the virtual space in accordance with the first stick operation data; and changing at least the position of the virtual camera in accordance with the change in the position of the virtual character.

18. A game program causing at least one processor to execute the following steps: acquiring, from a first input device held in one hand of a user and having a first mouse sensor and a first stick operated by the user, at least one of first stick operation data relating to an operation on the first stick or first mouse operation data corresponding to movement of the first input device; acquiring, from a second input device held in the other hand of the user and having a second mouse sensor and a second stick operated by the user, at least one of second stick operation data relating to an operation on the second stick or second mouse operation data corresponding to movement of the second input device; and executing game processing including positioning a virtual camera in a virtual space and executing a first operation mode, wherein the first operation mode comprises: changing at least the position of the virtual camera in accordance with the second stick operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data; A game program including changing at least the orientation of the virtual camera in accordance with the first mouse operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data.

19. The game program of claim 18, wherein the game processing includes executing one of a plurality of operation modes including the first operation mode and the second operation mode, and the second operation mode includes: changing at least the position of the virtual camera in accordance with the second stick operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data; and changing at least the orientation of the virtual camera in accordance with the first stick operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data.

20. The game program of claim 18 or 19, wherein the first input device further comprises the first stick and a first button above the first stick, which are provided on a first front surface that is the front surface of the first input device; the game program further causes the at least one processor to execute a step of outputting first button operation data related to an operation on the first button; and the first operation mode includes generating a predetermined in-game effect in accordance with the first button operation data, of the first stick operation data and the first button operation data.

21. A game system comprising the steps of: acquiring, from a first input device held in one hand of a user and having a first mouse sensor and a first stick operated by the user, at least one of first stick operation data relating to an operation on the first stick or first mouse operation data corresponding to movement of the first input device; acquiring, from a second input device held in the other hand of the user and having a second mouse sensor and a second stick operated by the user, at least one of second stick operation data relating to an operation on the second stick or second mouse operation data corresponding to movement of the second input device; and executing game processing including positioning a virtual camera in a virtual space and executing a first operation mode, wherein the first operation mode comprises: changing at least the position of the virtual camera in accordance with the second stick operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data; An information processing method including changing at least the orientation of the virtual camera in accordance with the first mouse operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data.

22. The information processing method according to claim 21, wherein the game processing includes executing one of a plurality of operation modes including the first operation mode and the second operation mode, and the second operation mode includes: changing at least the position of the virtual camera in accordance with the second stick operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data; and changing at least the orientation of the virtual camera in accordance with the first stick operation data among the first stick operation data, the first mouse operation data, the second stick operation data, and the second mouse operation data.

23. The information processing method according to claim 21 or 22, wherein the first input device further comprises the first stick and a first button above the first stick, which are provided on a first front surface that is the front surface of the first input device; the information processing method further comprises a step of outputting first button operation data relating to an operation on the first button; and the first operation mode includes producing a predetermined in-game effect in accordance with the first button operation data, of the first stick operation data and the first button operation data.

Images