Information processing program, information processing system, information processing method, and information processing device

Abstract

To provide an information processing system that has a function of distributing images from a master unit to a slave unit and can improve a user's convenience.SOLUTION: An information processing system includes a master unit and a slave unit. The master unit acquires master unit operation data corresponding to operation to an operation device of the master unit and acquires slave unit operation data from the slave unit. The master unit performs information processing on the basis of master unit operation data and received slave unit operation data, and generates a first image based on the information processing and a second image that is a UI image. The master unit outputs one of the first image and the second image to a display device of the master unit and transmits the other to the slave unit. The slave unit transmits slave unit operation data corresponding to operation to the operation device of the slave unit to the master unit and outputs the other image received from the master unit on the display device.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to an information processing program, an information processing system, an information processing method, and an information processing apparatus.

Background Art

[0002] Conventionally, there has been a technique for playing a game among a plurality of information processing apparatuses, in which one of the plurality of information processing apparatuses is set as a master device and the other devices are set as slave devices, and an image is distributed from the master device to the slave devices (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, there has been room for improvement in improving the convenience of users by using an information processing system having a function of distributing an image from a master device to a slave device.

[0005] Therefore, an object of the present invention is to provide an information processing system having a function of distributing an image from a master device to a slave device and capable of improving the convenience of users.

Means for Solving the Problems

[0006] In order to solve the above problems, the present invention employs the following configuration.

[0007] (First Configuration) The first configuration is an information processing program that causes a computer of a first information processing device to execute information processing based on operation data, and generates a first image and a second image that is a UI image based on the information processing. The information processing program causes the computer to, in a first mode, perform the information processing using, as the operation data, first input data based on an operation input to an operation device provided in or connected to the first information processing device, and output, to a display device provided in or connected to the first information processing device, one image that is selectively switchable based on the operation data among the first image and the second image, or an image including both the first image and the second image. Further, the information processing program causes the computer to, in a second mode, communicate with a second information processing device, perform the information processing using, as the operation data, at least one of the first input data and second input data received from the second information processing device, output one of the first image and the second image to the display device, and transmit the other to the second information processing device.

[0008] According to the above, when there is only the first information processing device, the first image and the second image that is a UI image are displayed on the display device of the first information processing device, and when there is a second information processing device in addition to the first information processing device, one of the first image and the second image is displayed on the first information processing device, and the other image is transmitted to the second information processing device. Thereby, when there is a second information processing device in addition to the first information processing device, the first image and the second image that is a UI image can be displayed on different display devices, improving the convenience for the user.

[0009] (Second configuration) In the second configuration, in the first configuration, the information processing is a game process, and the first image may be an image of a virtual space based on a virtual camera.

[0010] According to the above, a game process can be performed and an image based on a virtual camera can be generated as the first image.

[0011] (Third configuration) In the third configuration, in the second configuration, the second image may at least include a map image in the game.

[0012] According to the above, the user can view the map image on a separate screen while viewing the image based on the virtual camera.

[0013] (Fourth configuration) In the fourth configuration, in the first configuration, the second image may at least include an image showing an item to be selected. The information processing program may cause the computer to perform, as the information processing, at least a selection process of the item based on the operation data.

[0014] According to the above, the user can select an item to be selected on a separate screen.

[0015] (Fifth configuration) In the fifth configuration, in the fourth configuration, the item may be a music piece. The information processing program may further cause the computer to play the selected music piece and generate an image related to the music piece being played as the first image.

[0016] According to the above, it is possible to select a music piece on a separate screen to start generation and display an image related to the selected music piece as the first image.

[0017] (Sixth configuration) In the sixth configuration, in any one of the first to fifth configurations, the second input data may include touch input data related to an input to a touch panel provided in the second information processing device. The information processing program may cause the computer to perform the information processing using the second input data as the operation data in the second mode, and cause the computer to make a selection based on the touch input data for selectable items included in the UI of the second image.

[0018] According to the above, the user can select an item that can be selected using the touch panel.

[0019] Other configurations may be the above-described first information processing apparatus, an information processing system including the first information processing apparatus, or an information processing method performed in the information processing system.

Effects of the Invention

[0020] According to the present invention, when there is a second information processing apparatus in addition to the first information processing apparatus, the first image and the second image which is a UI image can be respectively displayed on different display apparatuses, and the convenience for the user can be improved.

Brief Description of the Drawings

[0021]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Mode for Carrying Out the Invention

[0022] (Description of the information processing apparatus) Hereinafter, an information processing apparatus used in an example of the present embodiment will be described. An example of the information processing apparatus 1 includes a main body apparatus 2, a left controller 3, and a right controller 4. The left controller 3 and the right controller 4 are each configured to be detachable from the main body apparatus 2. That is, the information processing apparatus 1 can be used as an integrated apparatus with the left controller 3 and the right controller 4 attached to the main body apparatus 2. Further, the information processing apparatus 1 can also be used with the left controller 3 and the right controller 4 removed from the main body apparatus 2. Hereinafter, after describing the configuration of the information processing apparatus 1 of the present embodiment, a game system including a plurality of information processing apparatuses 1 will be described.

[0023] FIG. 1 is a diagram showing an example of the information processing apparatus 1 with the left controller 3 and the right controller 4 attached to the main body apparatus 2. FIG. 2 is a diagram showing an example of the information processing apparatus 1 with the left controller 3 and the right controller 4 removed from the main body apparatus 2. As shown in FIG. 1, the left controller 3 and the right controller 4 are each attached to the main body apparatus 2 and integrated. The main body apparatus 2 is an apparatus that executes various processes (for example, game processes) in the information processing apparatus 1.

[0024] The main body apparatus 2 includes a display 12. The display 12 displays an image generated by the main body apparatus 2. The display 12 may be any type of display device. For example, the display 12 may also be a liquid crystal display (LCD) or an organic EL display device.

[0025] Further, the main body apparatus 2 includes a touch panel 13 on the screen of the display 12. In the present embodiment, the touch panel 13 is of a type capable of multi-touch input (for example, a capacitance type). However, the touch panel 13 may be of any type, for example, a type capable of single-touch input (for example, a resistive film type).

[0026] The left controller 3 and the right controller 4 are vertically long (i.e., long in the y-axis direction shown in FIG. 1). When the left controller 3 and the right controller 4 are removed from the main body device 2, they can be gripped in a vertically long orientation or in a horizontally long orientation.

[0027] The left controller 3 includes an analog stick 31 for the user to perform direction input and a plurality of operation buttons 32 for performing pressing operations. The right controller 4 includes an analog stick 41 for the user to perform direction input and a plurality of operation buttons 42 for performing pressing operations. Also, the left controller 3 and the right controller 4 may be provided with an acceleration sensor and an angular velocity sensor inside thereof to be able to detect movement and posture. Hereinafter, the left controller 3 and the right controller 4 may be collectively referred to as the "first controller".

[0028] The main body device 2 (information processing device 1) with the left controller 3 and the right controller 4 attached is sized to be portable by the user. For example, the user holds the left controller 3 integrated with the main body device 2 in the left hand and the right controller 4 integrated with the main body device 2 in the right hand, and performs game operations using the left controller 3 and the right controller 4, and plays the game while viewing the game image displayed on the front display 12. In this way, in the state where the left controller 3 and the right controller 4 are attached to the main body device 2, the play mode in which the user performs game operations using the left controller 3 and the right controller 4 and plays the game while viewing the game image displayed on the display 12 may be hereinafter referred to as the "portable mode".

[0029] Also, as shown in FIG. 2, the left controller 3 and the right controller 4 can be removed from the main body device 2. When the left controller 3 and the right controller 4 are removed from the main body device 2, the left controller 3 and the right controller 4 are wirelessly connected to the main body device 2. For example, a stand for standing the main body device 2 is provided on the back surface of the main body device 2. The user can place the main body device 2 on the table in a state where the main body device 2 is stood up using the stand so that the screen of the display 12 is substantially perpendicular to the table. Alternatively, the user may place the main body device 2 on the table so that the screen of the display 12 of the main body device 2 faces upward. The user can remove the left controller 3 and the right controller 4 from the main body device 2, perform a game operation using the left controller 3 and / or the right controller 4, and play the game while viewing the game image displayed on the display 12 of the main body device 2 placed on the table. In this way, a play mode in which the left controller 3 and the right controller 4 are wirelessly connected to the main body device 2, and the user performs a game operation using the left controller 3 and / or the right controller 4 and plays the game while viewing the game image displayed on the display 12 may be hereinafter referred to as the "table mode". Note that a second controller 7 (see FIG. 5), which is different from the left controller 3 and the right controller 4, may be wirelessly connected to the main body device 2. The second controller may be a controller that can be gripped and operated by the user with both hands. A play mode in which such a second controller is wirelessly connected to the main body device 2, and the user performs a game operation using the second controller and plays the game while viewing the game image displayed on the display 12 is also referred to as the "table mode". Hereinafter, the first controller and the second controller may be collectively referred to as the "controller".

[0030] Further, the user can also connect the main body device 2 to a stationary monitor (e.g., a television) 5 via the cradle 6 and play the game while viewing the game image displayed on the stationary monitor 5 (see FIG. 5). The main body device 2 is provided with a lower terminal 27 (see FIG. 3) for connection to the cradle 6. The main body device 2 is wired-connected to the stationary monitor 5 via the cradle 6. In this way, the play mode in which the user plays the game while viewing the image displayed on an external stationary monitor 5 different from the display 12 may be described as the "stationary mode". When the information processing apparatus 1 operates in the stationary mode, the first controllers (the left controller 3 and the right controller 4) are removed from the main body device 2 and wirelessly connected, and the user may perform game operations using the first controllers. Alternatively, when the information processing apparatus 1 operates in the stationary mode, with the left controller 3 and the right controller 4 attached to the main body device 2, another first controller or a second controller may be wirelessly connected to the main body device 2, and the user may perform game operations using the first controller or the second controller.

[0031] Next, the internal configuration of the information processing apparatus 1 will be described. FIG. 3 is a block diagram showing an example of the internal configuration of the information processing apparatus 1.

[0032] As shown in FIG. 3, the main body device 2 includes a processor 81. The processor 81 is an information processing unit that executes various information processes executed in the main body device 2. The processor 81 may be composed of, for example, one or more CPUs (Central Processing Unit), or may be composed of a SoC (System-on-a-chip) including one or more CPUs and one or more GPUs (Graphics Processing Unit). The processor 81 executes various information processes by executing an information processing program (e.g., a game program) stored in a storage unit (specifically, an internal storage medium such as a flash memory 84 or an external storage medium mounted in the slot 23).

[0033] The main body device 2 includes a flash memory 84 and a DRAM (Dynamic Random Access Memory) 85 as an example of an internal storage medium built therein. The flash memory 84 and the DRAM 85 are connected to the processor 81. The flash memory 84 is mainly a memory used to store various data (which may be programs) stored in the main body device 2. The DRAM 85 is a memory used to temporarily store various data used in information processing.

[0034] The main body device 2 includes a slot interface (hereinafter abbreviated as "I / F") 91. The slot I / F 91 is connected to the processor 81. The slot I / F 91 is connected to the slot 23 and reads and writes data to and from a predetermined type of storage medium (for example, a dedicated memory card) mounted in the slot 23 according to the instructions of the processor 81.

[0035] The processor 81 appropriately reads and writes data between the flash memory 84 and the DRAM 85, and each of the above storage media, and executes the above information processing.

[0036] The main body device 2 includes a network communication unit 82. The network communication unit 82 is connected to the processor 81. The network communication unit 82 communicates (specifically, wirelessly) with an external device via a network. In the present embodiment, the network communication unit 82 can directly perform wireless communication with other main body devices 2 existing within the communication range of its own device by a predetermined communication method (for example, a communication method based on a proprietary protocol or a method compliant with the Wi-Fi standard). Further, the network communication unit 82 can communicate with other main body devices 2 connected to a local area network including the access point via a wireless LAN access point existing within the communication range of its own device by a method compliant with the Wi-Fi standard. Such direct communication with other main body devices 2 and communication within the local area network via a wireless LAN access point are herein referred to as "local communication". Also, the network communication unit 82 can be connected to a wireless LAN by a method compliant with the Wi-Fi standard and can be connected to the Internet, and can communicate with other devices connected to the Internet. Note that the main body device 2 can be connected to a wired LAN and can also be connected to the Internet via the wired LAN. For example, the main body device 2 may be connectable to a wired LAN via the cradle 6. Such communication with other devices via the Internet is herein referred to as "Internet communication".

[0037] The main body device 2 includes a controller communication unit 83. The controller communication unit 83 is connected to the processor 81. The controller communication unit 83 performs wireless communication with the left controller 3 and / or the right controller 4. Also, the controller communication unit 83 can perform wireless communication with a second controller. The communication method between the main body device 2 and the left controller 3 and the right controller 4 (or the second controller) is arbitrary, but in the present embodiment, the controller communication unit 83 communicates between the left controller 3 and between the right controller 4 in accordance with the Bluetooth (registered trademark) standard.

[0038] The processor 81 is connected to the left terminal 20, the right terminal 21, and the lower terminal 27. When the processor 81 performs wired communication with the left controller 3, it transmits data to the left controller 3 via the left terminal 20 and receives operation data from the left controller 3 via the left terminal 20. Also, when the processor 81 performs wired communication with the right controller 4, it transmits data to the right controller 4 via the right terminal 21 and receives operation data from the right controller 4 via the right terminal 21. Further, when the processor 81 communicates with the cradle 6, it transmits data to the cradle 6 via the lower terminal 27. Thus, in the present embodiment, the main body device 2 can perform both wired communication and wireless communication with the left controller 3 and the right controller 4, respectively. Also, when the left controller 3 and the right controller 4 are attached to the main body device 2 as an integrated device or when the main body device 2 alone is attached to the cradle 6, the main body device 2 can output data (for example, image data or audio data) to the stationary monitor 5 via the cradle 6.

[0039] Here, the main body device 2 can communicate with a plurality of left controllers 3 simultaneously (in other words, in parallel). Also, the main body device 2 can communicate with a plurality of right controllers 4 simultaneously (in other words, in parallel). Therefore, a plurality of users can simultaneously perform input to the main body device 2 using a set of the left controller 3 and the right controller 4, respectively. As an example, while the first user performs input to the main body device 2 using the first set of the left controller 3 and the right controller 4, it is possible for the second user to perform input to the main body device 2 using the second set of the left controller 3 and the right controller 4.

[0040] The main body device 2 includes a touch panel controller 86 which is a circuit for controlling the touch panel 13. The touch panel controller 86 is connected between the touch panel 13 and the processor 81. The touch panel controller 86 generates data indicating, for example, the position where a touch input has been made based on a signal from the touch panel 13 and outputs it to the processor 81.

[0041] Further, the display 12 is connected to the processor 81. The processor 81 displays an image generated (for example, by executing the above information processing) and / or an image acquired from the outside on the display 12.

[0042] The main body device 2 includes a codec circuit 87 and speakers (specifically, a left speaker and a right speaker) 88. The codec circuit 87 is connected to the speakers 88 and the audio input / output terminal 25, and is also connected to the processor 81. The codec circuit 87 is a circuit that controls the input / output of audio data to / from the speakers 88 and the audio input / output terminal 25.

[0043] The main body device 2 also includes an acceleration sensor 89. In the present embodiment, the acceleration sensor 89 detects the magnitude of acceleration along a predetermined three axes (for example, the xyz axes shown in FIG. 1). Note that the acceleration sensor 89 may detect acceleration in one-axis or two-axis directions.

[0044] The main body device 2 also includes an angular velocity sensor 90. In the present embodiment, the angular velocity sensor 90 detects the angular velocity around a predetermined three axes (for example, the xyz axes shown in FIG. 1). Note that the angular velocity sensor 90 may detect the angular velocity around one-axis or two-axes.

[0045] The acceleration sensor 89 and the angular velocity sensor 90 are connected to the processor 81, and the detection results of the acceleration sensor 89 and the angular velocity sensor 90 are output to the processor 81. The processor 81 can calculate information regarding the movement and / or posture of the main body device 2 based on the detection results of the acceleration sensor 89 and the angular velocity sensor 90 described above.

[0046] The main body device 2 includes a power button 24, a power control unit 97, and a battery 98. The power control unit 97 is connected to the battery 98 and the processor 81. Although not shown, the power control unit 97 is also connected to each part of the main body device 2 (specifically, each part that receives power supply from the battery 98, the left terminal 20, and the right terminal 21). The power control unit 97 controls the power supply from the battery 98 to each of the above parts based on a command from the processor 81.

[0047] Also, the battery 98 is connected to the lower terminal 27. When an external charging device (for example, a cradle 6) is connected to the lower terminal 27 and power is supplied to the main body device 2 through the lower terminal 27, the supplied power is used to charge the battery 98.

[0048] The left controller 3 includes a terminal 35 connected to the left terminal 20 of the main body device 2. The left controller 3 also includes a control unit 30. The control unit 30 is connected to each component including the terminal 35. The control unit 30 controls the communication method that the left controller 3 performs with the main body device 2. In the present embodiment, the control unit 30 can communicate with the main body device 2 both by wired communication via the terminal 35 and by wireless communication via an antenna (not shown). That is, when the left controller 3 is attached to the main body device 2, the control unit 30 communicates with the main body device 2 via the terminal 35. Also, when the left controller 3 is removed from the main body device 2, the control unit 30 performs wireless communication with the main body device 2 (specifically, the controller communication unit 83). The wireless communication between the controller communication unit 83 and the control unit 30 is performed according to, for example, the Bluetooth (registered trademark) standard.

[0049] The left controller 3 also includes a memory 33 such as a flash memory. The control unit 30 is composed of, for example, a microcomputer (also referred to as a microprocessor), and executes various processes by executing the firmware stored in the memory 33.

[0050] The left controller 3 includes an analog stick (described as "stick" in FIG. 3) 31 and a plurality of operation buttons 32. Information regarding operations performed on the analog stick 31 and each operation button 32 is output to the repetition control unit 30 at appropriate timings.

[0051] Also, the left controller 3 includes a sensor 34. The sensor 34 includes an acceleration sensor and an angular velocity sensor. The acceleration sensor detects the magnitude of acceleration along each of the x, y, and z axes shown in FIG. 1, and the angular velocity sensor detects the angular velocity around each of the x, y, and z axes. The detection results of the acceleration sensor and the angular velocity sensor are output to the repetition control unit 30 at appropriate timings.

[0052] The control unit 30 acquires information regarding input (specifically, information regarding operations on the analog stick 31 and each operation button 32, and information regarding the detection results by the sensor 34) from each operation button 32, the analog stick 31, and the sensor 34. The control unit 30 transmits operation data including the acquired information (or information obtained by performing predetermined processing on the acquired information) to the main body device 2. Note that the operation data is repeatedly transmitted at a rate of once every predetermined time. Note that the intervals at which the information regarding input is transmitted to the main body device 2 may be the same or different for each input unit.

[0053] When the above operation data is transmitted to the main body device 2, the main body device 2 can determine operations on the analog stick 31 and each operation button 32 based on the operation data. Also, the main body device 2 can acquire information regarding the movement and / or posture of the left controller 3 based on the operation data (specifically, the detection results of the sensor 34).

[0054] Also, although not shown, the left controller 3 includes a battery that supplies power to each of the above units. Also, the left controller 3 may include a vibrator.

[0055] Also, as shown in FIG. 3, the right controller 4 includes a terminal 45 connected to the right terminal 21 of the main body device 2, a control unit 40, a memory 43, a stick 41, a plurality of operation buttons 42, and a sensor 44. Since each of these parts has the same function as each of the above parts of the left controller 3, the description thereof is omitted.

[0056] (Description of a game system including a plurality of information processing devices) Hereinafter, an example of a game system 10 for playing a game according to the present embodiment to be described later will be described. The game system 10 is a system configured by a plurality of information processing devices 1 communicating with each other. FIG. 4 is a diagram showing an example of the game system 10, and is a diagram showing an outline of the game system 10 configured by a plurality of information processing devices 1 performing local communication. FIG. 5 is a diagram showing an example of the game system 10, and is a diagram showing an outline of the game system 10 configured by a plurality of information processing devices 1 performing Internet communication.

[0057] As shown in FIGS. 4 and 5, the game system 10 includes a plurality of information processing devices 1. For example, the game system 10 includes an information processing device 1a, an information processing device 1b, an information processing device 1c, and an information processing device 1d.

[0058] Note that in FIGS. 4 and 5, the game system 10 is illustrated as including four information processing apparatuses 1, but the number of information processing apparatuses 1 included in the game system 10 may be arbitrary. Also, in any of the communication modes shown in FIGS. 4 and 5, the plurality of information processing apparatuses 1 included in the game system 10 may operate in the portable mode, the stationary mode, the table mode, or a combination thereof. For example, in the communication mode shown in FIG. 4, any of the information processing apparatuses 1a to 1d may operate in the portable mode, the stationary mode, the table mode, or a combination of the portable mode, the stationary mode, and the table mode. Further, in the game system 10 shown in FIG. 5, the stationary-mode information processing apparatuses (1a and 1b) and the portable-mode information processing apparatuses (1c and 1d) are mixed, but may include a table-mode information processing apparatus, and any of the information processing apparatuses 1a to 1d may be in the portable mode, the stationary mode, or the table mode.

[0059] In FIGS. 4 and 5, the information processing apparatus 1a functions as a master device. The information processing apparatus 1a, which is the master device, executes a game program. The processor 81 of the information processing apparatus 1a executes game processing related to a predetermined game by executing the game program. For example, an external storage medium storing the game program is attached to the slot 23 of the information processing apparatus 1a, and the processor 81 of the information processing apparatus 1a can read the game program stored in the external storage medium into the DRAM 85 and execute it. Note that the game program may be stored in the flash memory 84 of the information processing apparatus 1a or in another storage device readable by the information processing apparatus 1a. The predetermined game may be any game such as a racing game, a card game, a table game, a sports game, a fighting game, a shooting game, a role-playing game, a music game, or the like.

[0060] On the other hand, in FIGS. 4 and 5, the information processing devices 1b to 1d function as slave devices. The information processing devices 1b to 1d, which are slave devices, may not store a game program for executing the predetermined game and may not be able to execute the game program. That is, an external storage medium storing the game program is not attached to the slot 23 of the slave device, and the game program is not stored in the flash memory 84 of the slave device either.

[0061] Note that although the slave device also stores a game program, any one of the plurality of information processing devices 1 may function as a master device, and the remaining information processing devices 1 may function as slave devices, and game processing may be executed only by the master device.

[0062] Also, among the plurality of slave devices, there may be a device that functions only as a slave device.

[0063] Also, the master device and each slave device may be the same type of information processing device (for example, the same type of game device). Also, the master device and each slave device may be different types of information processing devices. Also, the plurality of slave devices may include the same type of information processing device as the master device and a different type of information processing device from the master device.

[0064] As shown in FIG. 4, the master device and each slave device may directly communicate by local communication (for example, a communication method based on a proprietary protocol or a method compliant with the Wi-Fi standard). Also, as shown in FIG. 5, the master device and each slave device may communicate via the Internet 8. In the present embodiment, a predetermined game is executed using the master device and the slave devices. The master device and each slave device establish a connection before starting the predetermined game.

[0065] Specifically, the host device acquires operation data corresponding to an operation on the host device's controller (the first controller or the second controller). Here, the operation data corresponding to the operation on the host device's controller is referred to as "host device operation data". Also, the slave device transmits operation data corresponding to an operation on the slave device's controller (the first controller or the second controller) to the host device. Here, the operation data transmitted from the slave device to the host device is referred to as "slave device operation data".

[0066] The host device performs game processing based on the host device operation data. Also, the host device receives the slave device operation data transmitted from the slave device and performs game processing based on the slave device operation data. The content of the game processing varies depending on the type of game.

[0067] Next, the host device generates image data based on the result of the game processing. Specifically, the host device generates image data for the host device and image data for the slave device.

[0068] The host device outputs the generated image data for the host device to the display 12 or the stationary monitor 5. As a result, the game image for the host device is displayed on the host device's display 12 or the stationary monitor 5. Also, the host device transmits the generated image data for the slave device to the slave device. The slave device receives the image data for the slave device transmitted from the host device and outputs the image data for the slave device to the display 12 or the stationary monitor 5. As a result, the game image for the slave device is displayed on each slave device's display 12 or the stationary monitor 5. Note that the host device may generate audio data for the host device and output an audio based on the audio data. Also, the host device may generate audio data for the slave device, transmit it to the slave device, and an audio based on the audio data for the slave device may be output at the slave device.

[0069] As described above, the game system 10 for playing the game according to this embodiment includes a plurality of information processing apparatuses 1. Any one of the plurality of information processing apparatuses 1 functions as a master device, and the other information processing apparatuses 1 function as slave devices. Game processing is performed based on master device operation data corresponding to an operation performed on the master device. Also, slave device operation data corresponding to an operation performed on a slave device is transmitted from the slave device to the master device, and game processing based on the slave device operation data is performed on the master device. The master device generates a game image according to the result of the game processing, and displays the game image on its own display 12 or the stationary monitor 5. Further, the master device transmits the game image according to the result of the game processing to the slave device, and the game image is displayed on the slave device. Thereby, a game is played in the game system 10 including the master device and the slave devices.

[0070] Next, the game of this embodiment performed using the game system 10 as described above will be described.

[0071] (Example of a game performed in a game system) The game of this embodiment is performed using the game system 10 configured by the above-described local communication. The game of this embodiment is a game performed using two information processing apparatuses 1. A first image is displayed on the display device of the first information processing apparatus 1, and a second image, which is an image of a user interface (UI), is displayed on the display device of the second information processing apparatus 1.

[0072] FIG. 6 is a diagram showing an example of the configuration of the game system 10 in which the game of this embodiment is performed.

[0073] As shown in FIG. 6, a game system 10 in which the game of the present embodiment is played includes a first information processing device 1a and a second information processing device 1b. As shown in FIG. 6, for example, the first information processing device 1a operates in the above-described stationary mode and is connected to the stationary monitor 5 via a cradle 6 (not shown). A controller (first controller or second controller) (not shown) is wirelessly connected to the first information processing device 1a. Further, the second information processing device 1b operates in, for example, a portable mode.

[0074] Note that the first information processing device 1a may operate in a portable mode or a table mode. Further, the second information processing device 1b may operate in a stationary mode or a table mode.

[0075] For example, the first information processing device 1a stores a game program for playing the game of the present embodiment, executes the game program, and functions as a master device. Further, the second information processing device 1b does not execute the game program and functions as a slave device.

[0076] Here, the first information processing device 1a functions as a master device and the second information processing device 1b functions as a slave device. However, the second information processing device 1b may function as a master device and the first information processing device 1a may function as a slave device.

[0077] The first information processing device 1a, which is the host device, acquires host operation data according to an operation on its own controller (the first controller or the second controller). Also, the second information processing device 1b, which is the slave device, acquires operation data according to an operation on its own controller or the touch panel 13b, and transmits the operation data as slave device operation data to the host device. The host device performs game processing based on the host operation data and the slave device operation data, and generates a first image and a second image which is a UI image based on the result of the game processing. The host device causes the generated first image to be displayed on the stationary monitor 5, and transmits the generated second image to the slave device. The slave device causes the second image received from the host device to be displayed on its own display 12b.

[0078] In this way, in the present embodiment, a game using two screens is performed using the host device and the slave device. Hereinafter, the game of the present embodiment will be exemplified.

[0079] In the game of the present embodiment using the first information processing device 1a and the second information processing device 1b, for example, an image of a virtual space is displayed as the first image, and a map image of the virtual space is displayed as the second image. For example, the game of the present embodiment may be a game in which the player character 71 moves in the virtual space and aims at a predetermined destination. The game of the present embodiment is performed by, for example, a single user.

[0080] FIG. 7 is a diagram showing an example of the second image displayed on the display 12b of the slave device when the game of the present embodiment is performed. FIG. 8 is a diagram showing another example of the second image displayed on the display 12b of the slave device when the game of the present embodiment is performed. FIG. 9 is a diagram showing an example of the first image displayed on the stationary monitor 5 connected to the host device when the game of the present embodiment is performed.

[0081] As shown in FIG. 9, on the stationary monitor 5 connected to the master unit, an image (first image) of a virtual space including a player character 71 controlled by the user is displayed. The first image includes images representing terrains such as the ground 72 and the sea 74. The first image is an image showing a partial range of the virtual space including the player character 71, and is generated based on, for example, a virtual camera arranged behind the player character 71. The player character 71 moves on the ground 72 in response to an operation on the controller of the master unit, aiming at a destination within the virtual space. In FIG. 9, since the destination is far from the position of the player character 71, an image showing the destination is not displayed in the first image.

[0082] On the other hand, as shown in FIG. 7, on the display 12b of the slave unit, a map image representing a wider range than the first image is displayed as the second image. The second image may be a map image representing the entire virtual space, or may be a map image representing a part of the virtual space wider than the first image. For example, the second image includes an icon indicating the player character 71, an image indicating the ground 72 on which the player character 71 can move, an image indicating the sea 74 on which the player character 71 cannot move, and an icon indicating the destination 73.

[0083] The user operates the controller connected to the master unit while looking at the first image to move the player character 71. When the player character 71 moves within the virtual space, an image of the virtual space after the movement is displayed on the stationary monitor 5 as the first image. Also, a map image corresponding to the position of the player character 71 after the movement is displayed on the display 12b as the second image.

[0084] Specifically, the master device updates the position of the player character 71 and the position of the virtual camera based on the master device operation data from the controller (the first controller or the second controller) wirelessly connected to the own device. Further, the master device updates the position of the icon of the player character 71 in the map image based on the updated position of the player character 71. Then, the master device generates a first image, which is an image of the virtual space, based on the virtual camera and displays it on the stationary monitor 5. Also, the master device generates a second image, which is a map image, and transmits it to the slave device. The slave device displays the received second image on the display 12b.

[0085] The user can view the second image displayed on the display 12b of the slave device, grasp the positional relationship between the player character 71 and the destination 73, and confirm the direction in which the player character 71 should move.

[0086] Note that the user may be able to perform operations on the controller (the first controller or the second controller) of the slave device. Also, the user may be able to perform operations on the touch panel 13b of the slave device. Slave device operation data corresponding to the operation on the controller or the touch panel 13b of the slave device is transmitted to the master device, game processing is performed in the master device, and a second image corresponding to the result of the game processing may be displayed on the display 12b. For example, in response to an operation on the controller or the touch panel 13b of the slave device, a predetermined position in the map image may be indicated, and information regarding the indicated position may be displayed on the display 12b.

[0087] Also, game processing may be performed in the master device based on an operation on the controller or the touch panel 13b of the slave device, and a first image corresponding to the result of the game processing may be displayed on the stationary monitor 5. For example, as shown in FIG. 8, as another example of the second image, an item selection screen for selecting one of a plurality of items may be displayed, and the item selected on the item selection screen may be used and reflected in the first image.

[0088] Specifically, as shown in FIG. 8, icons indicating each of a plurality of items are displayed on the display 12b of the slave unit. The plurality of items may be, for example, weapons used by the player character 71 for attacks, armor equipped by the player character 71, items for recovering the physical strength of the player character 71, and the like. The user selects one of the icons using the cursor based on an operation on the controller or the touch panel 13b of the slave unit, and uses the item corresponding to the selected icon using the use button. When an item is used, in the first image shown in FIG. 9, a display corresponding to the used item may be performed. For example, when a weapon is used as an item, a state in which the player character 71 equips the weapon and performs an attack action may be displayed.

[0089] In addition, the player character 71 displayed in the first image may be controlled using the controller or the touch panel 13b of the slave unit. For example, based on an operation on the controller of the slave unit, the player character 71 is moved, and the first image and the second image corresponding to the position of the player character 71 after the movement are generated and displayed on the stationary monitor 5 and the display 12b, respectively.

[0090] Here, the game of the present embodiment can be executed on two screens using the master unit and the slave unit connected as described above, but can also be executed using only one information processing apparatus 1. In this case, the game of the present embodiment is performed on one screen. The case where the game is performed on one screen is referred to here as the "one-screen mode". On the other hand, the case where the game is executed on two screens using the master unit and the slave unit as described above is referred to as the "two-screen mode". Hereinafter, the case where the game of the present embodiment is performed in the one-screen mode will be described.

[0091] FIG. 10 is a diagram showing an example of an image displayed on the display device of the information processing apparatus 1 when the game of the present embodiment is executed using one information processing apparatus 1.

[0092] As shown in FIG. 10, for example, when the game of the present embodiment is executed using only the first information processing apparatus 1a, a third image in which a second image that is a map image is superimposed on a first image that is an image of a virtual space is displayed on the stationary monitor 5 of the first information processing apparatus 1a. The user advances the game while viewing the first image and the second image that are simultaneously displayed on one screen.

[0093] Specifically, based on operation data from a controller (the first controller or the second controller) wirelessly connected to the own vehicle, the first information processing apparatus 1a updates the position of the player character 71 or causes the player character 71 to perform a predetermined action as game processing. Further, the first information processing apparatus 1a updates the position of the icon of the player character 71 in the map image in accordance with the update of the position of the player character 71. The first information processing apparatus 1a generates a first image based on a virtual camera, generates a second image that is a map image, and generates a third image in which the second image is superimposed on the first image. Then, the first information processing apparatus 1a causes the generated third image to be displayed on the stationary monitor 5.

[0094] The first information processing apparatus 1a can execute the game in the one-screen mode regardless of whether it operates in the portable mode, the stationary mode, or the table mode. When the first information processing apparatus 1a operates in the portable mode or the table mode, the third image is displayed on the display 12.

[0095] Note that when the game is performed in the one-screen mode, the first image and the second image may not be displayed simultaneously, and only one of the first image and the second image may be displayed. For example, usually only the first image that is an image of the virtual space is displayed, and in response to a switching operation by the user using the controller, the display may switch from the first image to the second image that is a map image. When the user performs a switching operation again, the display may switch from the second image to the first image.

[0096] FIG. 11 is a diagram showing an example of a first image displayed on the stationary monitor 5 connected to the information processing apparatus 1 when the game is played in the single-screen mode. FIG. 12 is a diagram showing an example of a second image displayed on the stationary monitor 5 connected to the information processing apparatus 1 when the game is played in the single-screen mode.

[0097] As shown in FIG. 11, when the game is played in the single-screen mode, an image of a virtual space based on a virtual camera is displayed as the first image on the entire surface of the stationary monitor 5. The first image displayed in the single-screen mode is the same as the first image (see FIG. 9) displayed in the two-screen mode, but in the single-screen mode, for example, a switching button 75 is included in the first image. For example, when the user selects the switching button 75 using the controller of the information processing apparatus 1 and performs a switching operation, as shown in FIG. 12, a map image is displayed as the second image on the entire surface of the stationary monitor 5. The second image displayed in the single-screen mode is the same as the second image (see FIG. 7) displayed in the two-screen mode, but in the single-screen mode, for example, a switching button 75 is included in the second image. When the switching button 75 included in the second image is selected and a switching operation is performed, the first image shown in FIG. 11 is displayed.

[0098] Note that in the single-screen mode, the switching between the first image and the second image is not limited to the switching button 75, and other user interfaces may be used. For example, the first image and the second image may be switched using a menu. Also, depending on the switching operation, the first image may be switched to another image. For example, depending on the switching operation, the first image may be switched to the item selection screen shown in FIG. 8.

[0099] As shown in FIG. 10, when the second image is superimposed on the first image, the visibility of the first image may be reduced. Also, the second image may be displayed small, and the visibility of the second image may also be reduced.

[0100] In addition, when the game is executed in the single-screen mode, as shown in FIGS. 11 and 12, when only one of the first image and the second image is displayed instead of both the first image and the second image being displayed simultaneously, for example, when the user wants to view the map image, it is necessary to perform a screen switching operation.

[0101] On the other hand, when the game is executed on two screens using the master unit and the slave unit as described above, one of the first image and the second image is displayed on the display device (the stationary monitor 5 or the display 12a) of the master unit, and the other image is displayed on the display device (the stationary monitor 5 or the display 12b) of the slave unit. As a result, without impairing the visibility of both the first image and the second image, the user can play the game while viewing the first image and the second image simultaneously.

[0102] Note that the game of this embodiment is assumed to be played by a single user. The game of this embodiment may be played by two users using the master unit and the slave unit. For example, while the first user operates the player character 71 using the controller of the master unit while viewing the first image displayed on the display device of the master unit, the second user may perform game operations or provide information to the user of the master unit while viewing the second image displayed on the display device of the slave unit.

[0103] (Examples of Applications Performed in the Game System) Next, a case where a predetermined application different from the above game is performed in the game system (information processing system) shown in FIG. 6 will be described. In the predetermined application, for example, as the second image, images of a plurality of items to be selected are displayed. Further, as the first image, an image corresponding to the selected item is displayed. For example, as the predetermined application, a karaoke application may be executed. In the karaoke application, the user selects one of a plurality of songs, and processing corresponding to the selected song is performed.

[0104] FIG. 13 and FIG. 14 are diagrams showing an example of a second image displayed on the display 12b of the slave unit when a predetermined application is executed. FIG. 15 is a diagram showing an example of a first image displayed on the stationary monitor 5 connected to the master unit when a predetermined application is executed.

[0105] As shown in FIGS. 13 and 14, on the display 12b of the slave unit, a music selection screen for allowing the user to select any one of a plurality of music pieces is displayed as the second image. On the music selection screen, a plurality of music icons 78 corresponding to each of the plurality of music pieces are displayed as a list. For example, the title of the music is displayed on each music icon 78. Also, a cursor 79 for selecting music and a scroll bar 80 are displayed. In the second image, a part of the plurality of music pieces that can be selected by the user is displayed, and when the user moves the cursor 79 downward, the displayed range changes. The user moves the cursor 79 by a selection operation using the controller or touch panel 13b of the slave unit to select any one of the plurality of music icons 78. In a state where any one of the plurality of music icons 78 is selected, the user performs a determination operation using the controller or touch panel 13b of the slave unit.

[0106] As shown in FIG. 14, when a determination operation is performed in a state where the music icon 78 indicating title G is selected on the music selection screen, playback of the music (the music with title G) corresponding to the selected music icon is started, and as shown in FIG. 15, a first image related to the music being played is displayed on the stationary monitor 5 of the master unit. For example, as the first image, a character 76 related to the music being played may be displayed. Also, as the first image, an image 77 (characters or character image) showing the lyrics of the music being played may be displayed. Note that the character 76 may be a predetermined character or a character corresponding to the user.

[0107] For example, a microphone is connected to the master device, and the user's voice is input to the master device using the microphone. The master device acquires the voice input data using the microphone as master device operation data. Note that the microphone may be connected to the slave device, and the voice input data using the microphone may be transmitted from the slave device to the master device as slave device operation data.

[0108] The master device performs predetermined application processing based on the user's input. For example, the master device performs an evaluation of the user's input (voice) as application processing and displays the evaluation result on the stationary monitor 5. Also, the character 76 may operate according to the user's input.

[0109] Thus, in the application of this embodiment, a selection screen for allowing the user to select any one of a plurality of items is displayed on the display device of the slave device, and a first image corresponding to the item selected by the selection screen is displayed on the display device of the master device.

[0110] Note that on the music selection screen, instead of simultaneously displaying a plurality of music that the user can select, only one of the plurality of music may be displayed. In this case, the music displayed on the music selection screen changes by a selection operation using the controller of the slave device. Then, when a determination operation is performed by the user in a state where any one of the plurality of music is displayed, the playback of the displayed music is started, and the first image shown in FIG. 15 is displayed on the stationary monitor 5 of the master device.

[0111] A predetermined application can also be executed in a single-screen mode using, for example, only the first information processing apparatus 1a, similar to the above-described game. When a predetermined application is executed in the single-screen mode, a third image in which a second image (music selection screen) is superimposed on the first image may be displayed on the display device of the first information processing apparatus 1a. For example, when a predetermined application is started in the single-screen mode, first, a second image (music selection screen) is displayed on the display device of the first information processing apparatus 1a. When a music is selected on the music selection screen, the playback of the music may be started and the screen may be switched from the second image to the first image shown in FIG. 15.

[0112] Also, when a predetermined application is executed in the single-screen mode, the first image and the second image are not displayed simultaneously, and the first image and the second image may be switched in response to a switching operation by the user. For example, in response to a switching operation by the user during the display of the first image (during the playback of music), a second image (music selection screen) may be displayed.

[0113] In addition, as a predetermined application for selecting a music piece using the music selection screen, a rhythm game may be played. In this case, as the second image, a music selection screen as shown in FIGS. 13 and 14 is displayed. When a music piece is selected on the music selection screen and a determination operation is performed, playback of the selected music piece is started, and a game image is displayed as the first image related to the music piece being played. For example, the first image includes an icon (instruction image) indicating the input timing of the user. Specifically, icons indicating a plurality of timings preset in accordance with the rhythm of the music piece being played are moved and displayed. The host device determines whether the timing at which the icon reaches a predetermined area matches the timing at which the user's input is made in the game process related to the rhythm game, and calculates points according to the result of the determination. Then, the host device generates a first image according to the result of the game process and displays it on the stationary monitor 5. The user's input may be made using the first controller or the second controller connected to the host device, or may be made using a dedicated input device connected to the host device. Also, the user's input may be made using the first controller or the second controller connected to the slave device, or may be made using a dedicated input device connected to the slave device.

[0114] As described above, when predetermined information processing (the above game processing and the above application processing) is performed using the host device and the slave device, either the first image or the second image which is the UI image is displayed on the display device (the stationary monitor 5 or the display 12) of the host device, and the other image is displayed on the display device (the stationary monitor 5 or the display 12) of the slave device. By displaying the UI image on another screen, the visibility of the first image and the second image can be improved. Also, operations can be performed using the controllers of the host device and the slave device, and the convenience for the user can be improved.

[0115] In the above embodiment, one slave device is connected to the master device, and a first image is displayed on the master device, and a second image which is a UI image is displayed on the slave device. In other embodiments, a plurality of slave devices may be connected to the master device, a first image may be displayed on the master device, and a second image which is a UI image may be displayed on each of the plurality of slave devices. In this case, the master device generates a second image for each slave device and transmits different second images to the respective slave devices. The second images displayed on the plurality of slave devices may be viewed by one user or may be viewed by a plurality of users. Further, the plurality of slave devices may be operated by one user or may be operated by a plurality of users.

[0116] (Details of Processing in Master Device and Slave Device) Next, details of the processing performed in the master device and the slave device will be described. First, the data stored in the master device and the slave device will be described. FIG. 16 is a diagram showing an example of data stored in the master device. FIG. 17 is a diagram showing an example of data stored in the slave device. Each data shown in FIGS. 16 and 17 is stored in the memory (any one of an external storage medium, a flash memory 84, and a DRAM 85) of each main body device 2.

[0117] As shown in FIG. 16, the master device stores a program, slave device data, master device operation data, slave device operation data, master device image data, slave device image data, and application data.

[0118] The program is a program for executing an application, for example, a program for executing the game of the present embodiment. Further, the program may be a program for executing the karaoke application.

[0119] The slave device data is data related to the slave device connected to the master device. The slave device data includes, for example, information for identifying the slave device (for example, a device ID, a MAC address, etc.). The slave device data is stored for each slave device connected to the master device.

[0120] The master unit operation data is data corresponding to operations performed in the master unit's controller (the first controller or the second controller). The main body device 2 acquires the master unit operation data from the master unit's controller at a predetermined time interval (for example, at intervals of 1 / 200 seconds). Note that the master unit operation data may include data corresponding to touch operations on the touch panel 13 of the main body device 2.

[0121] The slave unit operation data is data corresponding to operations performed in the slave unit's controller (the first controller or the second controller), and is transmitted from the slave unit. Note that the slave unit operation data may include data corresponding to touch operations on the touch panel 13 of the main body device 2. The slave unit transmits the slave unit operation data to the master unit at a predetermined time interval (for example, at intervals of 1 / 60 seconds). When a plurality of slave units are connected to the master unit, the slave unit operation data received from each slave unit is stored respectively.

[0122] The master unit image data is image data indicating an image displayed on the master unit's screen (the screen of the display 12 or the stationary monitor 5), and is generated in the master unit.

[0123] The slave unit image data is image data indicating an image displayed on the slave unit's screen (the screen of the display 12 or the stationary monitor 5), and is data generated in the master unit and transmitted to the slave unit. When a plurality of slave units are connected to the master unit, the respective slave unit image data is generated and stored. Note that the image size (resolution) of the slave unit image data may be variable. For example, the image size of the slave unit image data may change according to the number of slave units connected to the master unit. Also, the image size of the master unit image data and the image size of the slave unit image data may be different.

[0124] Application data is data used in an application. For example, when the games shown in FIGS. 7 to 9 are played, as application data, data related to player character 71, data related to terrain representing the ground 72 and the sea 74, data related to the destination 73, data related to various objects arranged in the virtual space, data related to the map image, etc. are stored. The data related to player character 71 includes data representing the shape and appearance of player character 71, and data indicating the position and orientation of player character 71 in the virtual space.

[0125] Also, for example, when the karaoke application shown in FIGS. 13 to 15 is executed, as application data, data related to a plurality of music pieces, data related to the music selection screen, etc. are stored. The data related to the music selection screen includes data indicating the music icon 78 corresponding to each music piece and data indicating the cursor 79.

[0126] On the other hand, as shown in FIG. 17, the slave device stores master device data, slave device operation data, and image data for the slave device.

[0127] The master device data is data related to the master device connected to the slave device. The master device data includes, for example, information for identifying the master device (e.g., device ID, MAC address, etc.).

[0128] The slave device operation data is data corresponding to an operation performed on the controller of the slave device (the first controller or the second controller). The main body device 2 acquires the slave device operation data from the controller of the slave device at a predetermined time interval (e.g., at an interval of 1 / 200 seconds). Note that the slave device operation data may include data corresponding to a touch operation on the touch panel 13 of the main body device 2. Also, the slave device transmits the acquired slave device operation data to the master device at a predetermined time interval (e.g., at an interval of 1 / 60 seconds).

[0129] The image data for the slave device is image data indicating an image displayed on the screen of the slave device (the screen of the display 12 or the stationary monitor 5), and is data received from the master device.

[0130] Note that the above program is not stored in the slave device, but a program for participating in the application performed on the master device (such as a program for connecting to the master device, a program for making a participation request to the master device, etc.) is stored.

[0131] Next, the processing performed on the master device and the slave device will be described. In the following, it will be described assuming that the master device and each slave device are connected in the communication mode shown in FIG. 4. Note that the master device and each slave device may be connected in the communication mode shown in FIG. 5.

[0132] (Master device processing) FIG. 18 is a flowchart showing an example of the master device processing performed on the master device. The processing shown in FIG. 18 is performed by the processor 81 of the main body device 2 of the master device.

[0133] As shown in FIG. 18, the master device first performs initial processing (step S10). In the initial processing, based on the user's operation, processing for determining the application to be executed, processing for selecting the communication mode (local communication or Internet communication), processing for setting the information processing device 1 as the master device, processing for connecting the master device and the slave device, processing for recruiting users (slave devices) participating in the application, processing for allowing the slave device with a participation request to participate in the application, etc. are performed. The communication modes selectable by the user vary depending on the application to be executed. When the initial processing is completed, the master device starts the application and then repeatedly executes the processing of steps S11 to S17 at a predetermined time interval (for example, at intervals of 1 / 60 second).

[0134] After the process of step S10, the master device acquires master device operation data (step S11). Specifically, when the master device operates in the mobile mode, it acquires the master device operation data from the first controllers (left controller 3 and right controller 4) attached to itself. Also, when the master device operates in the stationary mode or the table mode, it acquires the master device operation data from the first controller or the second controller wirelessly connected to itself. Note that the master device may acquire data corresponding to a touch operation on the touch panel 13 of the main body device 2 as the master device operation data.

[0135] Next, the master device receives slave device operation data from each slave device (step S12). Specifically, the network communication unit 82 of the master device receives the slave device operation data transmitted from the slave device. Note that the timing at which the master device receives the slave device operation data from each slave device may be different.

[0136] Next, the master device performs application processing based on the master device operation data (step S13). Also, in step S13, the master device performs application processing based on the received slave device operation data.

[0137] For example, when a game shown in FIGS. 7 to 9 is performed as an application, the master device updates the position of the player character 71 or causes the player character 71 to perform a predetermined operation based on the master device operation data. Also, the master device moves the virtual camera in accordance with the movement of the player character 71.

[0138] Also, when the karaoke application shown in FIGS. 13 to 15 is executed, the host device selects any one of a plurality of music pieces based on the slave device operation data. For example, when a music selection screen is displayed on the display device (display 12 or stationary monitor 5) of the slave device, the host device moves the cursor 79 and selects any one of the plurality of music icons 78 based on the slave device operation data. Further, when a determination operation is performed by the user, the host device starts playing the selected music piece. During the playback of the music piece, as application processing, the host device operates the character 76 or evaluates the user based on the host device operation data (for example, voice input data).

[0139] Next, the host device performs image generation processing based on the result of the application processing (step S14). Specifically, in the image generation processing, the host device generates host device image data and slave device image data. Further, the host device may generate host device voice data and slave device voice data.

[0140] For example, when the above game is played, the host device generates a first image (image of the virtual space) as shown in FIG. 9 as the host device image data. Further, the host device generates a second image (map image) as shown in FIG. 7 as the slave device image data.

[0141] Also, when the above karaoke application is performed, the host device generates a first image as shown in FIG. 15 as the host device image data. Further, the host device generates a second image as shown in FIGS. 13 and 14 as the slave device image data.

[0142] Next, the host device outputs the host device image data generated in step S14 to the display 12 or the stationary monitor 5 (step S15). Also, the host device causes the speaker 88 or the speaker of the stationary monitor 5 to output the voice based on the host device voice data generated in step S14.

[0143] Next, the master device transmits the image data for the slave device generated in step S14 to the slave device (step S16). Specifically, the network communication unit 82 of the master device transmits the generated image data for the slave device to each slave device. Also, the network communication unit 82 of the master device transmits the generated audio data to each slave device.

[0144] Next, the master device determines whether to end the application (step S17). The master device determines YES in step S17, for example, when the application is completed, when forced termination is instructed by the user of the master device during the execution of the application, or when slave device operation data regarding forced termination is received from the slave device during the execution of the application. When the master device determines YES in step S17, it ends the application and transmits an application end notification to each slave device. When it determines NO in step S17, the master device executes the process of step S11 again. This concludes the explanation of the master device process.

[0145] Note that while the processes of steps S11 to S17 are repeatedly executed, that is, while the application is being carried out between the master device and the slave devices, new slave devices may join.

[0146] (Slave device process) FIG. 19 is a flowchart showing an example of the slave device process performed in the slave device.

[0147] As shown in FIG. 19, the slave device first performs initial processing (step S20). In the initial processing, based on the user's operation, processing for setting the information processing device 1 as the slave device, processing for selecting the master device to connect to, processing for transmitting a participation request to participate in the application performed in the master device, etc. are performed. When the application is started in the master device, the initial processing in the slave device ends. Thereafter, the processes of steps S21 to S24 are repeatedly executed at a predetermined time interval (for example, at intervals of 1 / 60 second).

[0148] When the application is started, the slave device transmits slave device operation data to the master device (step S21). Specifically, when the slave device is operating in the portable mode, the slave device acquires operation data output from the first controllers (left controller 3 and right controller 4) attached to the own device. Also, when the slave device is operating in the stationary mode or the table mode, the slave device acquires operation data output from the first controller or the second controller connected to the own device. Note that the slave device may acquire data corresponding to a touch operation on the touch panel 13 of the main body device 2 as the operation data. Then, the network communication unit 82 of the slave device transmits the acquired operation data to the master device as slave device operation data. Note that the operation data output from the controller of the slave device may be transmitted to the master device as slave device operation data, or data obtained by performing predetermined processing on the operation data output from the controller of the slave device may be transmitted to the master device as slave device operation data.

[0149] Next, the slave device receives slave device image data from the master device (step S22). Also, the slave device may receive voice data for the slave device from the master device.

[0150] Note that the transmission frequency of the slave device operation data by the slave device and the reception frequency (frame rate) of the slave device image data may be different. For example, the reception frequency of the slave device image data may be lower than the transmission frequency of the slave device operation data. Also, for example, the reception frequency of the slave device image data of each slave device may be decreased according to the number of slave devices connected to the master device. In this case, the transmission frequency of the slave device operation data of each slave device may be the same regardless of the number of slave devices connected to the master device.

[0151] Next, the slave device outputs the received slave device image data (step S23). Specifically, when the slave device is operating in the portable mode or the table mode, the slave device outputs the received slave device image data to the display 12. Also, when the slave device is operating in the stationary mode, the slave device outputs the received slave device image data to the stationary monitor 5. Note that the slave device may output voice based on the received voice data.

[0152] Next, the slave device determines whether to terminate the application (step S24). For example, when the slave device receives an application termination notification from the master device, or when forced termination is instructed on the slave device during the execution of the application, the slave device terminates the application. If the application is not terminated, the slave device executes the process of step S21 again. This concludes the description of the slave device process.

[0153] Note that the processing of the above flowchart is merely an example, and for example, the order of each step may be swapped, other steps may be added, or some of the above steps may be omitted.

[0154] As described above, the information processing apparatus of the present embodiment operates in a portable mode, a stationary mode, and a table mode as a plurality of play modes. In the portable mode, the information processing apparatus performs processing according to an operation on an operation device provided in the information processing apparatus (for example, the left controller 3 and the right controller 4 attached to the main body device, the touch panel 13), and outputs an image corresponding to the result of the processing to a display device (for example, the display 12) provided in the information processing apparatus. Further, in the stationary mode, the information processing apparatus performs processing according to an operation on an operation device externally connected to the information processing apparatus (for example, the first controller or the second controller wirelessly connected to the main body device), and outputs an image corresponding to the result of the processing to a display device externally connected to the information processing apparatus (for example, the stationary monitor 5). Further, in the table mode, the information processing apparatus performs processing according to an operation on an operation device externally connected to the information processing apparatus (for example, the first controller or the second controller wirelessly connected to the main body device), and outputs an image corresponding to the result of the processing to a display device provided in the information processing apparatus (for example, the display 12). Further, the information processing apparatus can communicate with other information processing apparatuses in a plurality of communication modes including Internet communication and wireless local communication.

[0155] An information processing system is configured by a first information processing device which is such an information processing device and a second information processing device. The first information processing device performs information processing (for example, the above game processing, application processing) based on operation data in a first mode (1-screen mode) and a second mode (2-screen mode), and is capable of generating a first image and a second image which is a UI image based on the information processing.

[0156] Specifically, in the first mode, the first information processing device performs information processing based on first input data corresponding to an operation on an operation device (for example, a left controller 3 and a right controller 4 attached to the main body device, a touch panel 13, a first controller or a second controller wirelessly connected to the main body device) provided in or connected to the information processing device. Further, in the first mode, the first information processing device generates a first image and a second image based on the information processing, and outputs an image including one of the first image and the second image that is selectively switchable based on operation data, or both the first image and the second image, to a display device (for example, a display 12 or a stationary monitor 5) provided in or connected to the information processing device.

[0157] Further, in the second mode, the first information processing device communicates with the second information processing device. The second information processing device transmits second input data corresponding to an operation on an operation device (for example, a left controller 3 and a right controller 4 attached to the main body device, a touch panel 13, a first controller or a second controller wirelessly connected to the main body device) provided in or connected to the second information processing device to the first information processing device. The first information processing device performs information processing based on at least one of the first input data and the second input data, outputs one of the first image and the second image to the display device, and transmits the other to the second information processing device. The second information processing device outputs the other image received from the first information processing device to a display device (for example, a display 12 or a stationary monitor 5) provided in or connected to the second information processing device.

[0158] The first image is, for example, an image of a virtual space based on a virtual camera, and the second image may be a map image in a game. Further, the second image may be an image indicating any one of a plurality of items to be selected. The selectable item is a piece of music, and when the selected piece of music is played, an image related to the music being played may be displayed as the first image.

[0159] The second image may be an image for providing information to the user. Further, the second image may be an image for the user to make an input.

[0160] Also, in other embodiments, not limited to the games and applications exemplified above, application processing related to any application may be executed on the master device.

[0161] As described above, the present invention has been described, but the above description is merely an exemplification of the present invention, and various improvements and modifications may be added.

Explanation of Reference Numerals

[0162] 1 Information processing apparatus 1a Master device 1b, 1c, 1d Slave devices 2 Main body device 3 Left controller 4 Right controller 5 Stationary monitor 7 Second controller 10 Game system 12 Display

Claims

1. An information processing program that causes a computer of a first information processing device to execute information processing based on operation data and generate a first image and a second image that is a UI image based on the information processing. The program causes the computer to: In a first mode, Perform the information processing using, as the operation data, first input data based on an operation input to an operation device provided in or connected to the first information processing device, Output, to a display device provided in or connected to the first information processing device, one image that is selectable based on the operation data from among the first image and the second image, or an image including both the first image and the second image, In a second mode, Communicate with a second information processing device, Perform the information processing using, as the operation data, at least one of the first input data and second input data received from the second information processing device, Output one of the first image and the second image to the display device, And transmit the other to the second information processing device. An information processing program.

2. The information processing is a game process, And the first image is an image of a virtual space based on a virtual camera. The information processing program according to claim 1.

3. The second image at least includes a map image in the game. The information processing program according to claim 2.

4. The second image at least includes an image indicating an item to be selected, And the program causes the computer to perform, as the information processing, A selection process of the item based on at least the operation data. The information processing program according to claim 1.

5. The item is a music piece, And the program further causes the computer to perform, as the information processing, Play the selected music piece, And generate an image related to the music piece being played as the first image. The information processing program according to claim 4.

6. The second input data includes touch input data related to an input to a touch panel provided in the second information processing device, And the program causes the computer to: In the second mode, Perform the information processing using the second input data as the operation data, And perform a selection based on the touch input data for selectable items included in the UI of the second image. The information processing program according to any one of claims 1 to 5.

7. An information processing system including a first information processing device that executes information processing based on operation data and generates a first image and a second image that is a UI image based on the information processing. The first information processing device In the first mode Performs the information processing using, as the operation data, first input data based on an operation input to an operation device provided in or connected to the first information processing device. Outputs to a display device provided in or connected to the first information processing device, one image that is selectable based on the operation data from among the first image and the second image, or an image including both the first image and the second image. In the second mode Communicates with a second information processing device Causes the information processing to be performed using, as the operation data, at least one of the first input data and second input data received from the second information processing device. Outputs one of the first image and the second image to the display device. Transmits the other image to the second information processing device. The second information processing device Communicates with the first information processing device Transmits the second input data based on an operation input to an operation device provided in or connected to the second information processing device to the first information processing device. Outputs the other image received from the first information processing device to a display device provided in or connected to the second information processing device. Information processing system.

8. The information processing is a game process, The information processing system according to claim 7, wherein the first image is an image of a virtual space based on a virtual camera.

9. The information processing system according to claim 8, wherein the second image includes at least a map image in the game.

10. The second image includes at least an image indicating an item to be selected, The first information processing device, as the information processing, Performs a selection process of the item based on at least the operation data. The information processing system according to claim 7.

11. The item is a music piece, The first information processing device further, as the information processing, Plays the selected music piece, The information processing system according to claim 10, which generates an image related to the music piece being played as the first image.

12. The second input data includes touch input data related to an input to a touch panel provided in the second information processing apparatus. The first information processing apparatus In the second mode, perform the information processing using the second input data as the operation data, The information processing system according to any one of claims 7 to 11, wherein for selectable items included in the UI of the second image, a selection is made based on the touch input data.

13. An information processing method performed in an information processing system including a first information processing apparatus and a second information processing apparatus, In the first information processing apparatus, execute information processing based on operation data, and based on the information processing, generate a first image and a second image which is a UI image. The first information processing apparatus In the first mode, perform the information processing using, as the operation data, first input data based on an operation input to an operation device provided in or connected to the first information processing apparatus, output, to a display device provided in or connected to the first information processing apparatus, one image that is selectively switchable based on operation data among the first image and the second image, or an image including both the first image and the second image. In the second mode, communicate with the second information processing apparatus, cause the information processing to be performed using at least one of the first input data and second input data received from the second information processing apparatus as the operation data, output one image of the first image and the second image to the display device, transmit the other image to the second information processing apparatus, The second information processing apparatus communicates with the first information processing apparatus, transmits the second input data based on an operation input to an operation device provided in or connected to the second information processing apparatus to the first information processing apparatus, outputs the other image received from the first information processing apparatus to a display device provided in or connected to the second information processing apparatus. Information processing method.

14. The information processing is a game process, The information processing method according to claim 13, wherein the first image is an image of a virtual space based on a virtual camera.

15. The information processing method according to claim 14, wherein the second image includes at least a map image in the game.

16. The second image includes at least an image indicating an item to be selected. The first information processing apparatus, as the information processing, performs selection processing of the item based on at least the operation data, according to the information processing method of claim 13.

17. The item is a music piece, The first information processing apparatus, as the information processing, further plays the selected music piece, generates an image related to the music piece being played as the first image, according to the information processing method of claim 16.

18. The second input data includes touch input data related to an input to a touch panel provided in the second information processing apparatus. The first information processing apparatus in the second mode, uses the second input data as the operation data to perform the information processing, and makes a selection for selectable items included in the UI of the second image based on the touch input data, according to the information processing method according to any one of claims 13 to 17.

19. An information processing apparatus that executes information processing based on operation data and generates a first image and a second image which is a UI image based on the information processing, in a first mode, uses, as the operation data, first input data based on an operation input to an operation device provided in or connected to the information processing apparatus to perform the information processing, outputs to a display device provided in or connected to the information processing apparatus an image that is one of the first image and the second image that is selectably switchable based on the operation data, or an image including both the first image and the second image, in a second mode, communicates with a second information processing apparatus, uses at least any one of the first input data and second input data received from the second information processing apparatus as the operation data to perform the information processing, outputs one of the first image and the second image to the display device, and transmits the other to the second information processing apparatus. Information processing apparatus.

20. The information processing is a game process, The first image is an image of a virtual space based on a virtual camera, according to the information processing apparatus of claim 19.

21. The second image includes at least a map image in the game, according to the information processing apparatus of claim 20.

22. The second image includes at least an image indicating an item to be selected. The information processing apparatus according to claim 19, wherein the information processing includes at least selection processing of the item based on the operation data.

23. The item is a music piece, and as the information processing, further play the selected music piece, and generate an image related to the music piece being played as the first image, the information processing apparatus according to claim 22.

24. The second input data includes touch input data related to an input to a touch panel provided in the second information processing apparatus, and the information processing apparatus in the second mode, perform the information processing using the second input data as the operation data, and perform selection on selectable items included in the UI of the second image based on the touch input data, the information processing apparatus according to any one of claims 19 to 23.

Images