Game devices, methods, and programs
The game device and method enhance online gaming by enabling simultaneous execution of communication and game applications, facilitating data exchange between devices to improve user interaction and game appeal.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- NINTENDO CO LTD
- Filing Date
- 2024-08-07
- Publication Date
- 2026-05-12
AI Technical Summary
There is a need to enhance the interest and interaction in online games through improved communication capabilities between game devices.
A game device and method that allows simultaneous execution of a communication application and a game application, enabling data communication between devices in the same group, sharing information such as camera images and audio data, and controlling data exchange through an API to enhance game appeal.
Facilitates enhanced interaction and engagement in online games by allowing real-time sharing of user-generated content and game information between connected devices, improving the overall gaming experience.
Smart Images

Figure 0007857358000001 
Figure 0007857358000002 
Figure 0007857358000003
Abstract
Description
Technical Field
[0001] The present disclosure relates to a game device, a method, and a program.
Background Art
[0002] Online communication in which communication can be taken using images and sounds online is known (for example, Japanese Patent Application Laid-Open No. 2005-157586 (Patent Document 1)).
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] There is room for improvement in the interest of games through online communication
Means for Solving the Problems
[0005] (Configuration 1) A game device according to one embodiment includes execution means capable of simultaneously executing a communication application and a game application, and communication control means for controlling data communication with other game devices. The communication control means, in response to the execution of the communication application by the execution means, performs data communication between game devices corresponding to other accounts belonging to the same group in the communication application, and obtains first information from other game devices corresponding to other accounts belonging to the same group through said data communication. The execution means causes the running game application to obtain second information based on the first information in response to a request from the running game application to the running communication application via an API (Application Programming Interface).
[0006] According to Configuration 1, a running game application can use the second information to improve the game's appeal.
[0007] (Configuration 2) In Configuration 1, it may be possible to send and receive camera image data captured by a camera within the same group. The first information may include camera image data transmitted from other game devices. According to Configuration 2, the running game application can use the second information based on camera image data of users of other accounts belonging to the same group.
[0008] (Configuration 3) In Configuration 2, the second information may include transmitted camera image data. According to Configuration 3, the running game application can use camera image data of other users with accounts belonging to the same group.
[0009] (Configuration 4) In Configuration 3, if the use of transmitted camera image data in the communication application is restricted, the running game application does not need to use the camera image data included in the second information. According to Configuration 4, if the use of camera image data in the running communication application is restricted, this restriction can also be passed on to the running game application.
[0010] (Configuration 5) In any of Configurations 1 to 4, the second information may include information about a game application on another game device. According to Configuration 5, a running game application can, for example, perform processing that utilizes information about a game application on another game device.
[0011] (Configuration 6) In Configuration 5, the information regarding the game application may include information that identifies a game application running on another game device. According to Configuration 6, the running game application can, for example, perform processing that utilizes information that identifies a game application running on another game device.
[0012] (Configuration 7) In any of Configurations 1 to 6, it may be possible to send and receive audio data acquired by a microphone within the same group. The first information may include audio data transmitted by other game devices. According to Configuration 7, the running game application can use audio data from other users of accounts belonging to the same group.
[0013] (Configuration 8) In any of Configurations 1 to 7, the request may include causing the running communication application to be in a state where it causes the running game application to acquire second information when a predetermined condition is met. According to Configuration 8, the running communication application determines whether or not the predetermined condition is met, and when the predetermined condition is met, the running game application can acquire second information. Therefore, the running game application does not need to determine whether or not the predetermined condition is met, and can acquire second information when the predetermined condition is met.
[0014] (Configuration 9) In Configuration 8, the predetermined condition may be a condition that is met when the number of accounts belonging to the same group changes. According to Configuration 9, the running application can detect when the number of accounts belonging to the group changes. The running game application can, for example, execute processing in response to the change when the number of accounts changes.
[0015] (Configuration 10) In any of Configurations 1 to 9, the execution means may cause the running game application to obtain third information based on first information in response to a request via an API different from the request when the second information satisfies predetermined conditions. According to Configuration 10, the running communication application can request third information when the acquired second information satisfies predetermined conditions. This makes it possible to obtain third information at an appropriate time, for example, when predetermined information contained in the first information on which the third information is based is updated.
[0016] (Configuration 11) In Configuration 10, the predetermined condition may be a condition that is met when the number of accounts belonging to the same group changes. According to Configuration 11, when the number of accounts changes, the running game application can, for example, execute processing corresponding to that change.
[0017] (Configuration 12) In any of Configurations 1 to 11, the running game application may execute a communication game based on the second information. According to Configuration 12, a communication game can be executed that takes into account accounts belonging to the same group by using the second information based on the first information shared within the group to which it belongs.
[0018] (Configuration 13) In Configuration 12, the second information may include identification information of other accounts belonging to the same group. Based on this identification information, the running game application may perform a communication game with other game devices corresponding to accounts that meet predetermined conditions. According to Configuration 13, the running game application can, for example, perform a communication game with game terminals of the same group on which the same game application is running.
[0019] (Configuration 14) In any of Configurations 1 to 13, the second information may include identification information of other accounts belonging to the same group. Based on the second information, the running game application may generate an interface screen for allowing other accounts belonging to the same group to join the same game group. According to Configuration 14, the user can more easily decide which accounts to join the same game group.
[0020] (Configuration 15) In Configuration 12, the second information may include camera image data transmitted from another game device. According to Configuration 15, the running game application can output, for example, a game image using the camera image data.
[0021] (Configuration 16) In Configuration 15, the running game application may acquire transmitted camera image data corresponding to other accounts belonging to the same group and also belonging to the game group. The running communication application may transmit the game image output by the running game application, using the transmitted camera image data, to other game devices corresponding to accounts belonging to the same group. According to Configuration 16, communication can be facilitated by distributing game images using camera images of users of accounts belonging to the same group to users of accounts belonging to the same group.
[0022] (Configuration 17) In any of Configurations 1 to 15, the running communication application may send the image data output by the running game application to other game devices corresponding to other accounts belonging to the same group. According to Configuration 17, communication can be facilitated by distributing images from a game application that has acquired group information to users of other accounts belonging to the same group.
[0023] (Configuration 18) According to another embodiment, a method is provided that is performed on a game device. The method includes the steps of simultaneously running a communication application and a game application; performing data communication between game devices corresponding to accounts belonging to the same group in the communication application in response to the execution of the communication application; obtaining first information from other game devices corresponding to other accounts belonging to the same group through said data communication; and causing the running game application to obtain second information based on the first information in response to a request from the running game application to the running communication application via an API.
[0024] (Configuration 19) A program according to yet another embodiment causes one or more processors to execute steps of simultaneously executing a communication application and a game application, controlling data communication between game devices corresponding to accounts belonging to the same group in the communication application in response to execution of the communication application, obtaining first information from other game devices corresponding to other accounts belonging to the same group by the data communication, and causing the running game application to obtain second information based on the first information in response to a request via an API for the running communication application by the running game application.
Brief Description of Drawings
[0025] [Figure 1] It is a schematic diagram showing a configuration example of the system according to this embodiment. [Figure 2] It is a schematic diagram showing a hardware configuration example of the game device according to this embodiment. [Figure 3] It is a schematic diagram showing a hardware configuration example of the management server according to this embodiment. [Figure 4] It is a schematic diagram showing a software configuration example of the game device according to this embodiment. [Figure 5] It is a flowchart showing an example of processing for managing group information executed by the communication execution unit according to this embodiment. [Figure 6] It is a schematic diagram showing an example of group information of the game device according to this embodiment. [Figure 7] It is a flowchart showing an example of the transmission process of communication data executed by the communication execution unit according to this embodiment. [Figure 8] It is a flowchart showing an example of the reception process of communication data executed by the communication execution unit according to this embodiment. [Figure 9]This flowchart shows an example of interface processing by the communication execution unit according to this embodiment. [Figure 10] This flowchart shows another example of the interface processing of the communication execution unit according to this embodiment. [Figure 11] This is a sequence diagram showing an example of processing in a game application according to this embodiment. [Figure 12] This is a schematic diagram showing an example of game image data output by a game execution unit according to this embodiment. [Figure 13] This is a schematic diagram showing an example screen generated by a game execution unit according to this embodiment. [Figure 14] This is a schematic diagram showing another example screen generated by the game execution unit according to this embodiment. [Figure 15] This flowchart shows an example of processing by the game execution unit according to this embodiment. [Modes for carrying out the invention]
[0026] This embodiment will be described in detail with reference to the drawings. Note that identical or corresponding parts in the drawings are denoted by the same reference numerals, and their descriptions will not be repeated.
[0027] [A. System Configuration Example] First, an example of the system configuration according to this embodiment will be described.
[0028] Figure 1 is a schematic diagram showing an example configuration of System 1 according to this embodiment. System 1 includes one or more game devices 100. Game device 100 is, for example, a game-specific information processing device for providing games to users. Figure 1 shows an example configuration of System 1 including four game devices 100 connected to a network 4. In the following description, when it is necessary to identify each of the multiple game devices 100, they will be distinguished by subnumbers (for example, game devices 100-1, 100-2, 100-3, 100-4 as shown in Figure 1).
[0029] In this embodiment, a user using the game device 100 has their own account, and each game device 100 is associated with their own account. One account may be associated with multiple game devices 100, or multiple accounts may be associated with one game device 100. A user with an account can make the associated account join one or more communication groups (hereinafter also abbreviated as "group") by making a predetermined input to the game device 100. In this embodiment, being in a group indicates being able to communicate with other users of accounts that are in the group. Also, in this specification, "belonging" includes at least the state of being in a group. The state of an account belonging to a group may include the state in which the account is in the group and the state in which the account is awaiting acceptance before joining the group. Also, the state of an account belonging to a group may include either or both of the above, as well as the state after an account that has joined has left the group.
[0030] In this embodiment, a group is formed by multiple accounts, and communication can take place within the group. An account may belong to only one group at a time, or it may belong to multiple groups at the same time. The following describes the process when an account belongs to one group as an example. An upper limit may be set on the number of accounts that can belong to each group.
[0031] One example of how an account can join a group is that the account may be allowed to join only after it has received an invitation and the user of that account has accepted it. Alternatively, an account may be allowed to join a group only after it has applied to join the group and another account has accepted its application.
[0032] A game device 100 corresponding to an account belonging to any group transmits data used for communication between users (hereinafter also referred to as "communication data 10") to other game devices 100 corresponding to other accounts belonging to the same group. In this way, various types of information can be exchanged between game devices 100 used by each user belonging to any group.
[0033] For example, the communication data 10 may include audio data acquired by the game device 100, image data acquired by the game device 100, text data acquired by the game device 100, and information about the game being played on the game device 100.
[0034] In this specification, image data includes moving image data and one or more still image data. Image data may be captured using a camera 118 or the like available on the game device 100, or it may be an image of an application running on the game device 100.
[0035] In order to send and receive communication data 10, a session corresponding to the group may be established between multiple game devices 100 corresponding to accounts belonging to the group. That is, multiple game devices 100 corresponding to accounts belonging to the same group may have a common session. The management server 200 may manage the session.
[0036] Figure 1 shows an example where game devices 100-1 to 100-4 each correspond to four accounts belonging to the same group. Game device 100-1 transmits communication data 10-1 to one or more other game devices 100 and receives communication data 10-2 to 10-4 transmitted by one or more other game devices 100. Game devices 100-2 to 100-4 send and receive communication data 10 in the same way as game device 100-1. The processing based on communication data 10 will be described in detail later.
[0037] System 1 further includes a management server 200. The management server 200 is responsible for processes such as creating new groups and allowing one or more accounts to join groups. The management server 200 has management information 208 for managing the configured groups and the one or more accounts belonging to each group.
[0038] System 1 may further include a relay server 300. The relay server 300 relays communication data 10 transmitted and received by one or more game devices 100.
[0039] The management server 200 and relay server 300 may be implemented on a single physical server. System 1 may include multiple management servers 200 or multiple relay servers 300. The management server 200 and relay server 300 do not need to have separate functions. The management server 200 and relay server 300 may be virtual servers.
[0040] The method by which one game device 100 transmits communication data 10 to one or more other game devices 100 may be, in addition to, a method that uses one or more relay entities (e.g., relay servers 300), or alternatively, a method that directly transmits the communication data 10 to one or more other game devices 100 (e.g., a P2P method).
[0041] The same game application may be run on multiple game devices 100. In this case, the game application may be a communication game that exchanges data between the game devices 100. An account may be required to play the communication game.
[0042] Here, the account used to participate in the online game (hereinafter also referred to as the "game account" for distinction) may be the same as the account used to join the group, or it may be a different account. Furthermore, the account used to join the group and the game account may follow different systems.
[0043] Furthermore, when multiple users play the same game application (such as an online game), the collection of each user's game account is sometimes referred to as a "game group" to distinguish it from a communication group. At least some of the accounts belonging to a game group may also belong to the same group, while other accounts belonging to a game group may not belong to the same group.
[0044] [B. Hardware Configuration Example] Next, we will describe an example of the hardware configuration of each device included in System 1 according to this embodiment.
[0045] (b1: Game device 100) Figure 2 is a schematic diagram showing an example of the hardware configuration of a game device 100 according to this embodiment. The game device 100 is a type of computer. Referring to Figure 2, the game device 100 includes, for example, one or more processors 102, one or more memories 104, a communication unit 106, a camera interface 108, storage 110, an input unit 116, a display 120, a microphone 122, and a speaker 124. Each component may be detachable from the main body of the game device 100.
[0046] The processor 102 is the processing unit for executing processes in the game device 100. The processor 102 includes, for example, a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The processor 102 loads programs stored in the storage 110 into the memory 104 and executes them.
[0047] The memory 104 is a volatile storage medium accessible by the processor 102, and includes, for example, DRAM (Dynamic Random Access Memory) and SRAM (Static Random Access Memory).
[0048] The storage 110 is a non-volatile storage medium accessible by the processor 102, and includes, for example, flash memory or a hard disk. The storage 110 may also include, for example, a storage medium that can be attached to or removed from the game device 100, such as a cartridge or an optical disc.
[0049] The storage 110 stores, for example, a system program 112 and a game application 180.
[0050] The system program 112 includes computer-readable instructions for hardware control of the game device 100 and providing a program execution environment. The system program 112 also includes a communication application 114. As will be described in detail later, the communication application 114 performs processing related to the sending and receiving of communication data 10 between multiple game devices 100 corresponding to multiple accounts belonging to a group.
[0051] The game application 180 includes computer-readable instructions for running the game. Multiple game applications 180 may be installed on the game device 100. Furthermore, the game application 180 may be read from a separate storage medium.
[0052] In this specification, the term "processor" includes, at a minimum, processing circuits that perform processing according to computer-readable instructions, such as CPUs and GPUs, and hardwired circuits, such as ASICs (Application Specific Integrated Circuits) and FPGAs (Field Programmable Gate Arrays).
[0053] In this specification, the term “memory” includes at least the memory 104 and the storage 110.
[0054] In the game device 100, a System on Chip (SoC) in which functions such as a processor and memory are integrated may be used. In this case, the processor and memory reside on the same SoC (integrated circuit). Therefore, in this specification, the terms "processor" and "memory" include both independent configurations and integrated configurations.
[0055] The communication unit 106 transmits and receives data to and from other game devices 100, a management server 200, a relay server 300, etc., via the network 4. As an example of the network 4, the communication unit 106 may communicate data with other game devices 100, etc., via the Internet. The network 4 may also be a wireless network conforming to Bluetooth®, ZigBee®, wireless LAN (IEEE 802.11 standard), etc.
[0056] The camera interface 108 mediates the transmission of data to and from the camera 118. The camera interface 108 may be connected to the camera 118 by a wire or by wireless connection.
[0057] The input unit 116 accepts user input. The input unit 116 includes, for example, a keyboard, mouse, game controller, or touch panel. The input unit 116 may also be an interface with a device that accepts user input (for example, a game controller). That is, the device that accepts user input may be located outside the game device 100.
[0058] The display 120 displays images or videos generated by processing by the processor 102. The display 120 includes, for example, an LCD (Liquid Crystal Display) or an organic EL display. The display 120 may be located outside the game device 100. In this case, the game device 100 may include an interface circuit to the display 120.
[0059] Microphone 122 is located on the casing of the game device 100 and collects sound to generate an audio signal. Speaker 124 is located on the casing of the game device 100 and generates sound from the audio signal. At least one of microphone 122 and speaker 124 may be located outside the game device 100.
[0060] The camera 118 generates camera data (moving image data or still image data) of the subject in accordance with commands from the game device 100 or according to predetermined conditions.
[0061] The camera 118 includes an image sensor, such as a CCD (Charge-Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. A lens may be placed in front of the image sensor.
[0062] Camera 118 may be, for example, a camera for video calls. Camera 118 may be a dedicated camera that can only be connected to a specific device, or it may be a general-purpose camera that can be connected to any device. Multiple cameras 118 may be connected to the game device 100.
[0063] Furthermore, the game devices 100 corresponding to multiple accounts belonging to the same group do not necessarily have to have the same hardware configuration. For example, some game devices 100 may be dedicated game machines, while others may be personal computers, televisions, smartphones, tablets, etc., capable of running games. The game device 100 only needs to be an information processing device capable of running games.
[0064] (b2: Management Server 200) Figure 3 is a schematic diagram showing an example of the hardware configuration of a management server 200 according to this embodiment. Referring to Figure 3, the management server 200 includes, for example, one or more processors 202, one or more memories 204, one or more communication units 206, storage 210, and an input unit 216.
[0065] Processor 202 is the processing unit for executing processes in the management server 200. Processor 202 includes, for example, a CPU and a GPU. Processor 202 loads programs stored in storage 210 into memory 204 and executes them.
[0066] Memory 204 is a volatile storage medium accessible by the processor 202, and includes, for example, DRAM or SRAM.
[0067] The storage 210 is a non-volatile storage medium accessible by the processor 202, and includes, for example, a hard disk or flash memory. The storage 210 stores, for example, a system program 212 and a management program 214.
[0068] The system program 212 includes computer-readable instructions for hardware control of the management server 200 and providing a program execution environment.
[0069] The management program 214 includes computer-readable instructions for executing management-related processes that are handled by the management server 200.
[0070] The management information 208 may be stored in the storage 210 or memory 204. The communication unit 206 sends and receives data to and from the game device 100, the management server 200, etc., via the network 4. The communication unit 206 may be connected to the network 4 by wire or by wireless connection.
[0071] The input unit 216 accepts user input. The input unit 216 includes, for example, a keyboard or mouse.
[0072] (b3: Relay server 300) The hardware configuration example for the relay server 300 is the same as the hardware configuration example for the management server 200 shown in Figure 3, so a detailed explanation will not be repeated.
[0073] The relay program stored in the storage of the relay server 300 may include computer-readable instructions for sending, receiving, and relaying communication data 10.
[0074] [C. Example of software configuration for game device 100] Next, an example of the software configuration of the game device 100 according to this embodiment will be described.
[0075] Figure 4 is a schematic diagram showing an example of the software configuration of a game device 100 according to this embodiment. Referring to Figure 4, the game device 100 includes a program execution environment 130. The execution environment 130 may be realized by one or more processors 102 executing a system program 112.
[0076] In the execution environment 130, the system program 112, including the communication application 114, and the game application 180 can be executed simultaneously. Note that "simultaneous execution" means that multiple applications or programs are executed in parallel, and does not imply any limitation on execution timing.
[0077] The running system program 112 corresponds to the system module 132. The system module 132 provides the basic functions necessary for the game device 100.
[0078] The game execution unit 186 corresponds to the running game application 180. The system module 132 includes a communication execution unit 140. The communication execution unit 140 corresponds to the running communication application 114.
[0079] The system module 132 includes a microphone control unit 144, a camera control unit 146, a communication control unit 148, an image processing unit 150, and an audio processing unit 152.
[0080] The microphone control unit 144 generates audio data 154 from the audio signal output by the microphone 122. The microphone control unit 144 may also mute the microphone 122.
[0081] The camera control unit 146 generates camera image data 156 from the video signal output by the camera 118. The camera control unit 146 may also control the start and stop of image capture by the camera 118, and may also control the image capture conditions of the camera 118 (such as frame rate and white balance).
[0082] The communication control unit 148 issues commands to the communication unit 106 to control data communication with other game devices 100 and the like.
[0083] The image processing unit 150 has access to a storage area 160 for storing image data. The storage area 160 may, for example, utilize a portion of one or more memory 104 or storage 110. The image processing unit 150 may be capable of image processing on one or more image data.
[0084] The memory area 160 may include, for example, an area for storing display image data 162, game image data 182, distribution image data 164, camera image data 156, one or more received distribution image data 166, and one or more received camera image data 168.
[0085] The communication execution unit 140 performs processing to exchange communication data 10 with other game devices 100.
[0086] For example, the communication execution unit 140 may perform the necessary processing to join a designated group in response to user operations. The communication execution unit 140 may store group information 142. The communication execution unit 140 may update the group information 142 periodically or whenever predetermined conditions are met, based on information from the management server 200 or the like. The storage location for the group information 142 may be, for example, a part of one or more memory 104 or storage 110.
[0087] Furthermore, the communication execution unit 140 may transmit the execution status of the game application 180 to the management server 200 or other game devices 100 belonging to the same group using the communication control unit 148. The execution status of the game application 180 may be transmitted when predetermined conditions are met, or it may be transmitted periodically.
[0088] Furthermore, the communication execution unit 140 may transmit the audio data 154 generated by the microphone control unit 144 to another game device 100 using the communication control unit 148. The communication execution unit 140 may also output one or more audio data (received audio data 158) transmitted by the other game device 100 via the communication control unit 148 to the audio processing unit 152.
[0089] Furthermore, the communication execution unit 140 may transmit the camera image data 156 generated by the camera control unit 146 to another game device 100 using the communication control unit 148. The communication execution unit 140 may store the camera image data 156 in the storage area 160 of the image processing unit 150. The communication execution unit 140 may store one or more camera image data (received camera image data 168) transmitted by the other game device 100 in the storage area 160 of the image processing unit 150. The received camera image data 168 may include the camera image data 156 transmitted by its own device.
[0090] Furthermore, the communication execution unit 140 may transmit the distribution image data 164, generated by any method, to another game device 100 using the communication control unit 148. The communication execution unit 140 may store one or more distribution image data (received distribution image data 166) transmitted by the other game device 100 in the storage area 160 of the image processing unit 150. The received distribution image data 166 may include the distribution image data 164 transmitted by its own device.
[0091] In this manner, the communication control unit 148 communicates data with other game devices 100 and management servers 200 that correspond to other accounts belonging to the same group in the communication execution unit 140, in accordance with the communication execution unit 140, and obtains information (for example, communication data 10) from the other game devices 100 that correspond to other accounts belonging to the same group through data communication.
[0092] The distributed image data 164 may be generated based on one or more image data available in the game device 100. For example, if a game application 180 is running in the game device 100, the distributed image data 164 may be generated based on game image data 182 output by the running game application 180 (game execution unit 186). If a menu screen is displayed in the game device 100, the distributed image data 164 may be generated based on the menu screen. In other cases, for example, an image that substantially does not contain video information, such as a black image or a white image (hereinafter also referred to as a "mute image"), may be used as the distributed image data 164. The same applies to the received distributed image data 166 as to the distributed image data 164.
[0093] The image processing unit 150 generates a video signal based on the image data and outputs the generated video signal to the display 120. For example, display image data 162 is used to generate the video signal. The image processing unit 150 may generate the display image data 162 used to generate the video signal using one or more image data stored in the memory area 160. For example, the display image data 162 may be generated by superimposing camera image data 156 or received camera image data 168 onto game image data 182. By generating such display image data 162, the face of the user playing the game application 180 can be displayed along with the image (game image data 182) output by the game execution unit 186.
[0094] The audio processing unit 152 generates an audio signal based on the audio data and outputs the generated audio signal to the speaker 124. For example, the audio processing unit 152 may generate an audio signal by combining the game audio data 184 output by the game execution unit 186 with one or more received audio data 158.
[0095] In the software configuration example shown in Figure 4, at least a portion of the communication application 114 may be an application outside of the system module 132, similar to the game application 180. At least a portion of the game application 180 may be included in the system module 132.
[0096] At least a portion of the game execution by the game application 180 may utilize the execution environment 130 of another game device 100, or it may utilize external resources such as a server.
[0097] [D. Example of processing in the communication execution unit 140] Next, we will describe an example of processing in the communication execution unit 140.
[0098] (d1: Management of group information) The communication execution unit 140 manages group information 142 related to the group to which the account corresponding to its device belongs. An example of processing for managing group information 142 will be described below. Details of group information 142 will be described later.
[0099] Figure 5 is a flowchart illustrating an example of processing for managing group information 142, which is performed by the communication execution unit 140 according to this embodiment. Figure 5 shows examples of processing performed when joining a group (Figure 5(A)), when belonging to a group (Figure 5(B)), and when leaving a group (Figure 5(C)).
[0100] Referring to Figure 5(A), when the communication execution unit 140 receives a request to join any group, it exchanges data with the management server 200 to join the specified group (step S100). If joining the specified group is successful, the communication execution unit 140 generates group information 142 (step S102). The group information 142 may be generated based on information transmitted by the management server 200. The information transmitted by the management server 200 may be based on at least a portion of the management information 208 held by the management server 200. The process for joining the specified group may be account-based.
[0101] Referring to Figure 5(B), when belonging to any group, the communication execution unit 140 exchanges data with the management server 200 (step S110). Based on the data exchanged with the management server 200, the communication execution unit 140 updates the group information 142 (step S112).
[0102] For example, the communication execution unit 140 may send information about its own account (the account corresponding to its own device) to the management server 200. The exchange of data with the management server 200 may be performed, for example, at predetermined intervals.
[0103] Referring to Figure 5(C), when the communication execution unit 140 receives a request to leave the group it belongs to, it exchanges data with the management server 200 to leave the group (step S120). After leaving the group, the communication execution unit 140 deletes the group information 142 (step S122). Note that some or all of the group information 142 may be retained even after leaving the group.
[0104] Figure 6 is a schematic diagram showing an example of group information 142 of a game device 100 according to this embodiment. Referring to Figure 6, the group information 142 includes information about each account belonging to the same group. The group information 142 may also include information about game applications 180 on other game devices 100. Furthermore, the group information 142 may include information about other game devices 100.
[0105] Group information 142 includes, as an example, ID 1421, account 1422, and account name 1423. ID 1421 represents identification information to uniquely identify each account within the group. Account 1422 represents identification information to identify each account. Account name 1423 represents the name assigned to each account.
[0106] The group information 142 may include, as an example of information relating to a game application 180 in another game device 100, a game execution state 1424, running game information 1425, and owned game information 1426.
[0107] The game execution status 1424 indicates the execution status of the game application 180 on the game device 100 corresponding to each account. For example, "1" may mean running and "0" may mean not running. The game execution status 1424 may also be information indicating whether or not any game application 180 is running on each game device 100.
[0108] The running game information 1425 indicates the game application 180 running on the game device 100 corresponding to each account. The running game information 1425 is information that identifies game applications 180 running on other game devices 100. There may be multiple running game applications 180. In that case, the running game information 1425 may include one, some, or all of the running game applications 180.
[0109] The owned game information 1426 indicates the game applications 180 available on each account or their corresponding game device 100, or the game applications 180 owned by each account or their corresponding game device 100. Alternatively, for example, the owned game information 1426 may indicate game applications 180 that have been run on each account or their corresponding game device 100, or combinations of these conditions.
[0110] The group information 142 may include information indicating whether or not imaging by the camera 118 is possible on other game devices 100. For example, the game application 180 can use the information indicating whether or not imaging by the camera 118 is possible on game devices 100 to change the display in the game application 180.
[0111] The group information 142 may or may not include information about the local account (the account corresponding to the local device). The group information 142 does not have to include all of the information shown in Figure 6. For the sake of explanation, Figure 6 shows an example of the group information 142 in table format, but the format in which the information is stored can be anything.
[0112] The game device 100 does not need to constantly store the group information 142; it may query the management server 200 or other server each time. In this case, the game device 100 may temporarily store or cache at least a portion of the information obtained from the management server 200.
[0113] (d2: Sending process for communication data 10) The communication execution unit 140 performs the transmission process of the communication data 10.
[0114] Figure 7 is a flowchart showing an example of the communication data transmission process performed by the communication execution unit 140 according to this embodiment. The process shown in Figure 7 is performed while belonging to any of the groups.
[0115] Referring to Figure 7, the communication execution unit 140 acquires audio data 154 generated from the audio signal collected by the microphone 122 (step S200), and transmits the acquired audio data 154 (step S202). The audio data 154 may have undergone predetermined processing or treatment.
[0116] The communication execution unit 140 acquires camera image data 156 based on the image captured by the camera 118 (step S204) and transmits the acquired camera image data 156 (step S206). The camera image data 156 may include the entire image captured by the camera 118, or it may include only a part of the image. Furthermore, the camera image data 156 is not limited to the above and may have undergone predetermined processing or treatment.
[0117] The communication execution unit 140 acquires the distribution image data 164 (step S208) and transmits the acquired distribution image data 164 (step S210). The distribution image data 164 may have undergone predetermined processing or treatment. The game image data 182 may also be transmitted as the distribution image data 164 to other game devices 100 corresponding to other accounts belonging to the same group.
[0118] The acquisition and transmission cycles of the audio data 154, camera image data 156, and distributed image data 164 do not have to be the same. Furthermore, the order of these acquisition and transmission cycles does not matter. At least a portion of the audio data 154, camera image data 156, and distributed image data 164 may be, for example, data streams conforming to the H.264 (MPEG-4 AVC) standard.
[0119] (d3: Receiving communication data 10) The communication execution unit 140 performs the reception processing of the communication data 10.
[0120] Figure 8 is a flowchart showing an example of the communication data reception process performed by the communication execution unit 140 according to this embodiment. The process shown in Figure 8 is performed while belonging to any of the groups.
[0121] Referring to Figure 8, in this embodiment, when the communication execution unit 140 receives the communication data 10 (YES in step S300), it determines the data type contained in the communication data 10 (step S302). Based on the determination result of the data type, the communication execution unit 140 extracts the data contained in the communication data 10 (step S304).
[0122] The communication execution unit 140 identifies the account that sent the communication data 10 (step S306), associates it with the ID corresponding to the identified account, and stores the extracted data (step S308).
[0123] If the communication data 10 includes distribution image data, the distribution image data contained in the communication data 10 is extracted as the received distribution image data 166. Each of the received distribution image data 166 may be associated with a distribution image ID, which is an example of identification information for identifying the sender account.
[0124] If the communication data 10 includes camera image data, the camera image data contained in the communication data 10 is extracted as received camera image data 168. Each of the received camera image data 168 may be associated with a camera image ID, which is an example of identification information for identifying the sender's account.
[0125] If the communication data 10 includes audio data, the audio data included in the communication data 10 is extracted as the received audio data 158.
[0126] Image and audio data do not need to be associated with identifying information to identify the sending account.
[0127] (d4: Example of interface processing) As described above, the execution environment 130 simultaneously runs the communication application 114 (communication execution unit 140) and the game application 180 (game execution unit 186). Therefore, the execution environment 130 provides an interface for exchanging information between the communication execution unit 140 and the game execution unit 186. More specifically, the communication execution unit 140 can respond with information based on the communication data 10 in response to requests from various applications, including the game application 180.
[0128] The communication execution unit 140 may have an API (Application Programming Interface) for exchanging data with applications. In this case, an application such as a game application 180 requests data from the communication execution unit 140 according to a predefined set of instructions as the API.
[0129] In this way, the execution environment 130, in response to a request from the game execution unit 186 to the communication execution unit 140 via an API, causes the game execution unit 186 to acquire information based on information exchanged with other game devices 100 (for example, communication data 10). The information acquired by the game execution unit 186 may be the information itself acquired from other game devices 100, or it may be information that has been processed or modified in some way.
[0130] Figure 9 is a flowchart illustrating an example of interface processing of the communication execution unit 140 according to this embodiment. Referring to Figure 9, the communication execution unit 140 determines whether or not it has received a request from any application (step S400). If no request has been received from any application (NO in step S400), the processing in step S400 is repeated.
[0131] If a request is received from any application (YES in step S400), the communication execution unit 140 executes processing according to the received request (step S402) and sends the execution result to the requester (step S404). Then, the process from step S400 onward is repeated.
[0132] The processing in response to the request may include, for example, processing to respond with at least a portion of the group information 142, processing to respond with information based on at least a portion of the group information 142, processing to respond with at least a portion of the image data stored in the storage area 160 of the image processing unit 150, processing to respond with information about the image data stored in the storage area 160 of the image processing unit 150, processing to respond with the received audio data 158, and processing to respond with information about the received audio data 158.
[0133] As mentioned above, the group information 142 is updated by the communication execution unit 140. Therefore, as illustrated below, it may be more efficient for the communication execution unit 140 to determine whether or not the group information 142 meets the predetermined conditions.
[0134] Figure 10 is a flowchart illustrating another example of the interface processing of the communication execution unit 140 according to this embodiment. The communication execution unit 140 receives a request to start monitoring and notifies the requester when predetermined conditions are met. The predetermined conditions are, for example, that the group information 142 has been updated.
[0135] Referring to Figure 10, in this embodiment, the communication execution unit 140 determines whether or not it has received a request to start monitoring from the game execution unit 186 (step S500). If it has not received a request to start monitoring from the game execution unit 186 (NO in step S500), the process in step S500 is repeated.
[0136] If the game execution unit 186 requests the start of monitoring (YES in step S500), the communication execution unit 140 sets the game execution unit 186 as the notification destination (step S502).
[0137] The communication execution unit 140 determines whether or not the group information 142 has been updated (step S504). If the group information 142 has not been updated (NO in step S504), the process in step S504 is repeated.
[0138] When the group information 142 is updated (YES in step S504), the communication execution unit 140 notifies the game execution unit 186 that the predetermined conditions have been met (step S506). Then the process ends.
[0139] In the above explanation, an example of a process is shown where the monitoring process ends when a predetermined condition is met once. However, monitoring may be continued (steps S504 and S506) until a request to terminate monitoring is received. Alternatively, monitoring may be continued (steps S504 and S506) until the predetermined condition is met multiple times.
[0140] The predetermined conditions are not limited to updates to the group information 142. For example, they may include changes in the number of accounts belonging to the same group, the start or termination of execution of any application on the game device 100 corresponding to any account belonging to the same group, or any change in information contained in the group information 142. In these cases, after the group information 142 has been updated (YES in S504), the communication execution unit 140 may determine whether the updated content satisfies the predetermined conditions, and only notify the game execution unit 186 if the predetermined conditions are met. The predetermined conditions may also be specified in the received monitoring start request.
[0141] For example, if a predetermined condition is an increase in the number of accounts belonging to a group, the game application 180 can perform a predetermined process based on notification that the predetermined condition has been met, and by displaying a message based on that process, it can inform the user of the game device 100 that a new user has joined the group. The predetermined process may be, for example, a request for data from the communication execution unit 140.
[0142] In the processing example shown in Figure 10 above, the communication execution unit 140 notifies the game execution unit 186 when the group information 142 satisfies predetermined conditions. However, in another processing example, the communication execution unit 140 may continue to notify the game execution unit 186 whether or not the predetermined conditions are met.
[0143] By adopting processing examples like those shown in Figure 10, the degree of flexibility in processing within the application can be increased.
[0144] [E. Example of application processing] Next, as an example of application processing, we will describe some processes in which the game application 180 utilizes information provided by the communication execution unit 140.
[0145] (e1: Game application processing example 1) As an example, we will describe a scenario in which the same game application 180 is played simultaneously on multiple game devices 100. In this case, the game application 180 is an example of a communication game. Furthermore, it is assumed that each user of game devices 100-1 to 100-4 has already joined the same group based on their respective accounts.
[0146] Figure 11 is a sequence diagram showing an example of processing of a game application 180 according to this embodiment. In the example shown in Figure 11, game devices 100-1 to 100-4 exchange data necessary for the execution of the game application 180 (sequence SQ100).
[0147] For example, the game execution unit 186 may include the camera image of a user participating in the communication game in the game image being executed. In this embodiment, since the game execution unit 186 can identify the accounts of users participating in the communication game, it refers to the group information 142 to identify one or more accounts that also belong to the same group. Then, based on the accounts of the other users identified, the game execution unit 186 requests the camera image from the communication execution unit 140 via the API (sequence SQ102).
[0148] The communication execution unit 140 refers to the group information 142 and responds to the game execution unit 186 with the camera image ID value corresponding to the account of the other selected user (sequence SQ104).
[0149] The game execution unit 186 accesses the image processing unit 150 (sequence SQ106) and obtains received camera image data 168 associated with the acquired camera image ID value (sequence SQ108). The game execution unit 186 performs image generation processing, such as superimposing the acquired received camera image data 168 onto the image of the game currently being played (sequence SQ110). The game image data 182 generated by image synthesis is written to the memory area 160 of the image processing unit 150. The processing of sequences SQ106 to SQ110 may be repeated until a predetermined operation to stop the display of the camera image is performed.
[0150] Alternatively, instead of processing sequences SQ106 to SQ110, the game execution unit 186 may request the image processing unit 150 to perform the process of superimposing the received camera image data 168 associated with the acquired camera image ID value onto the game image data 182 to generate display image data 162.
[0151] Furthermore, the communication execution unit 140 may respond with an address of the storage area 160 or the like, instead of the camera image ID.
[0152] Thus, the game execution unit 186 may execute a communication game based on the received camera image data 168, etc., acquired via the communication execution unit 140.
[0153] For the sake of explanation, we will show an example of the process by which the game execution unit 186 acquires one received camera image data 168, but the game execution unit 186 can acquire multiple received camera image data 168 through similar processing.
[0154] For example, the game execution unit 186 may generate game image data 182 using one or more received camera image data 168 corresponding to one or more accounts belonging to the same group. In this case, the game image data 182 may include received camera image data 168 corresponding to accounts that do not belong to the game group.
[0155] Alternatively, game image data 182 may be generated using one or more received camera image data 168 corresponding to one or more accounts belonging to the current game group among accounts belonging to the same group. In this case, received camera image data 168 corresponding to accounts belonging to the same group but not belonging to the current game group may be restricted from being acquired by the communication execution unit 140, may not be acquired at all, or may be acquired and then discarded.
[0156] Furthermore, the game execution unit 186 may acquire corresponding received camera image data 168 in response to explicit user input. For example, if a user of game device 100-1 wants to see the face of another user playing simultaneously, and performs a predetermined operation including selecting another user, the game execution unit 186 may request a camera image corresponding to that selection from the communication execution unit 140.
[0157] Figure 11 shows an example of the process when the game execution unit 186 acquires a camera image, but it is also possible to acquire game images, audio, text, and other information.
[0158] Furthermore, the above explanation described the case where the same game application 180 is being executed simultaneously on multiple game devices 100. However, the game execution unit 186 may also acquire camera images from other game devices 100 running a different game application 180 from the same series, or from other game devices 100 running a predetermined game application 180 that is different from the game application 180.
[0159] At this time, in response to a request for camera images from the game execution unit 186, the communication execution unit 140 may cause the game execution unit 186 to acquire camera images that it can acquire. For example, based on the running game information 1425 of the group information 142, the communication execution unit 140 may identify other game devices 100 that are running the same or related game application 180 as the game application 180 currently running on the game device 100, and cause the game execution unit 186 to acquire camera images received from the identified game device 100. For example, the information identifying the game application 180 included in the running game information 1425 is an identifier (ID), and the system may verify whether the IDs are the same or related, and based on the verification result, identify other game devices 100 that are running the same or related game application 180. "Related ID" may be, for example, one or more IDs set in advance, or an ID based on a predetermined rule such as "the same ID except for the last character". Furthermore, the "related ID" may be held by the game application 180 on the game device 100, by the server, or by another game device 100.
[0160] Thus, the communication execution unit 140 may cause the game execution unit 186 to acquire a camera image based on information identifying the game application 180 currently running on the game device 100 and game information 1425 of other game devices 100.
[0161] Figure 12 is a schematic diagram showing an example of game image data output by a game execution unit 186 according to this embodiment. Figure 12(A) shows an example of game image data 182 when two users are playing simultaneously. Figure 12(B) shows an example in which received camera image data 168 capturing each user is superimposed on the game image data 182 shown in Figure 12(A).
[0162] (e2: Game application processing example 2) The game execution unit 186 may request group information 142 from the communication execution unit 140. As described above, the game execution unit 186 may request the communication execution unit 140 to obtain group information 142 in accordance with a predefined command system as an API. The game execution unit 186 may generate an arbitrary user interface screen based on the obtained group information 142.
[0163] Figure 13 is a schematic diagram showing an example screen generated by the game execution unit 186 according to this embodiment. Referring to Figure 13, the user interface screen 500 may include information indicating the current status of one or more accounts belonging to the group.
[0164] More specifically, the user interface screen 500 includes a table 502. Table 502 includes, for example, an account name 504, a status 506, and owned game information 508. The account name 504 is displayed based on the account name 1423 in the group information 142. The status 506 is displayed based on the game execution status 1424 and running game information 1425 in the group information 142. The owned game information 508 is displayed based on the owned game information 1426 in the group information 142.
[0165] Thus, the application may perform display processing based on the owned game information 508 obtained from the communication execution unit 140.
[0166] (e3: Game application processing example 3) After requesting the communication execution unit 140 to start monitoring, the game execution unit 186 may, upon receiving a predetermined judgment result (for example, "1" indicating that the number of accounts has changed), request the communication execution unit 140 to acquire group information 142.
[0167] Thus, when the predetermined judgment result from the communication execution unit 140 satisfies predetermined conditions, the game execution unit 186 may newly request the communication execution unit 140 to acquire group information 142, etc.
[0168] (e4: Game application processing example 4) The game execution unit 186 may provide various user interface screens based on the group information 142 obtained from the communication execution unit 140.
[0169] For example, when a user of an account belonging to a certain group is playing a game, a user interface screen may be provided for other users to play the game together. That is, the game execution unit 186 may generate an interface screen for other accounts belonging to the same group to join the same game group, based on group information 142, etc.
[0170] Figure 14 is a schematic diagram showing another example screen generated by a game execution unit according to this embodiment. Figure 14 shows, for example, a user interface screen 510 that is displayed when the game application 180 "G1" is running.
[0171] Referring to Figure 14, the user interface screen 510 may be displayed while the game application 180 is running.
[0172] The user interface screen 510 includes a table 512. Table 512 includes, for example, an account name 514, a status 516, and an action 518. The accounts included in table 512 may be displayed preferentially if they are currently running or can run "G1". For example, the account "CCC" is running "G1", and the account "DDD" owns "G1".
[0173] Action 518 may display an object for performing an action corresponding to the account. For example, the "Play Together" object may be displayed for the "CCC" account. When "Play Together" is selected, a message or other prompt for simultaneous play may be displayed on the game device 100 where the game is being played. Alternatively, the "Invite to Game" object may be displayed for the "DDD" account. When "Invite to Game" is selected, a message or other prompt to invite "G1" to play may be displayed on the corresponding game device 100.
[0174] Thus, the application may provide a user interface screen based on the owned game information 508 obtained from the communication execution unit 140.
[0175] In the user interface screen 510 shown in Figure 14, accounts that are currently running or can run the same game application among other accounts belonging to the same group are displayed. However, only accounts currently running the same game application may be displayed, or other accounts belonging to the same group may be displayed, with priority or emphasis given to accounts currently running the same game application.
[0176] Furthermore, a user interface screen for inviting players to the game may be provided. This user interface screen may display other accounts belonging to the same group that are running the same game application but are not currently running it. In this embodiment, when any account is selected, a message such as "Do you want to play with this person?" is displayed, and if "Yes" is selected, a process is executed to start a communication game with the game device 100 corresponding to the selected account.
[0177] Furthermore, in situations such as "joining a match room," one or more rooms (game groups) to which any account belonging to the same group belongs may be displayed in a list.
[0178] Furthermore, when the "Start Game Session" button is selected in any of the game applications 180, an invitation message or the like may be displayed on other game devices 100 corresponding to other accounts belonging to the same group. In this case, the "Start Game Session" button effectively also functions as an invitation button.
[0179] (e5: Game application processing example 5) The game execution unit 186 may execute a communication game based on the group information 142 obtained from the communication execution unit 140. More specifically, the game execution unit 186 may determine or assist in determining which accounts will participate in the communication game. In other words, the game execution unit 186 may perform matching for the communication game based on the information obtained from the communication execution unit 140.
[0180] Figure 15 is a flowchart showing an example of processing by the game execution unit 186 according to this embodiment. Figure 15 shows an example of processing to obtain the accounts of users who will play the game application 180 together.
[0181] Referring to Figure 15, in response to a predetermined user operation, the game execution unit 186 requests the communication execution unit 140 to acquire group information 142 (step S700). The game execution unit 186 acquires the group information 142 from the communication execution unit 140 (step S702) and also acquires the identification information of accounts playing the same game application 180 from the server (step S704). The server from which the identification information of accounts playing the same game application 180 is acquired may be the management server 200 or a server other than the management server 200.
[0182] The game execution unit 186 determines the identification information of one or more accounts that satisfy predetermined conditions based on the identification information of other accounts belonging to the same group included in the group information 142 (for example, account 1422 and account name 1423 shown in Figure 6), and the identification information of accounts obtained from the server (step S706).
[0183] The game application 180, which is a communication game, is played among multiple accounts, including the user's own account, as determined above.
[0184] Note that the processing in step S704 may be omitted. In this case, in step S706, it may be determined whether or not predetermined conditions are met based on the acquired group information 142. Alternatively, the processing in step S706 may be performed on the server. In this case, the group information is sent to the server in step S702.
[0185] Examples of predetermined conditions in step S706 include the following: For example, other accounts belonging to the same group that are running the same game application can be designated as allies. This type of matching allows players to communicate with each other while playing online games.
[0186] Alternatively, other accounts belonging to the same group that are running the same game application may be designated as opponents. This type of matchmaking ensures that players will enjoy the competitive aspect of the game.
[0187] Alternatively, other accounts belonging to the same group that are running the same game application may be excluded from being selected as allies. By performing this type of matchmaking, accounts that do not belong to the same group will be selected as allies, thus suppressing teaming and other similar activities.
[0188] In this way, the game execution unit 186 executes a communication game with other game devices 100 corresponding to accounts that meet predetermined conditions, based on the identification information of other accounts belonging to the same group.
[0189] (e6: Modification) The application processing described above is just one example, and the way the information provided by the communication execution unit 140 is used may vary. Furthermore, any combination of the processing examples described above may be used. Moreover, any combination of the processing examples described above may be combined with yet another arbitrary processing step.
[0190] Requests from applications such as the game application 180 to the communication execution unit 140 may follow any command system.
[0191] [F. Camera Image Limitations] From the perspective of privacy and the protection of minors, the communication execution unit 140 may restrict the use of the camera 118. Note that this restriction of use is different from temporarily muting the camera image. For example, it refers to cases where a password is required or parental permission is needed to use the camera 118. In such cases, the communication execution unit 140 may not include the camera image data 156 in the communication data 10, or it may include a muted image in place of the camera image data 156 in the communication data 10. Furthermore, the communication execution unit 140 may also restrict the use of camera image data (received camera image data 168) transmitted from other game devices 100.
[0192] When the use of camera image data transmitted from another game device 100 is restricted in the communication execution unit 140, the game execution unit 186 may restrict the use of the received camera image data 168. For example, it may choose not to use the received camera image data 168.
[0193] If the use of camera images is restricted in the communication execution unit 140, the communication execution unit 140 may not be able to acquire camera image data (received camera image data 168) from other game devices 100. Alternatively, when the communication execution unit 140 receives communication data 10 containing camera image data, it may discard it without processing. Alternatively, when the communication execution unit 140 receives communication data 10 containing camera image data, it may store the camera image data contained in the communication data 10 in the storage area 160 in a form that cannot be used by the game device 100. Furthermore, the communication execution unit 140 may store the camera image data contained in the communication data 10 as received camera image data 168 in the storage area 160 and then restrict the game execution unit 186 from using the received camera image data 168.
[0194] The game execution unit 186 may respond to a request from the game execution unit 186 based on information indicating whether or not there are restrictions on the use of the camera 118 in the communication execution unit 140 (hereinafter also referred to as the "camera usage restriction flag").
[0195] For example, when the communication execution unit 140 receives a request for a camera image from the game execution unit 186, it refers to the camera usage restriction flag. If the camera usage restriction flag indicates that the use of camera 118 is restricted, the communication execution unit 140 does not respond with a camera image ID value. Alternatively, the communication execution unit 140 may respond that the game execution unit 186 cannot obtain the camera image ID value. In this case, the communication execution unit 140 may inform the game execution unit 186 that the reason is the state of the camera usage restriction flag.
[0196] Alternatively, the game execution unit 186 may check whether camera use is restricted in the communication execution unit 140 prior to requesting the acquisition of the received camera image data 168. For example, the game execution unit 186 may acquire a camera use restriction flag from the communication execution unit 140. Depending on the acquired camera use restriction flag, the game execution unit 186 may generate or read an image such as "Camera images cannot be used because camera use is restricted" and display it on the display 120 without requesting the received camera image data 168 from the communication execution unit 140.
[0197] The information that the communication execution unit 140 responds to the game execution unit 186 may include, for example, whether or not it has stored camera image data from another game device 100, and whether or not the use of camera 118 is restricted.
[0198] [G. Audio Data] The communication execution unit 140 may respond to a request from the game execution unit 186 by sending audio data (received audio data 158) transmitted by another game device 100 to the game execution unit 186.
[0199] Alternatively, the communication execution unit 140 may respond with the location (such as an address) of the received voice data 158, which is temporarily stored in the voice processing unit 152.
[0200] In this manner, the game execution unit 186 can acquire the received audio data 158.
[0201] The communication execution unit 140 may respond not with the received audio data 158 itself, but with the total volume of all accounts belonging to the group. The communication execution unit 140 can combine the audio data 154 and each of the received audio data 158 to calculate the total volume. Such a total volume may be used, for example, to estimate the level of excitement within the group.
[0202] Furthermore, the communication execution unit 140 may respond to the game execution unit 186 with information indicating which of the accounts belonging to the group is speaking.
[0203] Furthermore, the communication execution unit 140 may perform speech recognition on the voice data 154 or either of the received voice data 158 to notify that a specific word has been spoken, or to respond with the content of what has been spoken.
[0204] [H. Variant] In the above explanation, a game application 180 was given as an example of an application that utilizes the information provided by the communication execution unit 140, but it is applicable to any application, not just games.
[0205] In the above explanation, for example, when the game execution unit 186 requests some information from the communication execution unit 140, the game execution unit 186, which is the source of the request, is instructed to obtain the target information. However, the information requested may be obtained by a party other than the game execution unit 186. In other words, the communication execution unit 140 may send or notify a party other than the source of a request of any request.
[0206] The embodiments disclosed herein should be considered in all respects to be illustrative and not restrictive. The scope of the present invention is indicated by the claims rather than by the foregoing description, and all modifications within the meaning and scope equivalent to the claims are intended to be included. [Explanation of Symbols]
[0207] 1 System, 4 Network, 10 Communication Data, 100 Game Device, 102,202 Processor, 104,204 Memory, 106,206 Communication Unit, 108 Camera Interface, 110,210 Storage, 112,212 System Program, 114 Communication Application, 116,216 Input Unit, 118 Camera, 120 Display, 122 Microphone, 124 Speaker, 130 Execution Environment, 132 System Module, 140 Communication Execution Unit, 142 Group Information, 144 Microphone Control Unit, 146 Camera Control Unit, 148 Communication Control Unit, 150 Image Processing Unit, 152 Audio Processing Unit, 154 Audio Data, 156 Camera Image Data, 158 Received Audio Data, 160 Storage Area, 162 Display Image Data, 164 Distribution Image Data, 166 Received Distribution Image Data, 168 Received Camera Image Data, 180 Game application, 182 game image data, 184 game audio data, 186 game execution unit, 200 management server, 208 management information, 214 management program, 300 relay server, 500, 510 user interface screen, 502, 512 tables, 504, 514, 1423 account name, 506, 516 status, 508, 1426 owned game information, 518 action, 1421 ID, 1422 account, 1424 game execution status, 1425 running game information.
Claims
1. It is a game device, An execution means capable of simultaneously running a communication application and a game application, It includes communication control means for controlling data communication with other game devices, The aforementioned communication control means is In response to the execution of the communication application by the execution means, data communication is performed with other game devices corresponding to other accounts belonging to the same group in the communication application. Through the said data communication, first information is obtained from the other game device corresponding to the other account belonging to the same group, The execution means, in response to a request made by the running game application to the running communication application via an API (Application Programming Interface), causes the running game application to acquire second information based on the first information. The second information includes information relating to a game application in the other game device, and is a game device.
2. The game device according to claim 1, wherein the information relating to the game application includes information identifying a game application currently running on the other game device.
3. It is a game device, An execution means capable of simultaneously running a communication application and a game application, It includes communication control means for controlling data communication with other game devices, The aforementioned communication control means is In response to the execution of the communication application by the execution means, data communication is performed with other game devices corresponding to other accounts belonging to the same group in the communication application. Through the said data communication, first information is obtained from the other game device corresponding to the other account belonging to the same group, The execution means, in response to a request made by the running game application to the running communication application via an API (Application Programming Interface), causes the running game application to acquire second information based on the first information. The request includes causing the running communication application to cause the running game application to acquire the second information when a predetermined condition is met, The aforementioned predetermined condition is a condition that is met when the number of accounts belonging to the same group changes, in this game device.
4. It is a game device, An execution means capable of simultaneously running a communication application and a game application, It includes communication control means for controlling data communication with other game devices, The aforementioned communication control means is In response to the execution of the communication application by the execution means, data communication is performed with other game devices corresponding to other accounts belonging to the same group in the communication application. Through the said data communication, first information is obtained from the other game device corresponding to the other account belonging to the same group, The aforementioned execution means is In response to a request made by the running game application to the running communication application via an API (Application Programming Interface), the running game application is made to obtain second information based on the first information. A game device that, when the second information satisfies predetermined conditions, causes the running game application to acquire third information based on the first information in response to a request via an API different from the aforementioned request.
5. The game device according to claim 4, wherein the predetermined condition is a condition that is satisfied when the number of accounts belonging to the same group changes.
6. It is a game device, An execution means capable of simultaneously running a communication application and a game application, It includes communication control means for controlling data communication with other game devices, The aforementioned communication control means is In response to the execution of the communication application by the execution means, data communication is performed with other game devices corresponding to other accounts belonging to the same group in the communication application. Through the said data communication, first information is obtained from the other game device corresponding to the other account belonging to the same group, The aforementioned execution means is In response to a request made by the running game application to the running communication application via an API (Application Programming Interface), the running game application is made to obtain second information based on the first information. The second information includes identification information of other accounts belonging to the same group. The aforementioned running game application is a game device that, based on the identification information, communicates with other game devices corresponding to accounts that meet predetermined conditions and executes a game.
7. It is a game device, An execution means capable of simultaneously running a communication application and a game application, It includes communication control means for controlling data communication with other game devices, The aforementioned communication control means is In response to the execution of the communication application by the execution means, data communication is performed with other game devices corresponding to other accounts belonging to the same group in the communication application. Through the said data communication, first information is obtained from the other game device corresponding to the other account belonging to the same group, The aforementioned execution means is In response to a request made by the running game application to the running communication application via an API (Application Programming Interface), the running game application is made to obtain second information based on the first information. The second information includes identification information of other accounts belonging to the same group. The running game application is a game device that generates an interface screen based on the second information to allow other accounts belonging to the same group to join the same game group.
8. It is a game device, An execution means capable of simultaneously running a communication application and a game application, It includes communication control means for controlling data communication with other game devices, The aforementioned communication control means is In response to the execution of the communication application by the execution means, data communication is performed with other game devices corresponding to other accounts belonging to the same group in the communication application. Through the said data communication, first information is obtained from the other game device corresponding to the other account belonging to the same group, The aforementioned execution means is In response to a request made by the running game application to the running communication application via an API (Application Programming Interface), the running game application is made to obtain second information based on the first information. The running game application executes a communication game based on the second information. The aforementioned second information includes camera image data transmitted from another game device, The running game application acquires the transmitted camera image data corresponding to another account that belongs to the same group and also belongs to the game group. The running communication application is a game device that transmits game images using the transmitted camera image data, output by the running game application, to other game devices corresponding to other accounts belonging to the same group.
9. Within the same group, it is possible to send and receive camera image data captured by the camera. The game device according to any one of claims 1 to 8, wherein the first information includes camera image data transmitted from another game device.
10. The game device according to claim 9, wherein the second information includes the transmitted camera image data.
11. The game device according to claim 10, wherein when the use of the transmitted camera image data by the communication application is restricted, the running game application does not use the camera image data included in the second information.
12. Within the same group, it is possible to send and receive audio data acquired by a microphone. The game device according to claim 9, wherein the first information includes audio data transmitted from another game device.
13. The game device according to claim 12, wherein the second information includes the transmitted audio data.
14. A program that runs on one or more processors, The steps include running a communication application and a game application simultaneously, The steps include: performing data communication with other game devices corresponding to other accounts belonging to the same group in the communication application in response to the execution of the aforementioned communication application; The steps include obtaining first information from the other game device corresponding to the other account belonging to the same group through the data communication, The process involves causing the running game application to obtain second information based on the first information in response to a request made by the running game application to the running communication application via an API, The second information is a program that includes information about a game application on the other game device.
15. The program according to claim 14, wherein the information relating to the game application includes information identifying a game application currently running on the other game device.
16. A program that runs on one or more processors, The steps include running a communication application and a game application simultaneously, The steps include: performing data communication with other game devices corresponding to other accounts belonging to the same group in the communication application in response to the execution of the aforementioned communication application; The steps include obtaining first information from the other game device corresponding to the other account belonging to the same group through the data communication, The process involves causing the running game application to obtain second information based on the first information in response to a request made by the running game application to the running communication application via an API, The request includes causing the running communication application to cause the running game application to acquire the second information when a predetermined condition is met, A program in which the aforementioned predetermined condition is a condition that is met when the number of accounts belonging to the same group changes.
17. A program that runs on one or more processors, The steps include running a communication application and a game application simultaneously, The steps include: performing data communication with other game devices corresponding to other accounts belonging to the same group in the communication application in response to the execution of the aforementioned communication application; The steps include obtaining first information from the other game device corresponding to the other account belonging to the same group through the data communication, The steps include: causing the running game application to obtain second information based on the first information in response to a request made by the running game application to the running communication application via API; A program that, when the second information satisfies predetermined conditions, causes the running game application to obtain a third information based on the first information in response to a request via an API different from the first request.
18. The program according to claim 17, wherein the predetermined condition is a condition that is satisfied when the number of accounts belonging to the same group changes.
19. A program that runs on one or more processors, The steps include running a communication application and a game application simultaneously, The steps include: performing data communication with other game devices corresponding to other accounts belonging to the same group in the communication application in response to the execution of the aforementioned communication application; The steps include obtaining first information from the other game device corresponding to the other account belonging to the same group through the data communication, The process involves causing the running game application to obtain second information based on the first information in response to a request made by the running game application to the running communication application via an API, The second information includes identification information of other accounts belonging to the same group. The aforementioned running game application is a program that, based on the identification information, communicates with other game devices corresponding to accounts that meet predetermined conditions and executes a game.
20. A program that runs on one or more processors, The steps include running a communication application and a game application simultaneously, The steps include: performing data communication with other game devices corresponding to other accounts belonging to the same group in the communication application in response to the execution of the aforementioned communication application; The steps include obtaining first information from the other game device corresponding to the other account belonging to the same group through the data communication, The process involves causing the running game application to obtain second information based on the first information in response to a request made by the running game application to the running communication application via an API, The second information includes identification information of other accounts belonging to the same group. The running game application is a program that generates an interface screen based on the second information to allow other accounts belonging to the same group to join the same game group.
21. A program that runs on one or more processors, The steps include running a communication application and a game application simultaneously, The steps include: performing data communication with other game devices corresponding to other accounts belonging to the same group in the communication application in response to the execution of the aforementioned communication application; The steps include obtaining first information from the other game device corresponding to the other account belonging to the same group through the data communication, The process involves causing the running game application to obtain second information based on the first information in response to a request made by the running game application to the running communication application via an API, The running game application executes a communication game based on the second information. The aforementioned second information includes camera image data transmitted from another game device, The running game application acquires the transmitted camera image data corresponding to another account that belongs to the same group and also belongs to the game group. The running communication application is a program that transmits game images using the transmitted camera image data output by the running game application to other game devices corresponding to other accounts belonging to the same group.
22. In the same group, it is possible to send and receive camera image data captured by the camera, The program according to any one of claims 14 to 21, wherein the first information includes camera image data transmitted from another game device.
23. The program according to claim 22, wherein the second information includes the transmitted camera image data.
24. The program according to claim 23, wherein when the use of the transmitted camera image data in the communication application is restricted, the running game application does not use the camera image data included in the second information.
25. In the same group, it is possible to send and receive audio data acquired by the microphone, The program according to claim 22, wherein the first information includes audio data transmitted from another game device.
26. The program according to claim 25, wherein the second information includes the transmitted audio data.
27. A method performed in a game device, The steps include running a communication application and a game application simultaneously, The steps include: performing data communication with other game devices corresponding to other accounts belonging to the same group in the communication application in response to the execution of the aforementioned communication application; The steps include obtaining first information from the other game device corresponding to the other account belonging to the same group through the data communication, The process includes the step of causing the running game application to obtain second information based on the first information in response to a request made by the running game application to the running communication application via an API, The method wherein the second information includes information relating to a game application in the other game device.
28. The method according to claim 27, wherein the information relating to the game application includes information identifying a game application running on the other game device.
29. A method performed in a game device, The steps include running a communication application and a game application simultaneously, The steps include: performing data communication with other game devices corresponding to other accounts belonging to the same group in the communication application in response to the execution of the aforementioned communication application; The steps include obtaining first information from the other game device corresponding to the other account belonging to the same group through the data communication, The process includes the step of causing the running game application to obtain second information based on the first information in response to a request made by the running game application to the running communication application via an API, The request includes causing the running communication application to cause the running game application to acquire the second information when a predetermined condition is met, A method wherein the predetermined condition is a condition that is met when the number of accounts belonging to the same group changes.
30. A method performed in a game device, The steps include running a communication application and a game application simultaneously, The steps include: performing data communication with other game devices corresponding to other accounts belonging to the same group in the communication application in response to the execution of the aforementioned communication application; The steps include obtaining first information from the other game device corresponding to the other account belonging to the same group through the data communication, The steps include: causing the running game application to obtain second information based on the first information in response to a request made by the running game application to the running communication application via API; A method comprising the step of causing the running game application to obtain third information based on the first information in response to a request via an API different from the first request, when the second information satisfies predetermined conditions.
31. The method according to claim 30, wherein the predetermined condition is a condition that is satisfied when the number of accounts belonging to the same group changes.
32. A method performed in a game device, The steps include running a communication application and a game application simultaneously, The steps include: performing data communication with other game devices corresponding to other accounts belonging to the same group in the communication application in response to the execution of the aforementioned communication application; The steps include obtaining first information from the other game device corresponding to the other account belonging to the same group through the data communication, The process includes the step of causing the running game application to obtain second information based on the first information in response to a request made by the running game application to the running communication application via an API, The second information includes identification information of other accounts belonging to the same group. A method for a running game application to communicate with another game device corresponding to an account that meets predetermined conditions, based on the identification information.
33. A method performed in a game device, The steps include running a communication application and a game application simultaneously, The steps include: performing data communication with other game devices corresponding to other accounts belonging to the same group in the communication application in response to the execution of the aforementioned communication application; The steps include obtaining first information from the other game device corresponding to the other account belonging to the same group through the data communication, The process includes the step of causing the running game application to obtain second information based on the first information in response to a request made by the running game application to the running communication application via an API, The second information includes identification information of other accounts belonging to the same group. A method for a running game application to generate an interface screen based on the second information to allow other accounts belonging to the same group to join the same game group.
34. A method performed in a game device, The steps include running a communication application and a game application simultaneously, The steps include: performing data communication with other game devices corresponding to other accounts belonging to the same group in the communication application in response to the execution of the aforementioned communication application; The steps include obtaining first information from the other game device corresponding to the other account belonging to the same group through the data communication, The process includes the step of causing the running game application to obtain second information based on the first information in response to a request made by the running game application to the running communication application via an API, The running game application executes a communication game based on the second information. The aforementioned second information includes camera image data transmitted from another game device, The running game application acquires the transmitted camera image data corresponding to another account that belongs to the same group and also belongs to the game group. A method for transmitting a game image using the transmitted camera image data output by the running game application to another game device corresponding to another account belonging to the same group.
35. In the same group, it is possible to send and receive camera image data captured by the camera, The method according to any one of claims 28 to 34, wherein the first information includes camera image data transmitted from another game device.
36. The method according to claim 35, wherein the second information includes the transmitted camera image data.
37. The method according to claim 36, wherein when the use of the transmitted camera image data in the communication application is restricted, the running game application does not use the camera image data included in the second information.
38. In the same group, it is possible to send and receive audio data acquired by the microphone, The method according to claim 35, wherein the first information includes audio data transmitted from another game device.
39. The method according to claim 38, wherein the second information includes the transmitted audio data.