Game device, method, and program

The integration of communication and game applications in game devices facilitates enhanced data sharing and interactive gameplay, improving entertainment value by allowing real-time user content exchange and group interaction.

JP2026028585AActive Publication Date: 2026-02-20NINTENDO CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2024131116
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-07
Publication Date
2026-02-20
Estimated Expiration
2044-08-07

AI Technical Summary

Technical Problem

There is a need to enhance the entertainment value of online communication games by integrating enhanced data communication between game devices to facilitate more engaging and interactive gameplay experiences.

Method used

A game device and method that allows simultaneous execution of a communication application and a game application, enabling data communication between game devices within the same group, sharing camera image data, audio data, and game application information, with controlled data transmission based on predetermined conditions.

Benefits of technology

Enhances gameplay interest by allowing real-time sharing of user-generated content and game information among group members, promoting interactive communication and improved user engagement.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026028585000001_ABST
    Figure 2026028585000001_ABST
Patent Text Reader

Abstract

There is room for improvement in amusement of a game or communication.SOLUTION: The game apparatus includes execution means capable of simultaneously executing a communication application and a game application, and communication control means for controlling data communication with another game apparatus. The communication control means performs, in accordance with the execution of the communication application by the execution means, data communication with another game apparatus corresponding to another account belonging to the same group in the communication application, and acquires first information from another game apparatus corresponding to another account belonging to the same group through the data communication, and the execution means causes the game application that is being executed to acquire second information based on the first information in accordance with a request made by the game application that is being executed to the communication application that is being executed via an API (ApplicationProgrammingInterface).SELECTED DRAWING: Figure 11
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a game device, a method, and a program. [Background technology]

[0002] BACKGROUND ART Online communication that allows communication to be carried out online using images and voices is well known (for example, Japanese Patent Application Laid-Open No. 2005-157586 (Patent Document 1)). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2005-157586 Summary of the Invention [Problem to be solved by the invention]

[0004] There is room for improvement in the entertainment value of games through online communication. [Means for solving the problem]

[0005] (Configuration 1) A game device according to one embodiment includes an execution means capable of simultaneously executing a communication application and a game application, and a communication control means for controlling data communication with other game devices. In response to execution of the communication application by the execution means, the communication control means performs data communication between game devices corresponding to other accounts belonging to the same group in the communication application, and acquires first information from the other game devices corresponding to other accounts belonging to the same group through the data communication. In response to a request from the running game application to the running communication application via an API (Application Programming Interface), the execution means causes the running game application to acquire second information based on the first information.

[0006] According to the first aspect, the running game application can use the second information to increase the interest of the game.

[0007] (Configuration 2) In configuration 1, camera image data captured by a camera may be transmitted and received within the same group. The first information may include camera image data transmitted from another game device. According to configuration 2, the currently running game application can use second information based on camera image data of a user of another account belonging to the same group.

[0008] (Configuration 3) In configuration 2, the second information may include the transmitted camera image data. According to configuration 3, the running game application can use the camera image data of users of other accounts who belong to the same group.

[0009] (Configuration 4) In configuration 3, when the use of the transmitted camera image data in the communication application is restricted, the running game application does not need to use the camera image data included in the second information. According to configuration 4, when the use of the camera image data in the running communication application is restricted, the restriction can be inherited by the running game application.

[0010] (Configuration 5) In any of configurations 1 to 4, the second information may include information about game applications on other game devices. According to configuration 5, the running game application can, for example, execute processing that utilizes information about game applications on other game devices.

[0011] (Configuration 6) In configuration 5, the information related to the game application may include information identifying the game application currently running on the other game device. According to configuration 6, the currently running game application can, for example, perform processing using information identifying the game application currently running on the other game device.

[0012] (Configuration 7) In any of configurations 1 to 6, audio data captured by a microphone may be transmitted and received within the same group. The first information may include audio data transmitted by another game device. According to configuration 7, a running game application can use audio data of users of other accounts belonging to the same group.

[0013] (Configuration 8) In any of configurations 1 to 7, the request may include causing the running communication application to enter a state that causes the running game application to acquire the second information when a predetermined condition is satisfied. According to configuration 8, the running communication application determines whether the predetermined condition is satisfied, and when the predetermined condition is satisfied, the running game application can acquire the second information. Therefore, the running game application does not need to determine whether the predetermined condition is satisfied, and can acquire the second information when the predetermined condition is satisfied.

[0014] (Configuration 9) In configuration 8, the predetermined condition may be a condition that is satisfied when the number of accounts belonging to the same group changes. According to configuration 9, the running application can detect a change in the number of accounts belonging to the group. For example, when the number of accounts changes, the running game application can execute processing in response to the change.

[0015] (Configuration 10) In any of configurations 1 to 9, the execution means may cause the running game application to acquire third information based on the first information in response to a request via an API different from the request when the second information satisfies a predetermined condition. According to configuration 10, the running communication application can request the third information when the acquired second information satisfies the predetermined condition. This makes it possible to acquire the third information at an appropriate time, such as when predetermined information included in the first information on which the third information is based is updated.

[0016] (Configuration 11) In configuration 10, the predetermined condition may be a condition that is satisfied when the number of accounts belonging to the same group changes. According to configuration 11, when the number of accounts changes, the running game application can, for example, execute processing in response to the change.

[0017] (Configuration 12) In any of configurations 1 to 11, the running game application may execute a communication game based on the second information. According to configuration 12, the second information based on the first information shared in the group to which the user belongs can be used to execute a communication game that takes into account accounts belonging to the same group.

[0018] (Configuration 13) In configuration 12, the second information may include identification information of other accounts belonging to the same group. The running game application may execute a communication game with other game devices corresponding to accounts that satisfy predetermined conditions based on the identification information. According to configuration 13, the running game application can execute a communication game with game terminals in the same group on which the same game application is executed, for example.

[0019] (Configuration 14) In any of configurations 1 to 13, the second information may include identification information of other accounts belonging to the same group. The running game application may generate an interface screen for inviting the other accounts belonging to the same group to join the same game group, based on the second information. According to configuration 14, the user can more easily determine the accounts to join the same game group.

[0020] (Configuration 15) In configuration 12, the second information may include camera image data transmitted from another game device. According to configuration 15, the running game application can output, for example, a game image using the camera image data.

[0021] (Configuration 16) In configuration 15, the running game application may acquire transmitted camera image data corresponding to another account that belongs to the same group and also belongs to the game group. The running communication application may transmit game images output by the running game application using the transmitted camera image data to another game device corresponding to an account that belongs to the same group. According to configuration 16, communication can be promoted by distributing game images using camera images of users of accounts that belong to the same group to users of accounts that belong to the same group.

[0022] (Configuration 17) In any of configurations 1 to 15, the running communication application may transmit image data output by the running game application to other game devices corresponding to other accounts belonging to the same group. According to configuration 17, communication can be promoted by distributing images from a game application that has acquired group information about the group to which the user belongs to, to users of other accounts belonging to the same group.

[0023] (Configuration 18) According to another embodiment, there is provided a method executed on a game device, the method including the steps of simultaneously executing a communication application and a game application, performing data communication between game devices corresponding to accounts belonging to the same group in the communication application in response to the execution of the communication application, obtaining first information from other game devices corresponding to other accounts belonging to the same group through the data communication, and causing the running game application to obtain second information based on the first information in response to a request from the running game application to the running communication application via an API.

[0024] (Configuration 19) A program according to yet another embodiment causes one or more processors to execute the steps of simultaneously executing a communication application and a game application; controlling data communication between game devices corresponding to accounts belonging to the same group in the communication application in accordance with the execution of the communication application; acquiring first information from other game devices corresponding to other accounts belonging to the same group through the data communication; and causing the running game application to acquire second information based on the first information in accordance with a request from the running game application to the running communication application via an API. [Brief explanation of the drawings]

[0025] [Figure 1] FIG. 1 is a schematic diagram showing an example of the configuration of a system according to an embodiment of the present invention. [Figure 2] FIG. 1 is a schematic diagram showing an example of a hardware configuration of a game device according to an embodiment of the present invention. [Figure 3] FIG. 2 is a schematic diagram illustrating an example of a hardware configuration of a management server according to the present embodiment. [Figure 4] FIG. 2 is a schematic diagram showing an example of a software configuration of a game device according to the present embodiment. [Figure 5] 10 is a flowchart showing an example of a process for managing group information executed by a communication executing unit according to the present embodiment. [Figure 6] FIG. 10 is a schematic diagram showing an example of group information of the game device according to the present embodiment. [Figure 7] 10 is a flowchart showing an example of a process of transmitting communication data executed by a communication executing unit according to the present embodiment. [Figure 8] 10 is a flowchart showing an example of a process of receiving communication data executed by a communication executing unit according to the present embodiment. [Figure 9]10 is a flowchart showing an example of processing by an interface of a communication executing unit according to the present embodiment. [Figure 10] 10 is a flowchart showing another example of processing by the interface of the communication executing unit according to the present embodiment. [Figure 11] FIG. 10 is a sequence diagram showing an example of processing of a game application according to the present embodiment. [Figure 12] 10A and 10B are schematic diagrams showing an example of game image data output by a game executing unit according to the present embodiment. [Figure 13] FIG. 10 is a schematic diagram showing an example of a screen generated by a game executing unit according to the present embodiment. [Figure 14] FIG. 10 is a schematic diagram showing another example of a screen generated by the game executing unit according to the present embodiment. [Figure 15] 10 is a flowchart showing an example of processing by a game executing unit according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0026] The present embodiment will be described in detail with reference to the drawings, in which the same or corresponding parts are designated by the same reference numerals and description thereof will not be repeated.

[0027] [A. System configuration example] First, an example of the configuration of a system according to the present embodiment will be described.

[0028] FIG. 1 is a schematic diagram showing an example configuration of a system 1 according to the present embodiment. System 1 includes one or more game devices 100. Game device 100 is, for example, a game-dedicated information processing device for providing games to users. FIG. 1 shows an example configuration of system 1 including four game devices 100 connected to network 4. In the following description, when it is necessary to identify each of the multiple game devices 100, they are distinguished by assigning a subnumber (for example, game devices 100-1, 100-2, 100-3, and 100-4 shown in FIG. 1).

[0029] In this embodiment, each user of a game device 100 has his or her own account, and the account is associated with each game device 100. One account may be associated with multiple game devices 100, or multiple accounts may be associated with one game device 100. A user with an account can make the associated account participate in one or more communication groups (hereinafter also abbreviated as "groups") by performing a predetermined input on the game device 100. In this embodiment, the state of participating in a group refers to a state in which communication is possible with users of other accounts participating in the group. In this specification, "belonging" includes at least the state of participating in a group. The state in which an account belongs to a group may include a state in which the account is participating in the group and a state in which the account is waiting for approval before joining the group. The state in which an account belongs to a group may include one or both of the above states, as well as a state after an account that once joined has left the group.

[0030] In this embodiment, a group is formed by multiple accounts, and communication can be carried out within the group. An account may belong to only one group at a time, or may belong to multiple groups at the same time. As an example, the process when an account belongs to one group will be described below. An upper limit may be set for the number of accounts that can belong to each group.

[0031] As an example of a process for an account to join a group, the account may join the group only if the user of the account accepts an invitation after the account has received one, or may join the group only if the other account accepts an application to join the group after the application has been submitted.

[0032] A game device 100 corresponding to an account belonging to a group transmits data used for communication between users (hereinafter also referred to as "communication data 10") to other game devices 100 corresponding to other accounts belonging to the same group. In this way, various information can be exchanged between the game devices 100 used by each user belonging to a group.

[0033] For example, the communication data 10 may include audio data acquired by the game device 100, image data acquired by the game device 100, text data acquired by the game device 100, information about the game played on the game device 100, and the like.

[0034] In this specification, image data includes moving image data and one or more still image data. The image data may be captured using a camera 118 available on game device 100, or may be an image from an application running on game device 100.

[0035] A session corresponding to a group may be established between multiple game devices 100 corresponding to accounts belonging to the group in order to send and receive communication data 10. In other words, multiple game devices 100 corresponding to accounts belonging to the same group may have a common session. The management server 200 may manage the session.

[0036] 1 shows, as an example, a case where game devices 100-1 to 100-4 correspond to four accounts belonging to the same group. Game device 100-1 transmits communication data 10-1 to one or more other game devices 100, and receives communication data 10-2 to 10-4 transmitted by one or more other game devices 100. Game devices 100-2 to 100-4 transmit and receive communication data 10 in the same way as game device 100-1. Processing based on communication data 10 will be described in detail later.

[0037] The system 1 further includes a management server 200. The management server 200 is responsible for processing to configure a new group and processing for one or more accounts to join a group. The management server 200 has management information 208 for managing the configured groups and one or more accounts belonging to each group.

[0038] The system 1 may further include a relay server 300. The relay server 300 relays communication data 10 transmitted and received by one or more game devices 100.

[0039] The management server 200 and the relay server 300 may be implemented on a single physical server. The system 1 may include multiple management servers 200, or multiple relay servers 300. The management server 200 and the relay server 300 do not need to have separate functions. The management server 200 and the relay server 300 may be virtual servers.

[0040] The method by which a game device 100 transmits communication data 10 to one or more other game devices 100 may be a method in which the communication data 10 is transmitted directly to one or more other game devices 100 (e.g., a P2P method) in addition to or instead of a method via one or more relay entities (e.g., relay servers 300).

[0041] The same game application may be executed between multiple game devices 100. In this case, the game application may be a communication game in which data is exchanged between the game devices 100. An account may be required to play the communication game.

[0042] Here, the account for participating in the online game (hereinafter also referred to as a "game account" for the sake of distinction) may be the same as the account for participating in the group, or may be a different account. Furthermore, the account for participating in the group and the game account may follow different systems.

[0043] Furthermore, when multiple users play the same game application (such as a communication game), the set of each user's game accounts is also referred to as a "game group" to distinguish it from a communication group. At least some of the accounts belonging to a game group may also belong to the same group, and other accounts belonging to a game group may not all belong to the same group.

[0044] [B. Hardware configuration example] Next, an example of a hardware configuration of each device included in system 1 according to the present embodiment will be described.

[0045] (b1: game device 100) 2 is a schematic diagram showing an example of the hardware configuration of game device 100 according to the present embodiment. Game device 100 is a type of computer. Referring to FIG. 2, game device 100 includes, for example, one or more processors 102, one or more memories 104, a communication unit 106, a camera interface 108, storage 110, an input unit 116, a display 120, a microphone 122, and a speaker 124. Each component may be detachable from the main body of game device 100.

[0046] Processor 102 is a processing entity for executing processes in game device 100. Processor 102 includes, for example, a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). Processor 102 loads a program stored in storage 110 into memory 104 and executes the program.

[0047] The memory 104 is a volatile storage medium accessible by the processor 102, and includes, for example, a dynamic random access memory (DRAM) or a static random access memory (SRAM).

[0048] Storage 110 is a non-volatile storage medium accessible by processor 102, and includes, for example, a flash memory, a hard disk, etc. Storage 110 may also include, for example, a storage medium that is detachable from game device 100, such as a cartridge or an optical disk.

[0049] The storage 110 stores, for example, a system program 112 and a game application 180 .

[0050] The system program 112 includes computer-readable instructions for controlling the hardware of the game device 100 and providing a program execution environment. The system program 112 also includes a communication application 114. As will be described in detail later, the communication application 114 executes processing related to the transmission and reception of communication data 10 between multiple game devices 100 corresponding to multiple accounts belonging to a group.

[0051] Game application 180 includes computer-readable instructions for executing a game. Multiple game applications 180 may be installed on game device 100. Game application 180 may also be read from a separate storage medium.

[0052] In this specification, the term "processor" encompasses at least processing circuits that perform processing according to computer-readable instructions, such as a CPU or GPU, and hardwired circuits, such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0053] As used herein, the term “memory” encompasses at least memory 104 and storage 110 .

[0054] Game device 100 may employ an SoC (System on Chip) that integrates functions such as a processor and memory. In this case, the processor and memory exist in the same SoC (Integrated Circuit). Therefore, in this specification, the terms "processor" and "memory" encompass both independent configurations and integrated configurations.

[0055] The communication unit 106 transmits and receives data to and from other game devices 100, the management server 200, the relay server 300, etc. via the network 4. The communication unit 106 may communicate data with other game devices 100, etc. via the Internet, which is an example of the network 4. The network 4 may also be a wireless network conforming to Bluetooth (registered trademark), ZigBee (registered trademark), wireless LAN (IEEE 802.11 standard), etc.

[0056] The camera interface 108 mediates data transmission to and reception from the camera 118. The camera interface 108 may be connected to the camera 118 via a wired connection or wireless connection.

[0057] The input unit 116 accepts user operations. The input unit 116 includes, for example, a keyboard, a mouse, a game controller, a touch panel, etc. The input unit 116 may be an interface with a device that accepts user operations (for example, a game controller). In other words, the device that accepts user operations may be located outside the game device 100.

[0058] Display 120 displays images or videos generated by processing by processor 102. Display 120 includes, for example, an LCD (Liquid Crystal Display) or an organic EL display. Display 120 may be located outside game device 100. In this case, game device 100 may include an interface circuit with display 120.

[0059] The microphone 122 is disposed on the housing of the game device 100 or the like, and collects sound and generates an audio signal. The speaker 124 is disposed on the housing of the game device 100 or the like, and generates sound from the audio signal. At least one of the microphone 122 and the speaker 124 may be located outside the game device 100.

[0060] Camera 118 generates camera data (moving image data or still image data) of an image of a subject in accordance with a command from game device 100 or in accordance with predetermined conditions.

[0061] The camera 118 includes an imaging element such as a charge-coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor, etc. A lens may be disposed in front of the imaging element.

[0062] The camera 118 may be, for example, a camera for video calls. The camera 118 may be a dedicated camera that can be connected only to a specific device, or a general-purpose camera that can be connected to any device. Multiple cameras 118 may be connectable to the game device 100.

[0063] It should be noted that the game devices 100 corresponding to the multiple accounts belonging to the same group do not need to have the same hardware configuration. For example, some game devices 100 may be dedicated game consoles, while other game devices 100 may be personal computers, televisions, smartphones, tablets, etc. capable of running games. The game devices 100 may be any information processing devices capable of running games.

[0064] (b2: Management Server 200) 3 is a schematic diagram showing an example of a hardware configuration of management server 200 according to this embodiment. Referring to FIG. 3, management server 200 includes, for example, one or more processors 202, one or more memories 204, one or more communication units 206, storage 210, and input unit 216.

[0065] The processor 202 is a processing entity for executing processes in the management server 200. The processor 202 includes, for example, a CPU, a GPU, etc. The processor 202 loads a program stored in the storage 210 into the memory 204 and executes the program.

[0066] The memory 204 is a volatile storage medium accessible by the processor 202, and includes, for example, DRAM, SRAM, and the like.

[0067] The storage 210 is a non-volatile storage medium accessible by the processor 202, and includes, for example, a hard disk, a flash memory, etc. The storage 210 stores, for example, a system program 212 and a management program 214.

[0068] The system program 212 includes computer-readable instructions for controlling the hardware of the management server 200 and providing a program execution environment.

[0069] The management program 214 includes computer-readable instructions for executing the management-related processes for which the management server 200 is responsible.

[0070] The management information 208 may be stored in the storage 210 or in the memory 204 . The communication unit 206 transmits and receives data to and from the game device 100, the management server 200, and the like via the network 4. The communication unit 206 may be connected to the network 4 via a wired connection or may be connected to the network 4 wirelessly.

[0071] The input unit 216 receives user operations and includes, for example, a keyboard and a mouse.

[0072] (b3: Relay Server 300) An example of the hardware configuration of relay server 300 is similar to the example of the hardware configuration of management server 200 shown in FIG. 3, and therefore detailed description thereof will not be repeated.

[0073] The relay program stored in the storage of the relay server 300 may include computer-readable instructions for transmitting, receiving, and relaying the communication data 10.

[0074] [C. Software Configuration Example of Game Device 100] Next, an example of the software configuration of game device 100 according to the present embodiment will be described.

[0075] 4 is a schematic diagram showing an example of the software configuration of game device 100 according to the present embodiment. Referring to FIG. 4, game device 100 includes a program execution environment 130. Execution environment 130 may be realized by one or more processors 102 executing system program 112.

[0076] In the execution environment 130, the system program 112 including the communication application 114 and the game application 180 can be executed simultaneously. Note that "executing simultaneously" means that multiple applications or programs are executed in parallel, and is not intended to limit the execution timing, etc.

[0077] The system program 112 in execution corresponds to a system module 132. The system module 132 provides the basic functions required in the game device 100.

[0078] The game execution unit 186 corresponds to the game application 180 that is running. The system module 132 includes a communication executor 140. The communication executor 140 corresponds to the communication application 114 that is running.

[0079] The system module 132 includes a microphone control unit 144 , a camera control unit 146 , a communication control unit 148 , an image processing unit 150 , and an audio processing unit 152 .

[0080] The microphone control unit 144 generates audio data 154 from the audio signal output by the microphone 122. The microphone control unit 144 may be able to change the microphone 122 to a mute state.

[0081] Camera control unit 146 generates camera image data 156 from the video signal output by camera 118. Camera control unit 146 may be able to control the start and stop of imaging by camera 118, and may also be able to control the imaging conditions of camera 118 (frame rate, white balance, etc.).

[0082] The communication control unit 148 issues commands to the communication unit 106 to control data communication with other game devices 100 and the like.

[0083] The image processing unit 150 can use a memory area 160 for storing image data. The memory area 160 may use, for example, one or more memories 104 or a partial area of ​​the storage 110. The image processing unit 150 may be capable of performing image processing on one or more pieces of image data.

[0084] The memory area 160 may include areas for storing, for example, display image data 162, game image data 182, distribution image data 164, camera image data 156, one or more received distribution image data 166, and one or more received camera image data 168.

[0085] The communication execution unit 140 executes processing for exchanging communication data 10 with other game devices 100 .

[0086] For example, the communication executing unit 140 may execute processing required to join a specified group in response to a user operation. The communication executing unit 140 may store group information 142. The communication executing unit 140 may update the group information 142 periodically, or whenever a predetermined condition is met, based on information from the management server 200 or the like. The group information 142 may be stored in, for example, one or more memories 104 or a partial area of ​​the storage 110.

[0087] Furthermore, the communication execution unit 140 may transmit the execution status of the game application 180 to the management server 200 or other game devices 100 belonging to the same group using the communication control unit 148. The execution status of the game application 180 may be transmitted when a predetermined condition is satisfied, or may be transmitted periodically.

[0088] Furthermore, the communication executing unit 140 may transmit the audio data 154 generated by the microphone control unit 144 to the other game devices 100 using the communication control unit 148. The communication executing unit 140 may output one or more pieces of audio data (received audio data 158) transmitted by the other game devices 100 to the audio processing unit 152 via the communication control unit 148.

[0089] Furthermore, the communication executing unit 140 may transmit camera image data 156 generated by the camera control unit 146 to the other game device 100 using the communication control unit 148. The communication executing unit 140 may store the camera image data 156 in the storage area 160 of the image processing unit 150. The communication executing unit 140 may store one or more pieces of camera image data (received camera image data 168) transmitted by the other game device 100 in the storage area 160 of the image processing unit 150 using the communication control unit 148. The received camera image data 168 may include camera image data 156 transmitted by the game device itself.

[0090] Furthermore, the communication executing unit 140 may transmit distribution image data 164 generated by any method to another game device 100 using the communication control unit 148. The communication executing unit 140 may store one or more pieces of distribution image data (received distribution image data 166) transmitted by another game device 100 in the storage area 160 of the image processing unit 150 via the communication control unit 148. The received distribution image data 166 may include distribution image data 164 transmitted by the game device itself.

[0091] In this way, the communication control unit 148 performs data communication with the management server 200 and other game devices 100 corresponding to other accounts belonging to the same group in the communication execution unit 140 in accordance with the communication execution unit 140, and acquires information (e.g., communication data 10) from the other game devices 100 corresponding to other accounts belonging to the same group through data communication.

[0092] The distribution image data 164 may be generated based on one or more image data available in the game device 100. For example, if a game application 180 is running on the game device 100, the distribution image data 164 may be generated based on game image data 182 output by the running game application 180 (game execution unit 186). If a menu screen is displayed on the game device 100, the distribution image data 164 may be generated based on the menu screen. In other cases, for example, an image that does not substantially contain video information, such as a black image or a white image (hereinafter also referred to as a "mute image"), may be used as the distribution image data 164. The same applies to the received distribution image data 166 as to the distribution image data 164.

[0093] The image processing unit 150 generates a video signal based on the image data and outputs the generated video signal to the display 120. For example, display image data 162 is used to generate the video signal. The image processing unit 150 may generate the display image data 162 used to generate the video signal using one or more pieces of image data stored in the storage area 160. For example, the display image data 162 may be generated by superimposing the camera image data 156 or the received camera image data 168 on the game image data 182. By generating such display image data 162, the face of a user playing the game application 180 can be displayed together with the image (game image data 182) output by the game execution unit 186.

[0094] The audio processing unit 152 generates an audio signal based on the audio data and outputs the generated audio signal to the speaker 124. For example, the audio processing unit 152 may generate an audio signal by combining game audio data 184 output by the game execution unit 186 with one or more pieces of received audio data 158.

[0095] 4, at least a portion of the communication application 114 may be an application outside the system module 132, similar to the game application 180. At least a portion of the game application 180 may be included in the system module 132.

[0096] At least a part of the game execution by game application 180 may utilize the runtime environment 130 of another game device 100, or may utilize an external resource such as a server.

[0097] [D. Example of processing in communication execution unit 140] Next, an example of processing in the communication execution unit 140 will be described.

[0098] (d1: Group information management) The communication execution unit 140 manages group information 142 relating to groups to which the account corresponding to the communication execution unit 140 belongs. An example of processing for managing the group information 142 will be described below. Details of the group information 142 will be described later.

[0099] Fig. 5 is a flowchart showing an example of processing executed by communication executing unit 140 according to the present embodiment for managing group information 142. Fig. 5 shows examples of processing executed when joining a group (Fig. 5(A)), when belonging to a group (Fig. 5(B)), and when leaving a group (Fig. 5(C)).

[0100] 5(A), when the communication executing unit 140 receives a request to join any group, it exchanges data for joining the specified group with the management server 200 (step S100). When joining the specified group is successful, the communication executing unit 140 generates group information 142 (step S102). The group information 142 may be generated based on information transmitted by the management server 200. The information transmitted by the management server 200 may be based on at least a part of the management information 208 held by the management server 200. The process for joining the specified group may be based on an account.

[0101] 5(B), in a state where the user belongs to any group, the communication executor 140 exchanges data with the management server 200 (step S110). The communication executor 140 updates the group information 142 based on the data exchanged with the management server 200 (step S112).

[0102] For example, the communication execution unit 140 may transmit information about its own account (the account corresponding to its own device) to the management server 200. Data exchange with the management server 200 may be performed, for example, at predetermined intervals.

[0103] 5(C), when the communication executor 140 receives a request to leave the group to which the user belongs, the communication executor 140 exchanges data for leaving the group with the management server 200 (step S120). After leaving the group, the communication executor 140 deletes the group information 142 (step S122). Note that some or all of the group information 142 may be maintained even after leaving the group.

[0104] 6 is a schematic diagram showing an example of group information 142 of game device 100 according to the present embodiment. Referring to FIG. 6, group information 142 includes information on each account belonging to the same group. Group information 142 may include information on game applications 180 in other game devices 100. Group information 142 may also include information on other game devices 100.

[0105] The group information 142 includes, for example, an ID 1421, an account 1422, and an account name 1423. The ID 1421 indicates identification information for uniquely identifying each account within the group. The account 1422 indicates identification information for identifying each account. The account name 1423 indicates the name given to each account.

[0106] Group information 142 may include, as examples of information relating to game applications 180 on other game devices 100, game execution status 1424, running game information 1425, and owned game information 1426.

[0107] The game execution status 1424 indicates the execution status of the game application 180 on the game device 100 corresponding to each account. For example, "1" may mean "running" and "0" may mean "not running." The game execution status 1424 may be information indicating whether or not any game application 180 is running on each game device 100.

[0108] The running game information 1425 indicates the game applications 180 currently running on the game device 100 corresponding to each account. The running game information 1425 is information that identifies game applications 180 currently running on other game devices 100. There may be multiple running game applications 180. In this case, the running game information 1425 may include one, some, or all of the running game applications 180.

[0109] Owned game information 1426 indicates game applications 180 available to each account or the game device 100 corresponding thereto, and game applications 180 owned by each account or the game device 100 corresponding thereto. Furthermore, for example, owned game information 1426 may indicate game applications 180 that have been executed by each account or the game device 100 corresponding thereto, or a combination of these conditions.

[0110] Group information 142 may include information indicating whether or not imaging is possible with camera 118 on another game device 100. For example, game application 180 can change the display on game application 180 using information indicating whether or not imaging is possible with camera 118 on game device 100.

[0111] Group information 142 may or may not include information about its own account (the account corresponding to its own device). Group information 142 does not have to include all of the information shown in Fig. 6. For ease of explanation, Fig. 6 illustrates group information 142 in table format, but the information may be stored in any format.

[0112] The game device 100 does not need to store the group information 142 all the time, and may inquire about it each time from the management server 200, etc. In this case, the game device 100 may temporarily store or cache at least a portion of the information acquired from the management server 200.

[0113] (d2: Transmission process of communication data 10) The communication execution unit 140 executes the transmission process of the communication data 10.

[0114] 7 is a flowchart showing an example of a communication data transmission process executed by communication executing section 140 according to the present embodiment. The process shown in FIG. 7 is executed while belonging to any group.

[0115] 7, the communication executing unit 140 acquires voice data 154 generated from a voice signal collected by the microphone 122 (step S200), and transmits the acquired voice data 154 (step S202). The voice data 154 may be processed or altered in a predetermined manner.

[0116] The communication execution unit 140 acquires camera image data 156 based on an image captured by the camera 118 (step S204), and transmits the acquired camera image data 156 (step S206). The camera image data 156 may include the entire image captured by the camera 118, or may include only a portion of the image. Furthermore, the camera image data 156 is not limited to the above, and may also be processed or altered in a predetermined manner.

[0117] The communication execution unit 140 acquires distribution image data 164 (step S208) and transmits the acquired distribution image data 164 (step S210). The distribution image data 164 may be processed or edited in a predetermined manner. Game image data 182 may be transmitted as the distribution image data 164 to other game devices 100 corresponding to other accounts belonging to the same group.

[0118] The acquisition and transmission periods of the audio data 154, camera image data 156, and distribution image data 164 do not have to be the same. Furthermore, the order of these acquisition and transmission periods does not matter. At least a portion of the audio data 154, camera image data 156, and distribution image data 164 may be a data stream conforming to the H.264 (MPEG-4 AVC) standard, for example.

[0119] (d3: Receiving communication data 10) The communication execution unit 140 executes a process for receiving the communication data 10.

[0120] 8 is a flowchart showing an example of a communication data reception process executed by communication executing section 140 according to the present embodiment. The process shown in FIG. 8 is executed while belonging to any group.

[0121] 8, in this embodiment, when the communication executing unit 140 receives the communication data 10 (YES in step S300), it determines the data type included in the communication data 10 (step S302). Based on the determination result of the data type, the communication executing unit 140 extracts the data included in the communication data 10 (step S304).

[0122] The communication executing unit 140 identifies the account that sent the communication data 10 (step S306), and stores the extracted data in association with the ID corresponding to the identified account (step S308).

[0123] If the communication data 10 includes distribution image data, the distribution image data included in the communication data 10 is extracted as received distribution image data 166. Each of the received distribution image data 166 may be associated with a distribution image ID, which is an example of identification information for identifying the account of the sender.

[0124] If the communication data 10 includes camera image data, the camera image data included in the communication data 10 is extracted as received camera image data 168. Each piece of received camera image data 168 may be associated with a camera image ID, which is an example of identification information for identifying the account of the sender.

[0125] If the communication data 10 includes voice data, the voice data included in the communication data 10 is extracted as received voice data 158 .

[0126] The image data and audio data do not need to be associated with identification information for identifying the account from which they were sent.

[0127] (d4: Interface processing example) As described above, the runtime environment 130 simultaneously executes the communication application 114 (communication execution unit 140) and the game application 180 (game execution unit 186). Therefore, the runtime environment 130 provides an interface for exchanging information between the communication execution unit 140 and the game execution unit 186. More specifically, the communication execution unit 140 can respond with information based on the communication data 10 in response to requests from various applications, including the game application 180.

[0128] Communication execution unit 140 may have an API (Application Programming Interface) for exchanging data with applications. In this case, an application such as game application 180 requests data from communication execution unit 140 in accordance with a command system predefined as the API.

[0129] In this way, in response to a request from the game executing unit 186 to the communication executing unit 140 via the API, the execution environment 130 causes the game executing unit 186 to acquire information based on information (e.g., communication data 10) exchanged with other game devices 100. The information acquired by the game executing unit 186 may be the information itself acquired from other game devices 100, or may be information that has been processed or altered in some way.

[0130] 9 is a flowchart showing an example of interface processing of communication executing unit 140 according to the present embodiment. Referring to FIG. 9, communication executing unit 140 determines whether or not a request has been received from any application (step S400). If a request has not been received from any application (NO in step S400), the processing of step S400 is repeated.

[0131] If a request is received from any application (YES in step S400), the communication execution unit 140 executes processing according to the received request (step S402) and transmits the execution result to the request source (step S404). Then, the processing from step S400 onwards is repeated.

[0132] The processing in accordance with the request may include, for example, a process of responding with at least a portion of the group information 142, a process of responding with information based on at least a portion of the group information 142, a process of responding with at least a portion of the image data stored in the memory area 160 of the image processing unit 150, a process of responding with information related to the image data stored in the memory area 160 of the image processing unit 150, a process of responding with the received audio data 158, a process of responding with information related to the received audio data 158, etc.

[0133] As described above, the group information 142 is updated by the communication executing unit 140. Therefore, as exemplified below, it may be efficient for the communication executing unit 140 to determine whether the group information 142 satisfies a predetermined condition.

[0134] 10 is a flowchart showing another example of processing of the interface of the communication executing unit 140 according to the present embodiment. Upon receiving a request to start monitoring, the communication executing unit 140 notifies the requestor when a predetermined condition is met. The predetermined condition may be, for example, that the group information 142 has been updated.

[0135] 10, in this embodiment, the communication executing unit 140 determines whether or not a request to start monitoring has been received from the game executing unit 186 (step S500). If a request to start monitoring has not been received from the game executing unit 186 (NO in step S500), the processing of step S500 is repeated.

[0136] If a request to start monitoring is received from the game executing unit 186 (YES in step S500), the communication executing unit 140 sets the game executing unit 186 as a notification destination (step S502).

[0137] The communication executing unit 140 determines whether the group information 142 has been updated (step S504). If the group information 142 has not been updated (NO in step S504), the process of step S504 is repeated.

[0138] When the group information 142 is updated (YES in step S504), the communication execution unit 140 notifies the game execution unit 186 that a predetermined condition has been met (step S506), and the process then ends.

[0139] Although the above description shows an example of a process in which the monitoring process ends when a predetermined condition is satisfied once, the monitoring (steps S504 and S506) may be continued until a request to stop monitoring is received. Also, the monitoring (steps S504 and S506) may be continued until the predetermined condition is satisfied multiple times.

[0140] The predetermined condition is not limited to an update of the group information 142. For example, it may include a change in the number of accounts belonging to the same group, the start or end of execution of any application on a game device 100 corresponding to any account belonging to the same group, or a change in some information included in the group information 142. In these cases, after the group information 142 is updated (YES in S504), the communication execution unit 140 may determine whether the updated content satisfies a predetermined condition, and notify the game execution unit 186 only if the predetermined condition is satisfied. The predetermined condition may also be specified in the received request to start monitoring.

[0141] For example, if the predetermined condition is an increase in the number of accounts belonging to a group, game application 180 performs predetermined processing based on the notification that the predetermined condition has been met, and displays a message based on the predetermined processing, thereby informing the user of game device 100 that a new user has joined the group. The predetermined processing may be, for example, a request for data to communication execution unit 140.

[0142] In the processing example shown in FIG. 10 above, the communication execution unit 140 notifies the game execution unit 186 when the group information 142 satisfies a predetermined condition, but in another processing example, the communication execution unit 140 may continue to notify the game execution unit 186 whether or not the predetermined condition is satisfied.

[0143] By adopting the processing example shown in FIG. 10, the degree of freedom in processing in the application can be increased.

[0144] [E. Application processing example] Next, as examples of application processing, several processes in which the game application 180 uses information provided by the communication execution unit 140 will be described.

[0145] (e1: Game application processing example 1) As an example, a case will be described in which the same game application 180 is played simultaneously on multiple game devices 100. In this case, game application 180 is an example of a communication game. It is also assumed that each user of game devices 100-1 to 100-4 has already joined the same group based on their own account.

[0146] Fig. 11 is a sequence diagram showing an example of processing by game application 180 according to the present embodiment. In the example shown in Fig. 11, game devices 100-1 to 100-4 exchange data necessary for executing game application 180 (sequence SQ100).

[0147] For example, the game execution unit 186 may include camera images of users participating in a communication game in the game image being executed. In this embodiment, the game execution unit 186 can identify the accounts of users participating in the communication game, and therefore refers to the group information 142 to identify one or more accounts that also belong to the same group. Then, based on the identified accounts of other users, the game execution unit 186 requests camera images from the communication execution unit 140 via the API (sequence SQ102).

[0148] The communication executing unit 140 refers to the group information 142 and returns the value of the camera image ID corresponding to the account of the selected other user to the game executing unit 186 (sequence SQ104).

[0149] The game execution unit 186 accesses the image processing unit 150 (sequence SQ106) and acquires the received camera image data 168 associated with the acquired camera image ID value (sequence SQ108). The game execution unit 186 performs image generation processing, such as superimposing the acquired received camera image data 168 on the image of the game being executed (sequence SQ110). The game image data 182 generated by image synthesis is written to the storage area 160 of the image processing unit 150. The processing of sequences SQ106 to SQ110 may be repeated until a predetermined operation is performed to stop the display of the camera image.

[0150] In addition, instead of processing sequences SQ106 to SQ110, the game execution unit 186 may issue a request to the image processing unit 150 to cause the image processing unit 150 to execute a process of superimposing the received camera image data 168 associated with the acquired camera image ID value on the game image data 182 to generate the display image data 162.

[0151] Furthermore, the communication execution unit 140 may respond with the address of the storage area 160 or the like instead of the camera image ID.

[0152] In this way, the game executing unit 186 may execute a communication game based on the received camera image data 168 acquired via the communication executing unit 140, etc.

[0153] For convenience of explanation, an example of processing in which the game executing unit 186 acquires one piece of received camera image data 168 will be shown, but the game executing unit 186 can acquire multiple pieces of received camera image data 168 through similar processing.

[0154] For example, the game execution unit 186 may use one or more received camera image data 168 corresponding to one or more accounts belonging to the same group to generate the game image data 182. In this case, the game image data 182 may include received camera image data 168 corresponding to accounts that do not belong to the game group.

[0155] Alternatively, the game image data 182 may be generated using one or more received camera image data 168 corresponding to one or more accounts that belong to the current game group among the accounts that belong to the same group. In this case, the communication executing unit 140 may restrict acquisition of received camera image data 168 corresponding to accounts that do not belong to the current game group among the accounts that belong to the same group, or may not acquire the data, or may acquire and then discard the data.

[0156] Furthermore, in response to an explicit operation by the user, the game executing unit 186 may acquire corresponding received camera image data 168. For example, if the user of game device 100-1 wishes to check the face of one of the users playing at the same time, and performs a predetermined operation including selecting another user, the game executing unit 186 may request the communication executing unit 140 to send a camera image corresponding to that selection.

[0157] FIG. 11 shows an example of processing in which the game execution unit 186 acquires a camera image, but it is also possible to acquire game images, audio, text, and other information.

[0158] The above description has been given of a case where the same game application 180 is being executed simultaneously on multiple game devices 100. The game execution unit 186 may also acquire camera images from other game devices 100 that are executing a game application 180 of the same series that is different from game application 180, or from other game devices 100 that are executing a predetermined game application 180 that is different from game application 180, rather than being limited to the "same game application 180."

[0159] At this time, in response to a request for camera images from the game executing unit 186, the communication executing unit 140 may cause the game executing unit 186 to acquire camera images that the game executing unit 186 is able to acquire. For example, based on the running game information 1425 of the group information 142, the communication executing unit 140 may identify other game devices 100 that are running game applications 180 that are the same as or related to the game application 180 currently running on the game device 100, and cause the game executing unit 186 to acquire camera images received from the identified game devices 100. For example, information identifying the game application 180 included in the running game information 1425 may be an identifier (ID), and the other game devices 100 that are running the same or related game application 180 may be identified based on the comparison result. The "related ID" may be, for example, one or more preset IDs, or an ID based on a predetermined rule, such as "IDs that are the same except for the last symbol." Furthermore, the "related ID" may be held by the game application 180 in the game device 100, by the server, or by another game device 100.

[0160] In this way, the communication execution unit 140 may cause the game execution unit 186 to acquire camera images based on information identifying the game application 180 running on the game device 100 and the running game information 1425 of the other game devices 100.

[0161] Fig. 12 is a schematic diagram showing an example of game image data output by the game execution unit 186 according to the present embodiment. Fig. 12(A) shows an example of game image data 182 in the case where two users are playing simultaneously. Fig. 12(B) shows an example in which received camera image data 168 capturing images of each user is superimposed on the game image data 182 shown in Fig. 12(A).

[0162] (e2: Game application processing example 2) The game executing unit 186 may request the group information 142 from the communication executing unit 140. As described above, the game executing unit 186 may request the communication executing unit 140 to acquire the group information 142 in accordance with a command system defined in advance as an API. The game executing unit 186 may generate any user interface screen based on the acquired group information 142.

[0163] 13 is a schematic diagram showing an example of a screen generated by the game executing unit 186 according to the present embodiment. Referring to FIG. 13, a user interface screen 500 may include information indicating the current status of one or more accounts belonging to the group.

[0164] More specifically, user interface screen 500 includes table 502. Table 502 includes, for example, account name 504, status 506, and owned game information 508. Account name 504 is displayed based on account name 1423 of group information 142. Status 506 is displayed based on game execution status 1424 and running game information 1425 of group information 142. Owned game information 508 is displayed based on owned game information 1426 of group information 142.

[0165] In this way, the application may execute display processing based on owned game information 508 acquired from communication execution unit 140.

[0166] (e3: Game application processing example 3) After requesting the communication execution unit 140 to start monitoring, the game execution unit 186 may request the communication execution unit 140 to obtain group information 142 when it receives a predetermined judgment result (for example, "1" indicating that the number of accounts has changed).

[0167] In this way, the game executing unit 186 may request the communication executing unit 140 to newly acquire the group information 142 and the like when a predetermined judgment result from the communication executing unit 140 satisfies a predetermined condition.

[0168] (e4: Game application processing example 4) The game execution unit 186 may provide various user interface screens based on the group information 142 obtained from the communication execution unit 140.

[0169] For example, while a user of an account belonging to a certain group is playing a game, a user interface screen may be provided for playing the game together with other users. That is, the game execution unit 186 may generate an interface screen for allowing other accounts belonging to the same group to join the same game group, based on the group information 142, etc.

[0170] 14 is a schematic diagram showing another example of a screen generated by the game execution unit according to the present embodiment. For example, FIG. 14 shows a user interface screen 510 that is displayed while the “G1” game application 180 is running.

[0171] Referring to FIG. 14, user interface screen 510 may be displayed while game application 180 is running.

[0172] The user interface screen 510 includes a table 512. The table 512 includes, for example, an account name 514, a status 516, and an action 518. Of the accounts included in the table 512, accounts that are currently executing or can execute "G1" may be displayed preferentially. For example, the "CCC" account is currently executing "G1," and the "DDD" account has "G1."

[0173] Action 518 may display an object for executing an action according to the corresponding account. For example, a "play together" object may be displayed in association with the "CCC" account. When "play together" is selected, a message for playing simultaneously may be displayed on the game device 100 on which the game is being played. Also, an "invite to game" object may be displayed in association with the "DDD" account. When "invite to game" is selected, a message for inviting "G1" to play may be displayed on the corresponding game device 100.

[0174] In this way, the application may provide a user interface screen based on owned game information 508 acquired from the communication execution unit 140.

[0175] In the user interface screen 510 shown in FIG. 14, accounts that are currently running or can run the same game application among other accounts belonging to the same group are displayed, but it is also possible to display only accounts that are currently running the same game application, or to display other accounts that belong to the same group and then prioritize or highlight the accounts that are currently running the same game application.

[0176] A user interface screen for inviting a user to a game may also be provided. This user interface screen may display other accounts that belong to the same group but are not running the same game application but are able to run it. In this embodiment, when an account is selected, a message such as "Do you want to play with this person?" is displayed, and when "Yes" is selected, processing is executed to start a communication game with the game device 100 corresponding to the selected account.

[0177] Furthermore, in a situation such as "join a battle room," one or more rooms (game groups) to which any of the accounts belonging to the same group belong may be displayed in a list.

[0178] Furthermore, when a game session start button is selected in any game application 180, an invitation message or the like may be displayed on other game devices 100 corresponding to other accounts belonging to the same group. In this case, the game session start button essentially doubles as an invitation button.

[0179] (e5: Game application processing example 5) The game executing unit 186 may execute a communication game based on the group information 142 acquired from the communication executing unit 140. More specifically, the game executing unit 186 may determine or assist in the determination of accounts to participate in the communication game. In other words, the game executing unit 186 may perform matching for the communication game based on the information acquired from the communication executing unit 140.

[0180] 15 is a flowchart showing an example of processing by game execution unit 186 according to the present embodiment. FIG. 15 shows an example of processing for acquiring the accounts of users who will play game application 180 together.

[0181] 15, in response to a predetermined user operation, the game executing unit 186 requests the communication executing unit 140 to acquire group information 142 (step S700). The game executing unit 186 acquires the group information 142 from the communication executing unit 140 (step S702), and also acquires identification information of accounts currently playing the same game application 180 from a server (step S704). The server that acquires the identification information of accounts currently playing the same game application 180 may be the management server 200, or may be a server other than the management server 200.

[0182] The game execution unit 186 determines the identification information of one or more accounts that satisfy a predetermined condition based on the identification information of other accounts that belong to the same group included in the group information 142 (for example, account 1422 and account name 1423 shown in FIG. 6) and the identification information of the account acquired from the server (step S706).

[0183] A game application 180, which is a communication game, is played among a plurality of accounts including the user's own account determined as described above.

[0184] The process of step S704 may be omitted. In this case, in step S706, it may be determined whether a predetermined condition is met based on the acquired group information 142. The process of step S706 may also be performed by the server. In this case, the group information is sent to the server in step S702.

[0185] Examples of the predetermined conditions in step S706 include the following. For example, accounts that belong to the same group and are running the same game application may be determined as allies. By matching in this way, players can play a communication game while communicating with each other.

[0186] Alternatively, accounts that belong to the same group and are running the same game application may be determined as opponents. By performing such matching, the fun of competing can be ensured.

[0187] Alternatively, accounts that belong to the same group and are running the same game application may be excluded from being determined as allies. By performing matching in this manner, accounts that do not belong to the same group are determined as allies, thereby preventing teaming and the like.

[0188] In this way, the game executing unit 186 executes a communication game with other game devices 100 corresponding to accounts that satisfy predetermined conditions, based on at least the identification information of other accounts that belong to the same group.

[0189] (e6: Variation) The above-described application processing is an example, and any method of using the information provided by the communication execution unit 140 may be used. Any of the above-described processing examples may be arbitrarily combined. Furthermore, any of the above-described processing examples may be arbitrarily combined, and then any other processing may be combined.

[0190] Requests from applications such as the game application 180 to the communication execution unit 140 may conform to any command system.

[0191] [F. Camera Image Restrictions] From the viewpoint of privacy or protection of minors, the communication executing unit 140 may be able to restrict the use of the camera 118. Note that restricting use here is different from temporarily muting the camera image. For example, it refers to a case where entering a password or permission from a parent or guardian is required to use the camera 118. In such a case, the communication executing unit 140 may not include the camera image data 156 in the communication data 10, or may include a mute image in the communication data 10 instead of the camera image data 156. The communication executing unit 140 may also restrict the use of camera image data transmitted from other game devices 100 (received camera image data 168).

[0192] When the communication execution unit 140 is restricted from using camera image data transmitted from other game devices 100, the game execution unit 186 may restrict the use of the received camera image data 168. For example, the game execution unit 186 may not use the received camera image data 168.

[0193] If the use of camera images is restricted in the communication executing unit 140, the communication executing unit 140 may not be able to acquire camera image data (received camera image data 168) from other game devices 100. Alternatively, when the communication executing unit 140 receives communication data 10 including camera image data, it may discard the received data without processing it. Alternatively, when the communication executing unit 140 receives communication data 10 including camera image data, it may store the camera image data included in the communication data 10 in the memory area 160 in a form that cannot be used by the game device 100. Furthermore, alternatively, the communication executing unit 140 may store the camera image data included in the communication data 10 in the memory area 160 as received camera image data 168, and then restrict the game executing unit 186 from using the received camera image data 168.

[0194] The game executing unit 186 may respond to a request from the game executing unit 186 based on information indicating whether or not the communication executing unit 140 has imposed a restriction on the use of the camera 118 (hereinafter also referred to as a "camera use restriction flag").

[0195] For example, when the communication execution unit 140 receives a request for a camera image from the game execution unit 186, it refers to the camera usage restriction flag. If the camera usage restriction flag is a flag indicating that the use of the camera 118 is restricted, the communication execution unit 140 does not respond with the value of the camera image ID. Alternatively, the communication execution unit 140 may respond that the game execution unit 186 cannot obtain the value of the camera image ID. At this time, the communication execution unit 140 may inform the game execution unit 186 that the reason is the state of the camera usage restriction flag.

[0196] Alternatively, the game executing unit 186 may check whether camera use is restricted in the communication executing unit 140 before making a request to acquire the received camera image data 168. For example, the game executing unit 186 may acquire a camera use restriction flag from the communication executing unit 140. In response to the acquired camera use restriction flag, the game executing unit 186 may generate or read an image such as "Camera images cannot be used because camera use is restricted" and display it on the display 120, without requesting the received camera image data 168 from the communication executing unit 140.

[0197] The information that the communication execution unit 140 responds to the game execution unit 186 may include, for example, whether camera image data from other game devices 100 is stored and whether use of the camera 118 is restricted.

[0198] [G. Audio Data] In response to a request from the game executing unit 186, the communication executing unit 140 may respond to the game executing unit 186 with audio data transmitted by other game devices 100 (received audio data 158).

[0199] Alternatively, the communication executing section 140 may respond with the location (address, etc.) of the received voice data 158 that is temporarily stored in the voice processing section 152.

[0200] In this manner, the game executing unit 186 can obtain the received audio data 158.

[0201] The communication executing unit 140 may respond with the total volume of all accounts belonging to the group, rather than the received voice data 158 itself. The communication executing unit 140 can calculate the total volume by combining the voice data 154 and each received voice data 158. Such a total volume may be used to estimate, for example, the level of excitement within the group.

[0202] Furthermore, the communication executing unit 140 may respond to the game executing unit 186 with information indicating which account, among the accounts belonging to the group, is speaking.

[0203] Furthermore, the communication execution unit 140 may perform voice recognition on the voice data 154 or any of the received voice data 158 to notify the user that a specific word has been spoken or to respond with the content of the word spoken.

[0204] [H. Variations] In the above explanation, the game application 180 is given as an example of an application that uses information provided by the communication execution unit 140, but the application is not limited to games and can be any application.

[0205] In the above description, for example, when the game executing unit 186 requests some information from the communication executing unit 140, the game executing unit 186 that made the request acquires the target information, but the requested information may also be acquired by a unit other than the game executing unit 186. In other words, the communication executing unit 140 may transmit or notify a response to a request to a unit other than the sender of the request.

[0206] The embodiments disclosed herein should be considered to be illustrative in all respects and not restrictive. The scope of the present invention is defined by the claims, not by the above description, and is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0207] 1 System, 4 Network, 10 Communication Data, 100 Game Device, 102, 202 Processor, 104, 204 Memory, 106, 206 Communication Unit, 108 Camera Interface, 110, 210 Storage, 112, 212 System Program, 114 Communication Application, 116, 216 Input Unit, 118 Camera, 120 Display, 122 Microphone, 124 Speaker, 130 Execution Environment, 132 System Module, 140 Communication Execution Unit, 142 Group Information, 144 Microphone Control Unit, 146 Camera Control Unit, 148 Communication Control Unit, 150 Image Processing Unit, 152 Audio Processing Unit, 154 Audio Data, 156 Camera Image Data, 158 Received Audio Data, 160 Storage Area, 162 Display Image Data, 164 Distributed Image Data, 166 Received Distributed Image Data, 168 Received Camera Image Data, 180 Game application, 182 game image data, 184 game audio data, 186 game execution unit, 200 management server, 208 management information, 214 management program, 300 relay server, 500, 510 user interface screen, 502, 512 table, 504, 514, 1423 account name, 506, 516 status, 508, 1426 owned game information, 518 action, 1421 ID, 1422 account, 1424 game execution status, 1425 running game information.

Claims

1. A gaming device, an execution means capable of simultaneously executing a communication application and a game application; a communication control means for controlling data communication with other game devices; The communication control means performing data communication with other game devices corresponding to other accounts belonging to the same group in the communication application in response to execution of the communication application by the execution means; acquiring first information from the other game devices corresponding to the other accounts belonging to the same group through the data communication; The execution means causes the running game application to obtain second information based on the first information in response to a request from the running game application to the running communication application via an API (Application Programming Interface).

2. In the same group, camera image data captured by a camera can be transmitted and received, The game device according to claim 1 , wherein the first information includes camera image data transmitted from another game device.

3. The game device according to claim 2 , wherein the second information includes the transmitted camera image data.

4. 4. The game device according to claim 3, wherein when use of the transmitted camera image data in the communication application is restricted, the running game application does not use the camera image data included in the second information.

5. The game device according to claim 1 , wherein the second information includes information relating to a game application in the other game device.

6. The game device according to claim 5 , wherein the information relating to the game application includes information identifying the game application running on the other game device.

7. In the same group, audio data acquired by a microphone can be transmitted and received; The game device according to claim 1 , wherein the first information includes audio data transmitted from another game device.

8. The game device according to claim 1 , wherein the request includes causing the running communication application to enter a state that causes the running game application to acquire the second information when a predetermined condition is met.

9. The game device according to claim 8 , wherein the predetermined condition is a condition that is satisfied when the number of accounts belonging to the same group changes.

10. 2. The game device according to claim 1, wherein the execution means, when the second information satisfies a predetermined condition, causes the running game application to acquire third information based on the first information in response to a request via an API different from the request.

11. The game device according to claim 10 , wherein the predetermined condition is a condition that is satisfied when the number of accounts belonging to the same group changes.

12. The game device according to claim 1 , wherein the running game application executes a communication game based on the second information.

13. the second information includes identification information of other accounts belonging to the same group; The game device according to claim 12 , wherein the running game application executes the communication game with another game device corresponding to an account that satisfies a predetermined condition, based on the identification information.

14. the second information includes identification information of other accounts belonging to the same group; The game device according to claim 1 , wherein the running game application generates an interface screen for allowing other accounts belonging to the same group to join the same game group based on the second information.

15. The game device according to claim 12 , wherein the second information includes camera image data transmitted from another game device.

16. the running game application acquires the transmitted camera image data corresponding to another account that belongs to the same group and also belongs to a game group; The game device according to claim 15, wherein the running communication application transmits a game image output by the running game application using the transmitted camera image data to another game device corresponding to another account belonging to the same group.

17. A game device according to any one of claims 1 to 15, wherein the running communication application transmits image data output by the running game application to other game devices corresponding to other accounts belonging to the same group.

18. 1. A method executed on a gaming device, comprising: simultaneously executing a communication application and a game application; performing data communication with other game devices corresponding to other accounts belonging to the same group in the communication application in response to execution of the communication application; acquiring, via the data communication, first information from the other game devices corresponding to the other accounts belonging to the same group; and causing the running game application to obtain second information based on the first information in response to a request from the running game application to the running communication application via an API.

19. A program that, when executed by one or more processors, simultaneously executing a communication application and a game application; performing data communication with other game devices corresponding to other accounts belonging to the same group in the communication application in response to execution of the communication application; acquiring, via the data communication, first information from the other game devices corresponding to the other accounts belonging to the same group; and a step of causing the running game application to acquire second information based on the first information in response to a request from the running game application to the running communication application via an API.

Citation Information

Patent Citations

  • Information processing program, information processor, information processing system and information processing method

    JP2012249866A

  • Information processor, communication server, and game system

    JP2018187209A

  • Voice communication system for online gaming platforms

    JP2022514640A

  • Computer system, control method, and program

    JP2024078794A

  • Virtual community system and its communication method and its program

    JP2005157586A