Information processing apparatus and image display method

Abstract

The content image display unit 112 displays a content image. The system image display unit 130 displays a system image on the content image according to a user operation. The button display unit 144 displays a session button for inviting a specific user to a game session.

Description

Technical Field

[0001] This disclosure relates to a technique for overlaying a system image generated by system software onto a content image and displaying the overlaid image. Background Technology

[0002] PTL 1 discloses a gaming device through which a user operates an input device to change the display screen from a game screen to a main screen, further operates the input device to change the display screen from the main screen to a function screen, and then selects a chat icon on the function screen to display an entry screen to a chat room.

[0003] [List of Citations]

[0004] [Patent Literature]

[0005] [PTL 1]

[0006] JP 2016-042338A Summary of the Invention

[0007] [Technical Issues]

[0008] In recent years, opportunities to establish communication with friends via the Internet have increased, such as playing games or chatting with friends in remote locations. Therefore, there is a need to simplify the process of establishing communication with friends.

[0009] [Problem Solution]

[0010] To address the aforementioned problems, an information processing apparatus according to one aspect of this disclosure includes a content image display section that displays a content image, and a system image display section that overlays a system image onto the content image and displays the overlaid image based on user operation. The system image display section includes a button display section that displays a function button for inviting a specific user. The button display section also displays a call button for inviting a specific user to participate in a game call.

[0011] According to another aspect of this disclosure, an image display method is a method of overlaying different images on a content image and displaying the overlaid images. The method includes: the step of displaying the content image; the step of overlaying a first window including information about multiple users on the content image and displaying the overlaid images; and the step of overlaying information about one of the users included in the first window with a second window including a session button for inviting the user to a game session on the content image and displaying the overlaid images.

[0012] Note that any combination of the above components and expressions of this disclosure is also valid as an aspect of this disclosure when transformed into methods, devices, systems, and computer programs. Attached Figure Description

[0013] Figure 1 This is a diagram illustrating an information processing system according to an embodiment.

[0014] Figure 2 This is a diagram showing the external structure of the upper surface of the input device.

[0015] Figure 3 This is a diagram showing the hardware configuration of an information processing device.

[0016] Figure 4 This is a diagram showing the functional blocks of an information processing device.

[0017] Figure 5 This is an example diagram showing a game screen.

[0018] Figure 6 This is an example of a system image overlaid on a game image and displayed.

[0019] Figure 7 This is an example image showing the friends window.

[0020] Figure 8 This is an example image showing a friend's detailed window.

[0021] Figure 9 This is a diagram showing an example of a project field.

[0022] Figure 10 This is an example image showing an invitation window. Detailed Implementation

[0023] Figure 1 This is an information processing system 1 according to an embodiment. Information processing system 1 includes an information processing device 10 used by user A, information processing devices 12a to 12c used by other users (hereinafter referred to as "information processing device 12" unless otherwise specifically distinguished), and a management server 5. Information processing devices 10 and 12 can be terminal devices with the same structure and functions. An access point (hereinafter referred to as "AP") 8 has the functions of a router and a wireless access point, and information processing device 10 is connected to AP 8 wirelessly or via a wired connection to connect to the management server 5 on network 3 through AP 8 in a manner capable of communicating with the management server 5. Information processing devices 10 and 12 are connected to each other through the management server 5, allowing users to play games together or chat with each other.

[0024] Auxiliary storage device 2 is a high-capacity storage device such as HDD (hard disk drive) or SSD (solid state drive). It can be an internal storage device or an external storage device connected to information processing device 10 via USB (Universal Serial Bus) or similar means. Output device 4 can be a television with an output image and speakers for output sound, or it can be a head-mounted display. Output device 4 can be connected to information processing device 10 via cable or wirelessly. A camera 7, which also functions as an imaging device, is provided near output device 4 to image the space around output device 4. Camera 7 can be a stereo camera.

[0025] The information processing device 10 is connected to the user-operated input device 6 via wired or wireless means. The input device 6 outputs the user's operation information to the information processing device 10. When operation information is received from the input device 6, the information processing device 10 reflects the operation information in the system software or application processing, and then outputs the processing result from the output device 4. In this embodiment, the information processing device 10 is a game device that executes a game program or other application, and the input device 6 can be a game controller that provides the user's operation information to the game device.

[0026] Management server 5 provides network services to users of information processing system 1. Management server 5 manages and identifies each user's network account, and each user logs in to the network services provided by management server 5 using his / her network account. Management server 5 provides an environment that allows users who have logged into the relevant network services to play games with each other or establish communication with each other through voice chat and video chat.

[0027] The button configuration for input device 6 will now be described.

[0028] Figure 2 The external configuration of the upper surface of the input device is shown. The user operates the input device 6 by holding the left grip portion 78b with his / her left hand and the right grip portion 78a with his / her right hand. The upper surface of the housing of the input device 6 is provided with directional keys 71, analog sticks 77a and 77b, and four operation buttons 76. The four buttons 72 to 75 have different graphics marked with different colors to allow them to be distinguished from each other. Specifically, the circular button 72 is marked with a red circle, the cross button 73 with a blue cross, the square button 74 with a purple square, and the triangular button 75 with a green triangle.

[0029] A function button 80 is provided between the two analog sticks 77a and 77b. The function button 80 is used to power on the input device 6 and simultaneously enable the communication function connecting the input device 6 and the information processing device 10. After the input device 6 is connected to the information processing device 10, the function button 80 is also used to cause the information processing device 10 to overlay a system image generated by the system software onto a content image such as a game image and display the overlaid image.

[0030] A touchpad 79 is provided in a flat area between the directional keys 71 and the operation buttons 76. The touchpad 79 also functions as a press-type button that retracts when pressed by the user and returns to its original position when the user removes their hand. A shared button 81 is provided between the touchpad 79 and the directional keys 71 for inputting user commands to the system software in the information processing device 10. An option button 82 is provided between the touchpad 79 and the operation buttons 76 for inputting user commands to the application (game) software executed by the information processing device 10.

[0031] Figure 3 The hardware configuration of the information processing device 10 is shown. The information processing device 10 includes a main power button 20, a power LED (light-emitting diode) 21, a standby LED 22, a system controller 24, a clock 26, a device controller 30, a media driver 32, a USB module 34, a flash memory 36, a wireless communication module 38, a wired communication module 40, a subsystem 50, and a main system 60.

[0032] The main system 60 includes a main CPU (Central Processing Unit), memory used as main storage, a memory controller, and a GPU (Graphics Processing Unit). The GPU is mainly used for computational processing of the game program. These functions can be configured as a system-on-a-chip and formed on a single chip. The main CPU has the function of executing the game program recorded in the auxiliary storage device 2.

[0033] Subsystem 50 includes a sub-CPU, memory used as the main storage device, a memory controller, etc., but does not include a GPU and does not have the function of executing game programs. The sub-CPU has fewer circuit gates than the main CPU, and the sub-CPU's operating power consumption is lower than that of the main CPU. The sub-CPU also operates when the main CPU is in standby mode, and its processing functions are limited to maintain low power consumption.

[0034] The main power button 20 is an input unit for user operation input and is provided on the front of the housing of the information processing device 10. Operating the main power button 20 turns the power supply to the main system 60 of the information processing device 10 on or off. When the main power button 20 is turned on, the power-on LED 21 illuminates, and when the main power button 20 is turned off, the standby LED 22 illuminates.

[0035] System controller 24 detects the pressing of the main power button 20 by the user. If the main power button 20 is pressed when the main power is off, system controller 24 accepts the pressing operation as an "on command"; however, if the main power button 20 is pressed when the main power is on, system controller 24 accepts the pressing operation as an "off command".

[0036] Clock 26 is a real-time clock that generates the current date and time information and provides this information to system controller 24, subsystem 50, and main system 60. Device controller 30 is configured as an LSI (Large-Scale Integrated Circuit) that performs information transfer between devices, such as the southbridge. As shown, devices such as system controller 24, media driver 32, USB module 34, flash memory 36, wireless communication module 38, wired communication module 40, subsystem 50, and main system 60 are connected to device controller 30. Device controller 30 adapts to differences in electrical characteristics or data transfer rates between devices and controls the timing of data transfer.

[0037] Media drive 32 is a drive device that loads and drives a ROM (Read-Only Memory) medium 44 on which software such as games and license information is recorded, and reads programs, data, etc. from the ROM medium 44. The ROM medium 44 is a read-only recording medium such as an optical disc, magneto-optical disc, or Blu-ray disc.

[0038] USB module 34 is a module that connects to external devices via a USB cable. USB module 34 can connect to auxiliary storage device 2 and camera 7 via the USB cable. Flash memory 36 is an auxiliary storage device that forms internal storage. Wireless communication module 38 performs wireless communication with input device 6, for example, under a communication protocol such as Bluetooth (registered trademark) or IEEE (Institute of Electrical and Electronics Engineers) 802.11. Incidentally, wireless communication module 38 can support digital mobile phone systems. Wired communication module 40 performs wired communication with external devices. Wired communication module 40 connects to external network 3, for example, via AP 8.

[0039] Figure 4Functional blocks of an information processing device are shown. The information processing device 10 includes a processing section 100 and a communication section 102. The processing section 100 includes an operation receiving section 110, a content image display section 112, an acquisition section 114, a session management section 116, a content execution section 118, and a system image display section 130. The system image display section 130 is implemented by system software and includes a menu display section 140, a friend information display section 142, a button display section 144, and a selection item display section 146, and generates a system image. The system image display section 130 overlays the system image onto the content image according to user operation and displays the overlaid image.

[0040] exist Figure 4 In this context, elements represented as functional blocks for performing various types of processing can be configured by hardware such as circuit blocks, memory, or another LSI, or implemented by software such as system software or game programs loaded into memory. Therefore, those skilled in the art will understand that these functional blocks can be implemented in various ways by hardware alone, by software alone, or by a combination of hardware and software. Functional blocks are not limited to any of these.

[0041] The communication unit 102 receives operation information related to operations performed by the user using buttons or other input devices 6, and simultaneously receives information from the management server 5 indicating the current status of user A's friends, chat-related data, etc. The communication unit 102 is described as having... Figure 3 The configuration of the functions of the wireless communication module 38 and the wired communication module 40 shown.

[0042] The operation receiving unit 110 receives operation information from the input device 6 via the communication unit 102. In this embodiment, the content execution unit 118 executes the game program and generates game image and sound data. The functions provided by the content execution unit 118 are implemented by system software, the game program, or hardware such as a GPU. Note that the game is an example of an application, and the content execution unit 118 can execute applications other than games.

[0043] While user A is playing the game, the operation receiving unit 110 provides operation information from the input device 6 to the content execution unit 118. Simultaneously, the content execution unit 118 performs computational processing to move the player character in virtual space based on the operation information. The content execution unit 118 includes a GPU that performs rendering processing, and upon receiving the results of the computational processing in virtual space, it generates game image data and game sound data from the viewpoint position (virtual camera) in virtual space. The content image display unit 112 displays the game image from the output device 4, and the sound providing unit (not shown) outputs the game sound from the output device 4.

[0044] Figure 5 An example of a game screen shown is being played by user A. User A is playing the game while viewing and listening to the game images and sounds output from output device 4, and simultaneously operating input device 6.

[0045] The information processing device 10 of this embodiment provides a solution that allows user A, who is playing a game, to invite a friend to join his / her game session in a simple process. During gameplay, when user A briefly presses the function button 80 of the input device 6, the operation receiving section 110 receives the brief press operation of the function button 80.

[0046] The operation receiving section 110 provides information about short-press operations of function button 80 received while the game is running to the system image display section 130. In the system image display section 130, the menu display section 140 overlays a system image, including multiple menu items, onto the game image and displays the overlaid image. When the system image is displayed overlaid on the game image, the operation receiving section 110 begins providing the system software with the operation information to be received subsequently.

[0047] Figure 6 An example is shown where system images, including menu icons, are overlaid on game images and displayed. The menu display section 140 sets up a function icon selection area 200 at the bottom of the display screen, arranging and placing multiple menu icons in a row. User A selects a menu icon, allowing user A to execute the system function associated with the selected icon. Here, user A selects the friend icon 202.

[0048] When the operation receiving unit 110 receives operation information related to the selection of the friend icon 202, the friend information display unit 142 overlays a system image containing information about user A's friends onto the game image and displays the overlaid image.

[0049] Figure 7 An example of the Friends window 210 is shown. The Friends information display section 142 overlays the Friends window 210, which includes the usernames of online users B, C, D, and E, as well as the titles of the games that users B, C, D, and E are playing, onto the game image, and displays the overlaid image. Information about friends is obtained from the management server 5 via the acquisition section 114. The acquisition section 114 can retrieve friend information from the management server 5 periodically, or it can retrieve friend information from the management server 5 when the status of a friend changes. Preferably, user A's friend information is kept up-to-date in the information processing device 10. User A can confirm online friends by viewing the Friends window 210, and can also confirm the title of the game that the online friend is playing.

[0050] The friends window 210 includes a selection box 212, which user A moves to select one of their friends. When user A aligns the selection box 212 with user B and operates the input button on the input device 6, the operation receiving section 110 receives the operation information, and the friend information display section 142 displays a detailed window including user B's information on the right side of the friends window 210.

[0051] Figure 8 An example of a friend's details window 214 is shown. The friend information display section 142 overlays the details window 214, which includes the details of the selected user B, onto the game image, and displays the overlaid image. In this example, the acquisition section 114 acquires the motion image of the game played by user B through the management server 5, and then reproduces the motion image in the details window 214. The details window 214 may display, for example, the game time, or information about the chat groups that user B participates in.

[0052] In the details window 214, the button display section 144 shows function buttons for inviting a specific user. This specific user is user B, selected in the friends window 210. Figure 8 In the example shown, the button display section 144 is arranged in rows in the detail window 214 and displays a text chat button 220 for inviting user B to text chat, a voice chat button 222 for inviting user B to voice chat, and a session button 224 for inviting user B to a game session.

[0053] The details window 214 is an area that displays a friend's details, and by placing the text chat button 220, the voice chat button 222, and the conversation button 224 in the details window 214, user A can easily invite a specific friend to a chat or game conversation.

[0054] The following outlines the process that occurs when user B is invited to a game session.

[0055] (Process 1) User A briefly presses function button 80 while playing the game, causing the function icon to appear at the bottom of the screen.

[0056] (Process 2) User A selects and manipulates the friend icon 202, and makes the friend window 210 overlap the game image and display the overlapping image.

[0057] (Process 3) User A selects User B in the Friends window 210 and makes the Details window 214 overlap the game image and display the overlapping image.

[0058] (Process 4) User A presses the Session button 224 in the details window 214.

[0059] In this way, user A can easily invite user B to the game session. Note that if user B is invited to text chat or voice chat instead of the game session, user A can press the text chat button 220 or the voice chat button 222 in process 4.

[0060] like Figure 8 As shown, the button display section 144 displays a text chat button 220, a voice chat button 222, and a conversation button 224 on the same screen as the screen that displays information about a specific user, allowing user A to confidently identify a game partner and also to invite the game partner to perform certain functions such as chat or game conversation.

[0061] Figure 9 An example of the item field 216 to be displayed after pressing the session button 224 is shown. When the session button 224 is pressed, the selection item display portion 146 displays item field 216, which includes options for inviting friends to an active game session and for inviting friends to an inactive game session. In the case where user A invites user B to a session of a game that user A is currently playing, user A selects the item "Invite to Game Session". Alternatively, in the case where user A invites user B to a session of another game, user A selects the item "Activate Game First, Invite to Game Session". In this way, in the information processing device 10 of this embodiment, invitations to game sessions are managed not by a single game, but by system software. Therefore, in any case where user A invites a friend to any type of game, the friend can be invited through the common user interface of the game.

[0062] Figure 10 An example of an invitation window 218 for user B is shown. When in Figure 9 When the item "Invite to Game Session" is selected in the item field 216 shown, the system image display section 130 displays the invitation window 218. When user A selects and operates the item "Invite", the session management section 116 sends an invitation message to user B through the management server 5. If a game session already exists, the session management section 116 invites user B to the existing game session; if no game session exists, the session management section 116 creates a new game session and then invites user B to that game session.

[0063] The present disclosure has been described above based on embodiments thereof. These embodiments are exemplary, and those skilled in the art should understand that the combination of its components and processes can be modified in various ways, and these examples of modifications also fall within the scope of this disclosure. In this embodiment, the game is provided as content; however, the content may include moving images in addition to the game.

[0064] [Industrial Applicability]

[0065] This disclosure can be applied to the technical field of multiple images overlapping each other.

[0066] [List of Reference Symbols]

[0067] 1: Information Processing System

[0068] 10: Information processing equipment

[0069] 100: Processing section

[0070] 102: Communication part

[0071] 110: Operation receiving section

[0072] 112: Content Image Display Section

[0073] 114: Obtaining Part

[0074] 116: Session Management Section

[0075] 118: Content Execution Section

[0076] 130: System Image Display Section

[0077] 140: Menu Display Section

[0078] 142: Friend Information Display Section

[0079] 144: Button Display Section

[0080] 146: Select the item to display section

Claims

1. An information processing device, comprising: The content image display section displays the content image. as well as The system image display section overlays the system image onto the content image based on user operations and displays the overlaid image, wherein... The system image display section includes a button display section, which displays function buttons for performing the function of inviting specific users, and The button display section shows a session button for inviting the specific user to a game session. The system image display section includes a selection item display section. When the session button is selected, the selection item display section displays options including items for inviting a specific user to an activated game session and items for inviting the specific user to a game session that has not yet been activated. The button display section includes a chat button for inviting specific users and a conversation button. The information processing device also includes: The user information display section shows information about the specific user, wherein... The button display section displays the function buttons on the same screen as the screen that displays information about the specific user.

2. An image display method for overlaying different images onto a content image and displaying the overlaid images, the method being implemented by the information processing device of claim 1, the method comprising: The steps for displaying the content image; The step of overlaying a first window containing information about multiple users onto the content image and displaying the overlaid image; as well as The step of overlaying a message about one of the users included in the first window onto the content image with a second window including a session button for inviting the user to a game session, and displaying the overlaid image.

3. A computer program product, comprising a computer program, characterized in that, The computer program enables the computer to implement the image display method of claim 2.

Images