Information processing apparatus and image display method

CN115777094BActive Publication Date: 2026-08-18SONY INTERACTIVE ENTERTAINMENT LLC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202180047757.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-08-07
Filing Date
2021-07-30
Publication Date
2026-08-18
Estimated Expiration
2041-07-30

AI Technical Summary

Benefits of technology

[0012]To address the aforementioned problems, one aspect of the information processing apparatus disclosed herein is a user-operated information processing apparatus, comprising: a communication processing section configured to communicatively connect to another information processing apparatus via a network; an acquisition section configured to acquire first image data from the other information processing apparatus; a display processing section configured to display a first image corresponding to the first image data acquired by the acquisition section; a receiving section configured to accept operation information from an input device for operating the information processing apparatus while the first image is displayed; and an image generation section configured to generate second image data corresponding to the operation information received by the receiving section. The display processing section reduces the size of the first image and displays the second image corresponding to the second image data in a manner superimposed on the reduced first image.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115777094B_ABST
    Figure CN115777094B_ABST
Patent Text Reader

Abstract

In the present application, the acquisition unit 110a acquires first image data from another information processing apparatus. The display processing unit 112a displays a first image corresponding to the first image data acquired by the acquisition unit 110a. When the first image is displayed, the reception unit 100a receives operation information for operating an input device of the first information processing apparatus 10a. The system image generation unit 104a generates second image data corresponding to the operation information received by the reception unit 100a. The display processing unit 112a reduces the first image and displays a second image corresponding to the second image data so as to be superimposed on the reduced first image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to a technology for displaying images. Background Technology

[0002] PLT1 discloses a technology that allows a user's terminal device to connect to a gaming device located in the user's home via the Internet, and allows login to the gaming device from a remote location. When the terminal device sends user operation information to the gaming device, the gaming device reflects the operation information during the game process and generates image and sound data. The gaming device streams the generated image and sound data back to the terminal device, allowing the user to play the game while they are away from the gaming device. This gaming mode is called "remote gaming."

[0003] Reference List

[0004] [Patent Literature]

[0005] [PLT 1]

[0006] WO2013 / 111247 Summary of the Invention

[0007] [Technical Issues]

[0008] By using a remote gaming mechanism, for example, when a user returns to their parents' home, the user can operate the gaming device in their parents' home, connect to their own home's gaming device, and play the games installed on their own home's gaming device. In other words, the user can play the relevant games in remote gaming mode without installing the relevant games on their parents' home gaming device.

[0009] When the gaming devices at the parents' home and the user's home are of the same type, the system screens (e.g., home screens) provided by both devices have the same layout. Therefore, it is difficult to determine whether the currently displayed system screen is provided by the user's home gaming device or the user's parents' gaming device. Therefore, it is best to employ a creative method that allows the user to identify which gaming device is providing the currently displayed screen.

[0010] Therefore, the purpose of this disclosure is to provide a technique that allows people to identify, during remote gaming, which of the connected source devices or connected destination devices is providing the screen being displayed.

[0011] [Solution to the problem]

[0012] To address the aforementioned problems, one aspect of the information processing apparatus disclosed herein is a user-operated information processing apparatus, comprising: a communication processing section configured to communicatively connect to another information processing apparatus via a network; an acquisition section configured to acquire first image data from the other information processing apparatus; a display processing section configured to display a first image corresponding to the first image data acquired by the acquisition section; a receiving section configured to accept operation information from an input device for operating the information processing apparatus while the first image is displayed; and an image generation section configured to generate second image data corresponding to the operation information received by the receiving section. The display processing section reduces the size of the first image and displays the second image corresponding to the second image data in a manner superimposed on the reduced first image.

[0013] Another aspect of this disclosure is a method for displaying an image on an information processing device, the method comprising the steps of obtaining first image data from another information processing device communicatively connected to the other information processing device via a network; displaying a first image corresponding to the first image data; receiving operation information of the information processing device for operating an input device while the first image is displayed; generating second image data corresponding to the operation information; and reducing the size of the first image and displaying the second image corresponding to the second image data in a manner superimposed on the reduced first image.

[0014] It should be noted that any combination of the above-described components of this disclosure and the conversion of their expressions between methods, devices, systems, recording media, computer programs, etc., are also valid aspects of this disclosure. Attached Figure Description

[0015] Figure 1 This is a diagram illustrating aspects of an information processing system according to an embodiment.

[0016] Figure 2 This is a diagram showing the hardware configuration of an information processing device.

[0017] Figure 3 This is a diagram showing the functional blocks of the first information processing device.

[0018] Figure 4 This is a diagram showing an example of a user's home screen provided by a first information processing device.

[0019] Figure 5 This is a diagram showing the state of the screen icon row on the main screen being moved.

[0020] Figure 6 This is an example diagram showing a screen for selecting a destination for a remote game connection.

[0021] Figure 7 This is a diagram showing the functional blocks of the second information processing device.

[0022] Figure 8 This is a diagram illustrating an example of a screen displayed when a connection is established between a first information processing device and a second information processing device.

[0023] Figure 9 This is a diagram showing an example of a user's home screen provided by a second information processing device.

[0024] Figure 10 This is an example image showing the main screen magnified.

[0025] Figure 11 This is a diagram showing an example of displaying the home screen across the entire screen.

[0026] Figure 12 This is a diagram showing the state of the icon row being moved on the home screen.

[0027] Figure 13 This is a diagram showing an example of a game screen where a user is playing remotely.

[0028] Figure 14 This is a diagram showing an example of a screen displayed when a user operates a predefined control component.

[0029] Figure 15 A diagram showing an example of a system screen provided by a first information processing device.

[0030] Figure 16 A diagram showing an example of a system screen provided by a first information processing device.

[0031] Figure 17 A diagram showing an example of a system screen provided by a second information processing device. Detailed Implementation

[0032] Figure 1 An aspect of an information processing system according to an embodiment is illustrated. In information processing system 1, management server 5 provides users with online services related to games. Management server 5 manages account information used to identify users, and users log in to the online services provided by management server 5 using their account information. It should be noted that logging into the online services may also be referred to as logging into management server 5 hereinafter.

[0033] Account information may include an email address and password. When a user logs into the information processing device that stores their account information, the account information is authenticated by the management server 5, allowing the user to log in to the management server 5. Logging into the information processing device means the user can use the device's functions, and logging into the management server 5 means the user can use network services.

[0034] By logging into management server 5, users can store game save data and register trophies earned during gameplay. Additionally, users can also perform "remote gaming" by logging into management server 5, where they log into an information processing device located remotely and play the game.

[0035] Figure 1 The illustrated information processing system 1 demonstrates its use when a user returns to his or her parents' home. A first information processing device 10a is provided in the user's parents' home, and a second information processing device 10b is provided in the user's home. By using a remote gaming mechanism, the user can access the second information processing device 10b in their own home from the first information processing device 10a in their parents' home and play games installed on the second information processing device 10b. During remote gaming, the first information processing device 10a, as the connection source, and the second information processing device 10b, as the connection destination, can connect to each other via P2P (peer-to-peer) communication through a network 3 (e.g., the Internet).

[0036] The first information processing device 10a is wirelessly or wiredly connected to the user-operated input device 6. When receiving operation information from the input device 6 in normal game mode, the first information processing device 10a reflects the operation information in the processing of system software and application software, and causes the output device 4a to output the processing result. In an embodiment, the first information processing device 10a is a game device that executes an application such as a game, and the input device 6 is a game controller that provides the user's operation information to the first information processing device 10a.

[0037] The auxiliary storage device 2a is a high-capacity storage device such as an HDD (hard disk drive) or an SSD (solid-state drive), and can be a built-in storage device or an external storage device connected to the first information processing device 10a via a USB (Universal Serial Bus) or similar means. The output device 4a can be a television set with a display for outputting images and speakers for outputting sound. The output device 4a can be connected to the first information processing device 10a via a wired cable or wirelessly.

[0038] Access point (hereinafter referred to as "AP") 8a has wireless access point and router functions, and first information processing device 10a is wirelessly or via wired cable connected to AP 8a and connected to external network 3. Camera 7a is a stereo camera and captures images of the space surrounding output device 4a.

[0039] As described above, a second information processing device 10b is provided in the user's home. The second information processing device 10b is wirelessly or wired connected to the auxiliary storage device 2b, the output device 4b, the camera 7b, and the AP 8b, each of which is a peripheral device. The connection between the second information processing device 10b and the various peripheral devices in the user's home can be made in the same manner as the connection between the first information processing device 10a and the various peripheral devices in the user's parents' home. In this embodiment, the second information processing device 10b is a gaming device of the same type as the first information processing device 10a, and without a particular distinction between the first information processing device 10a and the second information processing device 10b, these devices can simply be referred to as "information processing device 10".

[0040] Figure 2 The hardware configuration of the information processing device 10 is shown. The information processing device 10 includes a main power button 20, a power ON LED (light-emitting diode) 21, a standby LED 22, a system controller 24, a clock 26, a device controller 30, a media driver 32, a USB module 34, a flash memory 36, a wireless communication module 38, a wired communication module 40, a subsystem 50, and a main system 60.

[0041] The main system 60 includes a main CPU (central processing unit), memory as main storage, a memory controller, and a GPU (graphics processing unit). The GPU is mainly used to perform arithmetic operations in the game program. These functions are configured as a system-on-a-chip and formed on a single chip. The main CPU has the function of executing the game program recorded in the auxiliary storage device 2 or ROM (read-only memory) medium 44.

[0042] Subsystem 50 includes a sub-CPU, memory as the main storage device, memory controller, etc., but does not include a GPU and does not have the function of executing game programs. The sub-CPU has fewer circuit gates than the main CPU, and the sub-CPU has lower power consumption than the main CPU.

[0043] The main power button 20 is an input section for user operation. It is provided on the front surface of the housing of the information processing device 10 and is operated to turn the power supply of the main system 60 on or off. The power ON LED 21 lights up when the main power button 20 is turned on, and the standby LED 22 lights up when the main power button 20 is turned off.

[0044] The system controller 24 detects when the user presses the main power button 20. If the main power button 20 is pressed when the main power is off, the system controller 24 receives the press operation as an "on command", and if the main power button 20 is pressed when the main power is on, the system controller 24 receives the press operation as an "off command".

[0045] Clock 26 is a real-time clock that generates the current date and time information and provides this information to system controller 24, subsystem 50, and main system 60. Device controller 30 is configured as an LSI (Large-Scale Integrated Circuit) to act as a southbridge for information transfer between devices. As shown, devices such as system controller 24, media driver 32, USB module 34, flash memory 36, wireless communication module 38, wired communication module 40, subsystem 50, and main system 60 are all connected to device controller 30. Device controller 30 absorbs differences in electrical characteristics and data transfer rates between devices and controls the timing of data transfer.

[0046] The media drive 32 contains a ROM medium 44, which has application software, such as games, and license information recorded thereon to drive the ROM medium 44, as well as a drive mechanism for reading programs, data, etc. from the ROM medium 44. The ROM medium 44 can be a read-only recording medium, such as an optical disc, magneto-optical disc, Blu-ray disc, etc.

[0047] USB module 34 is a module that connects to external devices using a USB cable. USB module 34 can be connected to auxiliary storage device 2 and camera 7 using a USB cable. Flash memory 36 is an auxiliary storage device included in the internal memory. Wireless communication module 38 communicates wirelessly with, for example, input device 6 using communication protocols such as Bluetooth (registered trademark) or IEEE (Institute of Electrical and Electronics Engineers) 802.11. Wired communication module 40 communicates with external devices via wired connection and is connected to network 3 through AP 8.

[0048] In this embodiment, the user first logs into the first information processing device 10a at his or her parents' home and then logs into the management server 5. Then, the user executes an application for playing a remote game (hereinafter referred to as the "remote application"), accesses the second information processing device 10b, and logs into the second information processing device 10b.

[0049] Figure 3Functional blocks of the first information processing device 10a are shown. The first information processing device 10a includes a receiving section 100a, a login processing section 102a, a system image generation section 104a, an application execution section 106a, an application image generation section 108a, an acquisition section 110a, a display processing section 112a, and a communication processing section 114a. The communication processing section 114a is shown... Figure 2 The functions of the wireless communication module 38 and the wired communication module 40 shown are illustrated.

[0050] exist Figure 3 In this context, each of the components described as functional blocks performing various processes can be configured by circuit blocks, memory, and other LSI hardware, or implemented by program software such as programs loaded into memory. Therefore, those skilled in the art will understand that these functional blocks can be implemented in various ways, not limited to any one of them, by separate hardware, separate software, or a combination thereof.

[0051] When the first information processing device 10a starts up, the login processing unit 102a generates a login screen and displays it on the output device 4a. Information about users who have registered account information on the first information processing device 10a is displayed in a list on the login screen. When a user selects their own user information, the receiving unit 100a accepts the selection and the login processing unit 102a allows the user to log in. If a login password is set, the login processing unit 102a first verifies the password and then allows the user to log in. When a user logs into the first information processing device 10a, the account information registered on the first information processing device 10a is authenticated by the management server 5, and the user logs into the management server 5.

[0052] Figure 4 An example of a user home screen provided by a first information processing device 10a is shown. When a user logs into the first information processing device 10a, a system image generation unit 104a generates homepage image data for the user, and a display processing unit 112a displays the homepage image on an output device 4a. The system image generation unit 104a is implemented by system software and has the function of generating system image data for presenting menu items, etc., to the user. Homepage image data is a type of system image data.

[0053] On the main screen, icons for user-executable content such as games and applications are arranged side-by-side. The user uses the arrow keys on input device 6 to move a row of icons horizontally and arrange the desired content icons in selection area 150. Figure 4 On the main screen shown, remote application icon 152 is the icon for executing remote applications.

[0054] Figure 5 The diagram shows the state where the icon row has been moved on the main screen. When the user arranges the remote application icons 152 in the selection area 150, a launch button 154 for launching the remote application is displayed. When the user presses the launch button 154, the application execution section 106a launches the remote application.

[0055] Figure 6 An example of a screen for selecting a remote game connection destination is shown. The application image generation section 108a generates a connection destination selection image, while the display processing section 112a displays the connection destination selection image on the output device 4a. Figure 6 In the example shown, although two information processing devices, namely "Second Home Control Console" and "Bedroom Control Console," are displayed as connection destination selections, the number of options can be one, three, or more. Users can name the control consoles as needed. Here, "Second Home Control Console" is the information processing device provided in the user's second home, while "Bedroom Control Console" is a second information processing device 10b provided in the user's home. The user operates input device 6, moves selection box 156, selects "Bedroom Control Console" provided in his or her home in this example, and performs a confirmation operation.

[0056] When the receiving unit 100a accepts the confirmation operation of selecting "the control panel in the bedroom" as the connection destination, the communication processing unit 114a sends a connection request to the second information processing device 10b. At this time, if the main power of the second information processing device 10b is off, the main system 60 of the second information processing device 10b is started based on the connection request. The first information processing device 10a and the second information processing device 10b are connected to each other via P2P communication through the network 3, which creates an environment that enables remote gaming.

[0057] Figure 7 Functional blocks of the second information processing device 10b are shown. The second information processing device 10b includes a receiving section 100b, a login processing section 102b, a system image generation section 104b, an application execution section 106b, an application image generation section 108b, and a communication processing section 114b. The communication processing section 114b is shown... Figure 2 The functions of the wireless communication module 38 and the wired communication module 40 shown are illustrated.

[0058] exist Figure 7In this context, each of the components described as functional blocks performing various processes can be configured by hardware such as circuit blocks, memory, and other LSI components, or implemented by software such as program software loaded into memory. Therefore, those skilled in the art will understand that these functional blocks can be implemented in various ways, and are not limited to any one of them, by separate hardware, separate software, or combinations thereof. In this embodiment, the second information processing device 10b can be a gaming device of the same type as the first information processing device 10a, and therefore, the second information processing device 10b and the first information processing device 10a provide the same user interface to the user.

[0059] Figure 8 An example of a screen displayed when a connection is established between the first information processing device 10a and the second information processing device 10b is shown. The display processing section 112a not only displays the message "Connecting to your bedroom console" indicating that a connection is being established, but also sets and displays a reduced area 160, smaller than the entire display area of ​​the screen, within a portion of the display screen. The reduced area 160 is displayed differently from the screen background so that the user can easily identify the presentation of the reduced area 160.

[0060] When communication processing unit 114a and communication processing unit 114b are communicatively connected to each other via network 3 through P2P communication, the remote application sends a user login request from communication processing unit 114a to the second information processing device 10b.

[0061] In the second information processing device 10b, the communication processing unit 114b receives a user's login request from the first information processing device 10a. The receiving unit 100b accepts the login request received by the communication processing unit 114b and passes it to the login processing unit 102b, which then allows the user to log in. As a result of the user logging into the second information processing device 10b, the system image generation unit 104b generates homepage image data for the user, and the communication processing unit 114b sends the generated homepage image data to the first information processing device 10a.

[0062] In the first information processing device 10a, the communication processing unit 114a provides the received homepage image data to the acquisition unit 110a, and the acquisition unit 110a acquires the homepage image data. The display processing unit 112a displays the homepage image corresponding to the acquired homepage image data on the output device 4a.

[0063] Figure 9An example of a user home screen provided by a second information processing device 10b is shown. When a user logs into the second information processing device 10b, the display processing unit 112a displays the home screen in a reduced area 160. This reduced area 160 is the area set in the center of the display screen when a connection is established, and when the acquisition unit 110a acquires home page image data from the second information processing device 10b, the display processing unit 112a displays the home page image in a reduced manner on the output device 4a.

[0064] Display processing unit 112a displays information indicating that the homepage image data has been generated by the second information processing device 10b, in a manner added to the homepage image. Display processing unit 112a displays a frame 170 as said information, in a manner added to the homepage image generated by the second information processing device 10b. The frame 170 can be represented in a single color or multiple colors. In any case, the frame 170 is added to indicate that the image has been generated by an information processing device different from the first information processing device 10a directly operated by the user, and preferably in a color different from the background color.

[0065] Simultaneously, the display processing unit 112a can display console information 172 of the second information processing device 10b, which is the connection destination, as information indicating that the homepage image data has been generated by the second information processing device 10b. In this example, the console information 172 is the console name of the second information processing device 10b given by the user, and the user can identify that the homepage image data has been generated by the second information processing device 10b by viewing the console information 172.

[0066] The display processing unit 112a performs a display action, enlarging the homepage image displayed in the reduced area 160 to the entire display screen.

[0067] Figure 10 An example of the main screen being magnified is shown. The display processing unit 112a can magnify and display the main image at a predetermined rate.

[0068] Figure 11 An example of displaying the main screen across the entire display screen is shown. Even after the main screen has been displayed across the entire display screen, the display processing unit 112a continues to display the outer frame 170. This allows the user to recognize that the main screen being displayed is provided by the second information processing device 10b.

[0069] Meanwhile, the display processing unit 112a can limit the display of the console information 172 to a predetermined time period. Since the console information 172 enters the image, it is anticipated that continuous display would become a distraction. Therefore, the display processing unit 112a displays the console information 172 only for a predetermined time period after the homepage image begins to be displayed. For example, the display processing unit 112a can limit the display time of the console information 172 to a range of three to five seconds.

[0070] When the homepage image is displayed across the entire screen, the user's input device 6's operation information is essentially provided to the second information processing device 10b. It should be noted that the operation information of the predetermined operating components of the input device 6 is provided to the first information processing device 10a.

[0071] On the main screen provided by the second information processing device 10b, icons for content such as games and applications installed on the auxiliary storage device 2b are arranged side by side. When user operation information sent from the input device 6 is received while displayed on the main screen, the receiving unit 100a provides the operation information to the communication processing unit 114a, and the communication processing unit 114a sends the operation information to the second information processing device 10b. In the second information processing device 10b, when the communication processing unit 114b receives the operation information, the receiving unit 100b provides the operation information to the system image generation unit 104b.

[0072] exist Figure 11 On the main screen shown, when the user operates the horizontal arrow keys on the input device 6, the system image generation unit 104b generates homepage image data for horizontally moving the icon row, and the communication processing unit 114b sends the generated homepage image data to the first information processing device 10a. In the first information processing device 10a, the communication processing unit 114a provides the received homepage image data to the acquisition unit 110a, and the acquisition unit 110a acquires the homepage image data. The display processing unit 112a displays the homepage image corresponding to the acquired homepage image data on the output device 4a.

[0073] Figure 12The state of the icon row already moved on the main screen is shown. When the user arranges the game icons 174 in the selection area 150 and operates the predetermined execution button on the input device 6, the application execution section 106b launches a game called "Combat Field," and the application image generation section 108b generates game image data. The application image generation section 108b includes a GPU (Graphics Processing Unit) that performs rendering and other processing, and generates game image data from the viewpoint position (virtual camera) in virtual space in response to the arithmetic operation result in virtual space by the application execution section 106b. It should be noted that although the application sound generation section (not shown) generates game sound data simultaneously, the description of the game sound data will be omitted below.

[0074] The communication processing unit 114b streams game image data to the first information processing device 10a. In the first information processing device 10a, the acquisition unit 110a acquires the game image data, and the display processing unit 112a displays the game image corresponding to the game image data on the output device 4a.

[0075] Figure 13 An example of a game screen shown in a remote game played by a user is illustrated. In this example, the user plays a "battlefield" executed by the second information processing device 10b, and the display processing unit 112a displays a game image corresponding to the game image data sent from the second information processing device 10b. It should be noted that when displaying the game image, the display processing unit 112a does not add information indicating that the game image data has been generated by the second information processing device 10b. Figure 13 As shown, the outer frame 170 and console information 172 are not added to the game image, which allows users to play the game without noticing the outer frame 170 and console information 172.

[0076] As described above, the operation information of the input device 6 is essentially sent to the second information processing device 10b and processed during remote gaming. However, the functions for operating the first information processing device 10a are assigned to some operating components in the input device 6, and the user can display the system image of the first information processing device 10a by operating the relevant operating components during remote gaming.

[0077] Figure 14An example of a screen displayed when a user operates a predetermined operating component is shown. When a remote game is running, functions for operating the first information processing device 10a are assigned to some operating components of the input device 6, and when operation information regarding the operating components is received, the receiving section 100a provides the operation information to the system image generation section 104a. The system image generation section 104a generates system image data corresponding to the operation information received by the receiving section 100a, and the display processing section 112a displays system images 180 and 182 corresponding to the system image data on the output device 4a.

[0078] System images 180 and 182 are GUIs (Graphical User Interfaces) used to inform the user of information related to active applications on the first information processing device 10a, as well as information presumably of high priority to the user. The system image generation section 104a generates a card-like GUI for each unit of information, including a portion of that information. Here, system image 180 is a GUI about a remote game being played, and system image 182 is a GUI about music of interest to the user. It should be noted that the system image generation section 104a can generate three or more system image data entries.

[0079] Display processing unit 112a reduces the game image displayed across the entire screen to a smaller size and displays system images 180 and 182 overlaid on the reduced game image. Therefore, while displaying the game screen, display processing unit 112a not only displays the system images 180 and 182 in a reduced size but also uses them as background images, making it easier for the user to recognize that system images 180 and 182 were generated by the first information processing device 10a. Simultaneously, display processing unit 112a reduces the game image to the same size as the reduced area 160, making it easier for the user to recognize the reduced game image generated by the second information processing device 10b.

[0080] At this time, the display processing unit 112a adds an outline 170 to the game image displayed in a scaled-down manner. By adding the outline 170 to the scaled-down game image, it becomes easier for the user to recognize that the scaled-down game image was generated by the second information processing device 10b. System images 180 and 182 become active and operable by the user when displayed in the foreground, and the operation information of the input device 6 is processed by the first information processing device 10a.

[0081] When the user selects "Bedroom Control Panel" in system image 180 and performs a confirmation operation, system image generation section 104a generates system image data for remotely operating the second information processing device 10b, and display processing section 112a displays the system image corresponding to the system image data on output device 4a.

[0082] Figure 15 An example of a system screen provided by the first information processing device 10a is shown. System image 184 is generated by the first information processing device 10a and displayed in the foreground relative to a game image displayed in a scaled-down manner. Figure 15 In the system image 184 shown, the "Home" item is selected.

[0083] In system image 184, when the user selects "Home" and performs a confirmation operation, the communication processing unit 114a sends a request to the second information processing device 10b to generate homepage image data. In the second information processing device 10b, when the receiving unit 100b accepts the request to generate homepage image data, the system image generation unit 104b generates homepage image data for the relevant user, and the communication processing unit 114b sends the generated homepage image data to the first information processing device 10a.

[0084] In the first information processing device 10a, the communication processing unit 114a provides received homepage image data to the acquisition unit 110a, and the acquisition unit 110a acquires the homepage image data. The display processing unit 112a displays the homepage image corresponding to the acquired homepage image data on the output device 4a. At this time, as in... Figure 9 As shown, after displaying the homepage image in the reduced area 160, the display processing unit 112a performs a display action that gradually enlarges the homepage image (see reference). Figure 10 ), and finally display the homepage image on the entire screen (see reference). Figure 11 ).

[0085] Figure 16 An example of a system screen provided by the first information processing device 10a is shown. Figure 16In the system image 184 shown, the item "Control Center" is selected. In system image 184, when the user selects "Control Center" and performs a confirmation operation, the communication processing unit 114a sends a request to the second information processing device 10b to generate system image data. In the second information processing device 10b, when the receiving unit 100b accepts the request to generate system image data, the system image generation unit 104b generates system image data for the relevant user, and the communication processing unit 114b sends the generated system image data to the first information processing device 10a. The system image data is GUI (Graphical User Interface) data used to inform the user about information about active applications on the second information processing device 10b and information that is presumably of high priority to the user.

[0086] Figure 17 An example of a system screen provided by the second information processing device 10b is shown. In the first information processing device 10a, the communication processing unit 114a provides system image data received from the second information processing device 10b to the acquisition unit 110a, and the acquisition unit 110a acquires the system image data. The display processing unit 112a displays system images 186, 188, 190, and 192 corresponding to the acquired system image data on the output device 4a. At this time, in such... Figure 9 After displaying system images 186, 188, 190, and 192 in the reduced area 160 shown, the display processing unit 112a performs a display operation, gradually enlarging the system images 186, 188, 190, and 192, and finally displaying them on the entire screen.

[0087] At this time, the display processing unit 112a displays the outer frame 170 and console information 172 as information indicating that system image data has been generated in the second information processing device 10b. It should be noted that the console information 172 only needs to display a predetermined time period.

[0088] System images 186, 188, 190, and 192 are GUIs (Graphical User Interfaces) used to inform the user about active applications on the second information processing device 10b, as well as information presumably of high priority to the user. The system image generation section 104b generates a card-like GUI for each unit of information, including portions of the stated information. Here, system image 186 is a GUI about a game titled "Battlefield," system image 188 is a GUI about information from friends, system image 190 is a GUI about a new game that interests the user, and system image 192 is a GUI about online friends. When the user selects any of the GUIs, detailed information about that graphical user interface can be presented.

[0089] The description of this disclosure is based on the above embodiments. Those skilled in the art should understand that these embodiments are illustrative, and various modifications can be made to the combination of components and processes, and such modifications also fall within the scope of this disclosure.

[0090] [Industrial Applicability]

[0091] This disclosure applies to techniques for displaying images.

[0092] [List of Reference Symbols]

[0093] 1: Information Processing System

[0094] 4a: Output device

[0095] 6: Input devices

[0096] 10a: First information processing equipment

[0097] 10b: Second information processing equipment

[0098] 100a, 100b: Acceptance Part

[0099] 102a, 102b: Login processing section

[0100] 104a, 104b: System image generation section

[0101] 106a, 106b: Application execution section

[0102] 108a, 108b: Application image generation section

[0103] 110a: Acquiring Part

[0104] 112a: Display processing section

[0105] 114a, 114b: Communication processing section

Claims

1. A first information processing device operated by a user, wherein, The first information processing device is used to remotely control a game installed on the second information processing device, wherein the first information processing device and the second information processing device have the same screen layout, and the first information processing device includes: A communication processing section is configured to be communicatively connected to the second information processing device via a network; The acquisition section is configured to acquire first image data from the second information processing device; The display processing section is configured to display a first image corresponding to the first image data acquired by the acquisition section; The receiving portion is configured to accept operation information from an input device for operating the first information processing device when the first image is displayed; and The image generation section is configured to generate second image data corresponding to the operation information received by the receiving section, wherein... The display processing section shrinks the first image and displays a second image corresponding to the second image data by superimposing it on the shrunken first image, wherein the first image is a system image of the second information processing device and the second image is a system image of the first information processing device.

2. The first information processing device according to claim 1, wherein... The display processing section displays information indicating that the first image data has been generated by the second information processing device, in a manner added to the first image.

3. The first information processing device according to claim 2, wherein... The display processing section displays the outer frame as information by adding it to the first image.

4. The first information processing apparatus according to any one of claims 1 to 3, wherein, When the communication processing part establishes a connection with the second information processing device, the display processing part performs a display action, which sets a reduced area in a portion of the display screen, displays the first image in the reduced area after the connection is established, and enlarges the first image across the entire display screen.

5. An image display method for displaying an image on a first information processing device, wherein, The first information processing device is used to remotely control a game installed on the second information processing device, wherein the first information processing device and the second information processing device have the same screen layout, and the image display method includes: First image data is obtained from the second information processing device, wherein the first information processing device is communicatively connected to the second information processing device via a network; Display the first image corresponding to the first image data; When the first image is displayed, the device receives operation information from the input device for operating the first information processing device. Generate second image data corresponding to the operation information; and The first image is reduced in size and a second image corresponding to the second image data is displayed on top of the reduced first image, wherein the first image is a system image of the second information processing device and the second image is a system image of the first information processing device.

6. A recording medium for a first information processing device, having a program thereon for enabling the first information processing device to implement the image display method as described in claim 5.

Citation Information

Patent Citations

  • Information processing device and information processing system

    WO2013111247A1

  • Positioning a camera video overlay on gameplay video

    US20150290540A1