Information processing device, control method for information processing device, program, and recording medium

The information processing device emulates display monitor functions through setting acceptance, execution management, and display control units to simulate monitor behaviors, addressing the challenge of testing variable refresh rate support in application programs.

JP7730385B2Active Publication Date: 2025-08-27SONY INTERACTIVE ENTERTAINMENT LLC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2023576857
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-01-31
Filing Date
2023-01-19
Publication Date
2025-08-27
Estimated Expiration
2043-01-19

AI Technical Summary

Technical Problem

The challenge is to test and debug application programs on information processing devices that support variable refresh rates, given the wide variety of display monitor functions and the difficulty in obtaining monitors with specific specifications for testing.

Method used

An information processing device that includes a setting acceptance unit to input emulation settings, an execution management unit to manage application program execution, and a display control unit to emulate the state of a connected display monitor with specified functions, allowing for virtual connection and emulation of different display monitor behaviors.

Benefits of technology

Enables emulation of operations with various display monitor functions, facilitating debugging and testing of application programs by simulating the behavior of different monitors, even if they have limitations or restrictions on refresh rates.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007730385000001
    Figure 0007730385000001
  • Figure 0007730385000002
    Figure 0007730385000002
  • Figure 0007730385000003
    Figure 0007730385000003
Patent Text Reader

Abstract

An information processing device 1 accepts input of an emulation setting concerning a function that is of a display monitor and that is to be emulated, and displays and outputs an image, rendered by executing an application program, to a display monitor that is physically connected, while emulating a state where a display monitor having a function indicated by the accepted emulation setting is virtually connected.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an information processing device such as a home game console, a control method thereof, a program executed by the device, and a recording medium storing the program. [Background technology]

[0002] In recent years, there are display monitors with a variety of functions, including those that support so-called variable refresh rates, which dynamically change the refresh rate in response to differences in drawing time for each frame in order to smooth the movement of the drawn image, display monitors that do not, and display monitors that support variable refresh rates but have limitations on how the refresh rate can be changed.

[0003] Therefore, the system program (such as an operating system) of the information processing device executes processes according to the display monitor's various functions.

[0004] For this reason, even if an application program requests the use of a variable refresh rate, the system program may respond that it cannot accommodate the request. Summary of the Invention [Problem to be solved by the invention]

[0005] In such a situation, it would be ideal for a developer of an application program to be executed on an information processing device to sequentially connect various display monitors with different functions to the information processing device, run the application program, and check and debug whether it responds appropriately to responses from the system program.

[0006] However, as mentioned above, there are a wide variety of differences in display monitor functions, and it is not realistic to test all of them. Also, it may become difficult to obtain display monitors with relatively old specifications, and it may be difficult to connect such display monitors for testing.

[0007] The present invention has been made in consideration of the above-mentioned circumstances, and one of its objects is to provide an information processing device, a control method for the information processing device, a program, and a recording medium that can emulate the operation when display monitors with various functions are connected. [Means for solving the problem]

[0008] One aspect of the present invention that solves the problems of the above-mentioned conventional examples is an information processing device that includes a setting acceptance unit that accepts input of emulation settings related to the functions of a display monitor to be emulated, an execution management unit that manages the execution of an application program, and a display control unit that emulates a state in which a display monitor having the functions represented by the accepted emulation settings is virtually connected, and displays and outputs an image drawn by executing the application program to a display monitor that is actually connected. [Effects of the Invention]

[0009] According to the information processing device of this example, it is possible to emulate the operations that would occur if display monitors with various functions were connected. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a block diagram illustrating an example of the configuration of an information processing device according to an embodiment of the present invention. [Figure 2] 1 is a functional block diagram illustrating an example of an information processing device according to an embodiment of the present invention. [Figure 3]FIG. 2 is an explanatory diagram illustrating an example of a setting screen presented by the information processing device according to the embodiment of the present invention. [Figure 4] FIG. 10 is a flowchart illustrating an example of a goal setting process performed by the information processing device according to the embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0011] An information processing device 1 according to an embodiment of the present invention is, for example, a home game console, and is connected to a display monitor 2 for use.

[0012] 1, the information processing device 1 includes a control unit 11, a storage unit 12, an operation unit 13, and a display output unit 14. In addition to these components, the information processing device 1 may also include a network interface and the like.

[0013] The control unit 11 is a program-controlled device (at least one processor) such as a CPU, and in this embodiment, executes processing in accordance with a system program and an application program stored in the storage unit 12.

[0014] The system program is used to manage the start, termination, etc. of application programs. The control unit 11 performs processes such as starting and terminating application programs in accordance with this system program. In addition, while an application program is running, the control unit 11 controls the display monitor 2 in response to requests based on the processing of the application program, and also performs input / output processes such as outputting video signals based on each frame drawn by the application program.

[0015] The application program is, for example, a game application program, and executes processing such as a game in response to user operations. The use of a variable refresh rate for the display monitor may be set in advance in connection with this application program. Furthermore, in accordance with this application program, the control unit 11 repeatedly executes processing for drawing a screen (frame).

[0016] In this embodiment, the control unit 11 emulates the functions of a display monitor as part of the operation of the system program. That is, when an application program is executed, the control unit 11 emulates a state in which a display monitor with functions represented by pre-entered emulation settings is virtually connected.

[0017] As an example, even if the display monitor 2 connected to the information processing device 1 has no limit on the rate of change of the variable refresh rate between frames, the information processing device 1 emulates the behavior (response to an application program) of a display monitor with a limit on the rate of change of the variable refresh rate between frames. Also, even if the variable range of the variable refresh rate of the display monitor 2 actually connected to the information processing device 1 is 1 to 200 Hz, the information processing device 1 emulates the behavior of a display monitor with a variable range of 1 to 144 Hz. These operations of the control unit 11 will be described later.

[0018] The storage unit 12 includes a disk device such as an SSD or HDD, as well as a memory device, and holds programs executed by the control unit 11. The storage unit 12 also operates as a work memory for the control unit 11. The programs (system programs and application programs) stored in the storage unit 12 may be provided by being stored in a computer-readable, non-transitory recording medium and copied to the storage unit 12.

[0019] The operation unit 13 accepts user operation input from an input device and outputs it to the control unit 11. If the information processing device 1 is a personal computer, this input device may be a mouse, a keyboard, or the like. If the information processing device 1 is a home game console, this input device may be a game controller, or the like.

[0020] In accordance with instructions input from the control unit 11, the display output unit 14 generates a video signal representing the frame input from the control unit 11 at the instructed timing (update timing), and outputs it to the display monitor 2.

[0021] The display monitor 2 receives an input of one frame of video signal from the information processing device 1 and displays it at a predetermined timing. If the display monitor 2 does not support a variable refresh rate, this timing will be at a fixed cycle. If the display monitor 2 supports a variable refresh rate, this timing will basically be the timing specified by the information processing device 1. The operation of this display monitor 2 is widely known, so a detailed explanation will be omitted here.

[0022] In response to a request input from the information processing device 1, the display monitor 2 outputs to the information processing device 1 functional information indicating its functions, such as whether or not it supports a variable refresh rate, and if so, information on the variable range of the variable refresh rate, and whether or not it is a restricted display monitor with restrictions on changing the variable refresh rate.

[0023] Next, a description will be given of the operation of the control unit 11 of the information processing device 1 according to this embodiment. In this embodiment, the control unit 11 executes a system program stored in the storage unit 12, thereby realizing a configuration that functionally includes a setting acceptance unit 21, an execution management unit 22, and a display control unit 23, as illustrated in FIG.

[0024] The setting acceptance unit 21 accepts settings of the functions of the display monitor to be emulated from the user. As an example, the setting acceptance unit 21 presents options of the display monitor functions that can be emulated to the user. The user sets the functions of the display monitor to be emulated by selecting a function from the presented options.

[0025] At this time, the setting acceptance unit 21 may acquire information indicating the functions of the display monitor 2 that is actually connected, and present options for functions that can be emulated based on the acquired information.

[0026] In this example, the setting acceptance unit 21 accepts from the display monitor 2 a lower limit Rmin and an upper limit Rmax of the refresh rate when operating at a variable refresh rate as information on the range of variable refresh rates that the display monitor 2 can support. The setting acceptance unit 21 also accepts from the display monitor 2 whether or not the display monitor 2 is a restricted display monitor that has a limit on the rate of change in the variable refresh rate between frames (presence or absence of a limit). Furthermore, the setting acceptance unit 21 may acquire from the display monitor 2 information on other functions, such as the value (RB) of the refresh rate when operating at a fixed refresh rate.

[0027] The setting acceptance unit 21 presents options for the range (lower limit and upper limit) of the refresh rate of the display monitor to be emulated, within the acquired range of variable refresh rates that the display monitor 2 can support, and prompts the user to input the range. Specifically, if the range of variable refresh rates that the display monitor 2 can support has a lower limit of "1 Hz" and an upper limit of "200 Hz," the setting acceptance unit 21 presents options for the lower limit, such as "1 Hz," "30 Hz," "48 Hz," etc. For the upper limit, the setting acceptance unit 21 presents options below "200 Hz," such as "60 Hz," "80 Hz," "100 Hz," "120 Hz," "144 Hz," "165 Hz," etc.

[0028] Furthermore, if the lower limit of the range of variable refresh rates that the display monitor 2 can support is "30 Hz," the setting acceptance unit 21 will present the option of selecting "30 Hz," "48 Hz," etc., excluding values ​​below "30 Hz" as the lower limit.

[0029] From the options presented in this way, the user selects the upper and lower limit values ​​of the variable range of the variable refresh rate of the display monitor to be emulated, and inputs the emulation settings.

[0030] Furthermore, the setting acceptance unit 21 uses the information on the presence or absence of restrictions acquired from the display monitor 2, and if the acquired information indicates that there is no restriction, it presents the user with an option to select whether or not to emulate a display monitor with restrictions. If the acquired information indicates that there is a restriction, the setting acceptance unit 21 does not present the user with an option to select whether or not to emulate a display monitor with restrictions.

[0031] Note that, although options are presented here to prompt the user to make a selection, this is merely an example, and the setting acceptance unit 21 may also accept input from the user such as upper and lower limit values ​​for the variable refresh rate of the display monitor 2 to be emulated, whether or not to emulate a display monitor with restrictions, etc. In this case, if the input values ​​or settings cannot be emulated based on function information acquired from the actually connected display monitor 2, the setting acceptance unit 21 may notify the user of this and request correction of the input.

[0032] For example, if the information acquired from the display monitor 2 indicates that it is restricted, and the user sets it to emulate a display monitor that is not restricted, the setting acceptance unit 21 notifies the user that emulation corresponding to the setting cannot be performed, and requests the user to correct the setting.

[0033] The execution management unit 22 manages the execution of application programs. Specifically, the execution management unit 22 performs process management processing such as starting and stopping a specified application program in response to an instruction from a user. The execution management unit 22 also performs memory management processing such as allocating memory required to execute the application program.

[0034] The display control unit 23 displays and outputs the image drawn by the control unit 11 executing the application program on the actually connected display monitor 2, but at this time the display control unit 23 performs a display output that emulates the state in which a display monitor of the function represented by the emulation setting accepted by the setting acceptance unit 21 is virtually connected.

[0035] Specifically, the emulation settings accepted by the setting accepting unit 21 from the user are: Variable refresh rate lower limit: 48Hz, upper limit: 120Hz - It is a limited display monitor, and the absolute value of the difference in refresh rate between frames must be controlled so that it does not exceed ΔRlimit (a specific value must be determined). If it is as above, the display control unit 23 operates as follows.

[0036] When an application program is executed, the display control unit 23 obtains the value (target value) of the refresh rate required for the process, and then executes the next target value setting process.

[0037] In this target value setting process, the display control unit 23 compares the target value with the lower limit and upper limit of the variable refresh rate indicated by the emulation setting. If the target value Rtarget is not between the lower limit Rmin and upper limit Rmax of the variable refresh rate indicated by the emulation setting, for example, if Rtarget > Rmax, the display control unit 23 executes processing that is predetermined in the system program as processing to be performed when the target value deviates from the limitations imposed by the display monitor's functions. As an example, the display control unit 23 continues processing with Rtarget = Rmax and notifies the application program of the setting (setting change notification).

[0038] If the target value Rtarget is between the lower limit Rmin and upper limit Rmax of the variable refresh rate indicated by the emulation setting, the display control unit 23 continues the process as is.

[0039] The display control unit 23 then calculates the absolute value ΔR=|Rtarget-Rcurrent| (where |x| means the absolute value of x) of the difference between the current refresh rate Rcurrent and the target value Rtarget (which is the value if it has been reset to Rmax), and checks whether this absolute value ΔR exceeds ΔRlimit, which is the limit set in the emulation settings.

[0040] When ΔR > ΔRlimit, the display control unit 23 executes the processing defined in the system program in advance as the processing when the limit of the limited display monitor is exceeded. For example, when Rtarget = Rcurrent + ΔRlimit (when Rtarget > Rcurrent) or Rtarget = Rcurrent - ΔRlimit (when Rtarget < Rcurrent), the display control unit 23 sets the refresh rate of the next frame as the target value and ends the target value setting process.

[0041] When the display control unit 23 checks whether the absolute value ΔR exceeds ΔRlimit defined in the emulation settings, if ΔR ≦ ΔRlimit, the display control unit 23 sets the refresh rate of the next frame as Rtarget and ends the target value setting process.

[0042] The display control unit 23 outputs the Rtarget determined in the target value setting process so far to the display monitor 2. Then, when the drawing of the frame is completed by the processing of the application program, the display control unit 23 outputs the video signal of the drawn frame to the display monitor 2. If the target value specified by the application program is different from the Rtarget determined in the target value setting process, the display control unit 23 sets Rtarget to the target value specified by the application program and executes the target value setting process again.

[0043] When the display control unit 23 outputs the video signal of the frame to the display monitor 2, if the target value specified by the application program is the same as the Rtarget determined in the target value setting process, thereafter, until the target value is changed by the application program, every time the drawing of the frame is completed by the processing of the application program, the display control unit 23 repeats the process of outputting the video signal of the drawn frame to the display monitor 2.

[0044] Furthermore, when an application program requests control at a fixed refresh rate, if a fixed refresh rate value is set in the emulation setting accepted by the setting acceptance unit 21 from the user, the display control unit 23 emulates a state in which a display monitor with that fixed refresh rate is connected.

[0045] In this example, the execution management unit 22 performs processing according to the application program's rules when it receives the setting change notification. For example, if the application program does not perform processing in response to the setting change notification, some kind of result, such as a distorted display, will be observed, and the creator of the application program will be able to know that corrections are necessary.

[0046] [Operation] The information processing device 1 of this embodiment has the above configuration and operates as follows: When the information processing device 1 receives an instruction from a user to emulate a display monitor, it acquires information indicating the functions of the connected display monitor 2, and presents options for functions that can be emulated based on the acquired information.

[0047] In the following example, it is assumed that the lower limit of the range of variable refresh rates that the display monitor 2 actually connected to the information processing device 1 can support is "1 Hz" and the upper limit is "200 Hz." It is also assumed that this display monitor 2 has no limit on the rate of change in the variable refresh rate between frames (it is not a limited display monitor).

[0048] To allow the user to select the display monitor functions that can be emulated using the display monitor 2, the information processing device 1 presents the user with options by displaying a setting screen in a manner that allows the user to select the lower limit of the variable refresh rate from "1 Hz," "30 Hz," "48 Hz," etc. (FIG. 3). The upper limit of the variable refresh rate is also displayed in a manner that allows the user to select from options below "200 Hz," such as "60 Hz," "80 Hz," "100 Hz," "120 Hz," "144 Hz," "165 Hz," etc.

[0049] Furthermore, the information processing device 1 displays an option on this setting screen to allow the user to select whether or not to emulate a display monitor with restrictions.

[0050] When the user sets the emulation on this setting screen to emulate a display monitor with a lower limit of "48Hz" and an upper limit of "144Hz," for example, and with a limit on the rate of change in the variable refresh rate between frames, the information processing device 1 operates as follows.

[0051] The information processing device 1 starts a specified application program in response to an instruction from a user. This application program sequentially draws screens (frames) to be displayed.

[0052] Since the range of the variable refresh rate is set in the emulation settings, the information processing device 1 performs emulation assuming that a display monitor with a variable refresh rate of the set lower limit value Rmin = "48 Hz" and upper limit value Rmax = "144 Hz" is connected.

[0053] Furthermore, since the emulation setting is set to emulate a display monitor with limitations, a state is emulated in which the absolute value of the difference in refresh rate between frames does not exceed a predetermined value ΔRlimit.

[0054] Note that although this value ΔRlimit is set in advance here, this value may also be set by the user as an emulation setting.

[0055] During the processing of the application program, the information processing apparatus 1 obtains the value (target value) Rtarget of the refresh rate required for the display processing by the application program, and executes target value setting processing. Note that the information processing apparatus 1 stores the value of the target value requested by the application program as the original target value (Rdemand).

[0056] That is, as illustrated in FIG. 4, the information processing apparatus 1 determines whether the target value Rtarget requested by the application program is between the lower limit value Rmin and the upper limit value Rmax of the variable refresh rate indicated by the emulation setting (whether Rmax ≥ Rtarget ≥ Rmin) (S11).

[0057] If the target value Rtarget is not between the lower limit value Rmin and the upper limit value Rmax of the variable refresh rate indicated by the emulation setting (S11: No), the information processing apparatus 1 executes the processing defined in advance in the system program as the processing when the target value deviates from the limitation by the function of the display monitor (S12). For example, if Rtarget > Rmax, the information processing apparatus 1 sets Rtarget = Rmax, and if Rtarget < Rmin, the information processing apparatus 1 sets Rtarget = Rmin to update the target value Rtarget. Then, the information processing apparatus 1 executes processing to notify that the target value has been updated in the processing of the application program (setting change notification).

[0058] If the target value Rtarget is between the lower limit value Rmin and the upper limit value Rmax of the variable refresh rate indicated by the emulation setting in step S11 (S11: Yes), the information processing apparatus 1 skips the processing of step S12.

[0059] Next, for the emulation of the restricted display monitor, the information processing apparatus 1 acquires the current refresh rate Rcurrent being used in the current frame display, and obtains the absolute value ΔR = |Rtarget - Rcurrent| of the difference between this current refresh rate Rcurrent and the target value Rtarget (the value when reset in step S12) (S13).

[0060] The information processing apparatus 1 further checks whether or not the absolute value ΔR obtained in this step S13 exceeds ΔRlimit, which is the limit defined in the emulation settings (S14).

[0061] Here, if ΔR > ΔRlimit (S14: Yes), the information processing apparatus is the processing defined in the system program in advance as the processing when exceeding the limit of the restricted display monitor. For example, the information processing apparatus updates the target value by setting the refresh rate of the next frame to Rtarget = Rcurrent + ΔRlimit (when Rtarget > Rcurrent) or Rtarget = Rcurrent - ΔRlimit (when Rtarget < Rcurrent), and ends the target setting process.

[0062] Also, if ΔR > ΔRlimit is not satisfied in step S14, the target setting process is ended as it is.

[0063] The information processing apparatus outputs the Rtarget determined in this target setting process to the display monitor 2. Then, after the frame drawing is completed by the processing of the application program, the information processing apparatus outputs the video signal of the drawn frame to the display monitor 2. Also, if the target value (the value stored as Rdemand) specified by the application program is different from the Rtarget determined in the target value setting process, the information processing apparatus resets Rtarget to the target value Rdemand specified by the application program and executes the target value setting process again.

[0064] Here, the information processing device 1 stores the target value specified by the application program as Rdemand and compares it with Rtarget determined in the target value setting process, but the present embodiment is not limited to this example. The target value at that time just before step S13 of the target setting process may be stored as Rdemand, and the stored value may be compared with Rtarget determined in the target value setting process. If these differ, reset Rtarget=Rdemand and repeat the process from step S13.

[0065] Furthermore, when the information processing device 1 outputs a frame image signal to the display monitor 2, if the target value specified by the application program (the value stored as Rdemand) is the same as the Rtarget determined in the target value setting process, the information processing device 1 thereafter repeats the process of outputting the frame image signal to the display monitor 2 each time the application program completes drawing of a frame until the target value is changed by the application program.

[0066] According to this embodiment, it is possible to emulate the operation when display monitors with various functions are connected.

[0067] For example, the target setting process emulates the operation based on the application program when a refresh rate different from the requested refresh rate is used, which can be useful for debugging and other purposes. [Explanation of symbols]

[0068] 1 information processing device, 2 display monitor, 11 control unit, 12 storage unit, 13 operation unit, 14 display output unit, 21 setting acceptance unit, 22 execution management unit, 23 display control unit.

Claims

1. a setting accepting unit that accepts input of emulation settings relating to the functions of the display monitor to be emulated; an execution management unit that manages the execution of application programs; a display control unit that emulates a state in which a display monitor having a function represented by the accepted emulation setting is virtually connected, and displays and outputs an image drawn by executing the application program on the actually connected display monitor; Including, The emulation settings are: - Lower and upper limits of the refresh rate when operating at a variable refresh rate, - Whether to limit the variation of refresh rate from frame to frame, An information processing device including at least one of the above.

2. 2. The information processing device according to claim 1, The setting acceptance unit acquires information representing the functions of a display monitor that is actually connected to the information processing device, presents virtually configurable emulation options based on the acquired information, and allows the user to select one of the presented options, thereby accepting the emulation settings.

3. 2. The information processing device according to claim 1, The emulation settings include a setting of ΔR limit, which is a limit on the rate of change, as a setting for limiting the change in refresh rate for each frame; When the execution management unit executes an application program, the display control unit obtains a refresh rate value Rtarget required for the process, and if an absolute value ΔR of the difference between the current refresh rate value Rcurrent and the refresh rate value Rtarget exceeds ΔRlimit, which is a limit on the fluctuation rate included in the emulation setting, sets the refresh rate of the next frame to: If Rtarget>Rcurrent, Rtarget=Rcurrent+ΔRlimit If Rtarget<Rcurrent, Rtarget=Rcurrent-ΔRlimit An information processing device to be set.

4. An information processing device including a processor is used, and the processor emulation settings relating to the functions of the display monitor to be emulated, - Lower and upper limits of the refresh rate when operating at a variable refresh rate, - Whether to limit the refresh rate variation from frame to frame, Accepts input for emulation settings, including at least one of manages the execution of application programs; A control method for an information processing device that emulates a state in which a display monitor having a function represented by the accepted emulation setting is virtually connected, and displays and outputs an image drawn by executing the application program on a display monitor that is actually connected.

5. Computer, emulation settings relating to the functions of the display monitor to be emulated, - Lower and upper limits of the refresh rate when operating at a variable refresh rate, - Whether to limit the refresh rate variation from frame to frame, accepting means for accepting an input of emulation settings including at least one of: an execution management means for managing the execution of an application program; a display control means for emulating a state in which a display monitor having a function represented by the accepted emulation setting is virtually connected, and displaying and outputting an image drawn by executing the application program on the actually connected display monitor; A program that functions as a

6. emulation settings relating to the functions of the display monitor to be emulated, - Lower and upper limits of the refresh rate when operating at a variable refresh rate, - Whether to limit the refresh rate variation from frame to frame, accepting means for accepting an input of emulation settings including at least one of: an execution management means for managing the execution of an application program; a display control means for emulating a state in which a display monitor having a function represented by the accepted emulation setting is virtually connected, and displaying and outputting an image drawn by executing the application program on the actually connected display monitor; A computer-readable, non-transitory recording medium that stores a program that causes a computer to function as a

Citation Information

Patent Citations

  • Refresh frequency adjustment method and device, electronic equipment and readable storage medium

    CN111131622A

  • Method and device for image display

    JP1999231854A

  • Adaptive display rate transition management for different video playback scenarios

    JP2016529534A

  • Display control unit, display control method, and display control program

    JP2021135309A

  • Expanded Refresh Rates for a Display Service

    US20190172388A1