Information processing device, control method for information processing device, and program

The information processing device automatically manages low latency mode settings to accommodate Gaming-VRR needs, addressing the inconvenience of manual mode switching in gaming devices by enabling Gaming-VRR as needed, enhancing user convenience.

JP7749303B2Active Publication Date: 2025-10-06SONY INTERACTIVE ENTERTAINMENT LLC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2024532103
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-07-06
Filing Date
2023-06-30
Publication Date
2025-10-06
Estimated Expiration
2043-06-30

AI Technical Summary

Technical Problem

Existing gaming devices require users to manually switch between Gaming-VRR and ALLM modes frequently when switching applications, as turning off ALLM prevents Gaming-VRR from being enabled, leading to inconvenience.

Method used

An information processing device that automatically sets and manages low latency mode based on user preferences, allowing Gaming-VRR to be enabled regardless of the stored ALLM setting when necessary, using a processor, memory unit, and application execution to handle video signal output.

Benefits of technology

Enables low latency mode settings according to user wishes, improving convenience by automatically adjusting modes without manual intervention.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007749303000001
    Figure 0007749303000001
  • Figure 0007749303000002
    Figure 0007749303000002
  • Figure 0007749303000003
    Figure 0007749303000003
Patent Text Reader

Abstract

This information processing device is connected to video output equipment and outputs a video signal to said video output equipment. The information processing device comprises a processor and a storage unit. Said processor executes an application, receives a setting of an automatic low latency mode, and holds said setting in the storage unit. When the video signal is to be output at a variable refresh rate according to the processing by the application that has been executed, the processor performs operations on the assumption that the automatic low latency mode is ON regardless of the setting of the automatic low latency mode that has been held in the storage unit.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an information processing device that outputs a video signal to a video output device, a control method for the information processing device, and a program. [Background technology]

[0002] HDMI (registered trademark: High-Definition Multimedia Interface) 2.1a and later versions include various functional enhancements such as variable refresh rate (VRR), especially Gaming-VRR, QMS-VRR (Quick Media Switching VRR), and ALLM (Auto Low Latency Mode), and specifications corresponding to each of these functions have been established.

[0003] Of these, Gaming-VRR enables video output from the device (source) that outputs the video signal to the display (sink) with the lowest possible latency, so when using Gaming-VRR, ALLM should be turned on (see the HDMI2.1a specification). Summary of the Invention [Problem to be solved by the invention]

[0004] Generally, with gaming devices, it is considered that using Gaming-VRR as long as it is available will suit the user's purposes, so Gaming-VRR is left on all the time, and therefore ALLM is left on all the time.

[0005] However, in recent years, game consoles have begun to output video, such as movies, streamed over the Internet. Users also want to enjoy high-quality in-game video. In these cases, image quality takes priority over low latency, so it is best to turn off ALLM.

[0006] However, if a setting to turn off ALLM is introduced, for example, when an application such as a game requests Gaming-VRR, if ALLM remains off, Gaming-VRR cannot be turned on due to the above specifications. Therefore, in order to properly set ALLM while utilizing the Gaming-VRR function, the user must switch ALLM on and off every time they switch applications that output video signals, which is inconvenient.

[0007] The present invention has been made in consideration of the above-mentioned situation, and one of its objects is to provide an information processing device, a control method for the information processing device, and a program that allow a user to set a low latency mode in accordance with their wishes and improve the convenience of that setting. [Means for solving the problem]

[0008] One aspect of the present invention for solving the problems of the above-mentioned conventional examples is an information processing device that is connected to a video output device and outputs a video signal to the video output device, the information processing device having a processor and a memory unit, the processor executes an application, accepts an automatic low latency mode setting, and stores the setting in the memory unit, and when a video signal is to be output at a variable refresh rate due to processing of the application being executed, the information processing device operates as if the automatic low latency mode is on, regardless of the automatic low latency mode setting stored in the memory unit. [Effects of the Invention]

[0009] According to the present invention, the low latency mode can be set in accordance with the user's wishes, and the convenience of the setting can be improved. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a block diagram illustrating a configuration and connection example of an information processing device according to an embodiment of the present invention. [Figure 2]1 is a functional block diagram illustrating an example of an information processing device according to an embodiment of the present invention. [Figure 3] FIG. 2 is a flowchart illustrating an example of the operation of the information processing device according to the embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0011] An embodiment of the present invention will be described with reference to the drawings. An information processing device 1 according to the embodiment of the present invention is a program-controlled device such as a home game console or a personal computer, and as shown in Fig. 1, includes a control unit 11 as a processor, a storage unit 12, an operation unit 13, an output control unit 14, and a communication unit 15. The information processing device 1 is also connected to a video output device 2 such as a display.

[0012] The control unit 11 is a program-controlled device that operates according to a program stored in the storage unit 12, and in the example of this embodiment, it executes an application program and also accepts the setting of the automatic low latency mode (ALLM) and stores the setting in the storage unit 12. Furthermore, when a video signal should be output at a gaming variable refresh rate (Gaming-VRR) due to processing of the application being executed, the control unit 11 operates as if the automatic low latency mode is on, regardless of the setting of the automatic low latency mode stored in the storage unit 12. The operation of the control unit 11 will be described in detail later.

[0013] The storage unit 12 includes a memory device, a disk device, etc. The storage unit 12 stores a program executed by the control unit 11. The program may be provided by being stored in a computer-readable, non-transitory recording medium and copied to the storage unit 12. The storage unit 12 also operates as a work memory for the control unit 11.

[0014] The operation unit 13 is communicatively connected to input devices such as a game controller, mouse, and keyboard, and receives information representing the content of the instruction operations performed by the user from these input devices and outputs it to the control unit 11.

[0015] The output control unit 14 outputs video signals and control signals to the video output device 2 in accordance with instructions input from the control unit 11. The communication unit 15 is a network interface or the like, and communicates with a server or the like connected via a network in accordance with instructions input from the control unit 11.

[0016] Next, a description will be given of the operation of the control unit 11. As illustrated in Fig. 2, the control unit 11 of this embodiment functionally includes an application execution unit 21, an information acquisition unit 22, a setting processing unit 23, and a video output unit 24.

[0017] The application execution unit 21 executes an application program (hereinafter simply referred to as an application) instructed by the user and performs processing in accordance with the application. The applications executed by the application execution unit 21 include various programs such as game programs and video playback programs that play back videos distributed via a network.

[0018] In one example of an embodiment of the present invention, for each application installed in the information processing device 1, it is pre-set whether or not it requests the output of a video signal at a variable refresh rate (is it a Gaming-VRR requesting application), and this setting (application setting) is stored in the memory unit 12.

[0019] The information acquisition unit 22 communicates with the video output device 2 connected to the information processing device 1 at a predetermined timing, such as when the information processing device 1 is started up, and acquires information indicating whether the video output device 2 supports video output at a variable refresh rate (Gaming-VRR) (Gaming-VRR compatible or not) and whether it supports automatic low latency mode (ALLM) (ALLM compatible or not).

[0020] The setting processing unit 23 accepts a setting related to the automatic low latency mode from the user. Here, the setting related to the automatic low latency mode is, for example, a setting to turn the automatic low latency mode on (a mode in which the information processing device 1 determines the low latency mode as necessary) or off (a mode in which the information processing device 1 does not instruct the low latency mode).

[0021] When the information acquisition unit 22 acquires information indicating whether the video output device 2 connected to the information processing device 1 is ALLM-compatible, such as when the information acquisition unit 22 starts up the information processing device 1, the setting processing unit 23 initializes at least a part of the settings by referring to the information. Specifically, when information is acquired that the video output device 2 connected to the information processing device 1 is not ALLM-compatible, the setting processing unit 23 turns off the automatic low latency mode and stores and retains information indicating this in the storage unit 12.

[0022] In addition, when the setting processing unit 23 acquires information that the video output device 2 connected to the information processing device 1 is ALLM compatible, it turns on the automatic low latency mode and stores and retains information indicating this in the memory unit 12.

[0023] Furthermore, in accordance with instructions input by the user, the setting processing unit 23 obtains the current (at the time of the above instruction) automatic low latency mode settings stored in the memory unit 12, displays the contents of the settings, and allows the user to select whether to turn the automatic low latency mode on or off.

[0024] Here, when the user sets the automatic low latency mode to ON, the setting processing unit 23 refers to the information acquired by the information acquisition unit 22 indicating whether the video output device 2 is ALLM compatible, and if it determines based on the information that the video output device 2 is not ALLM compatible, it notifies the user of an error and keeps the automatic low latency mode OFF.

[0025] Furthermore, when the setting processing unit 23 refers to information indicating whether the video output device 2 is ALLM compatible or not, and determines based on the information that the video output device 2 connected to the information processing device 1 is ALLM compatible, the setting processing unit 23 turns on the automatic low latency mode in accordance with the user's settings, and stores and retains the information indicating the settings in the memory unit 12.

[0026] On the other hand, when the user is allowed to select whether to turn the automatic low latency mode on or off, if the user sets the automatic low latency mode to off, the setting processing unit 23 turns the automatic low latency mode off in accordance with the user's setting, and stores and retains information representing the setting in the memory unit 12.

[0027] The video output unit 24 determines whether the application being executed by the application execution unit 21 is a Gaming-VRR requesting application that requests video signal output at a variable refresh rate, and if the application being executed by the application execution unit 21 is not a Gaming-VRR requesting application, it operates in accordance with the automatic low latency mode settings stored in the memory unit 12.

[0028] In this case, if the setting of the automatic low latency mode stored in the storage unit 12 is "on", the video output unit 24 instructs the video output device 2 to enable the automatic low latency mode. Then, the video output unit 24 outputs the video signal to be output by the operation of the application execution unit 21 to the video output device 2.

[0029] At this time, the video output device 2 switches between a low latency mode and a non-low latency mode (referred to as a normal mode) without any human operation, in accordance with predetermined conditions (such as conditions using information indicating the type of video input from the information processing device 1) according to the input video signal, and displays and outputs the video. The operation of this video output device 2 is widely known, so a detailed description thereof will be omitted here.

[0030] Furthermore, if the setting of the automatic low latency mode stored in the storage unit 12 is "off," the video output unit 24 instructs the video output device 2 to disable the automatic low latency mode. Then, the video output unit 24 outputs the video signal that should be output by the operation of the application execution unit 21 to the video output device 2.

[0031] At this time, the video output device 2 displays and outputs the video in a normal mode different from the low latency mode, regardless of the video signal input from the information processing device 1 or the information indicating the video type.

[0032] On the other hand, when the video output unit 24 determines whether the application being executed by the application execution unit 21 is a Gaming-VRR requesting application that requests video signal output at a variable refresh rate, if the application being executed by the application execution unit 21 is a Gaming-VRR requesting application, it operates as if the automatic low latency mode is on, regardless of the automatic low latency mode setting stored in the memory unit 12, and instructs the video output device 2 to enable the automatic low latency mode.

[0033] Therefore, in this case, the video output device 2 switches between low latency mode and a non-low latency mode (called normal mode) without any human operation, according to predetermined conditions (such as conditions using information indicating the type of video input from the information processing device 1) depending on the input video signal, and displays and outputs the video.

[0034] In the explanation so far, when the video output unit 24 determines whether the application being executed by the application execution unit 21 is a Gaming-VRR request application, (1) When the application execution unit 21 executes one application at a time (single task): The video output unit 24 determines whether or not the one application being executed is a Gaming-VRR request application. Also, (2) When the application executed by the application execution unit 21 executes multiple applications in parallel (multitasking): the video output unit 24 may determine whether or not at least one of the applications being executed is a Gaming-VRR request application, (2') When the application executed by the application execution unit 21 executes multiple applications in parallel (multitasking), and some of the applications instruct the output of a video signal: the video output unit 24 may determine whether or not at least one of the applications instructing the output of the video signal is a Gaming-VRR request application.

[0035] In this latter example, when one of the applications executed by the application execution unit 21 is running in full screen mode (stopping the video output at the instruction of another application and outputting only the video signal at the instruction of its own application), the video output unit 24 will determine whether the application running in full screen mode is a Gaming-VRR request application.

[0036] [Operation] This embodiment basically has the above configuration and operates as follows: In the following explanation, it is assumed that the information processing device 1 runs multiple applications in parallel, but runs one of the applications in full screen (during which time, video output based on instructions from other applications is not performed).

[0037] At the time of startup, the information processing device 1 communicates with the video output device 2 connected to the information processing device 1 to acquire information indicating whether the video output device 2 supports video output at a variable refresh rate (Gaming-VRR) (Gaming-VRR compatible or not) and whether the video output device 2 supports automatic low latency mode (ALLM) (ALLM compatible or not), and the like, and stores the information in the storage unit 12. In the following example, it is assumed that the video output device 2 connected to the information processing device 1 is ALLM compatible.

[0038] A user operates the information processing device 1 to set the automatic low latency mode in advance. For example, a user who mainly uses an application for watching distributed video on the information processing device 1 sets the automatic low latency mode to off. The information processing device 1 then turns off the automatic low latency mode in accordance with the user's setting, and stores and retains information indicating the setting in the storage unit 12.

[0039] Thereafter, when the information processing device 1 receives an instruction from the user to start executing the processing of one of the installed applications, it starts the processing illustrated in FIG. 3 and checks whether the application that has been instructed to start executing outputs a video signal at a variable refresh rate (S11).

[0040] If the application instructed to start execution here outputs a video signal at a variable refresh rate (S11: Yes), the information processing device 1 operates as if the automatic low latency mode is on, regardless of the automatic low latency mode setting stored in the memory unit 12, and instructs the video output device 2 to enable the automatic low latency mode (S12).

[0041] The information processing device 1 then starts the application instructed to start execution and runs it in full screen (S13). Thereafter, the information processing device 1 executes the processing of the application until it receives an instruction to end the application or an instruction to switch to another application (S14).

[0042] When an instruction to terminate an application or to switch to another application is received, the information processing device 1 assumes that an instruction to start execution of the switched application (when an instruction to terminate an application is received, the application is switched to a so-called shell application for launching the application, etc.) has been received, and returns to step S11 to continue processing.

[0043] On the other hand, in step S11, if the application instructed to start execution does not output a video signal at a variable refresh rate (S11: No), the information processing device 1 refers to the automatic low latency mode setting stored in the memory unit 12 (S15), and if the setting is "on" (S15: "on"), it instructs the video output device 2 to enable the automatic low latency mode (S16), and proceeds to step S13 to continue processing.

[0044] Also, in step S15, if the referenced automatic low latency mode setting is "off" (S15: "off"), the video output device 2 is instructed to disable the automatic low latency mode (S17), and the process proceeds to step S13 to continue processing.

[0045] In the information processing device 1 according to an example of this embodiment, the above operations are performed, and thereby an instruction to enable or disable ALLM is issued as follows.

[0046] (1) If the connected video output device 2 does not support ALLM In this case, the information processing device 1 sets ALLM to OFF and notifies an error when the user attempts to set ALLM to ON.

[0047] (2) If the connected video output device 2 supports ALLM In this case, the information processing device 1 operates as follows depending on the user's ALLM on / off setting.

[0048] (a) When the application launched by the user and outputting video does not require video signal output in Gaming-VRR (for example, video signal output at a fixed refresh rate). In this case, the information processing device 1 follows the user's ALLM setting stored in the storage unit 12, and if the setting is off, instructs the video output device 2 to disable the automatic low latency mode and continues processing the application.

[0049] At this time, if the setting is on, the information processing device 1 instructs the video output device 2 to enable the automatic low latency mode, and continues processing the application.

[0050] (b) When the application launched by the user and outputting video requires video signal output via Gaming-VRR. In this case, the information processing device 1 instructs the video output device 2 to enable automatic low latency mode regardless of the user's ALLM setting stored in the memory unit 12 (i.e., whether the setting is on or off), and continues processing the application.

[0051] In this manner, in this embodiment, the low latency mode is set according to the user's wishes, and when Gaming-VRR is used, the low latency mode is enabled regardless of the user's settings, thereby improving the convenience of the settings.

[0052] [Gaming-VRR Settings] Furthermore, in the example of this embodiment, when the information processing device 1 has received a setting from the user as to whether or not to permit output of a video signal in Gaming-VRR, the information processing device 1 may operate as follows.

[0053] In this example, with regard to instructions to enable or disable ALLM, the information processing device 1 (1) performs the same operation as already described when the connected video output device 2 is not ALLM-compatible, and (2) when the connected video output device 2 is ALLM-compatible and (a) the application that the user has started and is outputting video does not request video signal output in Gaming-VRR, performs the same operation as already described.

[0054] On the other hand, (2) if the connected video output device 2 is ALLM compatible, and (b) if the application launched by the user to output video requests video signal output in Gaming-VRR, the information processing device 1 refers to the user's Gaming-VRR settings, and if the user has made a setting to allow video signal output in Gaming-VRR, the information processing device 1 instructs the video output device 2 to enable automatic low latency mode regardless of the user's ALLM settings stored in the memory unit 12 (i.e., whether the setting is on or off), and continues processing the application (as previously explained).

[0055] However, when (2) the connected video output device 2 is ALLM compatible, and (b) the application that the user has launched and is outputting video requests video signal output in Gaming-VRR, and the user has made a setting that does not allow video signal output in Gaming-VRR (when Gaming-VRR is turned off and, for example, video signal output at a fixed refresh rate is instructed), the information processing device 1 follows the user's ALLM setting stored in the memory unit 12, and if the setting is off, instructs the video output device 2 to disable automatic low latency mode and continues processing the application.

[0056] If the setting is on, the information processing device 1 instructs the video output device 2 to enable the automatic low latency mode, and continues processing the application.

[0057] Note that the information processing device 1 may accept a setting for turning ALLM on or off when video signal output at a fixed refresh rate is set (i.e., when Gaming-VRR is off). In this example, a menu for setting ALLM on or off is presented on the setting screen only when video signal output at a fixed refresh rate is set, for example. Also in this example, when video signal output at a fixed refresh rate is set, automatic low latency mode control is performed based on the setting. That is, the information processing device 1 follows the user's ALLM setting stored in the storage unit 12. If the setting is off, the information processing device 1 instructs the video output device 2 to disable the automatic low latency mode and executes application processing. If the setting is on, the information processing device 1 instructs the video output device 2 to enable the automatic low latency mode and executes application processing. Also, when video signal output at a fixed refresh rate is off (i.e., Gaming-VRR is on), the information processing device 1 may set ALLM on and display the setting screen so that ALLM is fixed to on. In this case, the information processing device 1 may store in the memory unit 12 the setting regarding ALLM on / off received from the user while Gaming-VRR is set to off (i.e., video output at a fixed refresh rate), and may return to the stored ALLM setting the next time Gaming-VRR is set to off (i.e., video output at a fixed refresh rate).

[0058] [Application-independent switching] In this way, when the information processing device 1 accepts a setting from the user as to whether or not to allow the output of video signals in Gaming-VRR, it may perform processing to determine whether or not to enable ALLM based on the setting, regardless of whether or not the application being launched requests the output of video signals in Gaming-VRR.

[0059] That is, in this example, (1) If the connected video output device 2 does not support ALLM In this case, the information processing device 1 sets ALLM to OFF and notifies an error when the user attempts to set ALLM to ON.

[0060] (2) If the connected video output device 2 supports ALLM In this case, the information processing device 1 operates as follows depending on the user's ALLM on / off setting.

[0061] (a') When the user has set up the device to allow the output of video signals in Gaming-VRR In this case, the information processing device 1 follows the user's ALLM setting stored in the memory unit 12, and if the setting is off, instructs the video output device 2 to disable the automatic low latency mode, and processes the application.

[0062] If the setting is on, the information processing device 1 instructs the video output device 2 to enable the automatic low latency mode, and performs application processing.

[0063] On the other hand, (b') when the user has set the device not to allow video signal output in Gaming-VRR. In this case, the information processing device 1 instructs the video output device 2 to enable automatic low latency mode, regardless of the user's ALLM setting stored in the memory unit 12 (i.e., whether the setting is on or off), and processes the application.

[0064] [Switching while an application is running] In the explanation up to this point, an application setting that determines whether or not to request video signal output in Gaming-VRR is held for each application, and the information processing device 1 determines whether or not the application to be executed requests video signal output in Gaming-VRR based on the application setting, and performs processing to determine whether or not to enable ALLM. However, the present embodiment is not limited to this.

[0065] That is, in one example of the present embodiment, the information processing device 1 may perform processing to determine whether to enable ALLM when an output of a video signal in Gaming-VRR is requested by an application process during execution of the application process. In this example, when the application is started, if the connected video output device 2 is ALLM-compatible, the information processing device 1 instructs the video output device 2 whether to enable or disable ALLM in accordance with the user's ALLM settings stored in the storage unit 12.

[0066] Thereafter, when the information processing device 1 receives a request to output a video signal in Gaming-VRR during the execution of an application process, it instructs the video output device 2 to enable automatic low latency mode regardless of the user's ALLM setting stored in the memory unit 12 (i.e., whether the setting is on or off), and continues processing the application.

[0067] Furthermore, when the information processing device 1 subsequently ends the output of the video signal in Gaming-VRR (the video signal is now output at a fixed refresh rate) during the execution of the processing of the application, it again instructs the video output device 2 to enable or disable ALLM according to the user's ALLM settings stored in the memory unit 12, and continues processing the application.

[0068] In this example, the application can select whether to turn ALLM on or off according to the user's setting, or to forcibly turn it on to use Gaming-VRR, depending on the video signal it outputs. As a result, for example, while a game application is running, the information processing device 1 turns Gaming-VRR on in scenes where real-time performance is important, such as battle scenes, and turns ALLM on regardless of the user's setting. On the other hand, in scenes where scenery or the like is enjoyed, the information processing device 1 determines whether to turn ALLM on or off according to the user's setting. In this way, the information processing device 1 of this embodiment is able to output video in accordance with the user's selection. [Explanation of symbols]

[0069] 1 information processing device, 2 video output device, 11 control unit, 12 storage unit, 13 operation unit, 14 output control unit, 15 communication unit, 21 application execution unit, 22 information acquisition unit, 23 setting processing unit, 24 video output unit.

Claims

1. An information processing device that is connected to a video output device and outputs a video signal to the video output device, the information processing device having a processor and a storage unit, This processor is Run the application and Accepting a setting for an automatic low latency mode and storing the setting in the storage unit; When a video signal should be output at a variable refresh rate due to processing of the application being executed, the information processing device operates as if the automatic low latency mode is on, regardless of the automatic low latency mode setting stored in the memory unit.

2. 2. The information processing device according to claim 1, The information processing device wherein, when the application being executed is an application that outputs a video signal at a variable refresh rate, the processor operates as if the automatic low latency mode is on while the application is being executed, regardless of the automatic low latency mode setting stored in the memory unit.

3. 2. The information processing device according to claim 1, The information processing device wherein the processor operates as if the automatic low latency mode is on when the application being executed requests that a video signal be output at a variable refresh rate, regardless of the automatic low latency mode setting stored in the memory unit.

4. An information processing device that is connected to a video output device and outputs a video signal to the video output device, the information processing device having a processor and a storage unit, This processor is Run the application and Accepting a setting for an automatic low latency mode and storing the setting in the storage unit; When a video signal should be output at a fixed refresh rate due to processing of the application being executed, the information processing device controls an automatic low latency mode based on the automatic low latency mode setting stored in the storage unit.

5. A control method for an information processing device that is connected to a video output device and outputs a video signal to the video output device, the information processing device having a processor and a storage unit, the processor, Run the application, Accepting an automatic low latency mode setting and storing the setting in the storage unit; A control method for an information processing device that operates as if an automatic low latency mode is on when a video signal should be output at a variable refresh rate due to processing of the application being executed, regardless of the automatic low latency mode setting stored in the memory unit.

6. An information processing device that is connected to a video output device and outputs a video signal to the video output device, Run the application, Accept the Auto Low Latency Mode setting and keep it set, When a video signal should be output at a variable refresh rate due to processing of the application being executed, the program functions to operate as if the automatic low latency mode is on, regardless of the retained automatic low latency mode setting.

Citation Information

Patent Citations

  • Display device, external device and playing control method

    CN114302195A

  • Image data output device, image data output method, image display device, and integrated circuit

    JP2018028559A