Methods for adapting projection coordinates and playback devices
By calculating the coordinates of the target rectangle and performing coordinate transformation in the projection system, the problem of the interface edge controls being obscured in the wide-format projection system was solved, achieving complete visibility and consistent display of the interface and controls.
Patent Information
- Application Number
- CN202611577752.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-10-13
- Publication Date
- 2026-11-10
AI Technical Summary
Existing projection systems cannot simultaneously guarantee the complete visibility of edge controls and the consistency of interface position when outputting different graphical interfaces. This is especially true in widescreen projection systems, where information such as buttons and focus boxes may be obscured, making it difficult for users to accurately determine the current focus position.
By obtaining the target aspect ratio and presentation method, the coordinates of the target rectangle are calculated, and a unified target rectangle is set in the system graphics output link to realize the coordinate transformation and mapping between the effective canvas and the global display rectangle, ensuring the complete visibility and positional consistency of the interface and edge controls.
Without modifying the layout, the player's desktop, settings page, media library, system dialog boxes, and third-party applications are simultaneously mapped to the wide visible area, ensuring the complete visibility and consistent position of the interface and edge controls, and avoiding the need to rearrange and modify the layout for each interface individually.
Smart Images

Figure CN123075166A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of projection technology, and in particular to a method for adapting projection coordinates and a playback device. Background Technology
[0002] 2.35:1, 21:9, and 1.85:1 aspect ratio projection systems typically retain a wide horizontal display area and use screen masking or lens positioning to fill the visible area with the video image. However, the player's desktop, settings page, media library, system dialog boxes, and third-party applications are still laid out according to the 16:9 logical canvas. If the device continues to output a complete 16:9 graphical interface, buttons, focus boxes, and prompts near the top and bottom edges of the screen may fall into the masked area, preventing the user from seeing the complete interface and accurately determining the current focus position. Summary of the Invention
[0003] The main purpose of this application is to provide a method for adapting projection coordinates and a playback device, which can solve the technical problem that the fixed display range in the prior art cannot simultaneously meet the complete display of different graphical interfaces.
[0004] To achieve the above objectives, the first aspect of this application provides a method for adapting projected coordinates, the method comprising: Obtain the settings data, which includes the target aspect ratio and presentation mode; If the playback state read is the global graphics state and the presentation mode is global compression, then the effective width and effective height of the corresponding effective canvas are obtained according to the current output mode read. Based on the target aspect ratio, the effective width and effective height of the effective canvas, obtain the rectangle coordinates of the target rectangle, and use the target rectangle as the global display rectangle. The rectangle coordinates include the coordinates of the top left corner, the width of the rectangle, and the height of the rectangle. Based on the original logical coordinates of the valid canvas, coordinate transformation and mapping between the valid canvas and the global display rectangle are performed through the corresponding target transformation method.
[0005] To achieve the above objectives, a second aspect of this application provides a playback device, including a memory and a processor. The memory stores a computer program, and when the computer program is executed by the processor, the processor performs the steps of the above-described method for adapting projection coordinates.
[0006] The embodiments of this application have the following beneficial effects: This application sets a unified target rectangle in the system's graphical output link, which can simultaneously map the player's desktop, settings page, media library, system dialog boxes, controls, and third-party applications to a wide visible area without modifying the layout. This ensures the complete visibility of the interface and edge controls, as well as the consistency of the interface position, without the need to rearrange and modify the layout for each interface individually. Attached Figure Description
[0007] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0008] in: Figure 1 This is a flowchart of the projection coordinate adaptation method in the embodiments of this application; Figure 2 This is a schematic diagram of the coordinate transformation between the effective canvas and the target rectangle in an embodiment of this application; Figure 3 This is a structural block diagram of the playback device in the embodiments of this application. Detailed Implementation
[0009] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.
[0010] 2.35:1, 21:9, and 1.85:1 aspect ratio projection systems typically retain a wider horizontal display area and use screen masking or lens positioning to fill the visible area with the video image. However, the player's desktop, settings page, media library, system dialog boxes, and third-party applications are still laid out according to the 16:9 logical canvas. If the device continues to output a complete 16:9 graphical interface, buttons, focus boxes, and prompts near the top and bottom edges of the screen may fall into the masked area, preventing the user from seeing the complete interface and accurately determining the current focus position.
[0011] Modifying the margins of controls within a proprietary media player only affects the player's internal pages. Third-party applications will still draw using their original logical coordinates, and system pop-ups and the desktop will not automatically follow.
[0012] In existing technologies, the first approach involves fixing and blocking the top and bottom portions of the 16:9 screen at the projection end, without altering the graphics output on the device side. This method can only reduce the actual visible area; it cannot move controls that were originally located at the edge into the visible area.
[0013] In addition, long-term fixed center compression will affect the full screen of the video; writing coordinates immediately upon receiving a playback exit event will write an error mode item because the HDMI mode is not yet stable.
[0014] The second approach is to add top and bottom margins within the desktop or media player. This approach requires each page to be adapted separately, and it cannot uniformly handle third-party applications, system dialog boxes, and subsequently added pages; the margin values used by different modules may also be inconsistent.
[0015] Based on this, this application provides a projection coordinate adaptation scheme.
[0016] like Figure 1 As shown, in one embodiment, a method for adapting projected coordinates is provided. This method can be applied to a terminal. The method for adapting projected coordinates specifically includes the following steps: S100: Obtain settings data, including target aspect ratio and presentation mode.
[0017] Specifically, the settings data can be selected by the user, or it can be the projection device configuration, display device capability information, or application scenario configuration.
[0018] The global adaptation service can pre-acquire and save the setting data, which includes the target aspect ratio r and the presentation mode c; wherein, the presentation mode c includes: global compression (i.e., desktop global compression) and graphic masking.
[0019] The target aspect ratio r, also known as the target width-to-height ratio r, can take any one of the following values: 2.35, 21 / 9, 1.85, or other preset ratios. This application does not impose any restrictions on this.
[0020] The target aspect ratio r and the presentation mode c can be saved separately, so that users do not need to reselect the aspect ratio r when changing the presentation mode c.
[0021] In addition, the initial state generation g can be obtained. If the settings change, the system increments the state generation g and notifies the global adaptation service to reprocess.
[0022] S200: If the playback state read is the global graphics state and the presentation mode is global compression, then obtain the effective width and effective height of the corresponding effective canvas according to the current output mode read.
[0023] Specifically, read the current output mode M, which is the HDMI output mode.
[0024] The playback state P includes the global graphics state G, the movie playback state V, and the pending recovery state E (i.e., exiting the pending recovery state E).
[0025] If the current playback state P is read as the global graphics state G, and the presentation mode c is global compression, then the target rectangle is determined to be used as the global display rectangle.
[0026] Before calculating the target rectangle, first obtain the effective width and effective height of the valid canvas (i.e., the application logical canvas).
[0027] More specifically, the current output mode M is normalized (mapped) to the corresponding target display category Km, and the effective width W and effective height H of the target display category Km are obtained; the target display category Km is, for example, one of 480, 576, 720p, 1080i, 1080p, 1440p, 3840×2160, 4096×2160, 7680×4320, etc.
[0028] The target display category Km can also be used as a normalization mode index to determine the coordinate storage location.
[0029] In one specific embodiment, if the effective width W and effective height H cannot be obtained, or if both W and H are zero, then the most recent effective width W and effective height H are used as the effective width W and effective height H of the current processing cycle, or the full-screen rectangle is temporarily restored as the global display rectangle, and invalid coordinates are not submitted.
[0030] This embodiment does not use a fixed 3840×2160 resolution to represent all output modes. Assuming the desktop output is 3840×2160, while the video output switches to 1920×1080 for frame rate matching, the target rectangle is calculated and saved separately for each output mode.
[0031] S300: Based on the target aspect ratio, the effective width and effective height of the effective canvas, obtain the rectangle coordinates of the target rectangle, and use the target rectangle as the global display rectangle. The rectangle coordinates include the coordinates of the top left corner, the width of the rectangle, and the height of the rectangle.
[0032] Specifically, the effective canvas is the graphical logic canvas of the current output mode.
[0033] This embodiment compares the target aspect ratio r (i.e., the target width-to-height ratio r) with the effective canvas ratio W / H, and executes the corresponding rectangular coordinate calculation rules based on the size comparison result.
[0034] More specifically, if the target canvas aspect ratio r is greater than or equal to the effective canvas aspect ratio W / H, then the full horizontal width W is maintained as the rectangle width, and the rectangle height H is obtained based on the ratio of the effective width W to the target canvas aspect ratio r.t Based on the rectangle height H t The x-coordinate of the top-left corner of the rectangle is obtained by combining the effective height H. t and the vertical axis Y t .
[0035] If the target image size r is smaller than the effective canvas ratio W / H, a symmetrical horizontal adaptation branch is used, that is, the full height H is maintained as the rectangle height, and the rectangle width W is obtained by multiplying the effective height H by the target image size ratio r. t Based on the effective width W and the rectangle width W t Get the x-coordinate of the top-left corner of the rectangle. t and the vertical axis Y t .
[0036] Finally, the target rectangle R(X) is obtained. t , Y t W t H t ).
[0037] The target rectangle can be compressed only vertically, or it can be compressed horizontally depending on the output direction.
[0038] S400: Based on the original logical coordinates of the valid canvas, perform coordinate transformation and mapping between the valid canvas and the global display rectangle through the corresponding target transformation method.
[0039] Specifically, application and system windows are drawn on the W×H effective canvas. During the system graphics output stage after the application window is composited, the ordinary graphics layer is uniformly mapped to the effective canvas. More specifically, the desktop, settings page, system dialog boxes, and third-party applications are usually drawn in their own windows or Surfaces and generally do not share a drawing buffer. The system composites these windows into the same W×H display logical coordinate space (effective canvas) to obtain the composited ordinary graphics layer.
[0040] After the application window is composited, mapping is performed. During the compositing output stage, the system display layer maps the graphics drawn on the valid canvas to the target rectangle R, so that subsequent operations such as projection can be performed based on the target rectangle. This allows for unified handling of interfaces such as the desktop, settings page, media library, system dialog boxes, third-party applications, and newly added pages, while also maintaining consistent margin values.
[0041] In this embodiment, the system performs a unified coordinate transformation after application windows are composited, allowing the desktop, system pages, and ordinary third-party applications to share the same wide target rectangle. When adding or upgrading third-party applications, there is no need to add a 2.35:1 margin for each page, and there will be no inconsistencies in interface positioning due to different application sizes.
[0042] It should be noted that the coordinates of the target rectangle can be saved. In different scene iterations, with the global graphics state and global compression as the rendering method, and under the same target aspect ratio, output category, and alignment step size, the stored target rectangle can be directly called without recalculating it, thus saving computational overhead.
[0043] This embodiment sets a unified target rectangle in the system's graphical output link, which can simultaneously map the player's desktop, settings page, media library, system dialog boxes, controls, and third-party applications to the wide-view visible area without modifying the layout. This ensures the complete visibility of the interface and edge controls, as well as the consistency of the interface position, without the need to rearrange and modify the layout for each interface individually.
[0044] In one embodiment, the method further includes: If the presentation mode is graphic masking and the playback state is global graphic state, then the full-screen rectangle will be used as the global display rectangle, and the top and bottom masks will be displayed.
[0045] Specifically, if the presentation mode c is graphic masking and the playback state P is global graphic state G, then no compression is performed and wide frame is not enabled. In this case, the target rectangle R is set to the full-screen rectangle (0,0,W,H) obtained based on the effective canvas.
[0046] In addition, a mask will be displayed at the top and bottom edges of the full-screen rectangle.
[0047] In this embodiment, only one output mode is enabled globally at a time. When global compression is selected (i.e., in global graphics state G), the currently effective mode is the wide-format target rectangle R. When graphics masking is selected, the currently effective mode is the full-screen rectangle Rfull, with additional top and bottom masks displayed. Both sets of rectangle parameters can be stored in the system simultaneously, but only one set is applied at any given time in the same graphics output link.
[0048] This embodiment allows for flexible, adaptive, and accurate determination of the rectangle type to be used through its presentation method.
[0049] In one embodiment, step S300, which obtains the rectangular coordinates of the target rectangle based on the target aspect ratio, the effective width of the effective canvas, and the effective height, includes: If the target aspect ratio is greater than or equal to the effective canvas aspect ratio, then the effective width of the current output mode is used as the rectangle width, and the ratio of the effective width to the target aspect ratio is used as the theoretical height. Here, the effective canvas aspect ratio is the ratio of the effective width to the effective height. The rectangle height is obtained by aligning the theoretical height using the alignment step size. Based on the effective height and rectangle height of the current output mode, obtain the ordinate of the top left corner of the top margin. The x-coordinate of the top left corner is 0; If the target aspect ratio is smaller than the effective canvas aspect ratio, then the effective height of the current output mode is used as the rectangle height, and the product of the effective height and the target aspect ratio is used as the rectangle width. The x-coordinate of the top-left corner of the target rectangle is obtained based on the effective width and the rectangle width. The top-left ordinate is set to 0.
[0050] Specifically, using a target rectangle enables wide-format display; that is, the target rectangle is a wide-format rectangle.
[0051] If the target aspect ratio r is greater than or equal to the effective canvas ratio W / H, then the effective width W of the effective canvas corresponding to the current output mode M is used as the rectangle width W. t That is, to maintain the full horizontal width of the target rectangle as the effective width W (W t =W).
[0052] The ratio of the effective width W to the target aspect ratio r, W / r, is used as the theoretical height H0 of the misalignment, i.e., H0 = W / r.
[0053] W represents the effective width of the current output mode in pixels; r represents the selected target aspect ratio; and H0 represents the theoretical height obtained according to the target aspect ratio.
[0054] The effective canvas ratio is the ratio of the effective width to the effective height, W / H.
[0055] Align the theoretical height H0 with the pixel alignment step size A to obtain the rectangle height H. t Specifically, as shown in Formula 1 below: Formula 1 In one specific embodiment, if the display hardware does not have additional alignment requirements for the coordinates, the alignment step size A is 1; if the display hardware requires even number, 4-pixel, or 8-pixel alignment, A is 2, 4, or 8 respectively, depending on the actual scenario. This application does not impose any restrictions on this.
[0056] Based on the effective height H and rectangular height H of the current output mode t The top margin Y is obtained. t That is, the ordinate of the top left corner, as shown in Formula 2 below: Formula 2 In Formulas 1 and 2, A is the pixel alignment step size; H t H represents the final height of the rectangle written to the display link; H represents the effective height of the current output mode; Y represents the height of the rectangle. t This is the offset of the top edge of the target rectangle relative to the top edge of the complete canvas. If H = H... t If the difference is odd, the system keeps the extra pixel on the bottom side, thus ensuring that all coordinates are integers.
[0057] In addition, the x-coordinate of the top left corner is set to 0.
[0058] The target rectangle R is determined according to formula 3: Formula 3 Taking a 3840×2160 output and a 2.35:1 aspect ratio as an example, when A is 1, H0 = 3840 / 2.35 ≈ 1634.04, H t =1634, Y t =(2160-1634) / 2=263, therefore R=(0,263,3840,1634). The same ratio is recalculated in 1920×1080 mode as R=(0,131,1920,817), without using the pixel values of 4K mode.
[0059] If the target aspect ratio r is less than the effective canvas aspect ratio W / H, then the effective height H of the effective canvas corresponding to the current output mode will be used as the rectangle height.
[0060] The product of the effective height H and the target aspect ratio r is used as the rectangle width W. t That is, W t =H×r.
[0061] Based on the effective width W and the rectangle width W t Obtain the x-coordinate of the top left corner of the target rectangle (wide-format rectangle). t Specifically, it can be obtained as shown in Formula 4 below: X t =(WW t ) / 2 Formula 4 In addition, the top-left ordinate is set to 0.
[0062] When the target aspect ratio r is less than W / H, a symmetrical horizontal adaptation branch is used, that is, the full height H is maintained, and W is set to... t Calculate according to H×r, and let X t =(WW t ) / 2. In this embodiment, the 2.35:1, 21:9, and 1.85:1 ratios are set to enter the vertical compression branch under the common 16:9 output. This embodiment retains the horizontal branch, so that the same algorithm can be applied to portrait screens or other narrower output canvases. That is, the common 2.35:1, 21:9, and 1.85:1 ratios usually follow the vertical compression branch relative to 16:9 output. This embodiment uses the horizontal branch, which can be used for portrait screens or other narrower output canvases.
[0063] The target rectangle R is determined according to formula 5: Formula 5 In one embodiment, based on the original logical coordinates of the effective canvas, coordinate transformation and mapping between the effective canvas and the global display rectangle are performed through a corresponding target transformation method, including: In the synthesis output stage, the original logical coordinates of the effective canvas are mapped to the target rectangle through positive coordinate transformation; In response to interaction with an absolute coordinate input device, the interactive physical coordinates on the target rectangle are restored to the original logical coordinate system of the valid canvas through an inverse transformation.
[0064] Specifically, application and system windows are drawn on the W×H effective canvas. More specifically, the desktop, settings page, system dialog boxes, and third-party applications are usually drawn in their own windows or surfaces, and generally do not share a drawing buffer; the system composites these windows into the same W×H display logical coordinate space (effective canvas) to obtain the composite ordinary graphics layer.
[0065] After the application window is composited, it undergoes mapping. During the compositing output phase, the system display layer maps the ordinary graphics layer of the valid canvas onto the target rectangle R. Therefore, the desktop, settings page, system dialog boxes, third-party applications, and controls will all be transformed simultaneously.
[0066] More specifically, a positive coordinate transformation T is performed using the following formula 6 to map the original logical coordinates (x, y) of the graphic drawn on the effective canvas to the target rectangle.
[0067] Formula 6 In Formula 6, (x, y) are the original logical coordinates used by the application; (x', y') are the transformed display coordinates; W t / W is the horizontal scaling factor, H t / H is the vertical scaling factor; X t Y t Offset to the target rectangle. In the current vertical compression method, W... t =W、X t =0, therefore x'=x, the system only performs a scaling transformation on the ordinate and increases Y. t Offset.
[0068] Figure 2 This refers to the process of mapping a 16:9 effective canvas (application logical canvas) to the central area of a 2.35:1 target rectangle (wide target rectangle R). The mapping occurs after the application window is composed, so the desktop, settings page, system dialog boxes, and ordinary third-party applications share the same transformation, eliminating the need to repeatedly calculate top and bottom margins in their respective layouts.
[0069] Therefore, under the global compression rendering method, through the above compositing and coordinate transformation, the desktop, settings page, system dialog boxes, and third-party applications can all undergo the same scaling and translation.
[0070] After completing the mapping from the valid canvas to the target rectangle, if an interaction from a non-absolute coordinate input device is received, such as a remote control focus navigation interaction, since the remote control directional keys are key / focus navigation, the events only indicate up, down, left, right, or confirmation, and do not carry absolute screen coordinates. The application still moves the focus within the original logical coordinate system, so usually no inverse transformation is needed, and no change to the key events is required.
[0071] If the interaction is received from an absolute input device, such as a touchscreen, air mouse, or regular mouse, these inputs will report the physical position (x', y') on the display screen. Therefore, it's necessary to convert them back to the application logical coordinates (x, y) before dispatching the event. More specifically, a reverse transformation restores the interaction's physical coordinates (x', y') on the target rectangle to the original logical coordinate system of the valid canvas, thus converting the physical input coordinates on the target rectangle back to the original display logical coordinates. This is illustrated in Formula 7 below: Formula 7 In Formula 7, `round` means taking the nearest integer, and `clamp` means restricting the result to an allowed range. If the input point is outside the target rectangle R, the system can either ignore the input or restrict it to the nearest edge of the target rectangle R; the choice between these two strategies is determined by the device interaction method. The forward and inverse transformations use the same set of X values. t Y t W t H t This prevents the clicked location from remaining in the original physical area even after the screen has moved.
[0072] Forward and inverse transformations are two opposite data paths: for display, the application's drawing point (x, y) is mapped to the display point (x', y') within the target rectangle; for input, the (x', y') reported by the input device is converted back to (x, y). The former determines where the graphic is displayed, while the latter is used for application click hits and touch processing; it does not involve performing two consecutive round-trip transformations on the same set of coordinates.
[0073] The system distributes the calculated logical coordinates to the window currently positioned at those coordinates and receiving input focus, for use in executing click, touch, drag, or hover events. This window could be the desktop, settings page, system dialog box, or a third-party application; it's not limited to third-party applications. The purpose of the calculation is to ensure that the application still uses the original logical coordinates to achieve control hits; the application also doesn't need to know that the screen image has been globally compressed.
[0074] In one specific embodiment, for a device with a variable shading position, X can also be calculated. t and Y t User-calibrated offsets are added at the time, but the same set of parameters is still used for both forward and inverse transformations.
[0075] In one specific embodiment, for remote control products without an absolute coordinate input device, only the global graphic forward transformation can be retained; for products with a touchscreen, mouse, or air mouse, the inverse coordinate transformation is enabled. For graphic paths that do not support a globally displayed rectangle, the system maintains full screen and uses a local safe area in the player or a graphic masking method.
[0076] This embodiment uses forward coordinate transformation to map the graphical interface on the logical canvas onto the target rectangle for complete display. After a global coordinate transformation occurs on the graphical screen, a reverse coordinate transformation ensures that operations from absolute coordinate input devices received on the target rectangle can still target the original logical controls. This embodiment uses the same set of rectangle parameters for both forward and reverse coordinate transformations. After the graphical interface is compressed to the center, absolute coordinate input can still be converted back to the original logical coordinates, thus avoiding separation between the display position and the click position.
[0077] While consistently compressing the system display area to the center works for regular application interfaces, it doesn't differentiate between the desktop and video playback states. If a compressed rectangle is still used during video playback, it can easily cause repeated scaling of the video frame and parts of the player interface.
[0078] Based on this, in this embodiment, the method further includes: If the current playback state is video playback, then the global display rectangle will be switched to a full-screen rectangle; If the current playback status is pending recovery, the global display rectangle will remain a full-screen rectangle. If the output link is stable, the global display rectangle will be switched to the target rectangle.
[0079] Specifically, the global graphics state G is used for the desktop, settings, and general application interfaces. When c is global compression, the system selects a wide rectangle R and enables positive transformation; when c is graphics masking, the system maintains a full-screen rectangle, displaying the mask only at the top and bottom edges. Masking can only hide edge areas and cannot move third-party application controls; therefore, graphics masking and global compression are two different paths.
[0080] After the player issues a playback start event, the system enters the video playback state V. At this time, the global display rectangle switches from the target rectangle to the full-screen rectangle (0,0,W,H). The video screen uses full-screen output and is not mapped to the target rectangle R, which can prevent desktop compression from continuing to affect the video.
[0081] The system's global graphic rectangle has also reverted to a full-screen rectangle (Rfull). The player's control interface also no longer accepts global compression; instead, the player places target controls such as progress bars and menus into a safe display area that matches the boundary of the target rectangle R during its own layout phase. In other words, the video uses a full-screen rectangle, and the target controls use a safe area layout, rather than mapping both the video and target controls onto the target rectangle R.
[0082] When the player exits, the system enters a waiting state E (exit playback). At this time, the target rectangle is not written immediately, but the full-screen rectangle is maintained first. After the output link is stable, the global display rectangle is switched from the full-screen rectangle to the target rectangle.
[0083] Furthermore, in the pending recovery state E, any old recovery tasks that have not yet been executed in the queue will be cancelled, and the system will wait for the HDMI output to return to a stable state. If a playback event is received again during the waiting period, g will change, and the original recovery task will become invalid due to the inconsistency in generation g.
[0084] Processing during video playback differs from that in the global graphics state. Video may use a separate video plane or may trigger HDMI mode switching due to frame rate matching, resolution matching, HDR, Dolby Vision, or HDR Vivid output. If the global compression rectangle (i.e., the target rectangle) used in the global graphics state continues to apply during playback, the video and playback controls may be compressed repeatedly.
[0085] In this embodiment, the target rectangle R is mainly used in the global graphics state G when "global compression" is selected, that is, when graphical interfaces such as the desktop, settings page, system dialog boxes, and ordinary third-party applications need to enter the wide-view visible area. After entering the movie playback state V, the system global output no longer uses the target rectangle R, but switches to the full-screen rectangle; the boundary parameters of R are only used as a reference for the player when arranging the local control interface.
[0086] This embodiment monitors the playback status. After switching from the global graphics state to the video playback state, it changes the global display rectangle to a full-screen rectangle so that the video frame and the player's partial interface are not repeatedly scaled during video playback.
[0087] In existing technology, another set of fixed coordinates is written immediately after receiving a playback start or exit event. When saving display coordinates, the system reads the HDMI output mode at the moment of execution and saves the coordinates to the corresponding mode item. For example, if the movie uses 1920×1080 and the desktop uses 3840×2160, the arrival of the exit event does not mean that HDMI has been restored to desktop mode. Immediate writing will save the desktop compression coordinates to 1080p mode, which may result in incorrect scaling when using this mode again later. That is, if the target rectangle is restored too early after exiting playback, the coordinates may be written to the output mode corresponding to the movie.
[0088] This embodiment uses the playback state to drive the switching between the full-screen rectangle and the target rectangle. It switches the display area between the global graphics state, the video playback state, and the exit / wait-to-restore state, while preventing old tasks from taking effect in the new state.
[0089] In this embodiment, the full-screen rectangle is maintained in the waiting state, and the target rectangle is restored after the output link is stable. This can prevent the coordinates of the target rectangle from being mistakenly written into the video during the playback period and prevent the video from being scaled incorrectly.
[0090] In one embodiment, the method further includes the following steps before switching the global display rectangle to the target rectangle: Perform system sampling to obtain the sampling results for each sampling. The sampling results include the current output mode, the current actual dynamic range format, and the current graphics composition path. If the sampling results are the same for a consecutive preset number of times, the output link is determined to be stable, and the target rectangle is submitted to the display control service.
[0091] Specifically, during playback exit, frame rate matching, or dynamic range switching, the system reads the output status at fixed intervals to obtain the k-th sample Qk=(Mk,Fk,Lk). Mk represents the current HDMI output mode at the k-th sample, Fk represents the current actual dynamic range format at the k-th sample, and Lk represents the current graphics composition path at the k-th sample. If the sampling results are the same for N consecutive samples, the output link is considered stable, and the target rectangle is submitted to the display control service.
[0092] N represents the number of consecutive samples required for stability determination, and N must be at least 2; the time interval between adjacent samples is Δt. Outputting a statement indicating state stability allows submission of coordinates.
[0093] The current actual dynamic range format Fk can be used to determine whether the output transformation is stable; the current graphic composition path Lk can be used to determine whether the current path supports global rectangular transformation.
[0094] The current actual dynamic range format Fk takes the value of one of the following: SDR, HDR10, HDR10+, HLG, Dolby Vision, and HDRVivid. The current actual dynamic range format Fk does not directly determine the wide-frame height, but changes in Fk may be accompanied by changes in output mode or graphics compositing path, and therefore participate in the determination of the rectangle submission timing.
[0095] For example, when switching from SDR to Dolby Vision while maintaining the same resolution, H t The system will not submit the changes in format name, but it will still wait for the actual dynamic range format F and the graphic composition path L to stabilize before submitting, in order to avoid using the old rectangle during the graphic composition path switching process.
[0096] Furthermore, output link stability can be determined through continuous sampling, or by receiving HDMI mode switching completion events, graphics compositing path ready events, or display service callbacks. Regardless of the triggering method used, the status generation and output mode at execution time should be verified before submission.
[0097] In one embodiment, submitting the target rectangle to the display control service includes: If the state generation of the asynchronous task remains unchanged, and the current playback state is the target playback state required by the task, and the width and height of the effective canvas are valid, and the current graphics composition path supports rectangle transformation, then the target rectangle is submitted to the display control service. If at least one of the settings data, playback state, output mode, graphics composition path, and dynamic range format changes, the state generation will change accordingly.
[0098] Specifically, in this embodiment, a consistency check is performed before submitting the target rectangle.
[0099] When executing asynchronous tasks, the system saves the initial state generation g0 at the time of creation. If any of the following changes occur, such as changes in settings data, changes in playback state (entering or exiting playback), changes in output mode, or changes in graphics path, a new state generation gcur will be generated.
[0100] Compare the initial state generation g0 when the asynchronous task was created with the current state generation gcur. If they are inconsistent, it means the task is based on the old state, and the task should be discarded directly. It is not allowed to overwrite the new state, nor is it allowed to submit the target rectangle.
[0101] When obtaining the valid width and height of the valid canvas, if no valid dimensions are read, or if both the valid width and height are zero, it means that the width and height of the valid canvas are invalid. If non-zero width and height are read, it means that the width and height of the valid canvas are valid.
[0102] This embodiment also needs to compare whether the current playback state P is still equal to the target playback state Ptarget required by the task.
[0103] If the current state generation gcur of the asynchronous task is still equal to the initial state generation g0; and the current playback state P is still equal to the target playback state Ptarget required by the task; and the output link is stable (i.e., the output state Qk has been continuously stable); and the effective width and height W and H of the effective canvas are valid; and the current graphics composition path Lk supports rectangle transformation, then it is determined that the target rectangle can be submitted. Otherwise, if any of the above conditions are not met, the task is abandoned, the target rectangle is not submitted, and the state is reacquired.
[0104] In one specific embodiment, a minimum waiting time T0 can be set first, and then sampling can be performed with a period of Δt. If the above conditions are met within the maximum waiting time Tmax, the submission is made immediately. If the above conditions cannot be met even after Tmax is reached, the system maintains full screen and continues to listen for the next state change, avoiding writing the target rectangle into the movie mode that has not yet been switched. Using a fixed delay, T0 can be set to 3 seconds; after adding continuous state determination, the recovery time can vary with the actual switching speed of the device.
[0105] In one embodiment, after submitting the target rectangle, the method further includes: Read the current output mode before the display control service execution submission as the second current output mode; The current output mode obtained by continuous and stable sampling is taken as the first current output mode; If the first current output mode is the same as the second current output mode, the control display control service saves and applies the target rectangle to perform the submission; After the display control service is submitted, read back the actual submission rectangle; Compare whether the actual submitted rectangle matches the target rectangle; If the actual submitted rectangle matches the target rectangle, the submission will take effect. If the actual submitted rectangle is inconsistent with the target rectangle, then resubmit it if the output link remains stable and the state generation remains unchanged. If the total number of resubmissions exceeds the threshold, a full-screen rectangle will be used.
[0106] Specifically, this embodiment also saves and verifies the results according to the output mode.
[0107] When the display control service executes the submission, it reads the current output mode Mexec again as the second current output mode, and uses the current output mode Mtarget, which is determined to be stable when the output link is stable through continuous and stable sampling, as the first current output mode. It compares whether the first and second current output modes are consistent; if they are consistent, it controls the display control service to save and apply the target rectangle to execute the submission. If they are inconsistent, it returns to the non-execution state, and the upper layer re-executes steps S100-S300 to obtain setting data, playback status, and target rectangle, and re-performs the pre-submission judgment and rectangle submission.
[0108] It should be noted that the rectangular coordinates of the target rectangle for different current output modes can be saved separately according to the display category Km. The display category is obtained by normalizing the current output mode and can be used as an index for persistent display coordinates. Output modes such as 1080p, 2160p, 4096×2160, and 8K have their own coordinate entries. When re-entering a certain output category or mode, the system reads the rectangular coordinates of the target rectangle for that output mode and does not directly apply pixel values from other resolutions to the current mode.
[0109] In this embodiment, after submitting the target rectangle, the actual output mode is checked again to promptly detect situations where the HDMI mode changes after the condition judgment, and to prevent the display control service from submitting an erroneous rectangle when the HDMI mode changes again.
[0110] After the display control service is allowed to execute the commit, this embodiment will also read back the actual commit rectangle Rread and compare it item by item with the target rectangle R. When the two match, the commit ends; if they do not match, a re-commit is only allowed if g is still valid and the output state is still stable. After the number of repeated commits exceeds the threshold, full screen is restored and failures are recorded to prevent infinite writing in abnormal states.
[0111] After the display control service completes its submission, it only indicates that the write call to the display control service has returned. It does not guarantee that the final value adopted by the hardware or display link is correct, so a readback verification is still required. The operation is only confirmed to be effective if the actual submitted rectangle Rread matches the target rectangle R. Inconsistencies may be caused by mode switching, overwriting, or underlying rejection. Before resubmitting, the state is rechecked: if g, output mode, target aspect ratio, etc., have not changed, the original target rectangle R is still submitted; if these inputs have changed, the original task is invalidated, a new state snapshot is generated, a new target rectangle is calculated, and then submitted. Recalculation is not performed every time there is a readback discrepancy.
[0112] In one embodiment, if the current playback state is a video playback state, the method further includes: The player is controlled to generate a safe display area based on the target aspect ratio or target rectangle. The target controls are arranged with reference to the safe display area to obtain the control interface. The target controls include at least one of the following: control bar, pop-up window, selection list and playback prompt. If the player enters, first restore full screen using a full-screen rectangle, then display the control interface; If the video playback state is exited, the control layer containing the control interface will be closed first, and the state will be in a waiting state. The target rectangle will be restored after the output link is stable.
[0113] Specifically, in the video playback state V, an additional safe display area that is the same as or approximately the numerical boundary of the target rectangle R is reserved during playback for use by the internal control layout of the player.
[0114] The safety display area is not the result of forward or reverse transformation, but rather based on the same set of X... t Y t W t H t Defines the internal layout boundaries of the player; the safe display area can have the same numerical boundaries as the target rectangle R, for example, using the same Y... t To Y t +H t However, their functions differ. The target rectangle R is submitted to the system display service for overall transformation of ordinary graphic output; the safe display area is only used for arranging progress bars, menus, and prompts within the player, and is not submitted as a global display rectangle. In the movie playback state V, both do indeed have corresponding data: the global full-screen rectangle Rfull is used to ensure that the video and system output are not compressed again; the player control interface only places controls within the safe area to ensure that controls do not fall into the screen's obstruction area.
[0115] According to Y t and H t Establish a safe display area. The layout boundaries of target controls such as progress bars, control bars, pop-ups, selection lists, and playback prompts are all referenced to this safe display area, and the target controls are displayed within the safe display area. When the player enters in movie playback state V, it first requests the system to restore the full-screen rectangle, and then displays the control interface arranged according to the safe area; when the player exits, it enters a waiting-to-restore state E, first closes the local control layer or control interface, maintains the full-screen rectangle, and then restores the target rectangle by the global adaptation service after stabilization. The two actions use the same target frame r, but the objects they affect are different: the former constrains the player's own graphic controls, and the latter transforms the system's ordinary graphic output.
[0116] This embodiment implements the use of a target rectangle (i.e., the desktop rectangle) for normal system graphics output in the global graphics state G. At any given time, only one rectangle is applied in the global display chain: the target rectangle R is applied when the desktop is globally compressed and in global graphics state G; the full-screen rectangle Rfull is applied during video playback, and the current value is temporarily maintained when exiting and waiting to resume. During video playback, a safe display area is also reserved for player control layout; therefore, during video playback, there is "one globally effective rectangle (full-screen rectangle) + one player layout area (safe display area)".
[0117] When the output is HDR, Dolby Vision, or HDR Vivid, this solution does not modify the video color data, dynamic metadata, or transfer curves. The dynamic range status is only used to determine whether the graphics compositing path is stable. Therefore, frame coordinate adaptation can coexist with different video output formats, independent of their encoding / decoding or tone mapping algorithms.
[0118] For third-party players that can report playback status, playback start and playback exit events can also be integrated; that is, third-party players that can report playback start and exit events can switch between global graphics state G → movie playback state V → exit waiting to recover state E → global graphics state G in the same way as the proprietary player.
[0119] Ordinary third-party applications that are not connected to the global graphics system still accept global graphics transformations. That is, ordinary third-party applications that cannot report these playback status events will not enter the video playback state V, but will continue to accept global graphics transformations according to the global graphics state G.
[0120] Applications using an independent protected video plane can maintain the video plane in full-screen mode, applying safe region constraints only to its graphics control layer. That is, if the player's video uses an independent video plane, this video plane is not part of a regular graphics compositing layer and can remain full-screen. The control layer does not resubmit the target rectangle R to the system; instead, it uses the boundary of the target rectangle R as a safe display area within the player, placing menus, control bars, and other controls only within this safe display area. This avoids video compression and prevents control bars from falling into upper or lower occlusion areas.
[0121] In one specific embodiment, the system can save the effective target rectangles according to the output category, and prioritize reading them when re-entering the same category; at the same time, it also needs to verify whether the target aspect ratio, rendering mode, alignment step, and effective canvas size are still consistent with those when saved. When the above inputs have not changed, the saved results can be applied directly; if any input changes, the saved value for that category still needs to be recalculated and overwritten. This avoids duplicate calculations and prevents rectangles under old aspect ratio settings from being mistakenly used under new settings.
[0122] The application's state generation and continuous stability determination prevent older asynchronous recovery tasks from overriding new playback states. Rectangles are not submitted while the output mode, dynamic range format, or graphic path is still changing. Upon submission, the actual mode is checked, and results are saved and read back according to the mode. This reduces issues such as incorrect coordinate writing to the output mode and abnormal scaling during subsequent mode switching.
[0123] The following example illustrates global wide-format adaptation in a third-party application: After the device is powered on, the output mode is 3840×2160. The user selects 2.35:1 and global compression mode, with an alignment step size A of 1. The system generates a state snapshot Q0=(2.35, global compression, G, 2160p, SDR, normal graphics path, g0), and normalizes 2160p to Km=2160p, resulting in W=3840 and H=2160.
[0124] Calculate H0 = 3840 / 2.35 ≈ 1634.04, H t =1634, Y t =263, resulting in the target rectangle R0=(0,263,3840,1634). After confirming that the current global graphics state G, g0 are still in the current generation, the output mode, and the graphics path are valid, the target rectangle R0 is submitted to the display control service. The service reads 2160p again, saves and applies the target rectangle R0 in 2160p mode, and then reads back the result to compare with the target rectangle R0.
[0125] The desktop, settings page, and third-party applications are still drawn on a 3840×2160 logical canvas. During the graphics compositing output stage, the system maps their vertical coordinates to the range of 263 to 1897, therefore third-party applications do not need to add a 2.35:1 layout. If a mouse is connected, and the physical pointer is at x'=1200 and y'=600, substituting into Formula 7, we get x=1200 and y=round[(600-263)×2160 / 1634]=445. The system then distributes the logical coordinates (1200, 445) to the applications, ensuring the pointer hits the same controls as before compression.
[0126] The following example illustrates the recovery process after switching the output mode of a video: The player is launched in the global graphics state G of Example 1. The player issues a playback entry event, the system updates its generation to g1 and enters the video playback state V, and all asynchronous tasks originally targeting g0 become invalid. The global adaptation service restores the system rectangle to a full-screen rectangle (0,0,3840,2160), and the player simultaneously follows Y... t =263、H t =1634 sets the local control layer security display area.
[0127] After the video starts, frame rate matching switches the HDMI output to 1920×1080 and enters HDR10 output. The output state changes sequentially from (2160p, SDR, normal graphics path) to intermediate states and (1080p, HDR10, video graphics path). Since the playback state P is still the video playback state V, the system maintains the full-screen rectangle corresponding to the current mode and does not write the target rectangle R0 used by the global graphics state G into the 1080p mode.
[0128] After the video ends, the system updates the generation to g2 and enters the exit-waiting-for-recovery state E. The first sample may still yield (1080p, HDR10, video graphics path), subsequently reverting to (2160p, SDR, normal graphics path) via HDMI. When N consecutive samples are in this state, and g2 remains the current generation, the system re-obtains W=3840, H=2160, and calculates R2=(0,263,3840,1634). Before submitting the display control service, it re-verifies that the execution mode is 2160p, saves and applies the target rectangle R2, and returns to the global graphics state G after confirming consistency.
[0129] If the user restarts the player during the waiting period, the system generates g3. When the original recovery task executes, it discovers that its saved g2 and g3 are inconsistent and immediately discards them, preventing the system rectangle from being compressed back to the center during new movie playback. Therefore, state generation, output stability determination, and execution mode verification collectively constrain the same recovery operation.
[0130] Abnormal input and boundary handling include: When r is less than or equal to 0, W or H is invalid, the calculated rectangle exceeds the current canvas, or the graphics path does not support a global rectangle, the system does not commit the calculation result and retains the most recent valid rectangle or restores full screen. If the output mode changes again during the commit process, the commit returns to an unexecuted state, and the system recalculates with new M, F, L, and g.
[0131] The inverse input transformation is only enabled on pointer-based devices. When the physical input is outside the target rectangle, it can be ignored according to the product interaction rules, or restricted to the nearest edge; a fixed strategy is used for the same device within a single session to avoid edge click behavior changing with the state.
[0132] refer to Figure 3 This application also provides a playback device, including a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the steps of any of the above methods.
[0133] This application implements a continuous control chain from frame setting, output mode recognition, global coordinate mapping, input coordinate reverse conversion, and playback state switching to mode-based recovery.
[0134] This application sets a unified target rectangle in the system's normal graphics output link, so that the interfaces of third-party applications that have not been separately adapted for wide-format display can enter the wide-format visible area together with the system interface.
[0135] The centering rectangle (target rectangle) is calculated based on the actual width and height of the current output mode and the target aspect ratio, and a pixel alignment step is introduced so that the same frame can be adapted to different output sizes such as 1080p, 2160p, 4096×2160 and 8K.
[0136] Based on the target rectangle, perform a forward transformation of the graphic coordinates and a reverse transformation of the input coordinates to ensure that the displayed results are consistent with absolute coordinate inputs such as touch and mouse.
[0137] The display state machine consists of a global graphics state, a video playback state, and an exit / restoration state. During playback, the system uses a full-screen rectangle; during desktop mode, it uses a wide-format rectangle; and the player's local control layer uses a safe display area calculated using the same aspect ratio parameters.
[0138] Assign state generations to enter playback, exit playback, settings changes, and output changes. Before submitting asynchronous tasks, check the generation and target state, and automatically discard expired display recovery tasks.
[0139] The output state is composed of the output mode, dynamic range format, and graphics composition path. The rectangle is submitted only after continuous sampling has stabilized. DV, HDR, and HDR Vivid are used to determine the submission point and are not involved in the target height calculation.
[0140] The display control service re-verifies the actual output mode upon submission, saves rectangles separately according to the normalization mode, and verifies the written results through readback comparison to prevent desktop coordinates from being saved to the output mode used by the movie.
[0141] This application's system performs coordinate transformation uniformly after application windows are composited, allowing the desktop, system pages, and ordinary third-party applications to share the same wide target rectangle. When adding or upgrading third-party applications, there is no need to add a 2.35:1 margin for each page, and there will be no inconsistencies in interface positioning due to different application sizes.
[0142] The forward display transformation and the inverse input transformation use the same set of rectangular parameters. After the graphical interface is compressed to the center, the absolute coordinate input can still be converted back to the original logical coordinates, thus avoiding the separation of the display position and the click position.
[0143] The playback state machine separates global desktop adaptation from full-screen video output. When playback starts, the system full-screen mode is restored, while the player's own control layer remains laid out in a safe area; when exiting, the desktop rectangle is restored to avoid repeated compression of the video and player controls.
[0144] State generation and continuous stability determination prevent older asynchronous recovery tasks from overriding new playback states. Rectangles are not submitted while the output mode, dynamic range format, or graphic path is still changing. Upon submission, the actual mode is checked, and results are saved and read back according to the mode. This reduces issues such as incorrect coordinate writing to the output mode and abnormal scaling during subsequent mode switching.
[0145] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and RAMbus dynamic RAM (RDRAM), etc.
[0146] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0147] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.
Claims
1. A method for adapting projected coordinates, characterized in that, The method includes: Obtain setting data, wherein the setting data includes the target aspect ratio and presentation mode; If the current playback state is read as a global graphics state, and the presentation mode is global compression, then the effective width and effective height of the corresponding effective canvas are obtained according to the current output mode read. Based on the target aspect ratio, the effective width and effective height of the effective canvas, obtain the rectangle coordinates of the target rectangle, and use the target rectangle as the global display rectangle. The rectangle coordinates include the coordinates of the top left corner, the width of the rectangle, and the height of the rectangle. Based on the original logical coordinates of the effective canvas, coordinate transformation and mapping between the effective canvas and the global display rectangle are performed through the corresponding target transformation method.
2. The method according to claim 1, characterized in that, The method further includes: If the presentation method is graphic masking, and the current playback state is global graphic state, then the full-screen rectangle will be used as the global display rectangle, and the top and bottom masks will be displayed.
3. The method according to claim 1, characterized in that, The step of obtaining the rectangular coordinates of the target rectangle based on the target aspect ratio, the effective width and effective height of the effective canvas includes: If the target aspect ratio is greater than or equal to the effective canvas aspect ratio, then the effective width of the current output mode is used as the rectangle width, and the ratio of the effective width to the target aspect ratio is used as the theoretical height. Here, the effective canvas aspect ratio is the ratio of the effective width to the effective height. The rectangle height is obtained by aligning the theoretical height using the alignment step size. Based on the effective height and rectangle height of the current output mode, obtain the ordinate of the top left corner of the top margin. The x-coordinate of the top left corner is 0; If the target aspect ratio is smaller than the effective canvas aspect ratio, then the effective height of the current output mode is used as the rectangle height, and the product of the effective height and the target aspect ratio is used as the rectangle width. The x-coordinate of the top-left corner of the target rectangle is obtained based on the effective width and the rectangle width. The top-left ordinate is set to 0.
4. The method according to any one of claims 1-3, characterized in that, The coordinate transformation and mapping between the effective canvas and the global display rectangle, based on the original logical coordinates of the effective canvas, is performed through a corresponding target transformation method, including: In the synthesis output stage, the original logical coordinates of the effective canvas are mapped to the target rectangle through positive coordinate transformation; In response to interaction with an absolute coordinate input device, the interactive physical coordinates on the target rectangle are restored to the original logical coordinate system of the valid canvas through an inverse transformation.
5. The method according to any one of claims 1-3, characterized in that, The method further includes: If the current playback state is video playback, then the global display rectangle will be switched to a full-screen rectangle; If the current playback status is pending recovery, the global display rectangle will remain a full-screen rectangle. If the output link is stable, the global display rectangle will be switched to the target rectangle.
6. The method according to claim 5, characterized in that, Before switching the globally displayed rectangle to the target rectangle, the method further includes: Perform system sampling to obtain the sampling results for each sampling, wherein the sampling results include the current output mode, the current actual dynamic range format, and the current graphics composition path; If the sampling results are the same for a consecutive preset number of times, the output link is determined to be stable, and the target rectangle is submitted.
7. The method according to claim 6, characterized in that, Submitting the target rectangle includes: If the state generation of the asynchronous task remains unchanged, and the current playback state is the target playback state required by the task, and the width and height of the effective canvas are valid, and the current graphics composition path supports rectangle transformation, then the target rectangle is submitted to the display control service. If at least one of the setting data, current playback state, output mode, graphics composition path, and dynamic range format changes, the state generation will change accordingly.
8. The method according to claim 7, characterized in that, After submitting the target rectangle, the method further includes: Read the current output mode before the display control service execution submission as the second current output mode; The current output mode obtained by continuous and stable sampling is taken as the first current output mode; If the first current output mode is the same as the second current output mode, the control display control service saves and applies the target rectangle to perform the submission; After the display control service is submitted, read back the actual submission rectangle; Compare whether the actual submitted rectangle matches the target rectangle; If the actual submitted rectangle matches the target rectangle, the submission will take effect. If the actual submitted rectangle is inconsistent with the target rectangle, then resubmit it if the output link remains stable and the state generation remains unchanged. If the total number of resubmissions exceeds the threshold, a full-screen rectangle will be used.
9. The method according to any one of claims 1-3, characterized in that, If the current playback state is a video playback state, the method further includes: Control the player to generate a safe display area based on the target aspect ratio or target rectangle; The target controls are arranged with reference to the safe display area to obtain the control interface, wherein the target controls include at least one of the following: control bar, pop-up window, selection list and playback prompt; If the player enters, first restore the full screen using a full-screen rectangle, and then display the control interface. If the video playback state is exited, the control layer containing the control interface will be closed first, and the state will be in a waiting state. The target rectangle will be restored after the output link is stable.
10. A playback device, comprising a memory and a processor, characterized in that, The memory stores a computer program that, when executed by the processor, causes the processor to perform the steps of the method as described in any one of claims 1 to 9.
