A video magnification method, device, equipment and storage medium

Abstract

An embodiment of the present application discloses a video magnification method, apparatus, device, and storage medium. The method includes: in response to a magnification window wake-up operation triggered for an ultra-high-definition video, displaying a magnification window on the display interface of the ultra-high-definition video; in the magnification window, based on the resolution of the ultra-high-definition video, displaying an enlarged image corresponding to the image in the target magnification area within the video picture of the ultra-high-definition video; the target magnification area is determined according to the display position of the magnification window on the display interface and the magnification ratio corresponding to the magnification window; the enlarged image is obtained by magnifying the image in the target magnification area based on the magnification ratio corresponding to the magnification window. This method can more intuitively reflect the advantages of ultra-high-definition videos on devices with limited display screen sizes, enabling users to obtain a better viewing experience for ultra-high-definition videos.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular, to a video magnification method, apparatus, device, and storage medium. Background Art

[0002] Ultra-high-definition video (4K / 8K), as a product of digital technology and high-definition technology, has the advantages of high resolution, high frame rate, high color depth, and high color gamut; the high resolution makes the ultra-high-definition video have richer picture levels and more delicate picture details, the high frame rate makes the ultra-high-definition video have higher smoothness and fluency, and the high color depth and high color gamut make the picture color display effect of the ultra-high-definition video better.

[0003] In the context of the era of full mobility, the development of ultra-high-definition video towards mobile devices will also be an irresistible trend. However, for mobile devices with limited display screen sizes (such as mobile phones, tablets, etc.), the advantages of ultra-high-definition video such as multiple details and high clarity are difficult to be intuitively reflected on such devices; that is to say, for users who watch ultra-high-definition video through mobile devices, they cannot intuitively feel the advantages of ultra-high-definition video, and the viewing experience of ultra-high-definition video cannot reach the expected effect. Summary of the Invention

[0004] Embodiments of this application provide a video magnification method, apparatus, device, and storage medium, which can more intuitively reflect the advantages of ultra-high-definition video on devices with limited display screen sizes, so that users can obtain a better viewing experience for ultra-high-definition video.

[0005] In view of this, in the first aspect of this application, a video magnification method is provided, and the method includes:

[0006] In response to a magnification window wake-up operation triggered for an ultra-high-definition video, a magnification window is displayed on the display interface of the ultra-high-definition video;

[0007] In the magnification window, based on the resolution of the ultra-high-definition video, a magnified image corresponding to the image in the target magnification area of the video picture of the ultra-high-definition video is displayed; the target magnification area is determined according to the display position of the magnification window in the display interface and the magnification ratio corresponding to the magnification window; the magnified image is obtained by magnifying the image in the target magnification area based on the magnification ratio corresponding to the magnification window.

[0008] In the second aspect of this application, a video magnification apparatus is provided, and the apparatus includes:

[0009] A magnification window wake-up module, configured to display a magnification window on the display interface of the ultra-high-definition video in response to a magnification window wake-up operation triggered for the ultra-high-definition video;

[0010] An enlarged content display module, configured to display, in the enlarged window, an enlarged image corresponding to an image within a target enlarged area in a video frame of the ultra-high-definition video based on the resolution of the ultra-high-definition video; the target enlarged area is determined according to the display position of the enlarged window in the display interface and the magnification factor corresponding to the enlarged window; the enlarged image is obtained by magnifying the image within the target enlarged area based on the magnification factor corresponding to the enlarged window.

[0011] A third aspect of the present application provides a device, the device includes a processor and a memory:

[0012] The memory is configured to store a computer program;

[0013] The processor is configured to execute the steps of the video magnification method described in the first aspect above according to the computer program.

[0014] A fourth aspect of the present application provides a computer-readable storage medium, the computer-readable storage medium is configured to store a computer program, and the computer program is used to execute the steps of the video magnification method described in the first aspect above.

[0015] A fifth aspect of the present application provides a computer program product or a computer program, the computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the steps of the video magnification method described in the first aspect above.

[0016] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages:

[0017] An embodiment of the present application provides a video magnification method. This method innovatively proposes a magnification function for ultra-high-definition videos. When a user views an ultra-high-definition video through a device with a limited display screen size, this magnification function can be used to magnify a local area in the video frame of the ultra-high-definition video to view the detailed picture that the ultra-high-definition video can clearly show. Specifically, in the video magnification method provided by the embodiment of the present application, the terminal device can respond to the magnification window wake-up operation triggered by the user for the ultra-high-definition video, and display a magnification window on the display interface of the ultra-high-definition video; and in this magnification window, based on the resolution of the ultra-high-definition video, display the magnified image corresponding to the image in the target magnification area in the video frame of the ultra-high-definition video; the target magnification area here is determined according to the display position of the magnification window on the display interface and the magnification ratio corresponding to the magnification window, and the magnified image here is obtained by magnifying the image in the target magnification area based on the magnification ratio corresponding to the magnification window. In this way, when a user views an ultra-high-definition video through a device with a limited display screen size, by performing the above magnification window wake-up operation, the user can trigger the display of the magnification window on the display interface of the ultra-high-definition video. Through this magnification window, the user can better view the details in the video frame of the ultra-high-definition video, thereby more intuitively experiencing the advantages of the ultra-high-definition video such as multiple details and high definition, and obtaining a better ultra-high-definition video viewing experience. Description of the Drawings

[0018] Figure 1 Schematic diagram of the application scenario of the video magnification method provided by the embodiment of the present application;

[0019] Figure 2 Schematic diagram of the process flow of the video magnification method provided by the embodiment of the present application;

[0020] Figure 3 Schematic diagram of the manifestation form of the magnification window wake-up control provided by the embodiment of the present application;

[0021] Figure 4 Schematic diagram of the implementation process of adjusting the display position of the magnification window based on the window position adjustment control provided by the embodiment of the present application;

[0022] Figure 5 Schematic diagram of the implementation process of adjusting the magnification ratio based on the magnification ratio adjustment control provided by the embodiment of the present application;

[0023] Figure 6 Schematic diagram of the implementation process of triggering the full-screen display operation for the magnification window provided by the embodiment of the present application;

[0024] Figure 7 Schematic diagram of the layout of interactive elements in the display interface provided by the embodiment of the present application;

[0025] Figure 8 Schematic diagram of the underlying processing logic of the magnification function provided by the embodiments of the present application;

[0026] Figure 9 Schematic diagram of the structure of the video magnification device provided by the embodiments of the present application;

[0027] Figure 10 Schematic diagram of the structure of the terminal device provided by the embodiments of the present application. Detailed implementation manners

[0028] In order to enable those skilled in the art of the present technology to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without making creative efforts shall fall within the scope of protection of the present application.

[0029] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily need to be used to describe a specific order or sequence. It should be understood that such used data can be interchanged under appropriate circumstances so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0030] In order to enable devices with limited display screen sizes to better reflect the advantages of ultra-high-definition videos and enable users to obtain a better video viewing experience when watching ultra-high-definition videos through such devices, the embodiments of the present application provide a video magnification method.

[0031] In this video magnification method, the terminal device responds to the magnification window wake-up operation triggered by the user for the ultra-high-definition video, and displays a magnification window on the display interface of the ultra-high-definition video; and in this magnification window, based on the resolution of the ultra-high-definition video, an enlarged image corresponding to the image in the target magnification area of the video picture of the ultra-high-definition video is displayed; the target magnification area here is determined according to the display position of the magnification window on the display interface and the magnification ratio corresponding to the magnification window, and the enlarged image here is obtained by magnifying the image in the target magnification area based on the magnification ratio corresponding to the magnification window.

[0032] The above video magnification method innovatively proposes a magnification function for ultra-high-definition videos. This magnification function supports users to trigger the wake-up operation of the magnification window during the viewing of ultra-high-definition videos, and correspondingly displays the magnification window in the display interface of the ultra-high-definition video. Furthermore, through this magnification window, an enlarged image corresponding to the image in the target magnification area of the video frame is displayed based on the resolution of the ultra-high-definition video. In this way, users can better view the details in the video frame of the ultra-high-definition video through this magnification window, thereby more intuitively experiencing the advantages of ultra-high-definition videos such as multiple details and high definition, and obtaining a better ultra-high-definition video viewing experience.

[0033] It should be understood that the video magnification method provided in the embodiments of the present application can be applied to terminal devices with ultra-high-definition video playback capabilities. Such terminal devices can specifically be smartphones, tablets, computers, personal digital assistants (PDAs), in-vehicle terminals, etc. The present application does not specifically limit the terminal devices applicable to this video magnification method.

[0034] To facilitate the understanding of the video magnification method provided in the embodiments of the present application, the application scenarios applicable to the video magnification method provided in the embodiments of the present application are introduced below by way of example.

[0035] See Figure 1 , Figure 1 which is a schematic diagram of the application scenario of the video magnification method provided in the embodiments of the present application. As Figure 1 shown, this application scenario includes a terminal device 110 on which a video playback application (APP) is running. This video playback APP can provide ultra-high-definition video resources for users.

[0036] In actual applications, when a user views an ultra-high-definition video through the video playback APP running on the terminal device 110, the user can trigger the wake-up operation of the magnification window for this ultra-high-definition video. In response to this wake-up operation of the magnification window, the terminal device 110 will correspondingly display the magnification window on the display interface of this ultra-high-definition video. Figure 1 shows a schematic diagram of the implementation process of an exemplary wake-up operation of the magnification window. As Figure 1 shown in (a) of, a magnification window wake-up control 111 is displayed on the display interface of the ultra-high-definition video. The user can trigger the wake-up operation of the magnification window by clicking on the magnification window wake-up control 111. After the terminal device detects that the user clicks on the magnification window wake-up control 111, it will correspondingly display the magnification window 112 on the display interface of the ultra-high-definition video, as Figure 1 shown in (b) of.

[0037] For the enlarged window displayed on the display interface of the ultra-high-definition video, the terminal device 110 will, based on the resolution of the ultra-high-definition video itself, display the enlarged image corresponding to the image in the target enlarged area of the currently playing video frame within the enlarged window; as Figure 1 shown in (b) of the figure, the terminal device 110 displays the enlarged image corresponding to the image in the corresponding target enlarged area within the enlarged window 112. When determining the display content within the enlarged window, the terminal device 110 needs to first determine the target enlarged area in the currently playing video frame. Specifically, the terminal device 110 can determine the target enlarged area in the currently playing video frame according to the display position of the enlarged window on the display interface and the magnification ratio corresponding to the enlarged window; then, the terminal device 110 can perform magnification processing on the image in the target enlarged area based on the magnification ratio corresponding to the enlarged window to obtain the enlarged image corresponding to the image in the target enlarged area; furthermore, within the enlarged window, the enlarged image corresponding to the image in the target enlarged area is displayed based on the resolution of the ultra-high-definition video.

[0038] Optionally, the display position of the above-mentioned enlarged window on the display interface of the ultra-high-definition video can be adjustable, so as to facilitate the user to select the area to be enlarged and viewed in the video frame according to their actual needs. For example, the terminal device can set a window position adjustment control on the display interface of the ultra-high-definition video, so that the user can adjust the position of the enlarged window on the display interface through the window position adjustment control; or for another example, the terminal device can support the user to adjust the display position of the enlarged window by dragging the enlarged window; and so on.

[0039] Optionally, the magnification ratio corresponding to the above-mentioned enlarged window can also be adjustable, so as to facilitate the user to adjust the magnification degree of the picture content to be enlarged and viewed according to their actual needs. For example, the terminal device can set a magnification ratio adjustment control on the display interface of the ultra-high-definition video, so that the user can adjust the magnification ratio corresponding to the enlarged window through the magnification ratio adjustment control; or for another example, the terminal device can support the user to use specific gesture operations to achieve the adjustment of the magnification ratio; and so on.

[0040] It should be understood that Figure 1 the application scenarios shown are only examples. In actual applications, the video magnification method provided by the embodiments of the present application can also be applied to other application scenarios. For example, the video magnification method provided by the embodiments of the present application can be applied to Figure 1 the smart phones shown in addition to being applicable to devices such as tablet computers and desktop computers that support ultra-high-definition video playback; no limitations are imposed on the application scenarios of the video magnification method provided by the embodiments of the present application here.

[0041] The video magnification method provided by the present application will be introduced in detail below through method embodiments.

[0042] See Figure 2 , Figure 2 which is a schematic flowchart of the video magnification method provided by an embodiment of this application. As Figure 2 shown, the video magnification method includes the following steps:

[0043] Step 201: In response to a magnification window wake-up operation triggered for an ultra-high-definition video, display a magnification window on the display interface of the ultra-high-definition video.

[0044] In practical applications, when a user watches an ultra-high-definition video through a video playback APP running on a terminal device, the user can trigger a magnification window wake-up operation for the watched ultra-high-definition video. In response to this magnification window wake-up operation, the terminal device will correspondingly display a magnification window on the display interface of the ultra-high-definition video. It should be noted that the above display interface refers to the interface for displaying the ultra-high-definition video, and the picture displayed on this display interface is the picture that the user can see; in practical applications, through this display interface, a complete video picture can be displayed, or a partial area of the video picture can be displayed.

[0045] Optionally, in an embodiment of this application, the terminal device may only support displaying a magnification window for ultra-high-definition videos, that is, only support triggering a magnification window wake-up operation for ultra-high-definition videos. In this case, the terminal device can determine whether the resolution of the currently played video reaches a preset resolution for its currently played video. For example, determine whether the resolution of the video exceeds 4K (i.e., 4096*2160), or for another example, determine whether the resolution of the video exceeds 4K and does not exceed 8K (i.e., 7680*4320); if it is determined that the resolution of the currently played video reaches the preset resolution, it can be determined that the currently played video belongs to an ultra-high-definition video. At this time, the user can be supported to trigger a magnification window wake-up operation for the ultra-high-definition video, and a control for triggering the magnification window wake-up operation is provided. Of course, in practical applications, the terminal device may also support triggering a magnification window wake-up operation for videos of various resolutions, and this application does not make any limitation on the video types applicable to this magnification window wake-up operation.

[0046] In a possible implementation manner, the terminal device may support the user to trigger the above magnification window wake-up operation through a magnification window wake-up control.

[0047] Figure 3 Two exemplary forms of the magnification window wake-up control are shown as follows. As Figure 3As shown in (a), the display ratio control 301 in the display interface can be used as a magnified window wake-up control. The display ratio control 301 is used to reflect the scaling ratio of the video picture currently displayed in the display interface relative to the original video picture (i.e., the video picture adapted to the size of the display interface). For example, when the scaling ratio displayed by the display ratio control 301 is 1×, it means that the currently displayed video picture is the video picture that matches the size of the display interface. When the scaling ratio displayed by the display ratio control 301 is 0.5×, it means that the size of the currently displayed video picture is half of the size of the display interface. The user can click on the display ratio control 301 to trigger the magnified window wake-up operation for the currently played ultra-high-definition video. As Figure 3 As shown in (b), a magnified window wake-up control 303 can be added to the operation control bar 302 corresponding to the display interface. The operation control bar 302 is used to carry operation controls for performing relevant settings on the video, such as a barrage switch, a playback speed adjustment control, a clarity adjustment control, a video sharing control, and so on. The user can click on the magnified window wake-up control 303 set in the operation control bar 302 to trigger the magnified window wake-up operation for the currently played ultra-high-definition video.

[0048] It should be understood that Figure 3 the manifestation forms of the magnified window wake-up controls shown are only examples. In practical applications, the magnified window wake-up control can also be set in other manifestation forms, and this application does not make any limitations on the manifestation forms of the magnified window wake-up control here.

[0049] In another possible implementation manner, the terminal device can support the user to trigger the above magnified window wake-up operation by using a specific gesture. For example, the user can draw an "O" shape on the display interface as the gesture for triggering the magnified window wake-up operation. Correspondingly, after the terminal device detects that the user draws an "O" shape on the display interface of the ultra-high-definition video, it can determine that the user has currently triggered the magnified window wake-up operation. Of course, in practical applications, any gesture can be set as the gesture for triggering the magnified window wake-up operation, and this application does not make any limitations on the gesture for triggering the magnified window wake-up operation here.

[0050] It should be understood that the specific implementation manners of the magnified window wake-up operation introduced above are only examples. In practical applications, the specific implementation manner of the magnified window wake-up operation can be set according to actual needs, and the embodiments of this application do not make any limitations on the specific implementation manner of the magnified window wake-up operation here.

[0051] After the terminal device detects that the user triggers the magnification window wake-up operation for the currently playing ultra-high-definition video, it will correspondingly activate the magnifying glass state for the ultra-high-definition video and display a magnification window at a specific position on the display interface of the ultra-high-definition video; for example, the terminal device can display a circular magnification window at the middle position of the display interface of the ultra-high-definition video, that is, the center of the magnification window coincides with the center of the display interface. Of course, in practical applications, the terminal device can also display the magnification window at other positions on the display interface, and the displayed magnification window can also be in other shapes, such as rectangles, triangles, irregular polygons, etc. This application does not make any limitations on the display position of the magnification window on the display interface and the shape of the magnification window.

[0052] Step 202: In the magnification window, based on the resolution of the ultra-high-definition video, display the magnified image corresponding to the image in the target magnification area in the video frame of the ultra-high-definition video; the target magnification area is determined according to the display position of the magnification window in the display interface and the magnification ratio corresponding to the magnification window; the magnified image is obtained by magnifying the image in the target magnification area based on the magnification ratio corresponding to the magnification window.

[0053] In the magnification window displayed on the display interface of the ultra-high-definition video, the terminal device can display the magnified image corresponding to the image in the target magnification area in the currently playing video frame of the ultra-high-definition video.

[0054] Specifically, after the terminal device detects that the user triggers the magnification window wake-up operation for the currently playing ultra-high-definition video, it will correspondingly determine the target magnification area in the currently playing video frame of the ultra-high-definition video according to the display position of the magnification window in the display interface of the ultra-high-definition video and the magnification ratio corresponding to the magnification window; it should be understood that after detecting that the user triggers the magnification window wake-up operation, a default magnification ratio, such as 10×, 20×, etc., can be configured for the magnification window first, and the user can adjust this magnification ratio according to their actual needs later. Then, based on the magnification ratio corresponding to the magnification window, magnify the image in the target magnification area to obtain the magnified image corresponding to the image in the target magnification area; furthermore, in the magnification window on the display interface, based on the resolution of the ultra-high-definition video itself, display the magnified image corresponding to the image in the target magnification area. To facilitate understanding of the above implementation process, the following takes the shape of the magnification window as a circle and the magnification ratio corresponding to the magnification window as 10 times as an example to exemplarily introduce the implementation process of displaying the magnified image corresponding to the image in the target magnification area in the magnification window.

[0055] Assume that the display position of the enlarged window is the center position of the display interface, that is, the center of the enlarged window coincides with the center of the display interface. Then, the terminal device can first determine the pixel point at the center position in the currently played video frame as the reference pixel point. In addition, the terminal device can also perform a 10-fold magnification process on the pixel point size in the currently played video frame to determine the display size of the pixel point originally displayed in the video frame within the enlarged window as the size of the enlarged pixel point. Then, the terminal device can combine the position of the reference pixel point in the video frame, the size of the enlarged window itself, and the size of the enlarged pixel point, and based on the position of the reference pixel point in the video frame, determine the area to be enlarged in the video frame as the target enlarged area. Exemplarily, the terminal device can determine the number of enlarged pixel points that should be displayed in the direction of the radius of the enlarged window based on the radius corresponding to the enlarged window and the size of the enlarged pixel point. Furthermore, centered on the position of the reference pixel point in the video frame, the pixel points that meet this number are determined along each radius direction within the enlarged window. The area covered by these pixel points and the reference pixel point in the video frame is the target enlarged area. Then, the image within the target enlarged area in the video frame is enlarged to obtain the enlarged image corresponding to the image, and the enlarged image is displayed within the enlarged window.

[0056] It should be noted that the magnification process of the image within the target enlarged area is essentially to magnify each pixel point within the target enlarged area based on the magnification ratio corresponding to the enlarged window. Magnifying a pixel point means expanding the display area of the pixel point on the display interface. For example, assume that an unenlarged pixel point in the video frame needs to be displayed through one display unit on the display screen. After a 10-fold magnification process on this pixel point, the obtained enlarged pixel point needs to be displayed through ten display units on the display screen. Here, the display unit is the smallest hardware display component on the display screen. The higher the screen resolution, the smaller the display area of the pixel points in this screen on the display screen, and the fewer the display units required to support the display of one pixel point in this screen. It should be noted that since the video frame of the ultra-high-definition video already has a high resolution, when magnifying a local area (i.e., the above-mentioned target enlarged area) in the video frame of the ultra-high-definition video, only the pixel points within this local area need to be magnified, and there is no need to specifically adjust the resolution of this local area. In this way, the picture content displayed within the enlarged window can be clear and natural, which can clearly reflect the picture details within this local area without overly rigidly showing the pixel points. It should be understood that during the playback of the ultra-high-definition video, the video frame will change, but the display position of the enlarged window in the display interface can remain unchanged, that is, the position of the target enlarged area in the video frame can remain unchanged. In this case, the enlarged image displayed within the enlarged window will change accordingly with the change of the video frame.

[0057] In practical applications, in order to further improve the user's viewing experience of ultra-high-definition videos and enable the user to view the details of each part of the video picture, the method provided by the embodiments of the present application can also support the user to adjust the picture area enlarged by the enlarged window.

[0058] In a possible implementation manner, the embodiments of the present application support the user to adjust the display position of the enlarged window in the display interface through the window position adjustment control, so as to adjust the picture area enlarged by the enlarged window. That is, in response to the enlarged window wake-up operation triggered for the ultra-high-definition video, a window position adjustment control is displayed on the display interface of the ultra-high-definition video; in response to the window position adjustment operation triggered through the window position adjustment control, the display position of the enlarged window in the display interface is adjusted.

[0059] Specifically, after the terminal device detects that the user triggers the enlarged window wake-up operation for the currently played ultra-high-definition video, in addition to being able to display the enlarged window in the display interface of the ultra-high-definition video, a window position adjustment control for adjusting the display position of the enlarged window can also be displayed in the display interface; for example, the terminal device can display the window position adjustment control at the lower left corner of the display interface, or for another example, the terminal device can display the window position adjustment control in the operation control bar of the display interface; the present application does not make any limitation on the specific display position of the window position adjustment control in the display interface. After the terminal device detects that the user triggers the window position adjustment operation through the window position adjustment control, the display position of the enlarged window in the display interface will be adjusted accordingly according to the window position adjustment operation triggered by the user, so as to adjust the target enlarged area in the enlarged video picture.

[0060] As an example, the above window position adjustment control may include a virtual joystick and a virtual joystick control area. When the user triggers the window position adjustment operation through the window position adjustment control, the position of the virtual joystick can be adjusted in the virtual joystick control area. Accordingly, the enlarged window in the display interface will move following the change of the virtual joystick position, so as to change the target enlarged area in the video picture. Figure 4 The following shows a schematic diagram of an exemplary implementation process of adjusting the display position of the enlarged window based on the window position adjustment control, as Figure 4 shown in (a) and (b) below, the display interface of the video picture includes a window position adjustment control 410, which includes a virtual joystick 411 and a virtual joystick control area 412, and the user can move the virtual joystick 411 within the virtual joystick control area 412; as Figure 4As shown in (b), after the user adjusts the position of the virtual joystick 411 in the virtual joystick control area 412, the display position of the enlarged window in the display interface will also be adjusted accordingly, so as to enlarge other areas in the video picture.

[0061] During the process that the user performs the window position adjustment operation through the above window position adjustment control, the terminal device will determine the displacement parameter of the virtual joystick according to the position adjustment operation triggered by the user on the virtual joystick in the virtual joystick control area; then, according to the displacement parameter of the virtual joystick, determine the position adjustment parameter corresponding to the enlarged window; furthermore, according to the position adjustment parameter corresponding to the enlarged window, adjust the display position of the enlarged window in the display interface.

[0062] Taking a smart phone as an example of a terminal device for playing an ultra-high definition video, the User Interface (UI) layer of the terminal device can detect the movement of the user's finger on the display screen. When the terminal device detects that the user's finger moves the virtual joystick in the virtual joystick control area, the terminal device can determine the displacement parameter of the virtual joystick according to the movement data of the user's finger collected by it; then, according to a preset conversion method, convert the displacement parameter of the virtual joystick into the position adjustment parameter corresponding to the enlarged window; furthermore, according to the position adjustment parameter corresponding to the enlarged window, control the enlarged window to move on the display interface, so that the enlarged window moves to a position corresponding to the position where the virtual joystick is located in the virtual joystick control area on the display interface.

[0063] Specifically, when implemented, the terminal device can determine the position offset angle and position offset amount of the virtual joystick according to the position adjustment operation triggered by the user on the virtual joystick in the virtual joystick control area, and determine the moving speed of the virtual joystick; furthermore, according to the position offset angle and position offset amount of the virtual joystick, determine the position adjustment direction and position adjustment amount corresponding to the enlarged window, and according to the moving speed of the virtual joystick, determine the position adjustment speed corresponding to the enlarged window; correspondingly, the terminal device can adjust the display position of the enlarged window in the display interface based on the position adjustment direction, position adjustment amount and position adjustment speed corresponding to the enlarged window.

[0064] Taking the terminal device for playing ultra-high-definition videos as a smartphone as an example, the UI layer of the terminal device can adjust the operation according to the position where the user's finger triggers the virtual joystick in the virtual joystick control area, determine the position offset angle and position offset amount of the virtual joystick relative to its previous position, and determine the moving speed of the virtual joystick when the user's finger controls the virtual joystick. Then, the terminal device can perform conversion processing on the position offset angle, position offset amount, and moving speed of the virtual joystick respectively according to a preset conversion method to obtain the position adjustment direction, position offset amount, and position adjustment speed corresponding to the enlarged window; for example, the terminal device can directly use the position offset angle of the virtual joystick as the position adjustment direction corresponding to the enlarged window, perform an enlargement process on the position offset amount of the virtual joystick according to the first ratio to obtain the position adjustment amount corresponding to the enlarged window, and perform an enlargement process on the moving speed of the virtual joystick according to the second ratio to obtain the position adjustment speed corresponding to the enlarged window.

[0065] It should be understood that the implementation form of the above window position adjustment control is only an example. In actual applications, other forms of window position adjustment controls can also be set according to actual needs. For example, a window position adjustment control including four position adjustment sub-controls corresponding to the four moving directions of up, down, left, and right can be set. By touching the position adjustment sub-control, the enlarged window can be moved in the corresponding direction. This application does not make any limitations on the form of the window position adjustment control here.

[0066] In another possible implementation manner, the embodiments of the present application support the user to adjust the picture area enlarged by the enlarged window by performing a drag operation on the enlarged window or a non-target enlarged area in the video picture.

[0067] As an example, the terminal device can respond to the drag operation triggered by the user on the enlarged window in the display interface, adjust the display position of the enlarged window in the display interface, so as to adjust the target enlarged area enlarged in the video picture of the ultra-high-definition video. Taking the device for playing ultra-high-definition videos as a smartphone as an example, the UI layer of the terminal device can detect the drag operation triggered by the user's finger on the enlarged window in the display interface, and correspondingly adjust the display position of the enlarged window on the display interface following the movement of the user's finger, so as to adjust the target enlarged area enlarged in the video picture.

[0068] As another example, the terminal device can respond to the drag operation triggered by the user on a non-target enlarged area in the video picture of the ultra-high-definition video, adjust the display position of the video picture of the ultra-high-definition video in the display interface, and adjust the target enlarged area in the video picture of the ultra-high-definition video.

[0069] Specifically, in practical applications, the video picture displayed on the display interface can be a video picture with a frame size smaller than the size of the display interface. For example, the video picture can be displayed in a partial area (such as the middle area) of the display interface, and there is a blank area on the display interface where the video picture is not displayed; or, the video picture displayed on the display interface can also be a partial area of the video picture, that is, the complete video picture is not fully displayed through the display interface. In the above cases, when the terminal device detects that the user triggers a drag operation on the video picture, it can correspondingly change the display position of the video picture on the display interface or change the picture area displayed by the video picture on the display interface. When there is a magnifying window displayed on the display interface, if the terminal device detects that the user triggers a drag operation on a non-target magnified area in the video picture, it can correspondingly adjust the position of the video picture on the display interface or correspondingly adjust the picture area displayed on the display interface; when the display position of the magnifying window on the display interface remains unchanged, adjusting the position of the video picture on the display interface and adjusting the picture area displayed on the display interface can both cause the target magnified area magnified by the magnifying window in the video picture to change.

[0070] It should be understood that the method for adjusting the target magnified area magnified by the magnifying window in the video picture introduced above is only an example. In practical applications, other methods can also be set according to actual needs to achieve the adjustment of the target magnified area magnified by the magnifying window.

[0071] In practical applications, in order to further improve the user's viewing experience of ultra-high-definition videos and enable the user to adjust the magnification of the picture area displayed in the magnifying window according to actual needs, the method provided in the embodiments of the present application can also support the user to adjust the magnification ratio corresponding to the magnifying window.

[0072] In a possible implementation manner, the embodiments of the present application support the user to adjust the magnification ratio corresponding to the magnifying window through a magnification ratio adjustment control. That is, in response to a magnifying window wake-up operation triggered for an ultra-high-definition video, a magnification ratio adjustment control is displayed on the display interface of the ultra-high-definition video; in response to a magnification ratio adjustment operation triggered through the magnification ratio adjustment control, the magnification ratio corresponding to the magnifying window is adjusted.

[0073] Specifically, after the terminal device detects that the user triggers the wake-up operation of the magnified window for the currently playing ultra-high-definition video, in addition to being able to display the magnified window in the display interface of the ultra-high-definition video, it can also display a magnification adjustment control for adjusting the magnification of the magnified window in this display interface; for example, the terminal device can display the magnification adjustment control at the right boundary of the display interface, or for another example, the terminal device can display the magnification adjustment control in the operation control bar of the display interface; this application does not make any limitation on the specific display position of the magnification adjustment control in the display interface. After the terminal device detects that the user triggers the magnification adjustment operation through the magnification adjustment control, it will correspondingly adjust the magnification corresponding to the magnified window according to the magnification adjustment operation triggered by the user, so as to change the target magnified area magnified by the magnified window in the video picture, and change the size of the magnified pixel points displayed in the magnified window.

[0074] As an example, the above magnification adjustment control can be embodied as a magnification adjustment wheel. When the user triggers the magnification adjustment operation through this magnification adjustment control, the user can slide the magnification adjustment wheel to rotate the magnification adjustment wheel to the magnification the user wants, that is, to make the magnification displayed at the magnification display result on the magnification adjustment wheel show the magnification the user wants; correspondingly, when the terminal device detects that the sliding operation triggered by the user for the magnification adjustment wheel stops, it will use the magnification displayed at the magnification adjustment result on the magnification adjustment wheel as the magnification corresponding to the magnified window, and adjust the target magnified area according to the magnification displayed at the magnification adjustment result, and adjust the size of the magnified pixel points displayed in the magnified window.

[0075] Figure 5 The following shows a schematic diagram of an exemplary implementation process for adjusting the magnification based on the magnification adjustment control, as Figure 5 shown in (a) and (b) below. The display interface of the video picture includes a magnification adjustment wheel 510, and the position 511 on this magnification adjustment wheel 510 is the position where the magnification adjustment result is displayed. The user can adjust the magnification adjustment result displayed at 511 by sliding the magnification adjustment wheel 510, so as to adjust the magnification corresponding to the magnified window; Figure 5 Figure (a) shows a schematic diagram of the display interface when the magnification is 16×, Figure 5 Figure (b) shows a schematic diagram of the display interface when the magnification is 8×. By comparison, it can be found that the larger the magnification, the smaller the target magnified area magnified by the magnified window, and the larger the magnified pixel points displayed in the magnified window.

[0076] It should be understood that the implementation form of the above magnification adjustment control is only an example. In actual applications, other forms of magnification adjustment controls can also be set according to actual needs. For example, a magnification selection bar can be set, and several optional magnifications are provided through this magnification selection bar. Users can select the magnification they want through this magnification selection bar. This application does not make any restrictions on the form of the magnification adjustment control here.

[0077] In another possible implementation manner, the embodiment of this application supports users to adjust the magnification corresponding to the enlarged window through specific gestures.

[0078] As an example, the terminal device can respond to the first magnification adjustment gesture triggered by the user within the enlarged window and adjust the magnification corresponding to the enlarged window. For example, a two-finger pinch gesture (i.e., two fingers sliding outward and two fingers sliding inward) can be preset as the first magnification adjustment gesture in advance; when the terminal device detects that the user triggers the operation of sliding two fingers outward within the enlarged window, it can determine that the user has triggered the operation of increasing the magnification corresponding to the enlarged window, and accordingly increase the current magnification corresponding to the enlarged window according to the preset magnification increase step; when the terminal device detects that the user triggers the operation of sliding two fingers inward within the enlarged window, it can determine that the user has triggered the operation of decreasing the magnification corresponding to the enlarged window, and accordingly decrease the current magnification corresponding to the enlarged window according to the preset magnification decrease step. It should be understood that the above first magnification adjustment gesture is only an example. In actual applications, other first magnification adjustment gestures can also be set, and this application does not make any restrictions on this first magnification adjustment gesture here.

[0079] As another example, the terminal device can respond to the second magnification adjustment gesture triggered by the user within the non-target enlarged area in the video picture of the ultra-high-definition video and adjust the magnification corresponding to the enlarged window. For example, the second magnification adjustment gesture can be preset as the user drawing an "L" shape and a "J" shape within the non-target enlarged area of the video picture. The "L" shape indicates an increase in magnification, and the "J" shape indicates a decrease in magnification; when the terminal device detects that the user draws an "L" shape within the non-target enlarged area of the video picture, it can determine that the user has triggered the operation of increasing the magnification corresponding to the enlarged window, and accordingly increase the current magnification corresponding to the enlarged window according to the preset magnification increase step; when the terminal device detects that the user draws a "J" shape within the non-target enlarged area of the video picture, it can determine that the user has triggered the operation of decreasing the magnification corresponding to the enlarged window, and accordingly decrease the current magnification corresponding to the enlarged window according to the preset magnification decrease step. It should be understood that the above second magnification adjustment gesture is only an example. In actual applications, other second magnification adjustment gestures can also be set, and this application does not make any restrictions on this second magnification adjustment gesture here.

[0080] It should be understood that the methods for adjusting the magnification factor corresponding to the enlarged window introduced above are only examples. In actual applications, other methods can also be set according to actual needs to display the adjustment of the magnification factor corresponding to the enlarged window.

[0081] It should be understood that when the target enlarged area corresponding to the enlarged window changes and / or the magnification factor corresponding to the enlarged window changes, the terminal device needs to re-determine the target enlarged area according to the methods introduced above, and perform magnification processing on the pixel points in the target enlarged area according to the changed magnification factor to adjust the enlarged content displayed in the enlarged window.

[0082] Optionally, in order to further facilitate the user to view the picture area displayed in the enlarged window, the embodiment of the present application can also respond to the full-screen display operation triggered by the user for the enlarged window, and full-screen display the enlarged image corresponding to the image in the target enlarged area on the display interface.

[0083] Exemplarily, Figure 6 The following shows a schematic diagram of the implementation process of a full-screen display operation triggered for an enlarged window provided by the embodiment of the present application. As Figure 6 shown in (a) below, the user can click on the enlarged window to trigger a full-screen display operation for the enlarged window; after the terminal device detects that the user triggers a full-screen display operation for the enlarged window, it will full-screen display the enlarged image corresponding to the image in the target enlarged area at the resolution of an ultra-high-definition video on the display interface, as Figure 6 shown in (b) below. Of course, in actual applications, the full-screen display operation triggered for the enlarged window can specifically adopt other methods, such as setting a specific control for triggering the full-screen display for the enlarged window. The present application does not make any limitation on the method for triggering the full-screen display operation for the enlarged window.

[0084] It should be noted that in actual applications, the size of the enlarged window may not be fully matched with the size of the display interface. For example, when the enlarged window is circular, the shape of the enlarged window does not match the shape of the display interface. Another example is that the aspect ratio of the enlarged window is inconsistent with the aspect ratio of the display interface, etc.; in such a case, the terminal device needs to re-determine the target enlarged area required for full-screen display based on the target enlarged area currently enlarged by the enlarged window. Exemplarily, the terminal device can select basic enlarged pixel points within the target enlarged area currently enlarged by the enlarged window. For example, select the pixel points located on the longitudinal axis of the enlarged window as the basic enlarged pixel points, and then, in combination with the size of the display interface, based on these basic enlarged pixel points, select the pixel points covered by the target enlarged area for full-screen display on the video screen, and further, full-screen display the enlarged pixel points corresponding to each pixel point in the target enlarged area on the display interface.

[0085] It should be understood that since the display interface is larger than the magnification window, when the magnified image corresponding to the image in the target magnification area is displayed full-screen on the display interface, the pixel points in the full-screen displayed magnified image will be larger than the pixel points displayed in the magnification window; that is, the terminal device needs to further magnify the pixel points displayed in the magnification window according to the relationship between the size of the magnification window and the size of the display interface, and then display the further magnified pixel points full-screen.

[0086] Optionally, the method provided in the embodiments of the present application can also support the user to trigger a zoom operation on the video picture displayed on the display interface, that is, to magnify or reduce the video picture displayed on the display interface. That is, in response to the zoom operation triggered by the user on the video picture of the ultra-high-definition video, the terminal device enters the video zoom mode and displays the zoomed image corresponding to the image in the target area of the video picture on the display interface. Here, the zoomed image is obtained by zooming the image in the target area according to the zoom ratio corresponding to the triggered zoom operation. Correspondingly, in this case, if there is a magnification window displayed on the display interface, the target magnification area magnified by the magnification window is determined according to the display position of the magnification window in the target area, the zoom ratio corresponding to the zoom operation, and the magnification factor corresponding to the magnification window. The magnified image displayed in the magnification window is obtained by magnifying the zoomed image in the target magnification area based on the magnification factor corresponding to the magnification window.

[0087] Exemplarily, after the terminal device detects a zoom operation triggered by the user for the video picture displayed on the display interface, for example, after detecting that the user performs a two-finger zoom gesture (including swiping outwards and inwards with two fingers) within the non-target magnification area in the video picture, the terminal device can enter the video zoom mode. In the video zoom mode, the terminal device can respond to the zoom operation triggered by the user for the video picture and adjust the video picture displayed on the display interface. For example, when detecting that the user performs an operation of swiping outwards with two fingers within the non-target magnification area in the video picture, the terminal device can magnify the currently displayed video picture according to a preset magnification ratio. The essence of this magnification process is to magnify the display area of the pixel points in the video picture. As the display area of the pixel points is magnified, the frame of the video picture will also be magnified accordingly. The size of the magnified video picture may exceed the size of the display interface. At this time, only a partial area of the video picture can be displayed through the display interface, and this partial area is the target area mentioned above. Another example is that when detecting that the user performs an operation of swiping inwards with two fingers within the non-target magnification area in the video picture, the terminal device can reduce the currently displayed video picture according to a preset reduction ratio. The essence of this reduction process is to reduce the display area of the pixel points in the video picture. As the pixel points are reduced, the frame of the video picture will also be reduced accordingly. The size of the reduced video picture may be smaller than the size of the display interface. At this time, only a partial area of the display interface can be used to display the reduced video picture, and the entire reduced video picture is the target area mentioned above.

[0088] In the video zoom mode, the target magnification area magnified by the magnification window will also change following the zoom of the video picture, and the size of the magnified pixel points displayed within the magnification window will also change accordingly. Specifically, in the video zoom mode, the terminal device will collaboratively determine the target magnification area that needs to be magnified and displayed through the magnification window in the target area based on the display position of the magnification window in the target area, the zoom ratio corresponding to the zoom operation, and the magnification factor corresponding to the magnification window. The implementation method of determining the target magnification area in the target area is similar to the implementation method of determining the target magnification area in the video picture introduced above. The only difference is that when determining the target magnification area in the target area, the zoom ratio corresponding to the zoom operation also needs to be considered collaboratively. Correspondingly, the magnified image displayed through the magnification window is also obtained by further magnifying the image after the zoom process.

[0089] In addition, the embodiments of the present application can also support the user to adjust the target area displayed on the display interface, that is, the terminal device can respond to the dragging operation triggered by the user for the target area displayed on the display interface and adjust the target area in the video picture displayed on the display interface.

[0090] Exemplarily, when the target area displayed in the display interface is a partial area of the video picture, the terminal device can adjust the partial area in the video picture displayed in the display interface in response to the dragging operation triggered by the user on the target area, that is, change the area in the video picture displayed through the display interface. When the target area displayed in the display interface is the entire video picture after being reduced and there is a blank area in the display interface where the video picture is not displayed, the terminal device can adjust the display position of the video picture in the display interface in response to the dragging operation triggered by the user on the target area, that is, change the display position of the video picture in the display interface.

[0091] In addition, the embodiments of the present application can also support the user to close the enlarged window and retain the video picture display mode in the video zoom mode; that is, the terminal device can cancel the enlarged window displayed in the display interface and retain the scaled image corresponding to the image in the target area on the display interface in response to the enlarged window closing operation triggered by the user.

[0092] Exemplarily, the user can trigger the enlarged window closing operation through the enlarged window closing control, or can also trigger the enlarged window closing operation through a specific gesture operation. The present application does not make any limitation on the specific implementation form of the enlarged window closing operation. After the terminal device detects that the user triggers the enlarged window closing operation, it can cancel the display of the enlarged window and related window position adjustment controls and magnification adjustment controls, and retain the display mode in the video zoom mode on the display interface, that is, still display the video picture based on the target area and the size of the scaled image in the video zoom mode.

[0093] The video magnification method provided by the embodiments of the present application innovatively proposes a magnification function for ultra-high-definition videos. This magnification function supports the user to trigger the enlarged window wake-up operation during the viewing of ultra-high-definition videos, and correspondingly displays an enlarged window in the display interface of the ultra-high-definition video. Furthermore, through this enlarged window, an enlarged image corresponding to the image in the target enlarged area in the video picture is displayed based on the resolution of the ultra-high-definition video; in this way, the user can better view the details in the video picture of the ultra-high-definition video through this enlarged window, so as to more intuitively experience the advantages of multi-details and high definition of the ultra-high-definition video and obtain a better ultra-high-definition video viewing experience.

[0094] To facilitate further understanding of the video magnification method provided by the embodiments of the present application, the video magnification method provided by the embodiments of the present application will be introduced as a whole exemplarily below.

[0095] Below, first in combination with Figure 7 introduce the interaction elements in the display interface of the ultra-high-definition video. As Figure 7As shown, the display interface 701 is used to carry the video picture of the ultra-high definition video. The video picture carried by the display interface 701 can be a complete video picture or a partial area in the video picture. The magnifying window 702 will appear in the display interface in response to the magnifying window wake-up operation triggered by the user for the ultra-high definition video. The magnifying window 702 is initially default set in the middle area of the display interface, and its display position in the display interface can be adjusted according to the user operation subsequently. The window position adjustment control 703 can be set at the lower left of the display interface, which includes a virtual joystick and a virtual joystick control area, and is used to adjust the display position of the magnifying window 702 in the display interface. The magnification adjustment control 704 can be set on the right side of the display interface, and it is specifically manifested as a magnification adjustment roulette. The user can adjust the magnification corresponding to the magnifying window 702 by holding and sliding the magnification adjustment roulette, so as to adjust the size of the view area displayed in the magnifying window 702.

[0096] When the user watches the ultra-high definition video, the magnifying window wake-up operation for the ultra-high definition video can be triggered through the magnifying window wake-up control in the display interface. For example, the user can trigger the magnifying window wake-up operation by clicking Figure 3 the magnifying window wake-up control 301 in the display interface shown in (a) in the figure, and wake up the magnifying window in the display interface. The magnifying window is default centered in the display interface.

[0097] After the terminal device detects that the user triggers the magnifying window wake-up operation for the ultra-high definition video, the window position adjustment control 703 and the magnification adjustment control 704 can also be correspondingly displayed in the display interface. As Figure 4 shown in (a) and (b) in the figure, when the window position adjustment control 703 includes a virtual joystick and a virtual joystick control area, the user can synchronously adjust the position of the magnifying window in the display interface by adjusting the position of the virtual joystick in the virtual joystick control area. As Figure 5 shown in (a) and (b) in the figure, when the magnification adjustment control 704 is a magnification adjustment roulette, the user can synchronously adjust the magnification corresponding to the magnifying window by holding and sliding the magnification adjustment roulette, so that the view size in the magnifying window is synchronously adjusted. In addition, as Figure 6 shown in (a) and (b) in the figure, the user can also click on the magnifying window to display the view in the magnifying window full screen in the display interface.

[0098] Next, in combination with Figure 8 the underlying processing logic for the terminal device to implement the above magnification function will be introduced. When the terminal device implements the above magnification function, it may specifically involve four parts: the user, the video player UI, the video player software development kit (SDK), and the server.

[0099] In the startup phase, when the user calls the video player to play a video through the terminal device, the video player SDK will read the media information of the played video and determine whether the resolution of the video exceeds 4K (i.e., 4096*2160) and does not exceed 8K (i.e., 7680*4320); if the resolution of the video meets the above requirements, the video player will display an operation entry related to the magnifying window, such as displaying a magnifying window wake-up control, to support the user to use the magnifying window function.

[0100] In the activation phase, after the terminal device detects that the user clicks the magnifying window wake-up control, the magnifying glass state will be activated accordingly. In this magnifying glass state, the video player will layout and display the magnifying window, the window position adjustment control, and the magnification adjustment control in the display interface. The video player SDK can update the player state data in real time according to the user's current operation state. Exemplarily, this state data can include the visible video picture in the display interface, the scaled picture corresponding to the video picture, and the local magnified area view within the magnifying window. These data can be used for the interface display of the video player UI layer. When the magnification adjustment control is a magnification adjustment wheel, the magnification adjustment wheel can display the current magnification corresponding to the magnifying window. The magnification = (width of the magnified pixel points / width of the pixel points in the source video picture) * 100%. The width of the magnified pixel points is the width of the magnified pixel points displayed within the magnifying window, and the width of the pixel points in the source video picture is the width of the pixel points that are not magnified and displayed in the video picture. This magnification data can also be used for the interface display of the video player UI layer. Within the magnifying window, the video content of the local rendering area in the ultra-high-definition video will be played accordingly. The local rendering area is determined in the video picture of the played ultra-high-definition video according to the position of the magnifying window in the display interface and the magnification corresponding to the magnifying window.

[0101] During the operation phase, the terminal device mainly supports two operations: adjusting the display position of the magnified window through the window position adjustment control, and adjusting the magnification ratio corresponding to the magnified window through the magnification ratio adjustment control. When the window position adjustment control includes a virtual joystick and a virtual joystick control area, the video player UI layer can call the ScrollTo interface of the video player SDK according to the position adjustment operation of the user's finger on the virtual joystick in the virtual joystick control area, and control the movement of the magnified window in the display interface, so that the magnified window can move in the direction of the virtual joystick at a preset speed. When the magnification ratio adjustment control is specifically a magnification adjustment wheel, the video player UI layer can call the zoom interface of the video player SDK through the sliding operation of the user's finger on the magnification adjustment wheel, and support the magnification and reduction of the view in the magnified window through the Zoom IN and Zoom Out interfaces. In addition, it also supports the user to perform a two-finger zoom operation, that is, in the area of the display interface that is not the magnified window, perform a two-finger outward expansion operation to magnify the visible video image, and perform a two-finger inward contraction operation to reduce the visible video image. Optionally, during the above operation process, the video player UI layer can also report relevant operation data to the server.

[0102] During the exit phase, when the terminal device detects that the user triggers the magnifying glass state exit operation, it correspondingly cancels the magnified window displayed in the display interface, and cancels the display window position adjustment control and the magnification ratio adjustment control. If a zoom operation is triggered on the video image in the magnifying glass state, after exiting the magnifying glass mode, the previous zoom ratio can still be retained to continue playing the ultra-high-definition video.

[0103] For the video magnification method described above, the present application also provides a corresponding video magnification device to enable the above video magnification method to be applied and implemented in practice.

[0104] See Figure 9 , Figure 9 is a schematic structural diagram of a video magnification device 900 corresponding to the video magnification method shown above. As Figure 2 shown, the video magnification device 900 includes: Figure 9 shown, the video magnification device 900 includes:

[0105] A magnified window wake-up module 901, configured to display a magnified window on the display interface of the ultra-high-definition video in response to a magnified window wake-up operation triggered for the ultra-high-definition video;

[0106] The enlarged content display module 902 is configured to display, in the enlarged window, an enlarged image corresponding to the image in the target enlarged area of the video frame of the ultra-high definition video based on the resolution of the ultra-high definition video; the target enlarged area is determined according to the display position of the enlarged window in the display interface and the magnification factor corresponding to the enlarged window; the enlarged image is obtained by magnifying the image in the target enlarged area based on the magnification factor corresponding to the enlarged window.

[0107] Optionally, based on the video magnification device shown in Figure 9 the enlarged window wake-up module 901 is further configured to: in response to the enlarged window wake-up operation triggered for the ultra-high definition video, display a window position adjustment control on the display interface of the ultra-high definition video;

[0108] Then the device further includes: a window position adjustment module; the window position adjustment module is configured to, in response to a window position adjustment operation triggered by the window position adjustment control, adjust the display position of the enlarged window in the display interface.

[0109] Optionally, the window position adjustment control includes a virtual joystick and a virtual joystick control area; then the window position adjustment module is specifically configured to:

[0110] Determine the displacement parameter of the virtual joystick according to the position adjustment operation triggered for the virtual joystick in the virtual joystick control area;

[0111] Determine the position adjustment parameter corresponding to the enlarged window according to the displacement parameter of the virtual joystick;

[0112] Adjust the display position of the enlarged window in the display interface according to the position adjustment parameter corresponding to the enlarged window.

[0113] Optionally, the window position adjustment module is specifically configured to:

[0114] Determine the position offset angle and position offset amount of the virtual joystick, and determine the moving speed of the virtual joystick according to the position adjustment operation triggered for the virtual joystick in the virtual joystick control area;

[0115] Determine the position adjustment direction and position adjustment amount corresponding to the enlarged window according to the position offset angle and position offset amount of the virtual joystick; determine the position adjustment speed corresponding to the enlarged window according to the moving speed of the virtual joystick.

[0116] Optionally, in Figure 9Based on the video magnification device shown, the device further includes: a magnification area adjustment module; the magnification area adjustment module is used to adjust the target magnification area in at least one of the following ways:

[0117] In response to a drag operation triggered on the display interface for the magnification window, adjust the display position of the magnification window in the display interface, and adjust the target magnification area in the video frame of the ultra-high-definition video;

[0118] In response to a drag operation triggered on a non-target magnification area in the video frame of the ultra-high-definition video, adjust the display position of the video frame of the ultra-high-definition video in the display interface, and adjust the target magnification area in the video frame of the ultra-high-definition video.

[0119] Optionally, on the basis of Figure 9 the video magnification device shown, the magnification window wake-up module 901 is further used to: in response to the magnification window wake-up operation triggered for the ultra-high-definition video, display a magnification ratio adjustment control on the display interface of the ultra-high-definition video;

[0120] Then the device further includes: a first magnification ratio adjustment module; the first magnification ratio adjustment module is used to adjust the magnification ratio corresponding to the magnification window in response to a magnification ratio adjustment operation triggered by the magnification ratio adjustment control.

[0121] Optionally, the magnification ratio adjustment control is a magnification ratio adjustment wheel; then the first magnification ratio adjustment module is specifically used to: according to the sliding operation triggered for the magnification ratio adjustment wheel, determine the magnification ratio displayed at the magnification ratio adjustment result on the magnification ratio adjustment wheel when the sliding operation stops, as the magnification ratio corresponding to the magnification window.

[0122] Optionally, on the basis of Figure 9 the video magnification device shown, the device further includes: a second magnification ratio adjustment module; the second magnification ratio adjustment module is used to adjust the magnification ratio corresponding to the magnification window in at least one of the following ways:

[0123] In response to a first magnification ratio adjustment gesture triggered within the magnification window, adjust the magnification ratio corresponding to the magnification window;

[0124] In response to a second magnification ratio adjustment gesture triggered within a non-target magnification area in the video frame of the ultra-high-definition video, adjust the magnification ratio corresponding to the magnification window.

[0125] Optionally, on the basis of Figure 9Based on the video magnification device shown, the device further includes: a magnified area full-screen display module; the magnified area full-screen display module is configured to, in response to a full-screen display operation triggered for the magnified window, full-screen display the magnified image corresponding to the image within the target magnified area on the display interface.

[0126] Optionally, based on Figure 9 the video magnification device shown, the device further includes: a video frame scaling module, configured to, in response to a scaling operation triggered for the video frame of the ultra-high-definition video, display the scaled image corresponding to the image within the target area in the video frame on the display interface; the scaled image is obtained by scaling the image within the target area according to the scaling ratio corresponding to the scaling operation; then the target magnified area is determined according to the display position of the magnified window in the target area, the scaling ratio corresponding to the scaling operation, and the magnification factor corresponding to the magnified window; the magnified image is obtained by magnifying the scaled image within the target magnified area based on the magnification factor corresponding to the magnified window.

[0127] Optionally, the video frame scaling module is further configured to, in response to a dragging operation triggered for the target area displayed on the display interface, adjust the target area in the video frame displayed on the display interface.

[0128] Optionally, the video frame scaling module is further configured to, in response to the triggered magnified window closing function, cancel the display of the magnified window and retain the display of the scaled image corresponding to the image within the target area on the display interface.

[0129] The video magnification device provided in the embodiments of the present application innovatively proposes a magnification function for ultra-high-definition videos. This magnification function supports the user to trigger a magnified window wake-up operation during the process of watching an ultra-high-definition video, and accordingly, display a magnified window in the display interface of the ultra-high-definition video. Furthermore, through this magnified window, display the magnified image corresponding to the image within the target magnified area in the video frame based on the resolution of the ultra-high-definition video; thus, the user can better view the details in the video frame of the ultra-high-definition video through this magnified window, and thereby more intuitively experience the advantages of the ultra-high-definition video such as multiple details and high definition, and obtain a better ultra-high-definition video viewing experience.

[0130] The embodiments of the present application also provide a device for supporting the implementation of video magnification. This device may specifically be a terminal device. Hereinafter, the terminal device and the server provided in the embodiments of the present application will be introduced from the perspective of hardware implementation.

[0131] See Figure 10 , Figure 10It is a schematic structural diagram of a terminal device provided by an embodiment of the present application. As Figure 10 shown, for the convenience of description, only the parts related to the embodiment of the present application are shown. For the specific technical details not disclosed, please refer to the method part of the embodiment of the present application. The terminal can be any terminal device including a mobile phone, a tablet computer, a personal digital assistant, a point-of-sale (POS) terminal, an in-vehicle computer, etc. Taking the terminal as a computer as an example:

[0132] Figure 10 Shown is a block diagram of a part of the structure of a computer related to the terminal provided by an embodiment of the present application. Referring to Figure 10 , the computer includes: a radio frequency (RF) circuit 1010, a memory 1020, an input unit 1030 (including a touch panel 1031 and other input devices 1032), a display unit 1040 (including a display panel 1041), a sensor 1050, an audio circuit 1060 (which can be connected to a speaker 1061 and a microphone 1062), a wireless fidelity (WiFi) module 1070, a processor 1080, and a power supply 1090, etc. Those skilled in the art can understand that Figure 10 the computer structure shown in does not constitute a limitation on the computer, and it may include more or fewer components than shown, or combine some components, or have different component arrangements.

[0133] The memory 1020 can be used to store software programs and modules. The processor 1080 executes various functional applications and data processing of the computer by running the software programs and modules stored in the memory 1020. The memory 1020 may mainly include a program storage area and a data storage area. Among them, the program storage area can store an operating system, applications required for at least one function (such as a sound playback function, an image playback function, etc.); the data storage area can store data created according to the use of the computer (such as audio data, a phone book, etc.). In addition, the memory 1020 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage devices.

[0134] The processor 1080 is the control center of the computer, connecting various parts of the entire computer through various interfaces and circuits. By running or executing software programs and / or modules stored in the memory 1020, and by invoking the data stored in the memory 1020, it executes various functions of the computer and processes data. Optionally, the processor 1080 may include one or more processing units; preferably, the processor 1080 may integrate an application processor and a modem processor. Among them, the application processor mainly processes the operating system, user interface, application programs, etc., and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor may not be integrated into the processor 1080 either.

[0135] In the embodiments of the present application, the processor 1080 included in the terminal further has the following functions:

[0136] In response to the magnification window wake-up operation triggered for the ultra-high-definition video, a magnification window is displayed on the display interface of the ultra-high-definition video;

[0137] In the magnification window, based on the resolution of the ultra-high-definition video, an enlarged image corresponding to the image in the target enlarged area of the video picture of the ultra-high-definition video is displayed; the target enlarged area is determined according to the display position of the magnification window in the display interface and the magnification ratio corresponding to the magnification window; the enlarged image is obtained by magnifying the image in the target enlarged area based on the magnification ratio corresponding to the magnification window.

[0138] Optionally, the processor 1080 is further configured to execute the steps of any implementation manner of the video magnification method provided in the embodiments of the present application.

[0139] The embodiments of the present application further provide a computer-readable storage medium for storing a computer program, and the computer program is used to execute any implementation manner of the video magnification method described in the foregoing various embodiments.

[0140] The embodiments of the present application further provide a computer program product or a computer program. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes any implementation manner of the video magnification method described in the foregoing various embodiments.

[0141] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments, and will not be described in detail here.

[0142] In several embodiments provided in this application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces, and the indirect couplings or communication connections of devices or units can be in electrical, mechanical, or other forms.

[0143] The units described as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0144] In addition, the functional units in each embodiment of this application can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

[0145] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in each embodiment of this application. And the aforementioned storage medium includes: USB flash drives, mobile hard disks, read-only memories (English full name: Read-Only Memory, English abbreviation: ROM), random access memories (English full name: Random Access Memory, English abbreviation: RAM), magnetic disks, or optical discs and other various media that can store computer programs.

[0146] It should be understood that in this application, "at least one (item)" means one or more, and "a plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist. For example, "A and / or B" can mean: only A exists, only B exists, and both A and B exist at the same time. Among them, A and B can be singular or plural. The character " / " generally means that the associated objects before and after are in an "or" relationship. "At least one (one) of the following" or a similar expression means any combination of these items, including any combination of single items (one) or plural items (ones). For example, at least one (one) of a, b, or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0147] As described above, the above embodiments are only used to illustrate the technical solutions of this application, rather than to limit them; although this application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A video magnification method, characterized in that, The method includes: In response to a magnification window wake-up operation triggered for an ultra-high-definition video, a magnification window is displayed on the display interface of the ultra-high-definition video through a window position adjustment control and a magnification ratio adjustment control; the window position adjustment control includes a virtual joystick and a virtual joystick control area; the magnification ratio adjustment control is a magnification adjustment wheel; In response to a window position adjustment operation triggered through the virtual joystick and the virtual joystick control area, the display position of the magnification window in the display interface is adjusted; In response to a magnification ratio adjustment operation triggered through the magnification adjustment wheel, the magnification ratio corresponding to the magnification window is adjusted; In the magnification window, based on the resolution of the ultra-high-definition video, an enlarged image corresponding to the image in the target enlarged area of the video frame of the ultra-high-definition video is displayed; the target enlarged area is determined according to the display position of the magnification window in the display interface and the magnification ratio corresponding to the magnification window; the enlarged image is obtained by magnifying the pixel points in the target enlarged area based on the magnification ratio corresponding to the magnification window, and the magnification process is to enlarge the display area of the pixel points in the display interface.

2. The method according to claim 1, wherein The adjusting the display position of the magnification window in the display interface in response to a window position adjustment operation triggered through the window position adjustment control includes: Determining a displacement parameter of the virtual joystick according to a position adjustment operation triggered for the virtual joystick in the virtual joystick control area; Determining a position adjustment parameter corresponding to the magnification window according to the displacement parameter of the virtual joystick; Adjusting the display position of the magnification window in the display interface according to the position adjustment parameter corresponding to the magnification window.

3. The method according to claim 2, wherein The determining a displacement parameter of the virtual joystick according to a position adjustment operation triggered for the virtual joystick in the virtual joystick control area includes: Determining a position offset angle and a position offset amount of the virtual joystick, and determining a moving speed of the virtual joystick according to a position adjustment operation triggered for the virtual joystick in the virtual joystick control area; The determining a position adjustment parameter corresponding to the magnification window according to the displacement parameter of the virtual joystick includes: Determining a position adjustment direction and a position adjustment amount corresponding to the magnification window according to the position offset angle and the position offset amount of the virtual joystick; determining a position adjustment speed corresponding to the magnification window according to the moving speed of the virtual joystick.

4. The method according to claim 1, characterized in that, The method further includes at least one of the following ways to adjust the target enlarged area: In response to a drag operation triggered for the magnification window on the display interface, adjusting the display position of the magnification window in the display interface and adjusting the target enlarged area in the video frame of the ultra-high-definition video; In response to a drag operation triggered for a non-target enlarged area in the video frame of the ultra-high-definition video, adjusting the display position of the video frame of the ultra-high-definition video in the display interface and adjusting the target enlarged area in the video frame of the ultra-high-definition video.

5. The method according to claim 1, characterized in that Adjusting the magnification factor corresponding to the magnified window in response to a magnification factor adjustment operation triggered by the magnification factor adjustment control includes: Determining, according to a sliding operation triggered for the magnification factor adjustment wheel, the magnification factor displayed at the magnification factor adjustment result on the magnification factor adjustment wheel when the sliding operation stops, as the magnification factor corresponding to the magnified window.

6. The method according to claim 1, wherein The method further includes at least one of the following ways to adjust the magnification factor corresponding to the magnified window: Adjusting the magnification factor corresponding to the magnified window in response to a first magnification factor adjustment gesture triggered within the magnified window; Adjusting the magnification factor corresponding to the magnified window in response to a second magnification factor adjustment gesture triggered within a non-target magnified area in the video frame of the ultra-high-definition video.

7. The method according to claim 1, wherein The method further includes: In response to a full-screen display operation triggered for the magnified window, full-screen displaying an enlarged image corresponding to the image within the target magnified area on the display interface.

8. The method according to claim 1, wherein The method further includes: In response to a zoom operation triggered for the video frame of the ultra-high-definition video, displaying a zoomed image corresponding to the image within a target area on the display interface; the zoomed image is obtained by performing a zoom process on the image within the target area according to the zoom ratio corresponding to the zoom operation; Then the target magnified area is determined according to the display position of the magnified window within the target area, the zoom ratio corresponding to the zoom operation, and the magnification factor corresponding to the magnified window; the enlarged image is obtained by enlarging the zoomed image within the target magnified area based on the magnification factor corresponding to the magnified window.

9. The method according to claim 8, characterized in that The method further includes: In response to a drag operation triggered for the target area displayed on the display interface, adjusting the target area within the video frame displayed on the display interface.

10. The method according to claim 8 or 9, characterized in that The method further includes: In response to a triggered magnified window closing function, canceling the display of the magnified window and retaining the display of the zoomed image corresponding to the image within the target area on the display interface.

11. A video magnification device, characterized in that, The apparatus includes: A magnified window wake-up module, configured to, in response to a magnified window wake-up operation triggered for an ultra-high-definition video, display a magnified window on the display interface of the ultra-high-definition video through a window position adjustment control and a magnification factor adjustment control; the window position adjustment control includes a virtual joystick and a virtual joystick control area; the magnification factor adjustment control is a magnification factor adjustment wheel; A window position adjustment module, configured to adjust the display position of the magnified window on the display interface in response to a window position adjustment operation triggered through the virtual joystick and the virtual joystick control area; A first magnification factor adjustment module, configured to adjust the magnification factor corresponding to the magnified window in response to a magnification factor adjustment operation triggered through the magnification factor adjustment wheel; The enlarged content display module is used to display, in the enlarged window, an enlarged image corresponding to the image in the target enlarged area of the video frame of the ultra-high-definition video based on the resolution of the ultra-high-definition video; the target enlarged area is determined according to the display position of the enlarged window in the display interface and the magnification factor corresponding to the enlarged window; the enlarged image is obtained by magnifying the pixel points in the target enlarged area based on the magnification factor corresponding to the enlarged window, and the magnification process is to expand the display area of the pixel points in the display interface.

12. The device according to claim 11, characterized in that, Specifically, the window position adjustment module is configured to: Determine the displacement parameter of the virtual joystick according to the position adjustment operation triggered on the virtual joystick in the virtual joystick control area; Determine the position adjustment parameter corresponding to the enlarged window according to the displacement parameter of the virtual joystick; Adjust the display position of the enlarged window in the display interface according to the position adjustment parameter corresponding to the enlarged window.

13. The device according to claim 12, wherein Specifically, the window position adjustment module is configured to: Determine the position offset angle and position offset amount of the virtual joystick, and determine the moving speed of the virtual joystick according to the position adjustment operation triggered on the virtual joystick in the virtual joystick control area; Determine the position adjustment direction and position adjustment amount corresponding to the enlarged window according to the position offset angle and position offset amount of the virtual joystick; determine the position adjustment speed corresponding to the enlarged window according to the moving speed of the virtual joystick.

14. The device according to claim 11, characterized in that, The device further includes: an enlarged area adjustment module; the enlarged area adjustment module is used to adjust the target enlarged area by at least one of the following methods: In response to a drag operation triggered on the enlarged window on the display interface, adjust the display position of the enlarged window in the display interface and adjust the target enlarged area in the video frame of the ultra-high-definition video; In response to a drag operation triggered on a non-target enlarged area in the video frame of the ultra-high-definition video, adjust the display position of the video frame of the ultra-high-definition video in the display interface and adjust the target enlarged area in the video frame of the ultra-high-definition video.

15. The device according to claim 11, characterized in that, Specifically, the first magnification factor adjustment module is configured to: determine the magnification factor displayed at the magnification adjustment result on the magnification adjustment wheel when the sliding operation stops according to the sliding operation triggered on the magnification adjustment wheel, as the magnification factor corresponding to the enlarged window.

16. The device according to claim 15, characterized in that, The device further includes: a second magnification factor adjustment module; the second magnification factor adjustment module is used to adjust the magnification factor corresponding to the enlarged window by at least one of the following methods: In response to a first magnification factor adjustment gesture triggered within the enlarged window, adjust the magnification factor corresponding to the enlarged window; In response to a second magnification factor adjustment gesture triggered within a non-target enlarged area in the video frame of the ultra-high-definition video, adjust the magnification factor corresponding to the enlarged window.

17. The device according to claim 11, characterized in that, The device further includes: a magnified area full-screen display module; the magnified area full-screen display module is configured to, in response to a full-screen display operation triggered for the magnified window, full-screen display a magnified image corresponding to the image within the target magnified area on the display interface.

18. The device according to claim 11, characterized in that, The device further includes: a video frame scaling module, configured to, in response to a scaling operation triggered for the video frame of the ultra-high-definition video, display a scaled image corresponding to the image within a target area in the video frame on the display interface; the scaled image is obtained by scaling the image within the target area according to the scaling ratio corresponding to the scaling operation; then the target magnified area is determined based on the display position of the magnified window in the target area, the scaling ratio corresponding to the scaling operation, and the magnification factor corresponding to the magnified window; the magnified image is obtained by magnifying the scaled image within the target magnified area based on the magnification factor corresponding to the magnified window.

19. The device according to claim 18, characterized in that, The video frame scaling module is further configured to, in response to a drag operation triggered for the target area displayed on the display interface, adjust the target area in the video frame displayed on the display interface.

20. The device according to claim 18 or 19, characterized in that, The video frame scaling module is further configured to, in response to a triggered magnified window closing function, cancel the display of the magnified window and retain the display of the scaled image corresponding to the image within the target area on the display interface.

21. A device, characterized in that, The device includes a processor and a memory; The memory is used to store a computer program; The processor is configured to execute the video magnification method according to any one of claims 1 to 10 based on the computer program.

22. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program, and the computer program is used to execute the video magnification method according to any one of claims 1 to 10.

23. A computer program product, characterized in that, The computer program product includes instructions, and when the instructions run on a computer device, the computer device is caused to execute the video magnification method according to any one of claims 1 to 10.

Images