Panoramic video control method and device, computer equipment and storage medium

Abstract

The invention relates to a panoramic video control method and device, computer equipment, a storage medium and a computer program product. The method comprises the following steps: in response to a touch operation in a playing interface detected in the playing interface of a panoramic video, determining a touch area of the touch operation in the playing interface; determining a panoramic video control function based on the touch area, the panoramic video control function at least including fast forward and fast backward and zooming; and adjusting the panoramic video content displayed in the playing interface based on the panoramic video control function. By adopting the method, the visual angle can be smoothly switched without influencing immersion.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the field of panoramic image control, and in particular, to a panoramic video control method and device, a computer device, and a storage medium. BACKGROUND

[0002] A panoramic image is an image form with a horizontal viewing angle range exceeding 180 degrees, which can bring a more extensive and immersive visual experience to the audience. Compared with ordinary images, a panoramic image can capture more rich scene information, making the audience feel as if they are in a real environment.

[0003] In the prior art, when watching a panoramic image, a sliding operation is usually adopted, that is, the panoramic image is dragged by a finger or a mouse to move horizontally on the screen, so that the audience can view different angle scenes in sequence. Although this sliding operation is simple and intuitive, it may affect the immersion and fluency of the audience in some cases.

[0004] Therefore, there is an urgent need for a control method that can smoothly switch the viewing angle without affecting the immersion when watching a panoramic video, so as to improve the user experience. SUMMARY

[0005] Therefore, there is an urgent need for a control method that can smoothly switch the viewing angle without affecting the immersion when watching a panoramic video, so as to improve the user experience.

[0006] In a first aspect, the present disclosure provides a panoramic video control method, characterized in that the method comprises:

[0007] In response to detecting a touch operation in a playing interface of a panoramic video, determining a touch area of the touch operation in the playing interface;

[0008] Based on the touch area, determining a panoramic video control function, the panoramic video control function at least comprising fast forward, fast backward, and zooming;

[0009] Based on the panoramic video control function, adjusting the panoramic video content displayed in the playing interface.

[0010] In one embodiment, the touch area comprises a first touch area in the playing interface and a second touch area in the playing interface, the first touch area and the second touch area being non-overlapping; the panoramic video control function further comprises a viewing angle rotation; and the determining of the panoramic video control function based on the touch area comprises:

[0011] In response to the touch area being a first touch area in the playing interface, a virtual control area is generated in the first touch area based on a touch position indicated by the touch operation, the virtual control area in the first touch area being used to control a rotation angle of the panoramic video;

[0012] In response to the touch area being a second touch area in the playing interface, a virtual control area is generated in the second touch area, the virtual control area in the second touch area being used to control fast forward and fast backward and zooming of the panoramic video.

[0013] In one of the embodiments, the virtual control area generated in the second touch area is a rocker area or a circular sliding area, a first direction and a second direction in the rocker area or the circular sliding area being used to control fast forward and fast backward of the panoramic video, a third direction and a fourth direction being used to control zooming of the panoramic video.

[0014] In one of the embodiments, the virtual control area generated in the first touch area is a rocker area or a circular sliding area, the rocker area or the circular sliding area being used to control rotation of the angle of the panoramic video.

[0015] In one of the embodiments, the virtual control areas generated in the first touch area and the second touch area are transparent or semi-transparent areas.

[0016] In one of the embodiments, the adjusting the content of the panoramic video displayed in the playing interface based on the panoramic video control function comprises:

[0017] Based on the touch position indicated by the touch operation in the rocker area or the circular sliding area, a fast forward and fast backward zooming rate is determined;

[0018] According to the fast forward and fast backward zooming rate, a playing progress and a picture size of the panoramic video are dynamically adjusted.

[0019] In one of the embodiments, the determining the fast forward and fast backward zooming rate based on the touch position indicated by the touch operation in the rocker area or the circular sliding area comprises:

[0020] An initial touch position in the touch position indicated by the touch operation is determined;

[0021] A control coordinate system is established based on the initial touch position, a horizontal coordinate in the control coordinate system representing a fast forward and fast backward zooming rate, a vertical coordinate in the control coordinate system representing a zooming rate;

[0022] determine a termination touch position in the touch position indicated by the touch operation, and determine a fast-forward and fast-reverse ratio according to a displacement difference of the termination touch position and an initial touch position relative to a horizontal coordinate in the control coordinate system;

[0023] determine a zoom ratio according to a displacement difference of the termination touch position and an initial touch position relative to a vertical coordinate in the control coordinate system.

[0024] In a second aspect, the present disclosure further provides a panoramic video control device. The device comprises:

[0025] a touch area determination module configured to determine a touch area of a touch operation in a play interface of a panoramic video in response to detecting the touch operation in the play interface;

[0026] a control function determination module configured to determine a panoramic video control function based on the touch area, the panoramic video control function comprising at least fast-forward and fast-reverse and zoom;

[0027] a video content adjustment module configured to adjust panoramic video content displayed in the play interface based on the panoramic video control function.

[0028] In a third aspect, the present disclosure further provides a computer device. The computer device comprises a memory and a processor, the memory stores a computer program, and the processor implements the steps in any of the above method embodiments when executing the computer program.

[0029] In a fourth aspect, the present disclosure further provides a computer readable storage medium. The computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the steps in any of the above method embodiments.

[0030] In a fifth aspect, the present disclosure further provides a computer program product. The computer program product comprises a computer program, and the computer program is executed by a processor to implement the steps in any of the above method embodiments.

[0031] In the above embodiments, through the binding of the "touch area" and the "control function" (such as the specific area corresponding to fast forward and fast backward, and the global area supporting zooming), the user does not need to remember complex operation instructions or find hidden buttons, and can trigger the function only by touching different positions of the screen. The preset corresponding relationship between the touch area and the function (such as limiting fast forward and fast backward in the bottom area and covering the zoom function in the picture area) can effectively distinguish the intention of different operations. The user does not need to find and click the physical buttons (such as the progress bar and the zoom icon) in the interface, and can complete the operation directly through the touch area, shortening the path from the "operation intention" to the "function implementation". The core advantage of the panoramic video is the "360-degree panoramic view", and the above-mentioned mode is fully adapted to this feature. For example, the zoom function can allow the user to freely enlarge the local details (such as distant scenery and fine textures) or reduce to view the panorama, and in combination with the flexible operation of the touch area, the user can more freely explore every corner of the video; fast forward and fast backward support the user to quickly locate the scene of interest, and in combination with the dynamic change of the panoramic picture, the immersive experience of "being on the scene" is further strengthened. BRIEF DESCRIPTION OF DRAWINGS

[0032] In order to more clearly illustrate the technical solutions in the specific embodiments of the present disclosure or the prior art, the drawings needed to be used in the specific embodiments or prior art description will be briefly introduced. Obviously, the drawings in the following description are some embodiments of the present disclosure, and other drawings can also be obtained by those skilled in the art without creative labor.

[0033] Figure 1 A flowchart of a panoramic video control method in an embodiment;

[0034] Figure 2 A flowchart of step S104 in an embodiment;

[0035] Figure 3 A schematic diagram of the first touch area and the second touch area in an embodiment;

[0036] Figure 4 A flowchart of step S106 in an embodiment;

[0037] Figure 5 A flowchart of step S302 in an embodiment;

[0038] Figure 6 A structural block diagram of a panoramic video control device in an embodiment;

[0039] Figure 7 An internal structure diagram of a computer device in an embodiment. DETAILED DESCRIPTION

[0040] In order to make the purposes, technical solutions and advantages of the present disclosure clearer, the present disclosure will be further described in detail below with reference to the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present disclosure and not to limit the present disclosure.

[0041] It should be noted that the terms "first", "second" and the like in the description and claims of the present specification and the above drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, device, product or apparatus that includes a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but can include other steps or units that are not clearly listed or inherent to these processes, methods, products or apparatuses.

[0042] In this paper, the term "and / or" is only a description of the association relationship between the associated objects, which means that there can be three relationships. For example, A and / or B can represent three cases: A exists alone, A and B exist together, and B exists alone. In addition, the character " / " in this paper generally represents an "or" relationship between the front and rear associated objects.

[0043] In one embodiment, as shown in Figure 1 A panoramic video control method is provided, which is described by taking a terminal as an example, including the following steps:

[0044] S102, in response to detecting a touch operation in the play interface of the panoramic video, determining that the touch operation is in a touch area in the play interface.

[0045] The play interface is usually a software interface for displaying panoramic video, which usually includes video pictures, play control buttons (such as pause / play, volume adjustment), progress bars and other elements. The touch operation is usually an operation performed by the user on the touch screen (such as the screen of a mobile phone or tablet) by finger or stylus. The touch area can be a specific location range of the touch operation on the play interface, such as the precise coordinate area of the click operation or the screen area covered by the sliding operation.

[0046] Specifically, the device (such as a mobile phone or a tablet) on which the playing interface is located monitors the physical contact on the screen in real time through the built-in touch sensor. When the user performs clicking, sliding, or other operations on the screen with a finger, the sensor will capture the action and convert it into an electrical signal to deliver to the operating system of the device. After receiving the touch signal, the operating system will determine the specific position of the touch operation in the playing interface through coordinate positioning (such as the X-axis and Y-axis coordinates of the screen). For example, when the user clicks the upper right corner of the screen, the system will identify the coordinate range corresponding to the position, that is, the touch area.

[0047] S104, based on the touch area, determine the panoramic video control function, the panoramic video control function at least includes: fast forward and fast backward and zoom.

[0048] The panoramic video control function generally refers to a function set for adjusting the playing state, perspective presentation, and the like of the panoramic video. Through these functions, the user can change the playing progress, picture size, or perspective range of the video according to the needs. Fast forward and fast backward are usually one of the panoramic video control functions, and are usually used to adjust the playing progress of the video. Fast forward is to make the video jump forward and play at a speed faster than the normal playing speed; fast backward is to make the video jump backward and play in a reverse or fast backward manner. Zoom is usually another panoramic video control function, which is used to adjust the display ratio of the video picture or the perspective range. Enlargement (positive operation of zoom) can make the picture of a local area in the video larger and more detailed (for example, enlarge the distant scenery); reduction (reverse operation of zoom) can make the perspective range of the video larger, presenting a wider picture (for example, switching from a local scene to a panoramic scene). In some embodiments of the present disclosure, fast forward and fast backward and zoom can be integrated together.

[0049] Specifically, different touch areas corresponding functions can be defined in the playing interface in advance, for example, the function of the touch area on the left side of the playing interface is defined as perspective rotation, and the function of the touch area on the right side of the playing interface is defined as fast forward and fast backward. According to different definitions, the panoramic video control function corresponding to the touch area is different, and in some embodiments of the present disclosure, the panoramic video control function is not limited. According to the position of the determined touch area in the playing interface and the pre-defined function, the panoramic video control function corresponding to the current touch area is determined.

[0050] S106, based on the panoramic video control function, adjust the panoramic video content displayed in the playing interface.

[0051] Specifically, the content of the panoramic video displayed in the playing interface can be adjusted according to the currently identified panoramic video control function. For example, the panoramic video control can be parsed, and then the content of the panoramic video is controlled (such as fast forward and fast backward, adjusting the perspective, zooming, etc.) by using the instructions obtained after parsing.

[0052] In the panoramic video control method, through the binding of the "touch control area" and the "control function" (such as the specific area corresponding to fast forward and fast backward, and the global area supporting zooming), the user does not need to remember complex operation instructions or find hidden buttons, and can trigger the function only by touching different positions of the screen. The preset correspondence between the touch control area and the function (such as limiting fast forward and fast backward in the bottom area, and covering the zoom function in the picture area) can effectively distinguish the intention of different operations. The user does not need to find and click the physical buttons (such as the progress bar and the zoom icon) in the interface, but can complete the operation directly through the touch control area, shortening the path from "operation intention" to "function implementation". The core advantage of the panoramic video is the "360-degree panoramic view", and the above-mentioned method fully adapts to this feature. For example, the zoom function can let the user freely enlarge local details (such as distant scenery and fine textures) or reduce to view the panorama, and with flexible operation of the touch control area, the user can more freely explore every corner of the video; fast forward and fast backward support the user to quickly locate the scene of interest, and in combination with the dynamic change of the panoramic picture, the immersive experience of "being there" is further strengthened.

[0053] In one embodiment, the touch control area includes a first touch control area in the playing interface and a second touch control area in the playing interface, and the first touch control area and the second touch control area do not overlap. The first touch control area can be another independent touch control area in the playing interface which does not overlap with the first touch control area, and is used to trigger another type of control function (for example, it can be set as a "perspective rotation area", and when the user slides in the area, the rotation of the panoramic perspective is triggered). The second touch control area is usually one of the independent touch control areas divided in the playing interface, and does not overlap with the second touch control area, and is used to trigger a type of panoramic video control function. The design that "the first touch control area and the second touch control area do not overlap" is to avoid triggering confusion when the user operates (for example, triggering fast forward and perspective rotation at the same time in the same area), to ensure that each type of operation corresponds to an explicit function, and to improve the interaction accuracy. The panoramic video control function further includes perspective rotation. As shown in Figure 2 The panoramic video control function is determined based on the touch control area, including:

[0054] S202, in response to the touch control area being a first touch control area in the playing interface, a virtual control area is generated in the first touch control area based on the touch position indicated by the touch operation, and the virtual control area in the first touch control area is used to control the rotation of the perspective of the panoramic video.

[0055] The touch position indicated by the touch operation can be a specific coordinate position of a finger or a stylus on the screen when a user performs a touch operation (such as clicking or sliding) in the first touch area. The virtual control area generated in the first touch area can be a sub-area that exists temporarily in the first touch area and is generated dynamically by the system according to the touch position after the user triggers the touch operation of the first touch area, and is used to accurately control the rotation of the perspective of the panoramic video (different from the first touch area, which is a more subdivided operation range).

[0056] Specifically, the system monitors the touch operation of a user in the playing interface in real time, and when it is identified that the touch position falls within the preset first touch area (for example, the user clicks the first touch area in the middle of the screen with a finger), the subsequent virtual control area generation logic is triggered. The system generates a temporary virtual control area in the first touch area based on the initial touch position of the user. For example, if the user clicks the (X=200, Y=300) coordinate point in the first touch area, the system can generate a circular virtual control area with a radius of 50 pixels around the point, or a rectangular virtual control area of 100x100 pixels with the point as the center. In addition, it should be noted that the size and shape of the virtual control area can be preset, and in some embodiments of the present disclosure, the shape and size of the virtual control area are not limited, as long as they are within the first touch area and do not exceed the range thereof, to avoid conflicts with other functional areas. When the user performs a sliding operation in the generated virtual control area, the system binds the operation to the rotation of the perspective of the panoramic video, and the specific rules can be preset.

[0057] If the sliding operation is to the left in the virtual control area, the perspective of the panoramic video can be rotated to the left (for example, from a front view to a left side view of the scene); if the sliding operation is to the right, the perspective is rotated to the right; if the sliding operation is upward, the perspective is rotated upward (for example, to view the sky); and if the sliding operation is downward, the perspective is rotated downward (for example, to view the ground). In addition, the distance and speed of the sliding operation determine the amplitude and speed of the rotation of the perspective (for example, a sliding distance of 100 pixels corresponds to a rotation of the perspective of 30 degrees, and the faster the sliding speed, the faster the rotation of the perspective).

[0058] S204, in response to the touch area being a second touch area in the playing interface, a virtual control area is generated in the second touch area, and the virtual control area in the second touch area is used to control fast forward, fast backward, and zoom of the panoramic video.

[0059] Specifically, the system monitors user touch operations in real time, and when it identifies that the operation position falls within a preset second touch area (for example, the user touches the strip area at the bottom of the screen), it starts the logic for generating a virtual control area. The system generates a virtual control area for fast forward and fast backward and zoom according to the function positioning of the second touch area, in accordance with preset rules. The boundary of the virtual control area can be temporarily displayed (or hidden) through a semi-transparent shadow, a virtual frame, etc., to prompt the user that the current operation corresponds to a function range that is always limited within the second touch area, to avoid conflicts with the functions of the first touch area. The virtual control area dynamically exists with user operations: when the user's finger leaves the second touch area, the virtual control area automatically disappears; when touch is resumed, the system re-generates the virtual control area according to the new operation position, to ensure that each operation is accurately responded based on the current touch point.

[0060] In some exemplary embodiments, as shown in Figure 3 When the user performs a touch operation in the first touch area, a virtual control area A can be generated based on the touch operation at the position of the touch operation. When the user performs a touch operation in the second touch area, a virtual control area B can be generated based on the touch operation at the position of the touch operation. The specific functions of the virtual control area B include fast forward and fast backward and zoom, and the specific functions of the virtual control area A are view angle rotation. In addition, it should be noted that the generation and disappearance of the virtual control area are instant responses, to ensure smooth operation without delay. The operations of the user in different touch areas do not interfere with each other, and the virtual control area A and the virtual control area B can exist at the same time, but operate independently of each other. While the user rotates the view angle in the A area, the user can perform fast forward and fast backward or zoom in the B area.

[0061] In this embodiment, the first touch area (view angle rotation) and the second touch area (fast forward and fast backward, zoom) are completely independent and non-overlapping, and cooperate with the respective generated virtual control areas to strictly limit different types of functions within the dedicated areas. For example: when the user slides in the first area, only view angle rotation (such as rotating the picture to view the panorama up, down, left, and right) is triggered, and fast forward is not triggered by mistake; when the user operates in the second area, the user focuses on progress adjustment or picture zoom, to avoid function confusion due to the similar operation logic of "rotation" and "zoom" (both involve sliding / pinch). This design spatially isolates functions, greatly reduces the probability of mistaken operation, and is particularly suitable for scenarios such as panoramic videos that require high-frequency switching of control methods. The virtual control area as a "sub-operation unit" within the touch area can be dynamically generated according to the real-time touch position of the user, to achieve accurate mapping of "operation-function".

[0062] In one embodiment, the virtual control region generated in the first touch control region is a rocker region or a circular sliding region, which is used to control the rotation of the perspective angle of the panoramic video. The virtual control region generated in the second touch control region is a rocker region or a circular sliding region, in which the first direction and the second direction are used to control the fast forward and fast backward of the panoramic video, and the third direction and the fourth direction are used to control the zoom size of the panoramic video.

[0063] The rocker region is usually a virtual control region simulating a physical rocker, which usually has a draggable "rocker" (icon or dot) as the core. The direction and amplitude of the dragging of the rocker correspond to the control parameters of the function (for example, the direction of the dragging corresponds to the direction of the rotation of the perspective angle, and the amplitude corresponds to the rotation speed).

[0064] The circular sliding region can be a circular virtual region with a certain point as the center. When the user slides along the circumference or the radius in the region, the sliding direction and distance correspond to the control logic of the function (for example, the clockwise sliding corresponds to the fast forward, and the counterclockwise corresponds to the fast backward). The first direction and the second direction: in the virtual control region of the second touch control region, two opposite directions (for example, left / right in the horizontal direction, or clockwise / counterclockwise in the circular region) are defined in advance, and correspond to the fast backward and fast forward functions respectively.

[0065] The third direction and the fourth direction: in the virtual control region of the second touch control region, two other opposite directions different from the first and second directions (for example, up / down in the vertical direction, or radially in / out in the circular region) correspond to the zoom-in and zoom-out functions respectively.

[0066] Specifically, when the user performs a touch operation (such as clicking or long pressing) in the first touch control region (such as the left side of the screen or the right side of the screen), the system generates a rocker region or a circular sliding region at the touch position. If it is a rocker region: a circular base of a fixed size is displayed, and there is a draggable rocker icon (such as a dot) in the center of the base. When the user drags the rocker, the base remains stationary, and the rocker can move within the range of the base. If it is a circular sliding region: a circular region (such as a radius of 50 pixels) with the touch point as the center is displayed, and the user can slide arbitrarily within the circumferential range. For the rocker region: the direction of the dragging of the rocker directly corresponds to the direction of the rotation of the perspective angle: dragging upward → rotating the perspective angle upward (looking up), dragging downward → rotating the perspective angle downward (looking down), dragging leftward → rotating the perspective angle leftward, and dragging rightward → rotating the perspective angle rightward. The distance between the rocker and the center of the base corresponds to the rotation speed: the farther the distance, the faster the rotation of the perspective angle; after the rocker is released, the perspective angle stops rotating and remains in the current direction.

[0067] For the circular sliding area: the user slides in the area along the horizontal direction (left / right) -> the view angle rotates left / right correspondingly; slides along the vertical direction (up / down) -> the view angle rotates up / down correspondingly. The sliding amplitude (distance from the center) corresponds to the rotation speed: generally, the longer the sliding distance, the faster the rotation; after the sliding is finished, the view angle stops rotating.

[0068] When the user performs a touch operation in the second touch area (e.g., the bottom of the screen), the system generates a joystick area or a circular sliding area, and four directions (first to fourth directions) are predefined in the area: if it is a joystick area: the base is rectangular or circular, and the joystick can move in the base along the horizontal (first and second directions) and vertical (third and fourth directions).

[0069] If it is a circular sliding area: the touch point is taken as the center of a circle, the horizontal direction (left / right) is defined as the first and second directions, and the vertical direction (up / down) is defined as the third and fourth directions (or the radial direction in / out is the third and fourth directions).

[0070] The control logic of fast forward and fast backward (first and second directions) is as follows: for the joystick area: the first direction (e.g., dragging the joystick left) -> triggers fast backward: the greater the dragging amplitude, the faster the fast backward speed (e.g., when the joystick is dragged to the leftmost end, the fast backward speed is 2 times); the second direction (e.g., dragging the joystick right) -> triggers fast forward: the logic is the same as above, the greater the dragging amplitude, the faster the fast forward speed. For the circular sliding area: the first direction (e.g., sliding counterclockwise) -> fast backward: the greater the sliding angle (e.g., from 0° to 180°), the longer the fast backward time (e.g., corresponding to 10 seconds of backward); the second direction (e.g., sliding clockwise) -> fast forward: the logic is the same as above, the greater the sliding angle, the longer the fast forward time. The control logic of zooming (third and fourth directions) is as follows: for the joystick area: the third direction (e.g., dragging the joystick down) -> triggers zooming out: the greater the dragging amplitude, the greater the zooming-out ratio (e.g., when the joystick is dragged to the lowermost end, the picture is zoomed out to 0.8 times); the fourth direction (e.g., dragging the joystick up) -> triggers zooming in: the logic is the same as above, the greater the dragging amplitude, the greater the zooming-in ratio (e.g., zoomed in to 1.5 times). For the circular sliding area: the third direction (e.g., sliding towards the center of the circle, radial in) -> zooming out: the farther the sliding distance (the closer to the center), the greater the zooming-out amplitude; the fourth direction (e.g., sliding away from the center of the circle, radial out) -> zooming in: the farther the sliding distance (the farther away from the center), the greater the zooming-in amplitude.

[0071] When the user's finger leaves the screen, the virtual control area (joystick or circular sliding area) of the first and second touch areas automatically disappears, avoiding interference with the video picture display.

[0072] In some exemplary embodiments, the user clicks the left side of the screen (the first touch area) to generate a circular sliding area; when sliding left, the panoramic video view angle is synchronously turned left, the faster the sliding speed, the more rapidly the view angle is turned, and the left scene can be viewed.

[0073] The user clicks the right side of the screen (the second touch area), and a joystick area is generated; dragging the joystick to the right (the second direction) fast forwards the video by 5 seconds; dragging the joystick upwards (the fourth direction) zooms in the picture to 1.2 times, and the details of the distant scenery are clearer.

[0074] In one embodiment, the virtual control area generated in the first touch area and the second touch area is a transparent or semi-transparent area.

[0075] In this embodiment, the transparent or semi-transparent virtual control area can minimize the obstruction to the video picture, and avoid the user from missing key picture information due to the existence of the operation area. In particular, in the first touch area (which usually covers the main area of the screen), this design can allow the user to clearly see most of the scene content when controlling the rotation of the view angle, and enhance the sense of immersion. The virtual control area needs to be perceived by the user (so as to clearly define the operation range), but should not interfere with the viewing experience too much. The semi-transparent design can both prompt the user that "current operation can be performed in this area" through the faint outline or light and shadow, and will not form a strong visual disconnection like a physical button, achieving a balance between "operation guidance" and "picture integrity".

[0076] In one embodiment, as shown in Figure 4 based on the panoramic video control function, adjusting the panoramic video content displayed in the playing interface, comprising:

[0077] S302, based on the touch position indicated by the touch operation in the joystick area or the circular sliding area, determining the fast forward and fast backward and zooming rate.

[0078] The touch position indicated by the touch operation can be the real-time coordinate position of the finger on the screen when the user performs sliding, dragging, etc. in the joystick area or the circular sliding area (such as the specific point to which the joystick is dragged, the end point of the sliding track, etc.). The fast forward and fast backward rate can be a parameter for measuring the fast forward or fast backward speed, that is, the multiple of the video playing speed relative to the normal speed (such as 1.5 times fast forward indicating that the video is played forward at 1.5 times the normal speed, and 2 times fast backward indicating that it is played backward at 2 times the normal speed). The zooming rate can be a parameter for measuring the degree of picture enlargement or reduction, that is, the ratio of the current picture size to the original size (such as 1.2 times zooming indicating that the picture is enlarged to 1.2 times the original size, and 0.8 times zooming indicating that it is reduced to 0.8 times the original size).

[0079] Specifically, the displacement of the current operation can be determined according to the touch position indicated by the touch operation, and the fast forward and fast backward and zooming rate can be determined according to the displacement.

[0080] In some exemplary embodiments, the system can predefine the correspondence between "touch position" and "zoom ratio" in the virtual control area, providing a reference for subsequent calculations. For the rocker, the boundary of the rocker base can be set as the maximum range, with the "distance from the center of the rocker and base" being proportional to the "zoom ratio" (the farther the distance, the greater the zoom ratio). Assuming the base radius is 50 pixels, the rules can be set as: distance 0 pixels (center) -> zoom ratio 1.0 (normal speed / original size); distance 50 pixels (edge) -> maximum zoom ratio (e.g., fast forward / rewind 3.0 times, zoom 2.0 times). For a circular sliding area, the center of the circle can be set as the origin, with the "distance from the sliding position to the center of the circle" being proportional to the "zoom ratio". For example, the circle radius is 100 pixels, and the rules can be set as: distance 0 pixels -> zoom ratio 1.0; distance 100 pixels -> maximum zoom ratio (e.g., fast forward / rewind 2.5 times, zoom 1.8 times).

[0081] S304, according to the fast forward and zoom ratio, dynamically adjusting the playback progress and picture size of the panoramic video.

[0082] Specifically, when adjusting using the fast forward / rewind ratio, the system calculates the offset of the video progress in real time according to the current fast forward / rewind ratio (e.g., 2.0 times fast forward, 1.5 times fast backward) and the operation duration:

[0083] Fast forward: progress offset = normal playback speed (1.0 times) x fast forward ratio x operation duration (seconds) Example: 2.0 times fast forward for 3 seconds -> progress offset forward by 1 x 2.0 x 3 = 6 seconds. Fast backward: progress offset = - (normal playback speed x fast backward ratio x operation duration) (negative sign indicates reverse) Example: 1.5 times fast backward for 2 seconds -> progress offset backward by - (1 x 1.5 x 2) = -3 seconds. The system superimposes the current playback progress and the offset to obtain the target progress (e.g., current progress 20 seconds + fast forward offset 6 seconds -> target progress 26 seconds), and accurately locates the video frame corresponding to the progress from the panoramic video file (each frame contains 360-degree panoramic data). In addition, if the ratio is ≤ 2.0 times (low-speed fast forward / rewind): the system plays the pictures between the target progress frame by frame, ensuring smooth transition (e.g., from 20 seconds to 26 seconds, continuously playing the pictures in the middle 6 seconds). If the ratio is > 2.0 times (high-speed fast forward / rewind): the system directly jumps to the target progress frame and inserts 1-2 frames of transition animation to avoid abrupt picture jumps. At the same time, the progress bar of the playback interface is updated in real time with the target progress, synchronously displaying the current time point (e.g., "00:26 / 05:00"). When the user ends the touch control (e.g., releases the rocker), the fast forward / rewind ratio returns to 1.0 times, and the video starts normal playback from the target progress, with the progress bar stopping and fixing at the current position.

[0084] When the zooming is adjusted, the original picture of the panoramic video is a 360-degree panoramic image (which can be understood as a "spherical development diagram"), and the system determines the picture range to be cut according to the zooming ratio: when zooming in (ratio > 1.0, such as 1.5 times): cut part of the picture from the central area of the current view angle, the cutting range = the original range ÷ the zooming ratio (for example, the original display view angle is 60 degrees, and after 1.5 times zooming, the display range is 40 degrees), the cut local picture is stretched to the full screen, and the details are enlarged. When zooming out (ratio < 1.0, such as 0.8 times): expand the cutting range = the original range ÷ the zooming ratio (for example, the original display is 60 degrees, and after 0.8 times zooming, the display range is 75 degrees), the wider panoramic picture is compressed to the full screen, and the view angle is wider.

[0085] The system processes the cut picture range through a graphics rendering engine. When zooming in: use an interpolation algorithm to supplement pixel details to avoid picture blur (for example, when zooming in 1.5 times, smooth interpolation is performed on the original pixels to maintain clarity). When zooming out: use an anti-aliasing algorithm to optimize picture edges to avoid line jaggies caused by compression (for example, when zooming out 0.8 times, the picture edges are blurred to improve the viewing experience).

[0086] If zooming and view angle rotation are performed at the same time (for example, after zooming in, the view angle is rotated to view the local part), the system will dynamically adjust the center coordinates of the cutting range: for example, in a 1.5 times zoom-in state, the user rotates the view angle 30 degrees to the left → the center of the cutting range is simultaneously moved 30 degrees to the left, ensuring that the zoom-in is always the central area of the current view angle.

[0087] After the user ends the zooming operation (such as releasing the double finger or joystick), the zooming ratio is fixed, and the picture remains the current size; if the zooming operation is triggered again, the system continues to adjust according to the new ratio based on the current size (for example, from 1.5 times zoom-in to 1.8 times).

[0088] In this embodiment, the traditional fixed ratio control (such as only supporting 2 times fast forward and 1.5 times zooming) cannot meet the diversified needs, and by dynamically determining the ratio through the touch position (for example, the farther the joystick deviates from the center, the larger the ratio), the user can flexibly adjust according to the actual scene.

[0089] In one embodiment, as shown in Figure 5 , the ratio of fast forward, fast backward, and zooming is determined based on the touch position indicated by the touch operation in the joystick area or the circular sliding area, including:

[0090] S402, determining an initial touch position in the touch position indicated by the touch operation.

[0091] S404, establishing a control coordinate system based on the initial touch position, the horizontal coordinate in the control coordinate system representing the fast forward and fast backward ratio, and the vertical coordinate in the control coordinate system representing the zooming ratio.

[0092] S406, determining a termination touch position in the touch position indicated by the touch operation, and determining a fast forward and fast backward multiple according to a displacement difference of the termination touch position and the initial touch position with respect to a horizontal coordinate in the control coordinate system.

[0093] S408, determining a zoom multiple according to a displacement difference of the termination touch position and the initial touch position with respect to a vertical coordinate in the control coordinate system.

[0094] The initial touch position is usually the position touched first when the user touches the play interface. When the user starts the touch operation in the virtual control area (such as a rocker area or a circular sliding area), the coordinate point (for example, (X0, Y0) when the finger is pressed) at which the finger first contacts the screen is the reference point for subsequent operations. The control coordinate system is usually a two-dimensional coordinate system with the initial touch position as the origin (0, 0), which is used to quantify the displacement direction and distance of the touch operation. The horizontal coordinate (X-axis) is specially used for the fast forward and fast backward multiple (positive direction for fast forward and negative direction for fast backward), and the vertical coordinate (Y-axis) is specially used for the zoom multiple (positive direction for zoom in and negative direction for zoom out). The termination touch position is the final coordinate point (for example, (X1, Y1) before the finger is released) when the user completes the touch operation (such as sliding ends), and the relative displacement of the termination touch position and the initial touch position is used to calculate the control multiple. The displacement difference is the coordinate difference of the termination touch position and the initial touch position in the coordinate system. The horizontal coordinate displacement difference (ΔX = X1 - X0) reflects the direction and amplitude of the fast forward and fast backward, and the vertical coordinate displacement difference (ΔY = Y1 - Y0) reflects the direction and amplitude of the zoom.

[0095] Specifically, when the user starts the operation (such as pressing the finger) in the virtual control area (such as a rocker area or a circular sliding area) of the second touch area, the system records the touch coordinate at that moment in real time, which is defined as the initial touch position (X0, Y0). For example, the coordinate of the user's finger when it is pressed is (300, 500), which is the reference point of the coordinate system. A two-dimensional coordinate system is established with the reference point as the origin. The horizontal coordinate (X-axis): horizontal direction, right direction for positive direction (corresponding to fast forward), left direction for negative direction (corresponding to fast backward); vertical coordinate (Y-axis): vertical direction, upward direction for positive direction (corresponding to zoom in), downward direction for negative direction (corresponding to zoom out). Usually, the range of the coordinate system is consistent with the boundary of the virtual control area (for example, the radius of the circular sliding area is 100 pixels, so the effective range of the X-axis and the Y-axis is [-100, 100] pixels), ensuring that the displacement calculation does not exceed the operation area. When the user slides in the virtual control area, the system tracks the finger position in real time until the user releases the finger, and records the final termination touch position (X1, Y1). Then the displacement difference with the initial position is calculated:

[0096] Horizontal coordinate displacement difference: ΔX = X1-X0 (unit: pixel). For example, initial position (300, 500), terminal position (350, 500), then ΔX = 350-300 = +50 pixels (positive, fast forward direction);

[0097] Vertical coordinate displacement difference: ΔY = Y1-Y0 (unit: pixel). For example, terminal position (300, 530), then ΔY = 530-500 = +30 pixels (positive, zoom-in direction).

[0098] The fast forward and fast backward magnification is determined according to the calculated horizontal coordinate displacement difference. For example, the fast forward and fast backward magnification can be determined based on a preset mapping rule of displacement difference and fast forward and fast backward magnification. The fast forward and fast backward magnification can also be determined in the following manner: wherein, P is the projection of the horizontal coordinate corresponding to the touch position at the current moment, and the value range is consistent with the width boundary of the virtual control region. P is the projection of the horizontal coordinate corresponding to the touch position at the current moment, and the value range is consistent with the width boundary of the virtual control region. × 0, wherein, P is the projection of the vertical coordinate corresponding to the touch position at the current moment, and the value range is consistent with the height boundary of the virtual control region. 0 is the current FOV (Field of View), P is the FOV normalization parameter, and the default value is 0.5 / height boundary, indicating that the range of the FOV after control is changed to [0.5 0, 1.5 0], and will not be scaled too large or too small. It should be noted that the FOV normalization parameter can also be determined according to actual conditions, and in some embodiments of the present disclosure, the parameter is not limited.

[0099] In the embodiment, a coordinate system is established with the initial touch position of the user as the origin, the abstract "fast forward and fast backward" and "zoom" functions are bound to the intuitive "horizontal sliding" and "vertical sliding" actions (the horizontal coordinate corresponds to fast forward and fast backward, and the vertical coordinate corresponds to zoom), which conforms to the natural cognition of the user that "left and right sliding controls time, and up and down sliding controls size". The user does not need to remember complex operation rules, and can control the two functions simultaneously or separately through one continuous sliding action, which has a low threshold for getting started. Through displacement quantization control parameters (the horizontal displacement difference corresponds to the fast forward and fast backward rate, and the vertical displacement difference corresponds to the zoom rate), the logic of "sliding distance and control strength are positively correlated" is realized. For example, the farther the sliding is, the faster the fast forward and fast backward speed is, and the greater the zoom amplitude is. Such a quantitative relationship enables the user to achieve fine control through fine adjustment of the sliding distance (for example, slight sliding achieves small amplitude fast forward or zoom), avoiding the limitations of the traditional button "fixed rate". In the same touch area, through the separation of the horizontal and vertical axes of the coordinate system, the two core functions of "fast forward and fast backward" and "zoom" are integrated into one touch operation, without the need to switch the operation area or interface. The coordinate system takes the initial touch position as the reference, rather than a fixed origin, which means that the user can start the operation at any position in the touch area (without the need to align the fixed starting point), which adapts to different user holding postures or operation preferences. No matter where the user starts sliding from in the area, the function definition of the horizontal and vertical axes is always clear, avoiding operation confusion caused by different initial positions.

[0100] It should be understood that, although each step in the flowchart involved in each of the above embodiments is shown in sequence according to the arrow, these steps are not necessarily executed in sequence according to the arrow. Unless otherwise specified herein, the execution of these steps is not strictly limited in sequence, and these steps can be executed in other sequences. Moreover, at least part of the steps in the flowchart involved in each of the above embodiments can include multiple steps or stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution sequence of these steps or stages is not necessarily sequential, but can be executed alternately or alternately with at least part of other steps or steps or stages in other steps.

[0101] Based on the same inventive concept, the embodiments of the present disclosure also provide a panoramic video control device for implementing the panoramic video control method described above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme described in the above method, so the specific limitations in one or more panoramic video control device embodiments provided below can refer to the limitations of the panoramic video control method in the above text, which will not be described here.

[0102] In one embodiment, as Figure 6As shown, a panoramic video control apparatus 500 is provided, comprising: a touch area determining module 502, a control function determining module 504 and a video content adjusting module 506, wherein:

[0103] The touch area determining module 502 is configured to, in response to detecting a touch operation in a playing interface of a panoramic video, determine a touch area of the touch operation in the playing interface.

[0104] The control function determining module 504 is configured to determine a panoramic video control function based on the touch area, the panoramic video control function comprising at least fast forward and fast backward and zooming.

[0105] The video content adjusting module 506 is configured to adjust panoramic video content displayed in the playing interface based on the panoramic video control function.

[0106] In an embodiment of the apparatus, the touch area comprises a first touch area in the playing interface and a second touch area in the playing interface, the first touch area and the second touch area being non-overlapping. The panoramic video control function further comprises a view angle rotation. The control function determining module 504 comprises:

[0107] A first generating module is configured to, in response to the touch area being the first touch area in the playing interface, generate a virtual control area in the first touch area based on a touch position indicated by the touch operation, the virtual control area in the first touch area being used to control a view angle rotation of the panoramic video.

[0108] A second generating module is configured to, in response to the touch area being the second touch area in the playing interface, generate a virtual control area in the second touch area, the virtual control area in the second touch area being used to control fast forward and fast backward and zooming of the panoramic video.

[0109] In an embodiment of the apparatus, the virtual control area generated in the second touch area is a rocker area or a circular sliding area, a first direction and a second direction in the rocker area or the circular sliding area being used to control fast forward and fast backward of the panoramic video, and a third direction and a fourth direction being used to control zooming of the panoramic video.

[0110] In an embodiment of the apparatus, the virtual control area generated in the first touch area is a rocker area or a circular sliding area, the rocker area or the circular sliding area being used to control the view angle rotation of the panoramic video.

[0111] In an embodiment of the apparatus, the virtual control areas generated in the first touch area and the second touch area are transparent or semi-transparent areas.

[0112] In an embodiment of the device, the video content adjustment module 506 comprises:

[0113] a magnification determination module, configured to determine the fast-forward and fast-reverse magnification based on the touch position indicated by the touch operation in the rocker area or the circular sliding area.

[0114] a video adjustment module, configured to dynamically adjust the playing progress and the picture size of the panoramic video according to the fast-forward and fast-reverse magnification.

[0115] In an embodiment of the device, the magnification determination module comprises:

[0116] an initial touch position determination module, configured to determine an initial touch position in the touch position indicated by the touch operation;

[0117] a coordinate system establishment module, configured to establish a control coordinate system based on the initial touch position, wherein the horizontal coordinate in the control coordinate system represents the fast-forward and fast-reverse magnification, and the vertical coordinate in the control coordinate system represents the zoom magnification;

[0118] a fast-forward and fast-reverse magnification determination module, configured to determine a terminal touch position in the touch position indicated by the touch operation, and determine the fast-forward and fast-reverse magnification according to the displacement difference between the terminal touch position and the initial touch position relative to the horizontal coordinate in the control coordinate system;

[0119] a zoom magnification determination module, configured to determine the zoom magnification according to the displacement difference between the terminal touch position and the initial touch position relative to the vertical coordinate in the control coordinate system.

[0120] The above-mentioned modules in the panoramic video control device can be realized by software, hardware and combinations thereof in whole or in part. The above-mentioned modules can be embedded in or independent of the processor in the computer device in hardware form, or stored in the memory in the computer device in software form, so as to be called and executed by the processor to perform the operations corresponding to the above-mentioned modules.

[0121] In an embodiment, a computer device is provided, which can be a terminal, and the internal structure diagram thereof can be as shown in Figure 7As shown in the figure. The computer device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operating system and the computer program in the non-volatile storage medium to run. The communication interface of the computer device is used to communicate with external terminals in a wired or wireless manner. Wireless mode can be achieved through WIFI, mobile cellular network, NFC (near field communication) or other technologies. The computer program is executed by the processor to implement a panoramic video control method. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer overlaid on the display screen, or a key, trackball or touchpad arranged on the shell of the computer device, or an external keyboard, touchpad or mouse, etc.

[0122] Those skilled in the art can understand that, Figure 7 The structure shown in the figure is only a block diagram of part of the structure related to the present disclosure, and does not constitute a limitation on the computer device to which the present disclosure is applied. The specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement.

[0123] In one embodiment, a computer device is provided, including a memory and a processor, the memory stores a computer program, and the processor executes the computer program to implement the steps in any of the above method embodiments.

[0124] In one embodiment, a computer readable storage medium is provided, which stores a computer program, and the computer program is executed by a processor to implement the steps in any of the above method embodiments.

[0125] In one embodiment, a computer program product is provided, including a computer program, and the computer program is executed by a processor to implement the steps in any of the above method embodiments.

[0126] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when the computer program is executed, the processes of the above-mentioned embodiments of each method can be included. Any reference to memory, database or other medium used in each embodiment provided by the present disclosure can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical storage, high-density embedded non-volatile memory, resistive memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration but not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The database involved in each embodiment provided by the present disclosure can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in each embodiment provided by the present disclosure can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., without being limited thereto.

[0127] Any combination of the technical features of the above embodiments can be made. In order to make the description simple, all possible combinations of each technical feature in the above embodiments are not described, however, as long as the combination of the technical features does not exist, it should be considered as the scope of the present disclosure.

[0128] The above embodiments only express several implementation manners of the present disclosure, and the description is more specific and detailed, but it should not be understood as a limitation on the scope of the patent of the present disclosure. It should be noted that for ordinary skilled persons in the art, without departing from the concept of the present disclosure, a number of modifications and improvements can be made, which are within the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be subject to the appended claims.

Claims

1. A panoramic video control method characterized by comprising: The method comprises: in response to detecting, in a playing interface of a panoramic video, a touch operation in the playing interface, determining a touch area in the playing interface for the touch operation; based on the touch area, determining panoramic video control functions, the panoramic video control functions at least comprising fast forward and fast backward and zooming; based on the panoramic video control functions, adjusting panoramic video content displayed in the playing interface.

2. The method of claim 1, wherein, The touch area comprises a first touch area in the playing interface and a second touch area in the playing interface, the first touch area and the second touch area being non-overlapping; the panoramic video control functions further comprise a view angle rotation; the determining, based on the touch area, of the panoramic video control functions comprises: in response to the touch area being the first touch area in the playing interface, generating a virtual control area in the first touch area based on a touch position indicated by the touch operation, the virtual control area in the first touch area being used to control a panoramic video rotation view angle; in response to the touch area being the second touch area in the playing interface, generating a virtual control area in the second touch area, the virtual control area in the second touch area being used to control a panoramic video fast forward and fast backward and zooming.

3. The method of claim 2, wherein, The virtual control area generated in the second touch area is a rocker area or a circular sliding area, a first direction and a second direction in the rocker area or the circular sliding area being used to control a panoramic video fast forward and fast backward, and a third direction and a fourth direction being used to control a panoramic video zooming size.

4. The method of claim 2, wherein, The virtual control area generated in the first touch area is a rocker area or a circular sliding area, the rocker area or the circular sliding area being used to control a panoramic video view angle rotation.

5. The method of claim 2, wherein, The virtual control areas generated in the first touch area and the second touch area are transparent or semi-transparent areas.

6. The method of claim 3, wherein, The adjusting, based on the panoramic video control functions, of the panoramic video content displayed in the playing interface comprises: based on a touch position indicated by the touch operation in the rocker area or the circular sliding area, determining a fast forward and fast backward and zooming rate; dynamically adjusting a playing progress and a picture size of a panoramic video according to the fast forward and fast backward and zooming rate.

7. The method of claim 6, wherein, The determining, based on a touch position indicated by the touch operation in the rocker area or the circular sliding area, of a fast forward and fast backward and zooming rate comprises: determining an initial touch position in the touch position indicated by the touch operation; based on the initial touch position, establishing a control coordinate system, a horizontal coordinate in the control coordinate system representing a fast forward and fast backward rate, and a vertical coordinate in the control coordinate system representing a zooming rate; determining a terminal touch position in the touch position indicated by the touch operation, and determining the fast forward and fast backward rate according to a displacement difference of the terminal touch position and the initial touch position relative to the horizontal coordinate in the control coordinate system; determining the zooming rate according to a displacement difference of the terminal touch position and the initial touch position relative to the vertical coordinate in the control coordinate system.

8. A panoramic video control device characterized by comprising: The device comprises: The touch area determination module is configured to, in response to detecting a touch operation in a play interface of the panoramic video, determine a touch area of the touch operation in the play interface. The control function determination module is configured to determine a panoramic video control function based on the touch area, the panoramic video control function including at least fast forward, fast backward, and zoom. The video content adjustment module is configured to adjust the panoramic video content displayed in the play interface based on the panoramic video control function. 9.A computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the computer device is configured to perform the method according to any one of claims 1-8 when the computer program is executed by the processor. The computer program is executed by the processor to implement the steps of the method in any one of claims 1 to 7.

10. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method in any one of claims 1 to 7.

Images