Panoramic shooting angle control method and device, computer device, and storage medium

Abstract

The present disclosure relates to a panoramic shooting angle control method and device, computer equipment and a storage medium. The method comprises: in response to the panoramic camera entering a planar shooting mode, acquiring a first panoramic image of the panoramic camera at the current time, determining a first focal point based on the first panoramic image, adjusting the panoramic picture in the panoramic camera at the current time using the first focal point to obtain a first picture; in response to detecting that the panoramic camera moves, acquiring the moving speed, moving track and second panoramic image after moving of the panoramic camera, determining a second focal point based on the second panoramic image; determining a transition mode according to the moving speed, moving track of the panoramic camera and the positional relationship between the first focal point and the second focal point; and transitioning the first picture to a second picture based on the transition mode, the second picture being determined according to the second focal point. The present method can facilitate post-editing.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of data processing, and in particular, to a panoramic shooting angle control method and device, a computer device, and a storage medium. BACKGROUND

[0002] With the development of panoramic technology, more and more users will use cameras or smart phones to take pictures in various scenes. However, when taking pictures, the user needs to manually adjust the camera to aim at the target, which is not only cumbersome but also easy to miss the shooting opportunity.

[0003] The panoramic camera has greater shooting freedom and flexibility due to its all-around shooting feature. However, the current panoramic camera has not fully utilized this feature, and the traditional panoramic camera has many inconveniences when using a selfie stick to shoot a flat video and when editing. SUMMARY

[0004] Therefore, it is necessary to provide a panoramic shooting angle control method, device, computer device, and storage medium to solve the above technical problems.

[0005] In a first aspect, the present disclosure provides a panoramic shooting angle control method. The method is applied to a panoramic camera, and the method comprises:

[0006] In response to the panoramic camera entering a flat shooting mode, a first panoramic image of the panoramic camera at the current time is obtained, a first focal point is determined based on the first panoramic image, and a panoramic picture in the panoramic camera at the current time is adjusted using the first focal point to obtain a first picture;

[0007] In response to detecting that the panoramic camera moves, the moving speed, moving track, and second panoramic image after moving of the panoramic camera are obtained, and a second focal point is determined based on the second panoramic image;

[0008] According to the moving speed, moving track, and positional relationship between the first focal point and the second focal point of the panoramic camera, a transition mode is determined;

[0009] Based on the transition mode, the first picture is transitioned to a second picture, and the second picture is determined according to the second focal point.

[0010] In one embodiment, the transition mode is determined according to the moving speed, moving track, and positional relationship between the first focal point and the second focal point of the panoramic camera, comprising:

[0011] Based on the positional relationship and moving track, a transition direction and transition distance are determined;

[0012] determining a transition type as a non-linear transition type in response to the moving speed of the panoramic camera being greater than a preset speed threshold, determining a first transition mode based on the transition direction, the transition distance and the moving speed and according to the non-linear transition type;

[0013] determining a transition type as a linear transition type in response to the moving speed of the panoramic camera being less than a preset speed threshold, determining a second transition mode based on the transition direction, the transition distance and the moving speed and according to the linear transition type.

[0014] In one of the embodiments, the determining the second transition mode based on the transition direction, the transition distance and the moving speed and according to the linear transition type comprises:

[0015] determining the first transition mode according to the transition direction, the transition distance and a uniform linear transition type in response to the transition distance being less than a preset transition distance threshold;

[0016] selecting at least one intermediate point in the transition direction in response to the transition distance being greater than a preset transition distance threshold, determining the first transition mode according to the at least one intermediate point, the transition distance and a variable linear transition type and in the transition direction;

[0017] determining a transition speed variation coefficient based on the transition distance and a preset time in response to the transition distance being greater than a preset transition distance threshold;

[0018] determining the first transition mode based on the transition speed variation coefficient and a variable linear transition type and in the transition direction;

[0019] wherein the transition distance threshold is determined according to the moving speed and a preset time.

[0020] In one of the embodiments, the position relationship comprises a distance relationship and an angle relationship; the non-linear transition type comprises a Bezier curve; and the transitioning the first picture to the second picture based on the transition direction comprises:

[0021] determining at least one intermediate control point based on a line connecting the first focal point and the second focal point and a preset length threshold in response to the distance relationship being greater than a preset distance threshold and / or the angle relationship being greater than a preset angle threshold;

[0022] selecting the Bezier curve based on the at least one intermediate control point, the first focal point and the second focal point to transition the first picture to the second picture, wherein the second focal point is located in the center of the second picture.

[0023] In one of the embodiments, the position relationship comprises a distance relationship; the linear transition type comprises a linear difference; and the transitioning the first picture to the second picture based on the transition manner comprises:

[0024] In response to the distance relationship being less than a preset distance threshold, determining a transition ratio according to a distance between the first focal point and the second focal point, and transitioning the first picture to the second picture according to the transition ratio and using the linear difference.

[0025] In one of the embodiments, after the panoramic camera enters the planar shooting mode, the method further comprises:

[0026] fixing a shooting field of view of the panoramic camera in a shooting direction of the panoramic camera.

[0027] In a second aspect, the disclosure further provides a panoramic shooting angle control device. The device is applied to a panoramic camera, and the device comprises:

[0028] a picture adjusting module configured to, in response to the panoramic camera entering a planar shooting mode, acquire a first panoramic image of the panoramic camera at a current time, determine a first focal point based on the first panoramic image, and adjust a panoramic picture in the panoramic camera at the current time using the first focal point to obtain a first picture;

[0029] a focal point determining module configured to, in response to detecting that the panoramic camera moves, acquire a moving speed, a moving track, and a second panoramic image after moving of the panoramic camera, and determine a second focal point based on the second panoramic image;

[0030] a transition manner determining module configured to determine a transition manner according to the moving speed, the moving track of the panoramic camera, and a position relationship between the first focal point and the second focal point;

[0031] a transition module configured to transition the first picture to a second picture based on the transition manner, the second picture being determined according to the second focal point.

[0032] In a third aspect, the disclosure further provides a computer device. The computer device comprises a memory and a processor, the memory stores a computer program, and the processor implements the steps in any of the above method embodiments when executing the computer program.

[0033] In a fourth aspect, the disclosure further provides a computer readable storage medium. The computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the steps in any of the above method embodiments.

[0034] In a fifth aspect, the present disclosure further provides a computer program product. The computer program product comprises a computer program which, when executed by a processor, implements the steps of any of the method embodiments described above.

[0035] In the above embodiments, the panoramic camera can automatically obtain a first panoramic image and determine a first focal point after entering the planar shooting mode, without the need for the user to manually and tediously search for and lock the focal point, greatly simplifying the operation process. The transition mode is determined by comprehensively analyzing the camera movement speed, movement trajectory, and the relationship between focal points, which can intelligently track the focal point changes during camera movement. Whether shooting a slowly moving object such as a flower blooming process or a fast-moving scene such as a sports competition, the focal point can be naturally and smoothly switched between different objects, and can adapt to various scenes. The determined focal point is used to adjust the picture, so that the picture is always centered on the important focal point, highlighting the subject and avoiding a messy picture. The transition from the first picture to the second picture is based on a scientific and reasonable transition mode, maintaining the stability of the picture and the comfort of the vision, reducing adverse phenomena such as picture shaking, blurring, or focal point mutation, and improving the overall shooting quality, and facilitating post-editing. BRIEF DESCRIPTION OF DRAWINGS

[0036] In order to more clearly illustrate the specific embodiments of the present disclosure or the technical solutions in the prior art, the drawings needed in the specific embodiments or prior art description will be briefly introduced below. Obviously, the drawings in the following description are some embodiments of the present disclosure, and those skilled in the art can also obtain other drawings according to these drawings without creative labor.

[0037] Figure 1 A flowchart of a panoramic shooting angle control method in an embodiment;

[0038] Figure 2 A flowchart of step S106 in an embodiment;

[0039] Figure 3 A flowchart of step S108 in an embodiment;

[0040] Figure 4 Another flowchart of step S108 in an embodiment;

[0041] Figure 5 A schematic diagram of a first focal point, a second focal point, and an intermediate control point in an embodiment;

[0042] Figure 6 A structural schematic block diagram of a panoramic shooting angle control device in an embodiment;

[0043] Figure 7 Fig. 1 is a schematic diagram of an internal structure of a computer device in an embodiment. DETAILED DESCRIPTION

[0044] In order to make the objectives, technical solutions and advantages of the present disclosure clearer, further detailed description will be made to the present disclosure in combination with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present disclosure and not intended to limit the present disclosure.

[0045] It should be noted that the terms "first", "second" and the like in the description and claims of the present disclosure and the above drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present disclosure described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, device, product or apparatus including a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to these processes, methods, products or apparatuses.

[0046] In this document, the term "and / or" is merely a description of an association relationship between associated objects, which means that there can be three relationships. For example, A and / or B can represent the following three cases: A exists alone, A and B exist together, and B exists alone. In addition, the character " / " in this document generally represents an "or" relationship between the front and rear associated objects.

[0047] In an embodiment, as shown in Figure 1 A panoramic shooting time control method is provided, and the present embodiment takes the method applied to a panoramic camera as an example, which includes the following steps:

[0048] S102, in response to the panoramic camera entering a planar shooting mode, acquiring a first panoramic image of the panoramic camera at the current time, determining a first focal point based on the first panoramic image, and adjusting a panoramic picture in the panoramic camera at the current time using the first focal point to obtain a first picture.

[0049] The planar shooting mode generally refers to a shooting setting in a photography or video shooting process, which is mainly used to obtain a two-dimensional planar image or video. In some embodiments of the present disclosure, the panoramic camera generally shoots a panoramic video, and in some scenarios, a user needs to convert the panoramic video into a planar video, in which case the video shooting mode can be the planar shooting mode. The first focal point can be a region of interest that needs to be focused on at present. The first picture is generally a panoramic picture with the focal point placed in the center of the picture.

[0050] Specifically, when the panoramic camera enters the flat shooting mode, the system will immediately obtain the first panoramic image at the current time. This panoramic image contains 360-degree scene information around the camera. Through specific image processing algorithms and focus recognition techniques, the first focus point is determined in this rich image data. This first focus point can be a person, object or specific point of interest in the picture, such as a distant mountain or a small boat in the lake when shooting scenery; when shooting live scenes, it can be an actor on stage or a key figure in the crowd. Then, using the determined first focus point, the panoramic picture in the panoramic camera at the current time is adjusted. Specifically, through the image adjustment mechanism inside the camera, the first focus point is moved to the center of the picture, while the other parts of the picture are scaled, cropped or deformed accordingly to ensure that the entire picture is visually balanced and coordinated. The final first picture, centered on the first focus point, clearly displays the relevant scene information around the focus point, allowing the experimenter or user to focus on this important focus point, highlighting the main subject of the shot, laying the foundation for subsequent editing, and making the picture more visually appealing and expressive.

[0051] S104, in response to detecting that the panoramic camera moves, obtaining the moving speed, moving trajectory and second panoramic image after moving of the panoramic camera, and determining a second focus point based on the second panoramic image.

[0052] Wherein, the panoramic camera moving refers to the change of the position of the panoramic camera in space, which can be caused by the user moving the camera, the camera being installed on a mobile device (such as a drone or a gimbal) and moving with it, or being displaced by external forces. The moving speed refers to the distance the panoramic camera moves in a unit of time, usually expressed in meters per second or other appropriate combination of length and time units, which reflects the speed of the camera's position change. The moving trajectory is the path the panoramic camera takes during movement, which can be described by a series of consecutive coordinate points in three-dimensional space, and its shape can be a straight line, a curve or a complex irregular path, depending on the way the camera moves. The second panoramic image refers to the image containing 360-degree scene information taken after the panoramic camera moves, which may differ from the first panoramic image in terms of scene content, object relative position and angle of view due to the change in camera position. The second focus point is a point of interest identified by specific algorithms and techniques in the second panoramic image, similar to the first focus point, which can be a person, object or specific landscape element, and is the key object for subsequent picture processing and focus switching.

[0053] Specifically, when the panoramic camera moves is detected by the internal sensors of the panoramic camera, the internal sensors of the camera can be used to record the moving speed and moving track of the camera, for example, using an accelerometer and a gyroscope. The accelerometer can measure the acceleration of the camera in each direction, and the speed information can be obtained by integrating the acceleration. The gyroscope can measure the rotation angle and angular velocity of the camera, and in combination with the time information, the moving direction and track of the camera can be determined. After the panoramic camera moves to a new position, the fisheye lens of the panoramic camera will continue to capture the light information of the surrounding environment, and convert the light into a digital image signal through the imaging system of the panoramic camera. After a series of image processing steps (such as noise reduction, color correction, etc.), a second panoramic image is generated. The second panoramic image is input into the trained focus recognition model, and the model outputs the possible focus objects and their position information in the image. According to the predetermined rules (such as preferentially selecting a person, a specific landmark object, etc.), the second focus is determined. The focus recognition model can be implemented using an image recognition algorithm. For example, a target detection algorithm based on deep learning, such as YOLO (You Only Look Once) or Faster R-CNN, etc. is used. A large amount of image data is trained to recognize different categories of objects. Thus, according to the predetermined rules, different ways to determine the focus are selected. In some embodiments of the present disclosure, how to determine the focus is not limited, and a person skilled in the art can flexibly select different ways to determine the focus according to the actual situation.

[0054] In addition, it should be noted that after the second panoramic image is determined, if the second focus does not exist in the second panoramic image, the current view angle of the camera can be fixed at the first focus, or the current actual picture of the camera can be kept. After the second panoramic image is determined, the second panoramic image is directly displayed without subsequent adjustment.

[0055] S106, according to the moving speed and moving track of the panoramic camera, and the positional relationship between the first focus and the second focus, a transition mode is determined.

[0056] The transition mode can include a linear transition type transition mode and a nonlinear transition type transition mode. The positional relationship between the first focus and the second focus can include an angle relationship and a distance relationship.

[0057] Specifically, different processing manners can be selected according to the moving speed of the panoramic camera, for example, when the moving speed of the panoramic camera is fast, a non-linear transition type can be selected, and the transition manner is determined by using the moving track and the position relationship. For another example, when the moving speed of the panoramic camera is slow, a linear transition type can be selected, and the transition manner is determined by using the moving track and the position relationship. In addition, when the moving speed is not uniform and meets the exponential function rule, the transition manner can be determined by using the moving track and the position relationship, and the transition manner is determined by the form of the exponential function.

[0058] In S108, the first picture is transitioned to a second picture according to the transition manner, and the second picture is determined according to the second focus.

[0059] Specifically, the first picture can be transitioned to the second picture according to different transition manners, and during the transition process, the second focus needs to be placed in the center of the second picture.

[0060] In some exemplary embodiments, if the transition manner is the linear transition type, and the camera moving speed is moderate and the focus position relationship is relatively simple, for example, from a part of one static object (the first focus) to another adjacent part (the second focus). First, the coordinate difference value of the first focus and the second focus in the picture is calculated, and the displacement amount of the focus in each time step is determined according to the transition time and the frame rate of the camera. In each time step, the picture is resampled and interpolated, and the pixel weight of the focus area in the picture is gradually adjusted, so that the focus is smoothly moved from the first focus position to the second focus position, while keeping the other parts of the picture relatively stable and naturally transitioned, and finally forming the second picture. When the transition manner is the non-linear transition type, for example, the Bezier curve transition manner, for example, in the case of shooting a dynamic scene and complex focus switching, the control points of the Bezier curve are determined according to the moving speed of the camera, the acceleration, and the position relationship of the first focus and the second focus. With the passage of time, the position coordinates of the focus at each time point are calculated according to the formula of the Bezier curve. For the picture, according to the change of the focus position, in each time step, the image deformation algorithm is used to perform local stretching, compression, and distortion operations on the picture, so that the picture can smoothly transition around the Bezier curve track of the focus, and ensure that the second picture maintains visual continuity and naturalness during the focus switching process.

[0061] In the panoramic shooting perspective control method, the panoramic camera can automatically obtain the first panoramic image and determine the first focus point after entering the planar shooting mode, without the need for the user to manually and tediously search for and lock the focus point, greatly simplifying the operation process. The transition mode is determined through comprehensive analysis of the camera moving speed, moving track, and relationship between the focus points, so that the focus point change can be intelligently tracked during the camera movement. Whether the object is slowly moving, such as the blooming process of a flower, or the scene is rapidly moving, such as a sports competition, the focus point can be ensured to naturally and smoothly switch between different objects. The determined focus point is used to adjust the picture, so that the picture is always centered on the important focus point, highlighting the subject and avoiding a messy picture. The transition from the first picture to the second picture is based on a scientific and reasonable transition mode, maintaining the stability of the picture and the comfort of the vision, reducing adverse phenomena such as picture shaking, blurring, or focus point mutation, improving the overall shooting quality, and facilitating post-editing.

[0062] In one embodiment, as shown in Figure 2 the transition mode is determined according to the moving speed, moving track, and position relationship between the first focus point and the second focus point of the panoramic camera, including:

[0063] S202, determining a transition direction and a transition distance based on the position relationship and the moving track.

[0064] The transition direction can generally be the transition mode required when transitioning from the first picture to the second picture.

[0065] Specifically, the transition distance can be calculated according to the coordinates of the first focus point and the second focus point. Generally, the moving track and the transition direction are the same. The transition direction can be determined according to the position relationship and / or the moving track. Considering the moving track of the camera, if the camera moves along a straight line and the moving direction is similar to the direction of the focus point connection line, the direction of the focus point connection line can be directly used as the transition direction. However, if the moving track of the camera is a curve, the direction of the focus point connection line needs to be corrected. For example, when the camera moves along a curve that bends to the right, and the focus point switches from an object on the left side of the picture to an object on the right side, the transition direction should be appropriately shifted to the right by a certain angle based on the direction of the focus point connection line, so as to better conform to the actual moving trend of the camera and ensure the naturalness of the picture transition. According to different situations, those skilled in the art can select the position relationship and the moving track.

[0066] S204, in response to the moving speed of the panoramic camera being greater than a preset speed threshold, determining that the transition type is a nonlinear transition type, and determining a first transition mode based on the transition direction, transition distance, and moving speed according to the nonlinear transition type.

[0067] The nonlinear transition type can be a focus or picture transition mode, and the transition process is not uniformly changed according to a fixed ratio, but is realized through a more complex curve or algorithm to adapt to complex and variable motion conditions, so that the transition effect is more natural and smooth, and the harshness of linear transition in some scenes is avoided.

[0068] Specifically, the system continuously monitors the moving speed of the panoramic camera. When it is detected that the camera moving speed is greater than a preset speed threshold, it is determined that the nonlinear transition type is adopted. This is because in the high-speed moving scene, linear transition may not meet the natural and smooth transition requirement, and nonlinear transition can better adapt to complex motion states. According to specific requirements, a suitable nonlinear function is selected, such as a Bezier curve function, a sine curve function, etc. Then the transition speed is determined according to the moving speed of the camera, to ensure that the transition speed of the focus is always less than or equal to the camera moving speed. In each frame of image, the position of the focus on the nonlinear curve is calculated according to the selected nonlinear transition type and the current time. As time goes on, the focus smoothly transitions from the first focus to the second focus along the nonlinear curve, realizing a natural and smooth transition effect, thereby determining the first transition mode.

[0069] S206, in response to the moving speed of the panoramic camera being less than a preset speed threshold, determining that the transition type is a linear transition type, determining a second transition mode based on the transition mode, the transition distance and the moving speed, and according to the linear transition type.

[0070] The linear transition type generally refers to a transition mode in which the position of the focus uniformly changes with time according to a fixed proportional relationship during focus switching. Its characteristics are simple and direct change process, showing a linear change trend, and it is suitable for the case where the camera moving speed is relatively smooth and the scene changes are relatively simple.

[0071] Specifically, when the panoramic camera moving speed is slow, the linear transition type can be selected. Because in the low-speed moving condition, linear transition is sufficient to ensure the smoothness of focus switching, and the calculation is relatively simple, which can meet the demand of picture transition. Since it is linear transition, the transition time can be calculated according to the moving speed and the transition distance, and the transition displacement per unit time (which can be the same or different) is determined using the transition time and the transition distance. Then the new position is calculated according to the transition displacement per unit time, thereby determining the second transition mode.

[0072] In this embodiment, the transition type is dynamically selected according to the camera movement speed, so that the focus transition matches the actual movement state of the camera. The nonlinear transition provides a more complex and natural transition path at high speed, and the linear transition ensures smooth and uniform transition at low speed. The combination of the two types of transitions ensures that the focus switching can best meet the human visual habits, enhances the realism and watchability of the picture, and effectively avoids the jumping and lagging phenomenon in the focus transition process. The curve characteristics of the nonlinear transition at high speed and the uniform change of the linear transition at low speed can make the focus smoothly transition between different positions, maintain the stability and smoothness of the picture, and present high-quality visual content to the user.

[0073] In one embodiment, as shown in Figure 3 The linear transition type includes a constant-speed linear transition type and a variable-speed linear transition type. The second transition mode is determined based on the transition mode, the transition distance, and the movement speed, and according to the linear transition type, which includes:

[0074] S302, in response to the transition distance being less than a preset transition distance threshold, determining a first transition mode according to the transition direction, the transition distance, and the constant-speed linear transition type.

[0075] The transition distance threshold is determined according to the movement speed and a preset time. Generally, the preset time can be the transition time. The constant-speed linear transition type is a transition mode for realizing smooth change from one state to another, and its core feature is that the change rate remains constant during the entire transition process.

[0076] Specifically, when the transition distance is less than the preset transition distance, it can be determined that the second focus can be transitioned within the preset time according to the movement speed. At this time, the first transition mode can be determined according to the transition direction, the transition distance, and the constant-speed linear transition type.

[0077] In some exemplary embodiments, the transition time is known (which can be set according to actual needs, for example, according to the total length of the animation and the desired smoothness), and according to the principle of constant-speed linear transition, the speed is equal to the distance divided by the time. For a two-dimensional case, the speed is decomposed into x and y directions, the component of the speed in the x direction, and the component of the speed in the y direction. If it is three-dimensional or higher dimensional, the decomposition is performed according to the dimension of the transition direction. In each time interval, the state is updated according to the formula of constant-speed linear transition to obtain the first transition mode.

[0078] S304, in response to the transition distance being greater than the preset transition distance threshold, selecting at least one intermediate point in the transition direction, determining a first transition mode according to the at least one intermediate point, the transition distance and the variable-speed linear transition type, and in the transition direction.

[0079] In some embodiments of the present disclosure, the intermediate point can refer to a point where the speed needs to be changed. The variable-speed linear transition type is a way of transitioning between two states, which is different from the constant-speed linear transition type in that the speed during the transition is not constant, but changes linearly with time or other factors.

[0080] Specifically, when the transition distance is greater than the preset transition distance threshold, if the constant-speed linear transition mode is used, the transition speed will be fast. Therefore, the variable-speed linear transition type can be used for gradual transition. One or more intermediate points can be selected in the transition direction according to the transition distance. For example, if the transition distance is d, and it is preset to be divided into n segments (n can be determined according to specific circumstances, such as the complexity of the transition, the desired number of variable-speed stages, etc.), then each segment has a distance of d / n. Starting from the starting point, the positions of the intermediate points are determined in sequence along the transition direction. In addition, the intermediate points can also be selected in combination with the actual characteristics of the scene. The specific selection of the intermediate points is not limited herein. The entire transition process is divided into multiple stages according to the intermediate points. Then the transition time and speed of each stage are determined, and the first transition mode is determined according to the transition time and speed of each stage, and in the transition direction. The transition time of each stage can usually be determined according to the preset time. For example, if the preset time is 5s and there are three stages, the first stage can be 1s, the second stage can be 1s, and the third stage can be 3s, or the first stage can be 1s, the second stage can be 2s, and the third stage can be 2s. According to different application scenarios, the transition time of each stage can be flexibly changed, and in some embodiments of the present disclosure, the transition time is not limited.

[0081] S306, in response to the transition distance being greater than the preset transition distance threshold, determining a transition speed change coefficient based on the transition distance and the preset time.

[0082] The transition speed change coefficient is usually a coefficient for describing how the transition speed changes. In the variable-speed linear transition, the transition speed is not constant, and this coefficient determines the linear law of speed change, such as the degree of acceleration or deceleration.

[0083] Specifically, when the transition distance is greater than a preset transition distance threshold, the system calculates a transition speed change coefficient according to the transition distance and a preset time. This coefficient will be used for subsequent variable speed linear transition. In this way, it can be ensured that the transition process can be completed within the preset time under a longer transition distance, and has a reasonable speed change rule. Taking position transition as an example, assuming that an object needs to be moved from point A to point B, and the transition direction is from A to B. Assuming that the transition distance is d, and the preset time is t. In variable speed linear transition, the relationship between speed and time can be expressed as v = kt + v0 (k is a transition speed change coefficient, and v0 is an initial speed, which is assumed to be 0 here for easy calculation). According to the kinematics formula in physics It can be deduced that k = 2d / t 2 It can be understood that the above is only used for illustration.

[0084] S308, based on the transition speed change coefficient and the variable speed linear transition type, and according to the transition direction, determine a first transition mode.

[0085] Specifically, after determining the transition speed change coefficient, the first transition mode can be determined according to the transition speed change coefficient, using the variable speed linear transition type, and according to the transition direction.

[0086] In this embodiment, by using the variable speed linear transition type and the calculated transition speed change coefficient, the object may start at a slow speed in the initial stage, and then gradually speed up, or start quickly and then gradually slow down. The linear change of speed makes the movement of the object look more natural, avoiding the unrealistic feeling caused by sudden acceleration or deceleration. By determining the transition speed change coefficient through the preset time, the rhythm of the transition can be accurately controlled. Whether it is a fast scene switching or a slow state evolution, the preset time can be adjusted according to specific needs, so as to effectively control the transition speed and rhythm, and make the entire transition process more consistent with the requirements of the application scenario.

[0087] In one embodiment, the position relationship includes: distance relationship and angle relationship; angle relationship: generally refers to the included angle formed by the line connecting the first focus and the second focus and a certain reference direction (such as the horizontal axis or the vertical axis of the image). It describes the relative direction change of the two foci in space. The non-linear transition type includes: Bezier curve, as shown in Figure 4 Based on the transition mode, the first picture is transitioned to the second picture, including:

[0088] S402: In response to the distance relationship being greater than a preset distance threshold, and / or the angle relationship being greater than a preset angle threshold, determining at least one intermediate control point based on a line between the first focus and the second focus and a preset length threshold.

[0089] S404 : Select the Bezier curve based on the at least one intermediate control point, the first focus, and the second focus, and transition the first picture to a second picture, wherein the second focus is located at the center of the second picture.

[0090] The intermediate control point can be a point located on or near the line connecting the first and second focal points, which is used to control the shape of the Bezier curve. By properly setting the intermediate control point, the Bezier curve can better adapt to the distance and angle changes between the focal points, achieving a smooth transition.

[0091] Specifically, the distance between the first and second focal points, as well as the angle between the line connecting them and the reference direction, are calculated and compared with preset distance and angle thresholds, respectively. Whenever the distance relationship exceeds the preset distance threshold or the angle relationship exceeds the preset angle threshold, the intermediate control point determination process is triggered. Based on the line connecting the first and second focal points, starting with the first focal point, the first intermediate control point is determined along the line according to a preset length threshold. If multiple intermediate control points are required (e.g., when the distance or angle between the focal points varies significantly), additional intermediate control points are determined along the line according to a specific pattern (e.g., evenly spaced). After determining at least one intermediate control point, a Bezier curve is defined by combining the first and second focal points. If there is only one intermediate control point, a quadratic Bezier curve can be used; if there are multiple intermediate control points, a higher-order Bezier curve is used. When implementing a frame transition, t gradually changes from 0 to 1 over time. In each frame, the corresponding point on the Bezier curve is calculated based on the current value. This point represents the position where the focal point should be at that moment. Then, according to the change of the focus position, the picture is adjusted accordingly, such as recomposing, adjusting the display of picture elements, etc., so as to achieve a smooth transition from the first picture to the second picture, and finally make the second focus located in the center of the second picture.

[0092] In some exemplary embodiments, Figure 5 As shown, A is the first focus, B is the second focus, AB is the line between the first focus and the second focus. If the preset length is 3 cm, the intermediate control point can be determined at any position on the edge of the circle C1 with a radius of 3 cm at point C. For example, the intermediate control points can be D1, D2 and D3.

[0093] In this embodiment, by introducing intermediate control points and using Bezier curves, smooth transition of the focus from the first focus to the second focus located in the center of the second picture can be achieved in cases where the distance between the two foci is large or the angle changes greatly. This transition avoids the harshness caused by direct switching, making the picture transition more natural and smooth, in line with the visual habits of the human eye. The number and position of the intermediate control points are dynamically determined according to the distance relationship and the angle relationship, allowing the system to adapt flexibly to different focus changes. Whether it is a small range of focus movement or a large range of focus jump, it can be optimized by a reasonable Bezier curve to ensure the quality of the transition effect.

[0094] In one embodiment, the position relationship includes a distance relationship; the linear transition type includes a linear difference; linear interpolation is a method of numerical estimation between two known data points. Transitioning the first picture to the second picture based on the transition mode includes:

[0095] In response to the distance relationship being less than a preset distance threshold, determining a transition ratio according to the distance between the first focus and the second focus, and transitioning the first picture to the second picture according to the transition ratio and using the linear difference, wherein the second focus is located in the center of the second picture.

[0096] Wherein, the transition ratio generally refers to the ratio of change in unit time, which can be a ratio value determined according to the distance between the first focus and the second focus. This ratio value is used to control the degree of transition of the picture from the first focus state to the second picture state with the second focus located in the center. For example, if the distance is short, the transition ratio may be relatively large, meaning that the picture transitions to the second picture faster; conversely, when the distance is slightly far, the transition ratio may be smaller, and the transition process is relatively gentle. According to the distance between the first focus and the second focus, the farther the distance, the larger the transition ratio, and the closer the distance, the smaller the transition ratio. For example, the distance d can be mapped to the transition ratio according to a preset rule or function. For example, a simple inverse proportional relationship p=k / d (k is a constant, which can be adjusted according to actual needs to ensure that the transition ratio is within a reasonable range) can be set, or a more complex function can be used to make the transition ratio more in line with the actual scene requirements.

[0097] Specifically, the distance between the first focus and the second focus can be calculated. Assuming that the position coordinates of a certain key element (related to the focus) in the first picture are (x1, y1), and the ideal position coordinates of the corresponding element in the second picture with the second focus as the center are (x2, y2). In each frame during the transition process, the current position coordinates (x, y) of the element are calculated according to the transition ratio p, and the formula is x = x1 + p(x2 - x1), y = y1 + p(y2 - y1). By constantly updating the element position, the smooth transition of the element position in the picture from the first focus-related position to the position with the second focus as the center is realized.

[0098] In the embodiment, when the distance relationship is less than the preset distance threshold, the transition ratio is determined according to the distance between the focuses, and then the picture transition is realized by using the linear difference method. This means that the transition of the picture from the first picture to the second picture is smooth and continuous. For example, the position, color and other attributes of the object in the picture will gradually change according to the linear law with the change of the transition ratio, and there will be no mutation or jump, so that the user can naturally feel that the focus of the picture is smoothly moved from the first focus to the second focus located in the center of the second picture.

[0099] In one embodiment, the method further comprises, after the panoramic camera enters the planar shooting mode:

[0100] Fixing the shooting field of view of the panoramic camera in the shooting direction of the panoramic camera.

[0101] The shooting direction of the panoramic camera can generally be the lens direction, i.e. the direction of the northern hemisphere. The system defaults to lock the field of view in the top area of the camera (defined as the northern hemisphere), thereby facilitating the user to point the panoramic camera at a target, so that the focus can be accurately and quickly locked in the subsequent use of the panoramic camera.

[0102] It should be understood that, although each step in the flowchart involved in each embodiment as described above is shown in sequence according to the arrow, these steps are not necessarily executed in sequence according to the arrow. Unless otherwise specified herein, the execution of these steps is not strictly limited in sequence, and these steps can be executed in other sequences. Moreover, at least part of the steps in the flowchart involved in each embodiment as described above can include multiple steps or stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution sequence of these steps or stages is not necessarily sequential, but can be executed in rotation or alternation with at least part of other steps or steps or stages in other steps.

[0103] Based on the same inventive concept, the disclosure also provides a panoramic shooting perspective control device for implementing the panoramic shooting perspective control method described above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme described in the above method, so the specific limitations in one or more panoramic shooting perspective control device embodiments provided below can refer to the limitations of the panoramic shooting perspective control method described above, which will not be repeated here.

[0104] In one embodiment, as shown in Figure 6 A panoramic shooting perspective control device 600 is provided, including a picture adjustment module 602, a focus point determination module 604, a transition mode determination module 606, and a transition module 608.

[0105] The picture adjustment module 602 is configured to, in response to the panoramic camera entering a planar shooting mode, acquire a first panoramic image of the panoramic camera at the current time, determine a first focus point based on the first panoramic image, and adjust a panoramic picture in the panoramic camera at the current time using the first focus point to obtain a first picture.

[0106] The focus point determination module 604 is configured to, in response to detecting that the panoramic camera moves, acquire a moving speed, a moving track, and a second panoramic image after moving of the panoramic camera, and determine a second focus point based on the second panoramic image.

[0107] The transition mode determination module 606 is configured to determine a transition mode according to the moving speed, the moving track, and a positional relationship between the first focus point and the second focus point.

[0108] The transition module 608 is configured to transition the first picture to a second picture based on the transition mode, wherein the second picture is determined according to the second focus point.

[0109] In one embodiment of the device, the transition mode determination module 606 includes:

[0110] A transition data determination module is configured to determine a transition direction and a transition distance based on the positional relationship and the moving track.

[0111] A first transition mode determination module is configured to, in response to the moving speed of the panoramic camera being greater than a preset speed threshold, determine a transition type as a nonlinear transition type, and determine a first transition mode based on the transition direction, the transition distance, and the moving speed and according to the nonlinear transition type.

[0112] The second transition mode determining module is configured to determine a transition type as a linear transition type in response to the moving speed of the panoramic camera being less than a preset speed threshold, determine a second transition mode based on the transition mode, the transition distance, and the moving speed, and determine the second transition mode according to the linear transition type.

[0113] In an embodiment of the apparatus, the first transition mode determining module comprises:

[0114] The first sub-module is configured to determine a first transition mode according to the transition direction, the transition distance, and a uniform linear transition type in response to the transition distance being less than a preset transition distance threshold.

[0115] The second sub-module is configured to select at least one intermediate point in the transition direction in response to the transition distance being greater than the preset transition distance threshold, determine the first transition mode according to the at least one intermediate point, the transition distance, and a variable linear transition type, and in accordance with the transition direction.

[0116] The third sub-module is configured to determine a transition speed variation coefficient based on the transition distance and a preset time in response to the transition distance being greater than the preset transition distance threshold, determine the first transition mode based on the transition speed variation coefficient and the variable linear transition type, and in accordance with the transition direction.

[0117] In an embodiment of the apparatus, the position relationship comprises a distance relationship and an angle relationship, and the nonlinear transition type comprises a Bezier curve. The transition module 608 is further configured to determine at least one intermediate control point based on a connection line between the first focal point and the second focal point and a preset length threshold in response to the distance relationship being greater than a preset distance threshold and / or the angle relationship being greater than a preset angle threshold, select the Bezier curve based on the at least one intermediate control point, the first focal point, and the second focal point, and transition the first picture to the second picture, wherein the second focal point is located at the center of the second picture.

[0118] In an embodiment of the apparatus, the position relationship comprises a distance relationship, and the linear transition type comprises a linear difference value. The transition module 608 is further configured to determine a transition ratio according to the distance between the first focal point and the second focal point in response to the distance relationship being less than a preset distance threshold, and transition the first picture to the second picture according to the transition ratio and by using the linear difference value, wherein the second focal point is located at the center of the second picture.

[0119] In an embodiment of the apparatus, the apparatus further comprises a field of view fixing module configured to fix a field of view of the panoramic camera in a shooting direction of the panoramic camera.

[0120] Each of the modules in the panoramic shooting perspective control apparatus can be implemented by software, hardware, or a combination thereof, in whole or in part. Each of the modules can be embedded in or independent of a processor in a computer device in hardware form, or stored in a memory in the computer device in software form, so as to be invoked and executed by the processor to perform the operations corresponding to each of the modules.

[0121] In one embodiment, a computer device is provided, which can be a terminal, and an internal structure diagram of the computer device can be as shown in FIG. 1. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. The processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for running the operating system and the computer program in the non-volatile storage medium. The communication interface of the computer device is configured to perform wired or wireless communication with an external terminal. The wireless communication can be achieved by WIFI, mobile cellular network, NFC (Near Field Communication), or other technologies. The computer program is executed by the processor to implement a panoramic shooting perspective control method. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer overlaid on the display screen, or a key, trackball, or touchpad arranged on the shell of the computer device, or an external keyboard, touchpad, or mouse, etc. Figure 7 Those skilled in the art can understand that the structure shown in FIG. 1 is only a block diagram of part of the structure related to the present disclosure, and does not constitute a limitation on the computer device to which the present disclosure is applied. Specifically, the computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0122] Figure 7 Those skilled in the art can understand that the structure shown in FIG. 1 is only a block diagram of part of the structure related to the present disclosure, and does not constitute a limitation on the computer device to which the present disclosure is applied. Specifically, the computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0123] In one embodiment, a computer device is provided, which includes a memory and a processor. The memory stores a computer program. The processor executes the computer program to implement the steps in any of the above method embodiments.

[0124] In one embodiment, a computer readable storage medium is provided, which stores a computer program. The computer program is executed by a processor to implement the steps in any of the above method embodiments.

[0125] In one embodiment, a computer program product is provided, which includes a computer program. The computer program is executed by a processor to implement the steps in any of the above method embodiments.

[0126] ​Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when the computer program is executed, the processes of the above-mentioned embodiments of the methods can be included. Any reference to memory, database or other medium used in the embodiments provided by the present disclosure can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical storage, high-density embedded non-volatile memory, resistive memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration but not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The database involved in the embodiments provided by the present disclosure can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in the embodiments provided by the present disclosure can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., without being limited thereto.

[0127] Any combination of the technical features of the above embodiments can be made. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described, however, as long as the combination of the technical features does not exist, it should be considered as the scope of the present disclosure.

[0128] The above embodiments only express several implementation manners of the present disclosure, and the description is more specific and detailed, but it should not be understood as a limitation on the scope of the patent of the present disclosure. It should be noted that for ordinary skilled persons in the art, without departing from the concept of the present disclosure, a number of modifications and improvements can be made, which are within the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be subject to the appended claims.

Claims

1. A panoramic shooting viewing angle control method, characterized in that: The method is applied to a panoramic camera, and the method comprises: In response to the panoramic camera entering a plane shooting mode, a first panoramic image of the panoramic camera at a current time is acquired, a first focal point is determined based on the first panoramic image, and a panoramic picture in the panoramic camera at the current time is adjusted using the first focal point to obtain a first picture; In response to detecting that the panoramic camera moves, a moving speed, a moving track, and a second panoramic image after moving of the panoramic camera are acquired, and a second focal point is determined based on the second panoramic image; A transition mode is determined according to the moving speed, the moving track, and a positional relationship between the first focal point and the second focal point of the panoramic camera; The transition mode is determined according to the moving speed, the moving track, and the positional relationship between the first focal point and the second focal point of the panoramic camera, comprising: in response to the moving speed of the panoramic camera being greater than a preset speed threshold, determining that the transition type is a nonlinear transition type; in response to the moving speed of the panoramic camera being less than the preset speed threshold, determining that the transition type is a linear transition type; and determining the transition mode based on the determined transition type and using the moving track and the positional relationship; The first picture is transitioned to a second picture based on the transition mode, wherein the second picture is determined according to the second focal point.

2. The method of claim 1, wherein, The transition mode is determined based on the determined transition type and using the moving track and the positional relationship, comprising: The transition direction and the transition distance are determined based on the positional relationship and the moving track; In response to determining that the transition type is a nonlinear transition type, a first transition mode is determined based on the transition direction, the transition distance, and the moving speed and according to the nonlinear transition type; In response to determining that the transition type is a linear transition type, a second transition mode is determined based on the transition mode, the transition distance, and the moving speed and according to the linear transition type.

3. The method of claim 2, wherein, The linear transition type comprises a uniform linear transition type and a variable linear transition type, and the second transition mode is determined based on the transition mode, the transition distance, and the moving speed and according to the linear transition type, comprising: In response to the transition distance being less than a preset transition distance threshold, a first transition mode is determined according to the transition direction, the transition distance, and the uniform linear transition type; In response to the transition distance being greater than the preset transition distance threshold, at least one intermediate point is selected in the transition direction, a first transition mode is determined according to the at least one intermediate point, the transition distance, and the variable linear transition type and in the transition direction; In response to the transition distance being greater than the preset transition distance threshold, a transition speed variation coefficient is determined based on the transition distance and a preset time; A first transition mode is determined based on the transition speed variation coefficient and the variable linear transition type and in the transition direction; The transition distance threshold is determined according to the moving speed and a preset time.

4. The method of claim 2, wherein, The position relationship comprises a distance relationship and an angle relationship; the nonlinear transition type comprises a Bezier curve; and the transitioning the first picture to the second picture based on the transition mode comprises: in response to the distance relationship being greater than a preset distance threshold value and / or the angle relationship being greater than a preset angle threshold value, determining at least one intermediate control point based on a line connecting the first focal point and the second focal point and a preset length threshold value; selecting the Bezier curve based on the at least one intermediate control point, the first focal point and the second focal point to transition the first picture to the second picture, wherein the second focal point is located at the center of the second picture.

5. The method of claim 2, wherein, The position relationship comprises a distance relationship. The linear transition type comprises a linear difference value; and the transitioning the first picture to the second picture based on the transition mode comprises: in response to the distance relationship being less than a preset distance threshold value, determining a transition ratio according to a distance between the first focal point and the second focal point, and transitioning the first picture to the second picture according to the transition ratio and using the linear difference value, wherein the second focal point is located at the center of the second picture.

6. The method of claim 1, wherein, After the panoramic camera enters the planar shooting mode, the method further comprises: fixing a shooting field of view of the panoramic camera in a shooting direction of the panoramic camera.

7. A panoramic shooting angle control device, characterized by comprising: The device is applied to a panoramic camera, and the device comprises: a picture adjustment module configured to, in response to the panoramic camera entering a planar shooting mode, acquire a first panoramic image of the panoramic camera at a current time, determine a first focal point based on the first panoramic image, and adjust a panoramic picture in the panoramic camera at the current time using the first focal point to obtain a first picture; a focal point determination module configured to, in response to detecting that the panoramic camera moves, acquire a moving speed, a moving track and a second panoramic image after moving of the panoramic camera, and determine a second focal point based on the second panoramic image; a transition mode determination module configured to determine a transition mode according to a moving speed, a moving track of the panoramic camera and a position relationship between the first focal point and the second focal point; the transition mode determination module is further configured to, in response to the moving speed of the panoramic camera being greater than a preset speed threshold value, determine that a transition type is a nonlinear transition type; in response to the moving speed of the panoramic camera being less than the preset speed threshold value, determine that the transition type is a linear transition type; and determine the transition mode based on the determined transition type and using the moving track and the position relationship; a transition module configured to transition the first picture to a second picture based on the transition mode, wherein the second picture is determined according to the second focal point. 8.A computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the computer device is configured to perform the method according to any one of claims 1-7. The processor implements the steps of the method of any one of claims 1 to 6 when executing the computer program.

9. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program, when executed by the processor, implements the steps of the method of any one of claims 1 to 6.

10. A computer program product comprising a computer program, characterized in that, The computer program, when executed by the processor, implements the steps of the method of any one of claims 1 to 6.

Images