Panoramic video playback method and related equipment
By calibrating and adaptive depth of field processing of panoramic videos, the problem that users cannot clearly view key objects from the same perspective is solved, and the adaptive depth of field technology of panoramic videos is realized, improving the viewing experience.
Patent Information
- Application Number
- CN202210198418.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-02
- Publication Date
- 2025-08-29
- Estimated Expiration
- 2042-03-02
AI Technical Summary
In the existing panoramic video technology, users are unable to clearly view the details of key objects from the same perspective, resulting in poor viewing experience.
By calibrating the panoramic video, the calibration information of the target object is obtained, including size, position and adaptive depth of field effect time, and the scaling and movement parameters of the target object are calculated based on the user's perspective information when the playback time is matched, so as to realize adaptive depth of field processing.
It improves the user's viewing experience in panoramic videos, ensures that key objects are clearly displayed, and enhances the viewing effect.
Smart Images

Figure CN116740185B_ABST
Abstract
Description
Technical field
[0001] The present invention relates to the field of information processing technology, and in particular to a panoramic video playback method and related equipment. [Background Technology]
[0002] Virtual Reality (VR) technology, a result of rapid advancements in computer hardware and software, sensing, robotics, artificial intelligence, and psychology, is the ultimate application of multimedia technology. Currently, VR technology is being applied in the entertainment sector. Through VR technology, users can experience a more realistic viewing experience. Conventional panoramic videos are viewed from a single point. All content in a panoramic video has the same viewing angle and viewing angle. This prevents users from viewing details of objects of interest. For example, when watching a basketball game, the court and the surrounding spectator seats have the same depth of field, which prevents the court, which should be the focal point, from being fully captured. Users may not be able to clearly see the players' impressive moves, but they can clearly see the surrounding audience. Therefore, how to provide users with a better viewing experience when watching panoramic videos is an urgent issue. [Summary of the invention]
[0003] In order to solve the above problems, embodiments of the present invention provide a panoramic video playback method and related devices, which can enhance the user's viewing experience.
[0004] In a first aspect, an embodiment of the present invention provides a panoramic video playback method, comprising:
[0005] Performing calibration processing on the panoramic video to obtain calibration information corresponding to a target object in the panoramic video, the calibration information including a size, a position, and an adaptive depth of field effective time of the target object;
[0006] When it is monitored that the playback time of the panoramic video matches the adaptive depth of field effective time, obtaining the current viewing angle information of the target user;
[0007] Calculating a scaling parameter of the target object according to the calibration information, and determining a movement parameter of the target object according to current viewing angle information of the target user and the calibration information;
[0008] The position and size of the target object are adjusted according to the scaling parameter and the movement parameter to complete adaptive depth of field processing of the target object.
[0009] In this embodiment of the present invention, the target object is calibrated to obtain calibration information for the target object to be highlighted. Adaptive depth of field processing is triggered when the playback time of the panoramic video matches the adaptive depth of field activation time in the calibration information. This allows the target object to be highlighted, enhancing the user's viewing experience.
[0010] In a possible implementation, performing calibration processing on the panoramic video to obtain calibration information corresponding to the target object in the panoramic video includes:
[0011] Dividing the horizontal angle of the panoramic video into m equal parts and dividing the vertical angle of the panoramic video into n equal parts to partition the panoramic video;
[0012] determining a minimum horizontal angle and a minimum vertical angle of the target object;
[0013] determining a preliminary bisection angle according to the minimum horizontal angle and the minimum vertical angle;
[0014] Calculate the partition where the target object is located according to the prepared equal division angle, the preset multiple and the preset angle;
[0015] The size and position of the target object are determined according to the partition where the target object is located.
[0016] In a possible implementation, calculating the scaling parameter of the target object according to the calibration information includes:
[0017] Obtain the first field of view angle of the panoramic video playback device;
[0018] determining an optimal field of view angle for the panoramic video according to a preset zoom threshold and the first field of view angle;
[0019] A scaling parameter of the target object is determined according to the optimal field of view angle and the size of the target object.
[0020] In a possible implementation, determining a scaling parameter of the target object according to the optimal field of view angle and the size of the target object includes:
[0021] Determining a horizontal scaling parameter of the target object in a horizontal direction and a vertical scaling parameter of the target object in a vertical direction according to the size of the target object and the optimal field of view;
[0022] A scaling parameter of the target object is determined according to the horizontal scaling parameter and the vertical scaling parameter.
[0023] In a possible implementation, determining the scaling parameter of the target object according to the horizontal scaling parameter and the vertical scaling parameter includes:
[0024] determining whether the horizontal scaling parameter and the vertical scaling parameter are both magnification parameters;
[0025] If both the horizontal scaling parameter and the vertical scaling parameter are magnification parameters, the scaling parameter of the target object is determined according to a minimum value of the horizontal scaling parameter and the vertical scaling parameter.
[0026] In a possible implementation, if both the horizontal scaling parameter and the vertical scaling parameter are reduction parameters, the method further includes:
[0027] The scaling parameter of the target object is determined according to a maximum value of the horizontal scaling parameter and the vertical scaling parameter.
[0028] In a possible implementation, determining the movement parameters of the target object according to the current viewing angle information of the target user and the calibration information includes:
[0029] Determine the center point position of the target object according to the calibration information;
[0030] The movement parameters of the target object moving to the center of the target user's viewing angle are calculated according to the current viewing angle information and the center point position.
[0031] In a second aspect, an embodiment of the present invention provides a panoramic video playback device, including:
[0032] a calibration module, configured to perform calibration processing on the panoramic video to obtain calibration information corresponding to a target object in the panoramic video, wherein the calibration information includes the size, position, and adaptive depth of field effective time of the target object;
[0033] A monitoring module, configured to obtain current viewing angle information of a target user when it is detected that the playback time of the panoramic video matches the adaptive depth of field effective time;
[0034] a processing module, configured to calculate a scaling parameter of the target object according to the calibration information, and determine a movement parameter of the target object according to current viewing angle information of the target user and the calibration information;
[0035] The processing module is further configured to adjust the position and size of the target object according to the scaling parameter and the movement parameter, so as to complete adaptive depth of field processing of the target object.
[0036] In a third aspect, an embodiment of the present invention provides an electronic device, including:
[0037] at least one processor; and
[0038] at least one memory in communication with the processor, wherein:
[0039] The memory stores program instructions that can be executed by the processor, and the processor calls the program instructions to execute the methods described in the first to fourth aspects.
[0040] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and the computer instructions enable the computer to execute the methods described in the first and second aspects.
[0041] It should be understood that the method described in the fourth aspect of the embodiment of the present invention is consistent with the technical solutions of the first and second aspects of the embodiment of the present invention, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated.
Brief Description of the Drawings
[0042] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0043] Figure 1 A flowchart of a panoramic video playback method provided by an embodiment of the present invention;
[0044] Figure 2 A schematic diagram of a panoramic video format provided by an embodiment of the present invention;
[0045] Figure 3 A schematic diagram of a panoramic video partition provided by an embodiment of the present invention;
[0046] Figure 4 A schematic structural diagram of a panoramic video playback device provided by an embodiment of the present invention;
[0047] Figure 5 A schematic structural diagram of an electronic device provided by an embodiment of the present invention. [Specific implementation method]
[0048] In order to better understand the technical solutions of this specification, the embodiments of the present invention are described in detail below with reference to the accompanying drawings.
[0049] It should be clear that the embodiments described are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.
[0050] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments and are not intended to limit this specification. The singular forms "a", "an", "the" and "the" used in the embodiments of the present invention and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise.
[0051] In an embodiment of the present invention, the size, position and adaptive depth of field effective time of the target object are obtained by calibrating the panoramic video, and the scaling parameters and movement parameters of the target object are calculated when it is monitored that the current playback time matches the adaptive depth of field effective time, thereby automatically performing adaptive depth of field processing and improving the user's viewing experience.
[0052] Figure 1 Flowchart of a panoramic video playback method provided by an embodiment of the present invention. Figure 1 As shown, the method includes:
[0053] Step 101: Calibrate the panoramic video to obtain the calibration information corresponding to the target object in the panoramic video. The calibration information includes the size, position and adaptive depth of field effective time of the target object. The target object is the object that needs to be displayed in a focused manner by depth of field processing, such as a player in a basketball game video. Since the panoramic video format is often 360°+180°, such as Figure 2 As shown in . Stereoscopic 360° videos are divided into left-eye and right-eye videos, both of which are standard 360°+180° panoramic videos. Therefore, for stereoscopic 360° videos, calibration can be performed on the left-eye and right-eye videos separately. Alternatively, calibration can be performed on only the left-eye or right-eye video. During calibration, the panoramic video can be partitioned by dividing the horizontal angle into m equal parts and the vertical angle into n equal parts.
[0054] Since the standard format of panoramic video has an aspect ratio of 2 to 1, m = 2n. That is, the horizontal angle of the panoramic video is divided into 2n equal parts, and the vertical angle of the panoramic video is divided into n equal parts. The panoramic video after partitioning is as follows Figure 3As shown, the angle in the horizontal direction after equal division ranges from -180° to 180°, and each equal division angle is 360° / 2n. The angle in the vertical direction after equal division ranges from -190° to 90°, and each equal division angle is 180° / n. Afterwards, the minimum horizontal angle and the minimum vertical angle of the target object are determined. Among them, the minimum horizontal angle is the angle of the leftmost edge position of the target object in the horizontal direction of the panoramic video, and the minimum vertical angle is the angle of the topmost edge position of the target object in the vertical direction of the panoramic screen. Afterwards, the preliminary equal division angle is determined according to the minimum horizontal angle and the minimum vertical angle. The partition where the target object is located is calculated based on the preliminary equal division angle, the preset multiple and the preset angle. The preset multiple is the multiple by which the divided angle is magnified in order to improve the accuracy and quality of the equal division. Optionally, in order to enable the angle to be completely divided into equal parts, the total number n of preliminary equal divisions is equal to the value divided by 1 plus 1. That is Where α is the minimum vertical angle, and β is the minimum horizontal angle. Once the value of n is determined, the panoramic video can be partitioned. The target object is then located in multiple partitions, and its size and position are determined based on the partition. The adaptive depth of field activation time can be set via preconfigured settings or manually entered by the user.
[0055] Step 102, when it is monitored that the playback time of the panoramic video matches the adaptive depth of field effective time, the current viewing angle information of the target user is obtained. Among them, the playback time of the panoramic video is the current playback progress, which can be implemented in the form of a timeline. For example, the duration of the panoramic video is 2 hours, and the adaptive depth of field effective time corresponding to the target object is 1 hour, 12 minutes and 2 seconds. When the current playback progress of the panoramic video is monitored to be 1 hour, 12 minutes and 2 seconds, it can be determined that the playback time of the panoramic video matches the adaptive depth of field effective time, and the current viewing angle information of the target user is obtained. Among them, the current viewing angle information can be the current viewing angle center coordinate information of the target user.
[0056] Step 103, calculate the scaling parameters of the target object based on the calibration information, and determine the movement parameters of the target object based on the current viewing angle information and calibration information of the target user. Among them, the edge area of the field of view (FOV) supported by the VR device is generally between 90°-110°, and the user cannot view the edge area as clearly as the center area of the FOV, so it is necessary to re-determine the optimal FOV to ensure the clarity of the target object that is not in the center area of the FOV, and calculate the scaling parameters of the target object. Therefore, the first field of view of the panoramic video playback device (VR device) can be obtained first. Then, the optimal field of view is determined for the panoramic video based on the preset scaling threshold and the first field of view. The FOV supported by the panoramic video playback device is reduced by the preset scaling threshold to ensure the effect of the optimal FOV. Optionally, the value of the preset scaling threshold can be 0.6-0.8. That is, the FOV supported by the panoramic video playback device is reduced to 0.6 to 0.8 times the original, and the optimal FOV is recorded as (a×F x , a×F y ).
[0057] Afterwards, the scaling parameters of the target object can be determined based on the optimal viewing angle and the size of the target object. Specifically, the horizontal scaling parameters of the target object in the horizontal direction and the vertical scaling parameters in the vertical direction can be determined based on the size of the target object and the optimal viewing angle. Afterwards, the scaling parameters of the target object can be determined based on the horizontal scaling parameters and the vertical scaling parameters. Wherein, the size of the target object is denoted as (b x ×n,b y ×n), where n is the minimum angle after partitioning during the calibration process. The horizontal scaling parameters and vertical scaling parameters of the target object can be obtained by calculating the ratio of the target object display size to the optimal FOV. Specifically, Among them, scale x is the horizontal scaling parameter, scale y is the vertical scaling parameter. A scale value greater than 1 indicates proximity to the object, while a scale value less than 1 indicates distance from the object. The scale value range is determined by the radius of the panoramic video. If the radius of the panoramic video is denoted as R, the range of distance variation is (R×0.5, R×2), and the scale value range is (0.5, 2).
[0058] In some embodiments, the scaling parameter of the target object can be determined based on whether the horizontal scaling parameter and the vertical scaling parameter are magnification parameters or reduction parameters. Specifically, it is determined whether the horizontal scaling parameter and the vertical scaling parameter are both magnification parameters. If the horizontal scaling parameter and the vertical scaling parameter are both magnification parameters, the scaling parameter of the target object is determined based on the minimum value of the horizontal scaling parameter and the vertical scaling parameter. For example, if the scale x and scale y If both are greater than 1, it means that they are all magnification parameters, and you can use scale x and scale y The minimum value in determines the scaling parameter of the target object. Specifically, the scaling parameter of the target object = min(max(min(scale x ,scale y ),0.5),2). If scale x and scale y If both are greater than 1, it means that they are all magnification parameters. In this case, you can use scale x and scale y The maximum value among determines the scaling parameter of the target object. Specifically, the scaling parameter of the target object = min(max(max(scale x ,scale y ),0.5),2). In this way, the scaling parameters of the target object are limited to the optimal scaling range.
[0059] For the movement parameters of the target object, the center point position of the target object can be determined based on the calibration information. Specifically, the center point position of the target object can be calculated based on the size and position information of the target object determined in the calibration information ( x , O y ). Among them, the size of the target object is (b x ×n,b y ×n), the current position of the target object is (c x ×n,c y ×n) Then, the movement parameter of the target object moving to the center of the target user's perspective is calculated based on the current perspective information and the center point position. Specifically, the movement parameter of the target object (M x , M y )=(O x -U x ,O y -U y ).
[0060] Step 104 : adjusting the position and size of the target object according to the scaling parameter and the movement parameter to complete adaptive depth of field processing of the target object.
[0061] The method described in the embodiment of the present invention partitions the panoramic video and calibrates the key areas (the areas where the target objects are located), and calculates the scaling and movement data required for the adaptive depth of field processing when the current playback time is detected to match the adaptive depth of field effective time. This can automatically zoom in or out according to the video content and automatically adjust the display position of the perspective content without user instructions, presenting the content that needs to be highlighted in the panoramic video more clearly and completely to the user's current perspective, thereby improving the user's viewing experience. The method described in the embodiment of the present invention can adapt different adaptive depth of field effects to different areas corresponding to different time periods, the same area corresponding to different time periods, and different areas corresponding to the same time period.
[0062] Corresponding to the above-mentioned panoramic video playback method, an embodiment of the present invention provides a structural diagram of a panoramic video playback device, such as Figure 4 As shown, the device includes: a calibration module 401 , a monitoring module 402 and a processing module 403 .
[0063] The calibration module 401 is used to perform calibration processing on the panoramic video to obtain calibration information corresponding to the target object in the panoramic video. The calibration information includes the size, position and adaptive depth of field effective time of the target object.
[0064] The monitoring module 402 is configured to obtain the current viewing angle information of the target user when it is detected that the playback time of the panoramic video matches the adaptive depth of field effective time.
[0065] The processing module 403 is configured to calculate a scaling parameter of the target object according to the calibration information, and determine a movement parameter of the target object according to the current viewing angle information of the target user and the calibration information.
[0066] The processing module 403 is further configured to adjust the position and size of the target object according to the scaling parameter and the movement parameter to complete adaptive depth of field processing of the target object.
[0067] Figure 4 The mobile terminal provided in the embodiment shown can be used to execute the Figure 1-Figure 3 The technical solution of the method embodiment shown, its implementation principle and technical effects can be further referred to the relevant description in the method embodiment.
[0068] Figure 5 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention is shown in FIG. Figure 5 As shown, the electronic device may include at least one processor and at least one memory in communication with the processor, wherein the memory stores program instructions that can be executed by the processor, and the processor calls the program instructions to execute the instructions in this specification. Figure 1-Figure 3The illustrated embodiment provides a method for playing panoramic videos.
[0069] like Figure 5 As shown, the electronic device is implemented as a general-purpose computing device. Components of the electronic device may include, but are not limited to, one or more processors 510, a communication interface 520, and a memory 530, and a communication bus 540 connecting different system components (including the memory 530, the communication interface 520, and the processing unit 510).
[0070] Communication bus 540 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. Examples of these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnection (PCI) bus.
[0071] Electronic devices typically include a variety of computer system readable media. These media can be any available media that can be accessed by the electronic device, including volatile and non-volatile media, removable and non-removable media.
[0072] Memory 530 may include computer-readable media in the form of volatile memory, such as random access memory (RAM) and / or cache memory. The electronic device may further include other removable / non-removable, volatile / non-volatile computer system storage media. Memory 530 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of various embodiments of this specification.
[0073] A program / utility having a set (at least one) of program modules may be stored in memory 530. Such program modules include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. The program modules generally implement the functions and / or methods of the embodiments described herein.
[0074] The processor 510 executes various functional applications and data processing by running the programs stored in the memory 530, such as implementing the Figure 1-Figure 3 The illustrated embodiment provides a method for playing panoramic videos.
[0075] The embodiment of this specification provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, wherein the computer instructions enable the computer to execute the present specification. Figure 1-Figure 3 The illustrated embodiment provides a method for playing panoramic videos.
[0076] The above-mentioned computer-readable storage medium can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or component, or any combination of the above. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM) or flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, device or device.
[0077] The foregoing description of this specification describes specific embodiments. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that described in the embodiments and still achieve the desired results. Furthermore, the processes depicted in the accompanying drawings do not necessarily require the specific order shown or the sequential order to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0078] In the description of this specification, the reference terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" mean that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of this specification. In this specification, the schematic expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine different embodiments or examples described in this specification and features of different embodiments or examples without contradiction.
[0079] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of the technical features being referred to. Thus, a feature specified as "first" or "second" may explicitly or implicitly include at least one such feature. Throughout this specification, "plurality" means at least two, such as two or three, unless otherwise specifically defined.
[0080] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of this specification includes alternative implementations in which functions may be performed out of the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of this specification belong.
[0081] The word "if," as used herein, may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to the determination" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)," depending on the context.
[0082] It should be noted that the devices involved in the embodiments of this specification may include but are not limited to personal computers (Personal Computer; hereinafter referred to as: PC), personal digital assistants (Personal Digital Assistant; hereinafter referred to as: PDA), wireless handheld devices, tablet computers (Tablet Computer), mobile phones, MP3 displays, MP4 displays, etc.
[0083] In the several embodiments provided in this specification, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed may be through some interface, indirect coupling or communication connection of devices or units, which may be electrical, mechanical or other forms.
[0084] In addition, the functional units in the various embodiments of this specification may be integrated into a single processing unit, each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or hardware plus software functional units.
[0085] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium and includes a number of instructions for causing a computer device (which can be a personal computer, a connector, or a network device, etc.) or a processor to execute some steps of the method described in each embodiment of this specification. The aforementioned storage medium includes: a USB flash drive, a mobile hard disk, a read-only memory (hereinafter referred to as: ROM), a random access memory (hereinafter referred to as: RAM), a magnetic disk or an optical disk, and other media that can store program code.
[0086] The above description is only a preferred embodiment of this specification and is not intended to limit this specification. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of this specification should be included in the scope of protection of this specification.
Claims
1. A panoramic video playback method, characterized in that: include: Performing calibration processing on the panoramic video to obtain calibration information corresponding to a target object in the panoramic video, the calibration information including a size, a position, and an adaptive depth of field effective time of the target object; When it is monitored that the playback time of the panoramic video matches the adaptive depth of field effective time, obtaining the current viewing angle information of the target user; Calculating a scaling parameter of the target object according to the calibration information, and determining a movement parameter of the target object according to current viewing angle information of the target user and the calibration information; The position and size of the target object are adjusted according to the scaling parameter and the movement parameter to complete adaptive depth of field processing of the target object.
2. The method according to claim 1, characterized in that Calibration processing is performed on the panoramic video to obtain calibration information corresponding to the target object in the panoramic video, including: Dividing the horizontal angle of the panoramic video into m equal parts and dividing the vertical angle of the panoramic video into n equal parts to partition the panoramic video; determining a minimum horizontal angle and a minimum vertical angle of the target object; determining a preliminary bisection angle according to the minimum horizontal angle and the minimum vertical angle; Calculate the partition where the target object is located according to the prepared equal division angle, the preset multiple and the preset angle; The size and position of the target object are determined according to the partition where the target object is located.
3. The method according to claim 1, characterized in that Calculating a scaling parameter of the target object according to the calibration information includes: Obtain the first field of view angle of the panoramic video playback device; determining an optimal field of view angle for the panoramic video according to a preset zoom threshold and the first field of view angle; A scaling parameter of the target object is determined according to the optimal field of view angle and the size of the target object.
4. The method according to claim 3, characterized in that Determining a scaling parameter of the target object according to the optimal field of view angle and the size of the target object includes: Determining a horizontal scaling parameter of the target object in a horizontal direction and a vertical scaling parameter of the target object in a vertical direction according to the size of the target object and the optimal field of view; A scaling parameter of the target object is determined according to the horizontal scaling parameter and the vertical scaling parameter.
5. The method according to claim 4, characterized in that Determining the scaling parameter of the target object according to the horizontal scaling parameter and the vertical scaling parameter includes: determining whether the horizontal scaling parameter and the vertical scaling parameter are both magnification parameters; If both the horizontal scaling parameter and the vertical scaling parameter are magnification parameters, the scaling parameter of the target object is determined according to a minimum value of the horizontal scaling parameter and the vertical scaling parameter.
6. The method according to claim 5, characterized in that If both the horizontal scaling parameter and the vertical scaling parameter are reduction parameters, the method further includes: The scaling parameter of the target object is determined according to a maximum value of the horizontal scaling parameter and the vertical scaling parameter.
7. The method according to claim 1, characterized in that Determining the movement parameters of the target object according to the current viewing angle information of the target user and the calibration information includes: Determine the center point position of the target object according to the calibration information; The movement parameters of the target object moving to the center of the target user's viewing angle are calculated according to the current viewing angle information and the center point position.
8. A panoramic video playback device, characterized in that: include: a calibration module, configured to perform calibration processing on the panoramic video to obtain calibration information corresponding to a target object in the panoramic video, wherein the calibration information includes the size, position, and adaptive depth of field effective time of the target object; A monitoring module, configured to obtain current viewing angle information of a target user when it is detected that the playback time of the panoramic video matches the adaptive depth of field effective time; a processing module, configured to calculate a scaling parameter of the target object according to the calibration information, and determine a movement parameter of the target object according to current viewing angle information of the target user and the calibration information; The processing module is further configured to adjust the position and size of the target object according to the scaling parameter and the movement parameter, so as to complete adaptive depth of field processing of the target object.
9. An electronic device, characterized in that: include: at least one processor; as well as at least one memory in communication with the processor, wherein: The memory stores program instructions that can be executed by the processor, and the processor can execute the method according to any one of claims 1 to 7 by calling the program instructions.
10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions enable the computer to execute the method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Virtual picture control method and device, terminal equipment and storage medium
CN110456907A
Panoramic video playing method and device
CN111954003A
Image adjustment method and device, storage medium and mixed reality equipment
CN118233619A