VR video playing processing method and device, electronic equipment and storage medium

Abstract

The invention provides a VR video playing processing method and device, electronic equipment and a storage medium. The method comprises the following steps: in response to switching of a visual angle field in a VR video playing process, obtaining switching data of the visual angle field; based on the switching data, determining a tile type of a target tile in the view field after switching; based on the tile type, determining a repetition value of the playing frame number of the next frame of video of the target tile, the repetition value being used for indicating the repetition display frequency of the next frame of video; and determining candidate video data of a plurality of different key frame intervals, and determining target video data from the candidate video data based on the repetition value so as to play the target video data in the target tile. Therefore, according to the scheme, the video data of different key frame intervals can be dynamically called according to the type of the tile in the view angle field, so that the effects of dynamically adjusting the downloading bandwidth and reducing the video playing delay in the view angle during view angle switching are achieved, and the visual experience of a user is improved.

Description

Technical Field

[0001] This application relates to the field of video transmission technology, and in particular to a processing method, apparatus, electronic device and storage medium for VR video playback. Background Technology

[0002] Currently, virtual reality (VR) players based on the field of view (FOV) employ a dual-stream approach: one stream is a low-resolution, full-keyframe stream covering the entire view, and the other is a high-resolution hybrid video stream within the field of view. This combination of a low-quality full-view stream and a high-quality viewable area is used to display the VR visuals. When the user's head-mounted display (HMD) changes its viewing angle, the VR player determines the content to play in the next frame based on the FOV change data.

[0003] To ensure smooth transitions and reduce latency when the user's viewpoint changes, the number of keyframes in the high-definition hybrid video frame stream within that viewpoint is increased, thus reducing the keyframe interval. However, increasing the number of keyframes leads to a larger video stream size, increasing network bandwidth usage. If the keyframe interval is too large, the decoding wait time during viewpoint changes is longer, increasing playback latency and causing the user to perceive a blurred field of vision, resulting in a poor user experience. Summary of the Invention

[0004] The purpose of this application is to at least partially solve one of the technical problems in the related art.

[0005] Therefore, the first objective of this application is to propose a VR video playback processing method to dynamically call video data at different keyframe intervals based on the type of tiles in the viewpoint field.

[0006] The second objective of this application is to provide a processing device for VR video playback.

[0007] The third objective of this application is to propose an electronic device.

[0008] The fourth objective of this application is to provide a computer-readable storage medium.

[0009] To achieve the above objectives, a first aspect of this application proposes a VR video playback processing method, comprising: in response to a viewpoint field switching during VR video playback, acquiring viewpoint field switching data; determining the tile type of a target tile within the switched viewpoint field based on the switching data; determining a repetition value of the next frame video playback frame number of the target tile based on the tile type, the repetition value indicating the number of times the next frame video is displayed repeatedly; determining multiple candidate video data with different keyframe intervals, and determining target video data from the candidate video data based on the repetition value, so as to play the target video data in the target tile.

[0010] To achieve the above objectives, a second aspect of this application provides a processing apparatus for VR video playback, comprising: an acquisition module, configured to acquire view field switching data in response to a view field switching during VR video playback; a first determination module, configured to determine the tile type of a target tile within the switched view field based on the switching data; a second determination module, configured to determine a repetition value of the next frame video playback frame number of the target tile based on the tile type, the repetition value indicating the number of times the next frame video is displayed repeatedly; and a third determination module, configured to determine multiple candidate video data with different keyframe intervals, and determine target video data from the candidate video data based on the repetition value, so as to play the target video data in the target tile.

[0011] To achieve the above objectives, a third aspect of this application provides an electronic device, including: a processor; and a memory communicatively connected to the processor; the memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory to enable the processor to perform the VR video playback processing method described in the first aspect of the application.

[0012] To achieve the above objectives, a fourth aspect of this application provides a computer-readable storage medium having a computer program stored thereon, the computer instructions being used to cause the computer to execute the VR video playback processing method described in the above aspect of the embodiment.

[0013] The VR video playback processing method, apparatus, electronic device, and storage medium provided in this application determine the tile type of the target tile within the switched viewpoint field from the viewpoint field switching data, and then determine the repetition value of the next frame video playback frame number of the target tile based on the tile type. Furthermore, based on the repetition value, the target video data can be determined from candidate video data with different keyframe intervals and played. Therefore, this solution can dynamically call video data with different keyframe intervals according to the tile type within the viewpoint field, achieving dynamic adjustment of download bandwidth and reducing video playback latency within the viewpoint during viewpoint switching, thereby improving the user's visual experience.

[0014] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0015] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein: Figure 1 A flowchart illustrating a VR video playback processing method provided in an embodiment of this application; Figure 2 This is a schematic flowchart illustrating another VR video playback processing method provided in an embodiment of this application. Figure 3 This is a schematic diagram illustrating the mapping relationship between the next frame video playback frame number, repetition value, and keyframe interval provided in an embodiment of this application. Figure 4 This is a schematic flowchart illustrating another VR video playback processing method provided in an embodiment of this application. Figure 5 A schematic diagram of the target tile within the field of view provided in the embodiments of this application; Figure 6 A schematic diagram illustrating the repetition values ​​of different frame numbers provided in the embodiments of this application; Figure 7 This is a schematic diagram of the structure of a VR video playback processing device provided in an embodiment of this application. Detailed Implementation

[0016] The embodiments of this application are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application.

[0017] The processing method and apparatus for VR video playback according to embodiments of this application are described below with reference to the accompanying drawings.

[0018] It should be noted that in panoramic image or video processing, in order to efficiently store, transmit, and render high-resolution 360-degree content, the entire field of view is divided into multiple small blocks, which are often referred to as "tiles" in technical implementation. Each tile is a local area of ​​the panoramic image, and the complete panoramic image can be reconstructed by stitching together multiple tiles.

[0019] Figure 1 This is a flowchart of a VR video playback processing method provided according to an embodiment of this application, such as... Figure 1 As shown, the VR video playback processing method of this application embodiment includes, but is not limited to, the following steps: S101, in response to the switching of view field during VR video playback, acquires view field switching data.

[0020] It should be noted that the VR video playback processing method provided in this application embodiment is executed by an electronic device, which can be a Virtual Reality (VR) video player. Optionally, the VR video player can be a VR headset. This application embodiment does not impose specific limitations.

[0021] In some embodiments, when a user moves while wearing a VR video player and the VR video player is playing a VR video, the user's perspective will change, resulting in a switching of the field of view during the VR video process.

[0022] In some embodiments, each view field consists of multiple tiles, and the switching data of the view field can be determined based on the tiles within the switched view field. Optionally, the tile identifiers of the tiles within the switched view field can be obtained, and the switching data can be generated based on the tile identifiers.

[0023] It should be noted that when users obtain a 360-degree, all-around, and blind-spot-free visual experience in a virtual environment, VR videos provide users with a complete perspective, which includes multiple viewpoints.

[0024] If the user turns to the left, the viewpoint also moves to the left, and the viewpoint field will switch. For example, a viewpoint contains 3 viewpoint fields. When the user is looking straight ahead, it is viewpoint 1, and the viewpoint fields in viewpoint 1 are viewpoint field A, viewpoint field B, and viewpoint field C. When the user turns to the left, it is viewpoint 2, and the viewpoint fields in viewpoint 2 are viewpoint field B, viewpoint field C, and viewpoint field D.

[0025] In other words, during VR video playback, when the user turns to the left, the field of view switches from field of view A, field of view B, and field of view C to field of view B, field of view C, and field of view D. The tile identifiers within field of view A, field of view B, field of view C, and field of view B, field of view C, and field of view D can be obtained as data for the switching of the field of view.

[0026] S102, Based on the switching data, determine the tile type of the target tile in the switched field of view.

[0027] In some embodiments, there are multiple tiles in the field of view. When there is a field of view switching, the tiles in the field of view before the switch and the field of view after the switch may be duplicated. The tile type of the target tile can be determined based on whether the target tile in the field of view after the switch is duplicated with the tile in the field of view before the switch.

[0028] In some embodiments, the first tile identifier of the target tile and the second tile identifier of the tile in the field of view before the switch can be obtained from the switching data. Then, it can be determined whether the target tile is a duplicate of the tile in the field of view before the switch based on whether the first tile identifier is the same as the second tile identifier.

[0029] In some embodiments, the first tile identifier of the target tile and the second tile identifier of the tile in the field of view before the switch can be obtained from the switching data. If there is a second tile identifier that is the same as the first tile identifier, it can be determined that the target tile is the same as the tile in the field of view before the switch.

[0030] In some embodiments, the tile type of the target tile that is the same as the tile in the field of view before the switch can be used as the first type, and the target tile that is not the same as the target tile can be used as the second type. For example, the first type is new tile, and the second type is old tile.

[0031] S103, based on the tile type, determine the repetition value of the next frame video playback frame number of the target tile. The repetition value is used to indicate the number of times the next frame video is displayed repeatedly.

[0032] In some embodiments, a correspondence between different tile types and repetition values ​​can be preset, and after the tile type of the target tile is determined, the repetition value of the next frame video playback frame number of the target tile can be determined by querying the correspondence.

[0033] In some embodiments, the repetition value indicates the number of times the next frame of video is displayed. If the repetition value is 0, it means that the next frame of video is displayed once. If the repetition value is 1, it means that the next frame of video is displayed once, for a total of 2 times.

[0034] In some embodiments, if the tile type is a first type, the repetition value corresponding to the first type is a first set value; if the tile type is a second type, the repetition value corresponding to the second type is increased by a second set value. For example, if the target tile is a new tile, the repetition value of the next video playback frame number of the target tile is set to 0; if the target tile is an old tile, the repetition value of the next video playback frame number of the target tile is increased by 1.

[0035] In some embodiments, if there is no change in the view field after the view field switch, the repetition value of the next frame video playback frame number of the second type of target tile continues to increase by the second set value.

[0036] S104, determine multiple candidate video data with different keyframe intervals, and determine the target video data from the candidate video data based on the repetition value, so as to play the target video data in the target tile.

[0037] In some embodiments, for the same video content, multiple candidate video data with different keyframe intervals can be obtained by pre-encoding the video content. The candidate video data have the same video frame rate but different keyframe intervals.

[0038] For example, there are three candidate video data sets: H1, H2, and H3. H1 has a video frame rate of 40 FPS and a keyframe interval of 10. H2 has a video frame rate of 40 FPS and a keyframe interval of 20. H3 has a video frame rate of 40 FPS and a keyframe interval of 40.

[0039] In some embodiments, if the repetition value is a first preset value, the candidate video data with the smallest keyframe interval can be selected from the candidate video data as the target video data, and the target video data can be played in the target tile. In the example above, if the repetition value is the first preset value, then H1 is determined to be the target video data.

[0040] In some embodiments, if the repetition value is the repetition value after adding a second set value, then according to the pre-established mapping relationship between the next frame video playback frame number, the repetition value and the keyframe interval, after determining the repetition value and the next frame video playback frame number, the target keyframe interval of the target video data can be determined by querying the mapping relationship, thereby determining the candidate video data with the keyframe interval of the target keyframe interval from the candidate video data as the target video data.

[0041] It should be noted that when playing the target video data, you can switch to decoding and playing the target video data after waiting for the set number of frames to play. For example, you can wait for the playback duration of frames 0-9. If the current frame's playback frame number is n, then the target video data will be played when the next frame's playback frame number is 10n.

[0042] In some embodiments, when the next keyframe of the target video data is decoded and played, a panoramic low-definition full keyframe stream video transition can be used to improve the smoothness of video playback.

[0043] It should be noted that when the field of view does not change, the repetition value of the target tile within the field of view increases continuously. This allows video data with large keyframe intervals to be gradually retrieved for decoding and playback, thereby reducing network download bandwidth.

[0044] In the VR video playback processing method provided in this application embodiment, the tile type of the target tile within the switched view field is determined from the view field switching data, and the repetition value of the next frame video playback frame number of the target tile is determined based on the tile type. Furthermore, based on the repetition value, the target video data can be determined from candidate video data with different keyframe intervals and played. Therefore, this solution can dynamically call video data with different keyframe intervals according to the tile type within the view field, achieving dynamic adjustment of download bandwidth and reducing video playback latency within the view field during view switching, thereby improving the user's visual experience.

[0045] Figure 2This is a flowchart of a VR video playback processing method provided according to an embodiment of this application, such as... Figure 2 As shown, the VR video playback processing method of this application embodiment includes, but is not limited to, the following steps: S201, in response to the switching of view field during VR video playback, acquire view field switching data.

[0046] S202, Based on the switching data, determine the tile type of the target tile in the field of view after the switch.

[0047] S203, based on the tile type, determine the repetition value of the next frame video playback frame number of the target tile. The repetition value is used to indicate the number of times the next frame video is displayed repeatedly.

[0048] S204, determine multiple candidate video data with different keyframe intervals.

[0049] In the embodiments of this application, steps S201-S204 can be implemented in any of the embodiments of this application, and no limitation is made here, nor will it be described in detail.

[0050] S205, in response to the repetition value satisfying the first set condition, candidate video data with a keyframe interval of the first interval is determined from the candidate video data and used as the target video data.

[0051] S206, in response to the repetition value satisfying the second set condition, the target video data is determined from the candidate video data based on the next frame video playback frame number and the repetition value of the target tile.

[0052] In some embodiments, a first setting condition and a second setting condition can be determined based on the magnitude of the repetition value, wherein the first setting condition can be that the repetition value is a first setting value, and the second setting condition can be that the repetition value is greater than or equal to a second setting value.

[0053] In some embodiments, if the repetition value meets the first set condition, it means that the repetition value is the first set value, and candidate video data with a keyframe interval of the first interval can be determined from the candidate video data as target video data.

[0054] In some embodiments, if the repetition value meets a second preset condition, it means that the repetition value is greater than or equal to the second preset value. In this case, the target video data can be determined from the candidate video data according to the mapping relationship between the next video playback frame number, the repetition value, and the keyframe interval. In some embodiments, the target video data is determined from the candidate video data by obtaining a pre-established mapping relationship between the next video playback frame number, the repetition value, and the keyframe interval, and querying the mapping relationship based on the next video playback frame number and the repetition value of the target tile.

[0055] For example, the mapping relationship between the next frame video playback frame number, repetition value, and keyframe interval is as follows: Figure 3 As shown, Figure 3 In this context, I-frame represents a keyframe, n is a non-negative integer, x is 1 to 9, repeat represents a repetition value, and H1, H2, and H3 refer to candidate video data. The period of H1 is 10, which means the keyframe interval is 10; the period of H2 is 20, which means the keyframe interval is 20; and the period of H3 is 40, which means the keyframe interval is 40.

[0056] Let the next frame of the video playback for the target tile be 40n+x+repeat-1. If repeat=3, according to... Figure 3 The target video data can be identified as H1. If repeat=20, according to... Figure 3 It can be determined that the target video data is H2. If repeat=55, according to Figure 3 The target video data can be identified as H3.

[0057] In some embodiments, when a user is very interested in the content within a certain viewpoint, the viewpoint field may remain unchanged for a long time or change slightly. In this case, the repetition value of the target tile of the second type within the viewpoint field will continue to increase, and the target video data to be played can be switched.

[0058] In some embodiments, it can be determined whether the repetition value and the next frame video playback frame number meet the switching conditions of the video data, and if the switching conditions are met, candidate video data with different keyframe intervals can be switched and played.

[0059] In some embodiments, the switching conditions for video data include a first switching condition, a second switching condition, and a third switching condition. The first switching condition may be that the repetition value is within a first range; the second switching condition may be that the repetition value is within a second range, and the next frame of video playback is a keyframe of candidate video data in a second interval; the third switching condition may be that the repetition value is within a third range, and the next frame of video playback is a keyframe of candidate video data in a third interval.

[0060] In some embodiments, in response to satisfying a first switching condition, candidate video data with a keyframe interval of a first interval is played in the target tile; in response to satisfying a second switching condition, candidate video data with a keyframe interval of a second interval is played in the target tile; and in response to satisfying a third switching condition, candidate video data with a keyframe interval of a third interval is played in the target tile.

[0061] In some embodiments, in response to the failure to meet a second switching condition, candidate video data with a keyframe interval of a first interval is continued to be played in the target tile; in response to the failure to meet a third switching condition, candidate video data with a keyframe interval of a second interval is continued to be played in the target tile.

[0062] It should be noted that the first interval is smaller than the second interval, which is smaller than the third interval. The larger the repetition value, the larger the keyframe interval of the target video data.

[0063] For example, the candidate video data for the first interval is H1, the candidate video data for the second interval is H2, and the candidate video data for the third interval is H3. The first range is 1-10, the second range is 11-40, and the third range is greater than 31.

[0064] In other words, when 1 ≤ repetition value ≤ 10, keep video H1 playing; When 11≤repetition value≤40, if the next frame of video playback is an I-frame of H2 high-definition video, then switch to H2 video playback; otherwise, keep playing H1 video. When the repetition value is ≥31, if the next frame of video playback is an I-frame of H3 high-definition video, then switch to H3 video playback; otherwise, keep playing H2 video.

[0065] In the VR video playback processing method provided in this application embodiment, it is determined whether the repetition value meets a first set condition and a second set condition. When the first set condition is met, candidate video data with a keyframe interval of the first interval is determined as target video data. When the second set condition is met, the target video data can be determined according to a pre-established mapping relationship. During video playback, if the viewpoint field does not switch, video data with a large keyframe interval can be gradually called for playback, thereby reducing the amount of data transmission, optimizing storage space, reducing bandwidth, and improving the smoothness and response speed of video playback.

[0066] Figure 4 This is a flowchart of a VR video playback processing method provided according to an embodiment of this application, such as... Figure 4 As shown, the VR video playback processing method of this application embodiment includes, but is not limited to, the following steps: S401, in response to the switching of view field during VR video playback, acquires view field switching data.

[0067] In the embodiments of this application, step S401 can be implemented in any of the ways described in the embodiments of this application. This is not limited here and will not be described in detail.

[0068] S402, based on the switching data, determine whether the target tile in the field of view after the switch is the same as the tile in the field of view before the switch.

[0069] In some embodiments, the switching data may include tile identifiers, so that it can be determined whether the target tile in the switched field of view is the same as the tile in the field of view before the switch based on whether the first tile identifier of the target tile is the same as the second tile identifier of the tile in the field of view before the switch.

[0070] In some embodiments, if they are the same, it can be determined that the target tile in the switched field of view is the same as the tile in the field of view before the switch; if they are different, it can be determined that the target tile in the switched field of view is not the same as the tile in the field of view before the switch.

[0071] S403, in response to the fact that the tile does not overlap with the tile in the view field before the switch, determines that the tile type of the target tile is the first type.

[0072] S404, in response to the repetition of tiles in the view field before the switch, determines that the tile type of the target tile is the second type.

[0073] For example, the complete view of a VR video can be divided into 16*8 tiles according to the set rules, where each view contains 9 tiles.

[0074] like Figure 5 A schematic diagram of the target tile within the field of view shown. Figure 5 The tiles within the solid-lined box (column 5, row 3 to column 7, row 5) are the target tiles, and their corresponding first tile identifiers are: a53, a54, a55, a63, a64, a65, a73, a74, a75; the tiles within the dashed-lined box (column 3, row 3 to column 5, row 5) are the tiles in the field of view before the switch, and their corresponding second tile identifiers are: a33, a34, a35, a43, a44, a45, a53, a54, a55.

[0075] From Figure 5 If a53, a54, and a55 are determined to be duplicates, then the tile type of the corresponding target tile is type two; and from... Figure 5 If it is determined that a63, a64, a65, a73, a74, and a75 are not repeated, then the tile type of the target tile corresponding to them is the first type.

[0076] S405, based on the tile type, determines the repetition value of the next frame video playback frame number of the target tile. The repetition value is used to indicate the number of times the next frame video is displayed repeatedly.

[0077] In some embodiments, in response to the tile type being a first type, the repetition value of the next frame video playback frame number of the target tile is determined to be a first preset value. In response to the tile type being a second type, the repetition value of the next frame video playback frame number of the target tile is increased by a second preset value.

[0078] Figure 6 The diagram shows the repetition values ​​for different frame numbers. Figure 6 The next frame of video playback includes frame number 2, frame number 3, and frame number 4. If the target tile corresponding to frame number 2 is of type 1, then its repeat value repeat=0; if the target tile corresponding to frame number 3 is of type 2, then its repeat value repeat=repeat+1; if the target tile corresponding to frame number 3 is of type 2, then its repeat value repeat=repeat+1.

[0079] Figure 6 In the text, 0 represents the first setting value, and 1 represents the second setting value.

[0080] S406, determine multiple candidate video data with different keyframe intervals, and determine target video data from the candidate video data based on the repetition value, so as to play the target video data in the target tile.

[0081] In the embodiments of this application, step S406 can be implemented in any of the ways described in the various embodiments of this application. This is not limited here and will not be described in detail.

[0082] In the VR video playback processing method provided in this application embodiment, based on the switching data of the view field, it is determined whether there is tile repetition. The tile type of the target tile is determined based on whether the tile is repetitive, and then the repetition value of the next frame video playback frame number of the target tile is determined based on the tile type. This allows for the retrieval of video data with different keyframe intervals for different target tiles based on their repetition values ​​within the view field, thereby dynamically adjusting the download bandwidth and reducing playback latency.

[0083] Corresponding to the VR video playback processing methods proposed in the above embodiments, one embodiment of this application also proposes a VR video playback processing device. Since the VR video playback processing device proposed in this application corresponds to the VR video playback processing methods proposed in the above embodiments, the implementation methods of the above VR video playback processing methods are also applicable to the VR video playback processing device proposed in this application, and will not be described in detail in the following embodiments.

[0084] Figure 7 This is a schematic diagram of the structure of a VR video playback processing device provided in an embodiment of this application.

[0085] like Figure 7 As shown, the VR video playback processing device 700 includes: The acquisition module 701 is used to acquire the switching data of the view field in response to the switching of the view field during VR video playback. The first determining module 702 is used to determine the tile type of the target tile in the switched field of view based on the switching data; The second determining module 703 is used to determine the repetition value of the next frame video playback frame number of the target tile based on the tile type, wherein the repetition value is used to indicate the number of times the next frame video is displayed repeatedly; The third determining module 704 is used to determine multiple candidate video data with different keyframe intervals, and determine target video data from the candidate video data based on the repetition value, so as to play the target video data in the target tile.

[0086] In one possible implementation of this application embodiment, the third determining module 704 is further configured to: in response to the repetition value satisfying a first set condition, determine candidate video data from the candidate video data whose keyframe interval is a first interval, and use it as the target video data.

[0087] In one possible implementation of this application embodiment, the third determining module 704 is further configured to: in response to the repetition value satisfying the second set condition, determine target video data from the candidate video data based on the next frame video playback frame number of the target tile and the repetition value.

[0088] In one possible implementation of this application embodiment, the third determining module 704 is further configured to: obtain a pre-established mapping relationship between the next frame video playback frame number, the repetition value, and the keyframe interval; and query the mapping relationship based on the next frame video playback frame number and the repetition value of the target tile to determine the target video data from the candidate video data.

[0089] In one possible implementation of this application embodiment, the third determining module 704 is further configured to: determine whether the repetition value and the next frame video playback frame number satisfy the video data switching condition; in response to satisfying the first switching condition, play candidate video data with the keyframe interval of the first interval in the target tile; in response to satisfying the second switching condition, play candidate video data with the keyframe interval of the second interval in the target tile; and in response to satisfying the third switching condition, play candidate video data with the keyframe interval of the third interval in the target tile.

[0090] In one possible implementation of this application embodiment, the third determining module 704 is further configured to: in response to the second switching condition not being met, maintain the playback of candidate video data with the keyframe interval of the first interval in the target tile; and in response to the third switching condition not being met, maintain the playback of candidate video data with the keyframe interval of the second interval in the target tile.

[0091] In one possible implementation of this application embodiment, the first determining module 702 is further configured to: determine, based on the switching data, whether the target tile in the switched field of view is the same as the tile in the field of view before the switch; in response to the tile being the same as the tile in the field of view before the switch, determine that the tile type of the target tile is a first type; and in response to the tile not being the same as the tile in the field of view before the switch, determine that the tile type of the target tile is a second type.

[0092] In one possible implementation of this application embodiment, the second determining module 703 is further configured to: in response to the tile type being the first type, determine the repetition value of the next frame video playback frame number of the target tile as a first preset value; and in response to the tile type being the second type, increase the repetition value of the next frame video playback frame number of the target tile by a second preset value.

[0093] In the VR video playback processing apparatus provided in this application embodiment, the tile type of the target tile within the switched view field is determined from the view field switching data, and the repetition value of the next frame video playback frame number of the target tile is determined based on the tile type. Furthermore, based on the repetition value, the target video data can be determined from candidate video data with different keyframe intervals and played. Therefore, this solution can dynamically call video data with different keyframe intervals according to the tile type within the view field, achieving the effect of dynamically adjusting download bandwidth and reducing video playback latency within the view field during view switching, thereby improving the user's visual experience.

[0094] It should be noted that the foregoing explanation of the VR video playback processing method embodiment also applies to the VR video playback processing device of this embodiment, and will not be repeated here.

[0095] To implement the above embodiments, this application also proposes an electronic device, including: a processor and a memory communicatively connected to the processor; the memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory to implement the method provided in the foregoing embodiments. To implement the above embodiments, this application also proposes a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the methods provided in the foregoing embodiments.

[0096] To implement the above embodiments, this application also proposes a computer program product, including a computer program that, when executed by a processor, implements the methods provided in the foregoing embodiments.

[0097] The collection, storage, use, processing, transmission, provision, and application of user personal information involved in this application all comply with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0098] It should be noted that personal information collected from users should be used for legitimate and reasonable purposes and should not be shared or sold outside of these legitimate uses. Furthermore, such collection / sharing should only be conducted after receiving the user's informed consent, including but not limited to notifying the user to read the user agreement / user notice and sign an agreement / authorization that includes authorization of relevant user information before the user uses the function. In addition, any necessary steps must be taken to protect and safeguard access to such personal information data and ensure that others with access to personal information data comply with their privacy policies and procedures.

[0099] This application is intended to provide an implementation scheme for users to selectively prevent the use or access to their personal information data. Specifically, this application is intended to provide hardware and / or software to prevent or block access to such personal information data. Once personal information data is no longer needed, risks can be minimized by restricting data collection and deleting data. Furthermore, where applicable, such personal information is de-identified to protect user privacy.

[0100] In the foregoing descriptions of the embodiments, the terms "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., refer to specific features, structures, materials, or characteristics described in connection with that embodiment or example, which are included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0101] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "multiple" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0102] Any process or method description in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing custom logic functions or processes, and the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as should be understood by those skilled in the art to which embodiments of this application pertain.

[0103] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Alternatively, the computer-readable medium may be paper or other suitable media on which the program can be printed, since the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in a computer memory.

[0104] It should be understood that various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it can be implemented using any of the following techniques known in the art, or a combination thereof: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0105] Those skilled in the art will understand that all or part of the steps of the methods in the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.

[0106] Furthermore, the functional units in the various embodiments of this application can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0107] The storage medium mentioned above can be a read-only memory, a disk, or an optical disk, etc. Although embodiments of this application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting this application. Those skilled in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of this application.

Claims

1. A method for processing virtual reality (VR) video playback, characterized in that, The method includes: In response to the switching of the view field during VR video playback, the switching data of the view field is acquired; Based on the switching data, determine the tile type of the target tile within the switched field of view; Based on the tile type, determine the repetition value of the next frame video playback frame number of the target tile, the repetition value being used to indicate the number of times the next frame video is displayed repeatedly; Multiple candidate video data with different keyframe intervals are determined, and target video data is determined from the candidate video data based on the repetition value, so as to play the target video data in the target tile.

2. The method according to claim 1, characterized in that, The step of determining the target video data from the candidate video data based on the repetition value includes: In response to the repetition value satisfying a first preset condition, candidate video data with the keyframe interval of the first interval is determined from the candidate video data and used as the target video data.

3. The method according to claim 2, characterized in that, The step of determining the target video data from the candidate video data based on the repetition value further includes: In response to the repetition value satisfying the second set condition, target video data is determined from the candidate video data based on the next frame video playback frame number of the target tile and the repetition value.

4. The method according to claim 3, characterized in that, The step of determining the target video data from the candidate video data based on the next frame video playback frame number of the target tile and the repetition value includes: Obtain the pre-established mapping relationship between the next frame video playback frame number, repetition value, and keyframe interval; Based on the next frame video playback frame number of the target tile and the repetition value, the mapping relationship is queried to determine the target video data from the candidate video data.

5. The method according to claim 4, characterized in that, The method further includes: Determine whether the repetition value and the next frame video playback frame number satisfy the video data switching conditions; In response to the fulfillment of a first switching condition, candidate video data with a keyframe interval of the first interval is played in the target tile; In response to the fulfillment of the second switching condition, candidate video data with the keyframe interval of the second interval is played in the target tile; In response to the fulfillment of the third switching condition, candidate video data with the keyframe interval of the third interval is played in the target tile.

6. The method according to claim 5, characterized in that, The method further includes: In response to the failure to meet the second switching condition, the candidate video data with the keyframe interval of the first interval is continued to be played in the target tile; In response to the failure to meet the third switching condition, the candidate video data with the keyframe interval of the second interval is continued to be played in the target tile.

7. The method according to any one of claims 1-6, characterized in that, The step of determining the tile type of the target tile within the switched field of view based on the switching data includes: Based on the switching data, determine whether the target tile in the field of view after the switch is the same as the tile in the field of view before the switch; In response to the repetition of tiles within the field of view before the switch, the tile type of the target tile is determined to be a first type; In response to the fact that the tile does not overlap with the tile in the field of view before the switch, the tile type of the target tile is determined to be the second type.

8. The method according to claim 7, characterized in that, The step of determining the repetition value of the next frame video playback frame number of the target tile based on the tile type includes: In response to the tile type being the first type, the repetition value of the next frame video playback frame number of the target tile is determined to be a first preset value; In response to the tile type being the second type, the repetition value of the next frame video playback frame number of the target tile is increased by a second set value.

9. A processing device for playing virtual reality (VR) videos, characterized in that, The device includes: The acquisition module is used to acquire the switching data of the view field in response to the switching of the view field during VR video playback. The first determining module is used to determine the tile type of the target tile in the switched field of view based on the switching data; The second determining module is used to determine the repetition value of the next frame video playback frame number of the target tile based on the tile type, wherein the repetition value is used to indicate the number of times the next frame video is displayed repeatedly; The third determining module is used to determine multiple candidate video data with different keyframe intervals, and to determine target video data from the candidate video data based on the repetition value, so as to play the target video data in the target tile.

10. An electronic device, characterized in that, include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory to implement the method as described in any one of claims 1-7.

Images