Video frame synchronization method, device, head-mounted device and medium for multiple head-mounted devices
By processing the video frame information on the main head-mounted device and sending it to the head-mounted device, video frame synchronization between multiple head-mounted devices is achieved, which solves the problem of no video synchronization between VR devices in the existing technology. Improved user experience.
Patent Information
- Application Number
- CN202111274494.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-10-29
- Publication Date
- 2025-01-21
- Estimated Expiration
- 2041-10-29
AI Technical Summary
In the application scenario where multiple VR devices are interconnected, video synchronization is not performed between each interconnected VR device, resulting in poor user experience.
By processing the target video according to preset rules on the main headset, video synchronization information is generated, and the information is sent to the headset that is successfully interconnected and paired with the main headset. After receiving the video synchronization information from the headset, it determines whether the video frame currently played by itself is consistent with the target video frame. If it is inconsistent, the current video frame is updated to the target video frame and the video is played.
It achieves video frame synchronization between multiple headsets, allowing users to have a higher user experience during movie viewing.
Smart Images

Figure CN114025150B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of head mounted devices, and in particular to a method and device for synchronizing video frames of multiple head mounted devices, a head mounted device and a computer readable storage medium. Background Art
[0002] As VR and other head-mounted devices become more popular, people's demand for scenarios where multiple VR devices are connected is also increasing, such as VR movie watching, VR classrooms or VR conferences. In the application scenarios where multiple VR devices are connected, the images played by multiple VR devices need to be as consistent as possible, but in the existing technology, there is no video synchronization between the connected VR devices, resulting in a poor user experience.
[0003] In view of this, how to achieve video frame synchronization between multiple head-mounted devices and improve the user experience has become a problem that technical personnel in this field need to solve. Summary of the invention
[0004] The purpose of the embodiments of the present invention is to provide a video frame synchronization method and device for multiple head-mounted devices, a head-mounted device and a computer-readable storage medium, which can achieve video frame synchronization between a slave head-mounted device and a master head-mounted device during use, thereby improving the user experience during the user's viewing process.
[0005] In order to solve the above technical problems, an embodiment of the present invention provides a video frame synchronization method between multiple head mounted devices, which is applied to a master head mounted device, and includes:
[0006] Processing the target video according to a preset rule to obtain video synchronization information; the video synchronization information includes a target video frame of the video currently being played by the main head mounted device;
[0007] The video synchronization information is sent to a slave head-mounted device that is successfully interconnected and paired with the master head-mounted device, so that the slave head-mounted device determines whether the current video frame currently being played by itself is consistent with the target video frame based on the video synchronization information; if not, the current video frame is updated to the target video frame, and the updated current video frame is played.
[0008] Optionally, the process of processing the target video according to the preset rule is:
[0009] Encoding each video frame of the target video to obtain a frame queue; the frame queue includes a plurality of frame queue elements arranged in time sequence;
[0010] A frame sequence is generated according to the frame queue and a target frame queue element corresponding to a target video frame currently being played, and the frame sequence is used as the video synchronization information.
[0011] Optionally, the process of encoding each video frame of the target video to obtain a frame queue is:
[0012] Add a corresponding frame time flag to each video frame of the target video, and obtain each frame queue element respectively;
[0013] Each of the frame queue elements is sorted in chronological order to obtain a frame queue.
[0014] Optionally, the process of generating a frame sequence according to the frame queue and a target frame queue element corresponding to the target video frame currently being played is:
[0015] Extracting each frame time flag in the frame queue to form a frame time sequence;
[0016] Adding a frame start flag at the head of the frame time sequence, and adding a check frame flag and a frame end flag at the tail of the frame time sequence to generate a frame sequence; wherein the check frame flag includes time information of the video currently being played by the main head mounted device;
[0017] Then, the process of judging whether the current video frame currently being played is consistent with the target video frame according to the video synchronization information is as follows:
[0018] Obtaining a target frame time corresponding to a video currently being played by the primary head mounted device according to a frame start flag and a check frame flag in the frame sequence;
[0019] Get the current frame time corresponding to the current video frame currently being played;
[0020] Determine whether the current frame time is consistent with the target frame time.
[0021] Optionally, also include:
[0022] Adding a master-slave device flag before the frame start flag;
[0023] Then, the process of sending the video synchronization information to the slave head mounted device that is successfully interconnected and paired with the master head mounted device is:
[0024] According to the master-slave device flag in the frame sequence, the frame sequence is sent to a slave head mounted device that is successfully interconnected and paired with the master head mounted device and corresponds to the master-slave device flag.
[0025] The embodiment of the present invention further provides a video frame synchronization device between multiple head mounted devices, which is applied to a main head mounted device, and includes:
[0026] A processing module, configured to process the target video according to a preset rule to obtain video synchronization information; the video synchronization information includes a target video frame of the video currently being played by the main head mounted device;
[0027] The sending module is used to send the video synchronization information to the slave head-mounted device that is successfully interconnected and paired with the master head-mounted device, so that the slave head-mounted device can determine whether the current video frame currently played by itself is consistent with the target video frame based on the video synchronization information. If inconsistent, the current video frame is updated to the target video frame, and the updated current video frame is played.
[0028] An embodiment of the present invention further provides a method for synchronizing video frames between multiple head-mounted devices, which is applied to a head-mounted device, and includes:
[0029] Receiving video synchronization information sent by a primary head mounted device, the video synchronization information including a target video frame of a video currently played by the primary head mounted device; wherein the video synchronization information is obtained after the primary head mounted device processes the target video according to a preset rule;
[0030] It is determined whether the current video frame being played is consistent with the target video frame according to the video synchronization information; if not, the current video frame is updated to the target video frame, and the updated current video frame is played.
[0031] An embodiment of the present invention further provides a video frame synchronization device between multiple head-mounted devices, which is applied to a head-mounted device, comprising:
[0032] A receiving module, configured to receive video synchronization information sent by a primary head mounted device, wherein the video synchronization information includes a target video frame of a video currently played by the primary head mounted device; wherein the video synchronization information is obtained after the primary head mounted device processes the target video according to a preset rule;
[0033] A judgment module, used for judging whether the current video frame being played is consistent with the target video frame according to the video synchronization information, and triggering an update module if they are inconsistent;
[0034] The updating module is used to update the current video frame to the target video frame, and play the updated current video frame.
[0035] An embodiment of the present invention further provides a head mounted device, comprising:
[0036] Memory for storing computer programs;
[0037] A processor is used to implement the steps of the method for synchronizing video frames between multiple head-mounted devices as described above when executing the computer program.
[0038] An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method for synchronizing video frames between multiple head-mounted devices as described above are implemented.
[0039] The embodiments of the present invention provide a method, an apparatus, a head-mounted device and a computer-readable storage medium for synchronizing video frames between multiple head-mounted devices. In the method, a master head-mounted device processes a target video being played according to a preset rule to obtain video synchronization information, and then sends the video synchronization information to a slave head-mounted device that is successfully interconnected and paired with the master head-mounted device, wherein the video synchronization information includes a target video frame of a video currently being played by the master head-mounted device. After receiving the video synchronization information, the slave head-mounted device determines whether a current video frame currently being played by the slave head-mounted device is consistent with the target video frame in the video synchronization information based on the video synchronization information. If not, the slave head-mounted device updates its current video frame to the target video frame, and plays the updated current video frame, thereby achieving video frame synchronization between the slave head-mounted device and the master head-mounted device, and improving the user experience during the viewing process. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the prior art and the drawings required for use in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0041] Figure 1 A schematic diagram of a flow chart of a method for synchronizing video frames between multiple head-mounted devices provided by an embodiment of the present invention;
[0042] Figure 2 It is a schematic diagram of a first embodiment of the present invention;
[0043] Figure 3 A schematic diagram of the structure of a video frame synchronization device between multiple head-mounted devices provided by an embodiment of the present invention;
[0044] Figure 4 A schematic flow chart of another method for synchronizing video frames between multiple head-mounted devices provided by an embodiment of the present invention;
[0045] Figure 5 A schematic structural diagram of another apparatus for synchronizing video frames between multiple head mounted devices provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0046] The embodiments of the present invention provide a method and apparatus for synchronizing video frames of multiple head-mounted devices, a head-mounted device, and a computer-readable storage medium. During use, video frame synchronization between a slave head-mounted device and a master head-mounted device can be achieved, thereby improving the user experience during the viewing process.
[0047] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0048] Please refer to Figure 1 , Figure 1 A schematic flow chart of a method for synchronizing video frames between multiple head-mounted devices provided in an embodiment of the present invention. The method is applied to a master head-mounted device and includes:
[0049] S110: Processing the target video according to a preset rule to obtain video synchronization information; the video synchronization information includes a target video frame of the video currently being played by the main head mounted device;
[0050] It should be noted that the master head-mounted device in the embodiment of the present invention can send interconnection pairing requests to multiple slave head-mounted devices located in the same local area network in advance. After receiving the interconnection pairing request, the slave head-mounted device can participate in the pairing, and after participating in the pairing, the interconnection pairing with the master head-mounted device is successfully completed, so that the same video can be played together with the master head-mounted device. The video can be called the target video, wherein the master head-mounted device can also number each slave head-mounted device according to itself and according to the order in which the slave head-mounted devices participate in the interconnection pairing. When the master head-mounted device needs to synchronize the video with the slave head-mounted device connected to it, it can process the target video being played according to the preset rules to obtain the video synchronization information including the target video frame of the video currently played by the master head-mounted device.
[0051] S120: Send the video synchronization information to the slave head-mounted device that is successfully interconnected and paired with the master head-mounted device, so that the slave head-mounted device can determine whether the current video frame currently being played by itself is consistent with the target video frame based on the video synchronization information. If inconsistent, the current video frame is updated to the target video frame, and the updated current video frame is played.
[0052] Specifically, after obtaining the video synchronization information, the video synchronization information is sent to the slave head-mounted device. After receiving the video synchronization information, the slave head-mounted device obtains the target video frame of the video currently played by the master head-mounted device in the video synchronization information, and then compares the current video frame currently played by the slave head-mounted device itself with the target video frame. If the two are consistent, it means that they are currently synchronized. If the two are inconsistent, it means that the playback progress of the slave head-mounted device is different from that of the master head-mounted device, and the two are not synchronized. At this time, the slave head-mounted device needs to adjust its own playback progress. Specifically, the current video frame currently played by itself can be updated to (that is, adjusted to) the target video frame played by the master head-mounted device, and then continue to play, so that the slave head-mounted device completes the video frame synchronization between the slave head-mounted device and the master head-mounted device.
[0053] Furthermore, the process of processing the target video according to the preset rule in the above S110 may specifically be:
[0054] Encoding each video frame of the target video to obtain a frame queue; the frame queue includes a plurality of frame queue elements arranged in time sequence;
[0055] A frame sequence is generated according to the frame queue and the target frame queue element corresponding to the target video frame currently being played, and the frame sequence is used as video synchronization information.
[0056] It should be noted that the main head mounted device can specifically encode each video frame of the target video to obtain a frame queue. Specifically, each frame queue element can be obtained by adding a corresponding frame time flag to each video frame of the target video. The frame queue element includes the frame time flag at the head and the video frame data behind the frame time flag. Then, each frame queue element is sorted in chronological order to obtain a frame queue. The specific formats of the frame queue element and the frame queue are as follows: Figure 2 as shown in .
[0057] Furthermore, the process of generating a frame sequence according to the frame queue and the target frame queue element corresponding to the target video frame currently being played may specifically be:
[0058] Extract each frame time flag in the frame queue to form a frame time sequence;
[0059] Adding a frame start flag at the head of the frame time sequence, and adding a check frame flag and a frame end flag at the tail of the frame time sequence to generate a frame sequence; wherein the check frame flag includes time information of the video currently being played by the main head mounted device;
[0060] That is, in order to reduce the amount of data transmission and improve the efficiency of video synchronization, in the embodiment of the present invention, the frame time flag of each frame element can be extracted from the frame queue, and each frame time flag is formed into a frame time sequence in time order. The specific format is as follows: Figure 2 Then, a frame start flag is added to the head of the frame time sequence, for example, the frame start flag is T0, and a calibration frame flag and a frame end flag are added to the tail of the frame time sequence in sequence, thereby generating a frame sequence.
[0061] Then, the above process of judging whether the current video frame currently being played is consistent with the target video frame based on the video synchronization information may be specifically:
[0062] According to the frame start flag and the check frame flag in the frame sequence, a target frame time corresponding to the video currently played by the main head mounted device is obtained;
[0063] Get the current frame time corresponding to the current video frame currently being played;
[0064] Determine whether the current frame time is consistent with the target frame time.
[0065] It should be noted that after receiving the video synchronization information (frame sequence), the slave head-mounted device obtains the frame start flag and the check frame flag from the frame sequence, and then can determine the target frame time corresponding to the video currently played by the master head-mounted device based on the frame start flag and the frame check flag, that is, the frame time T within which the video currently played by the master head-mounted device is located, for example, within T1, and then obtains the current frame time corresponding to the current video frame currently played by the slave head-mounted device, for example, within T2, which means that the two are inconsistent, and it is necessary to jump the video frame currently played by the slave head-mounted device to T1, so as to achieve frame synchronization of the video. Furthermore, the method may also include:
[0066] Add the master and slave device flags before the frame start flag;
[0067] Then, the process of sending the video synchronization information to the slave head mounted device that is successfully paired with the master head mounted device may specifically be:
[0068] According to the master-slave device flag in the frame sequence, the frame sequence is sent to the slave head-mounted device that is successfully interconnected and paired with the master head-mounted device and corresponds to the master-slave device flag.
[0069] Specifically, in an embodiment of the present invention, a master-slave device flag can be added at the head position of the frame sequence and before the frame start flag. Of course, a master device flag can also be added, which can be determined according to actual needs, so as to send the frame sequence to the designated slave head-mounted device.
[0070] In addition, it should be noted that the video frame synchronization can be performed on the slave head-mounted device for the first time when the video starts playing, and the video frame synchronization can be performed on the slave head-mounted device at any time as needed during the video playback. The specific implementation can be based on actual needs.
[0071] It can be seen that the master head-mounted device in the present invention processes the target video being played according to preset rules to obtain video synchronization information, and then sends the video synchronization information to the slave head-mounted device that is successfully interconnected and paired with the master head-mounted device, wherein the video synchronization information includes the target video frame of the video currently played by the master head-mounted device. After receiving the video synchronization information, the slave head-mounted device determines whether the current video frame currently played by the slave head-mounted device itself is consistent with the target video frame in the video synchronization information based on the video synchronization information. If inconsistent, the slave head-mounted device updates its current video frame to the target video frame, and plays the updated current video frame, thereby realizing video synchronization between the slave head-mounted device and the master head-mounted device, and improving the user experience during the user's viewing process.
[0072] Based on the above embodiment, the embodiment of the present invention further provides a video frame synchronization device between multiple head-mounted devices. Figure 3 , the device is applied to a main head-mounted device, comprising:
[0073] The processing module 11 is used to process the target video according to a preset rule to obtain video synchronization information; the video synchronization information includes the target video frame of the video currently played by the main head mounted device;
[0074] The sending module 12 is used to send the video synchronization information to the slave head-mounted device that is successfully interconnected and paired with the master head-mounted device, so that the slave head-mounted device can determine whether the current video frame currently played by itself is consistent with the target video frame based on the video synchronization information. If inconsistent, the current video frame is updated to the target video frame, and the updated current video frame is played.
[0075] It should be noted that the video frame synchronization device between multiple head-mounted devices in the embodiment of the present invention has the same beneficial effects as the video frame synchronization method between multiple head-mounted devices provided in the above embodiment, and for the specific introduction of the video frame synchronization method between multiple head-mounted devices involved in the embodiment of the present invention, please refer to the above embodiment, and the present invention will not be repeated here.
[0076] Based on the above embodiment, the embodiment of the present invention also provides a method for synchronizing video frames between multiple head-mounted devices. Figure 4 The method is applied to a head mounted device, comprising:
[0077] S210: Receive video synchronization information sent by the primary head mounted device, where the video synchronization information includes a target video frame of a video currently played by the primary head mounted device; wherein the video synchronization information is obtained after the primary head mounted device processes the target video according to a preset rule;
[0078] S220: judging whether the current video frame being played is consistent with the target video frame according to the video synchronization information, if not, proceeding to S230;
[0079] S230: Update the current video frame to the target video frame, and play the updated current video frame.
[0080] Specifically, the master head-mounted device in the embodiment of the present invention can send an interconnection pairing request to multiple slave head-mounted devices located in the same local area network in advance. After receiving the interconnection pairing request, the slave head-mounted device can perform parameter pairing, and after participating in the pairing, it can successfully interconnect and pair with the master head-mounted device, so that it can play the same video with the master head-mounted device. The video can be called a target video. When the master head-mounted device needs to synchronize the video with the slave head-mounted device connected to it, it can process the target video being played according to preset rules to obtain video synchronization information including the target video frame of the video currently being played by the master head-mounted device, and send the video synchronization information to the slave head-mounted device. After receiving the video synchronization information, the slave head-mounted device obtains the target video frame of the video currently being played by the master head-mounted device in the video synchronization information, and then compares the current video frame currently being played by the slave head-mounted device itself with the target video frame. If the two are consistent, it means that they are currently synchronized. If the two are inconsistent, it means that the playback progress of the slave head-mounted device is different from that of the master head-mounted device, and the two are not synchronized. At this time, the slave head-mounted device needs to adjust its own playback progress. Specifically, the current video frame currently being played by itself can be updated to (that is, adjusted to) the target video frame played by the master head-mounted device, and then continue to play, so that the slave head-mounted device completes the video frame synchronization between the slave head-mounted device and the master head-mounted device.
[0081] Specifically, the process of achieving frame synchronization between the master head mounted device and the slave head mounted device may be parameterized by the above method embodiment, and the present invention will not be described in detail herein.
[0082] Based on the above embodiment, the embodiment of the present invention further provides a video frame synchronization device between multiple head-mounted devices. Figure 5 The device is applied to a head-mounted device, comprising:
[0083] The receiving module 21 is used to receive the video synchronization information sent by the main head mounted device, where the video synchronization information includes the target video frame of the video currently played by the main head mounted device; wherein the video synchronization information is obtained after the main head mounted device processes the target video according to a preset rule;
[0084] A judgment module 22 is used to judge whether the current video frame being played is consistent with the target video frame according to the video synchronization information, and if not, trigger an update module 23;
[0085] The updating module 23 is used to update the current video frame to the target video frame and play the updated current video frame.
[0086] Based on the above embodiment, an embodiment of the present invention further provides a head mounted device, including:
[0087] Memory for storing computer programs;
[0088] A processor is used to implement the steps of the above-mentioned method for synchronizing video frames between multiple head-mounted devices when executing a computer program.
[0089] For example, the processor in the embodiment of the present invention can be specifically used to process the target video according to preset rules to obtain video synchronization information; the video synchronization information includes the target video frame of the video currently played by the main head-mounted device; the video synchronization information is sent to the slave head-mounted device that is successfully interconnected and paired with the main head-mounted device, so that the slave head-mounted device can determine whether the current video frame currently played by itself is consistent with the target video frame based on the video synchronization information. If inconsistent, the current video frame is updated to the target video frame, and the updated current video frame is played.
[0090] Or it is specifically used to receive video synchronization information sent by a main head-mounted device, where the video synchronization information includes a target video frame of a video currently being played by the main head-mounted device; wherein the video synchronization information is obtained after the main head-mounted device processes the target video according to a preset rule; and whether the current video frame being played is consistent with the target video frame is determined based on the video synchronization information; if not, the current video frame is updated to the target video frame, and the updated current video frame is played.
[0091] Based on the above embodiments, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the video frame synchronization method between multiple head-mounted devices are implemented.
[0092] The computer-readable storage medium may include: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.
[0093] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.
[0094] It should also be noted that, in this specification, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.
[0095] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A video frame synchronization method between multiple head-mounted devices, characterized in that: Applicable to the main headset, including: Processing the target video according to a preset rule to obtain video synchronization information; the video synchronization information includes a target video frame of the video currently being played by the main head mounted device; The video synchronization information is sent to the slave head mounted device that is successfully interconnected and paired with the master head mounted device, so that the slave head mounted device determines whether the current video frame currently played by itself is consistent with the target video frame according to the video synchronization information. If not, the current video frame is updated to the target video frame, and the updated current video frame is played; wherein: The process of processing the target video according to the preset rule is as follows: adding a corresponding frame time flag to each video frame of the target video to obtain each frame queue element respectively; sorting each frame queue element in time order to obtain a frame queue; the frame queue includes a plurality of frame queue elements arranged in time order; extracting each frame time flag in the frame queue to form a frame time sequence; adding a frame start flag to the head of the frame time sequence, and adding a check frame flag and a frame end flag to the tail of the frame time sequence to generate a frame sequence, and using the frame sequence as the video synchronization information; wherein the check frame flag includes time information of the video currently played by the main head mounted device; Then, the process of judging whether the current video frame currently being played is consistent with the target video frame based on the video synchronization information is as follows: obtaining the target frame time corresponding to the video currently being played by the main head mounted device based on the frame start flag and the check frame flag in the frame sequence; obtaining the current frame time corresponding to the current video frame currently being played; and judging whether the current frame time is consistent with the target frame time.
2. The video frame synchronization method between multiple head mounted devices according to claim 1, characterized in that: Also includes: Adding a master-slave device flag before the frame start flag; Then, the process of sending the frame sequence to the slave head mounted device that is successfully interconnected and paired with the master head mounted device is: According to the master-slave device flag in the video synchronization information, the frame sequence is sent to the slave head mounted device that is successfully interconnected and paired with the master head mounted device and corresponds to the master-slave device flag.
3. A video frame synchronization device between multiple head-mounted devices, characterized in that: Applicable to the main headset, including: A processing module, used for adding a corresponding frame time flag to each video frame of a target video to obtain each frame queue element respectively; sorting each frame queue element in time order to obtain a frame queue; the frame queue includes a plurality of frame queue elements arranged in time order; extracting each frame time flag in the frame queue to form a frame time sequence; adding a frame start flag to the head of the frame time sequence, and adding a check frame flag and a frame end flag to the tail of the frame time sequence to generate a frame sequence; wherein the check frame flag includes time information of a video currently being played by a main head mounted device, and the frame sequence is used as video synchronization information; the video synchronization information includes a target video frame of a video currently being played by the main head mounted device; A sending module is used to send the video synchronization information to a slave head-mounted device that is successfully interconnected and paired with the master head-mounted device, so that the slave head-mounted device can obtain a target frame time corresponding to the video currently played by the master head-mounted device based on a frame start flag and a check frame flag in the frame sequence; obtain a current frame time corresponding to a current video frame currently being played; determine whether the current frame time is consistent with the target frame time, and if not, update the current video frame to the target video frame, and play the updated current video frame.
4. A video frame synchronization method between multiple head-mounted devices, characterized in that: Applied to head mounted devices, including: Receiving video synchronization information sent by a primary head mounted device, the video synchronization information including a target video frame of a video currently played by the primary head mounted device; wherein the video synchronization information is obtained after the primary head mounted device processes the target video according to a preset rule; Determine whether the current video frame being played is consistent with the target video frame according to the video synchronization information; if not, update the current video frame to the target video frame, and play the updated current video frame; wherein: The process of processing the target video according to the preset rule is as follows: adding a corresponding frame time flag to each video frame of the target video to obtain each frame queue element respectively; sorting each frame queue element in time order to obtain a frame queue; the frame queue includes a plurality of frame queue elements arranged in time order; extracting each frame time flag in the frame queue to form a frame time sequence; adding a frame start flag to the head of the frame time sequence, and adding a check frame flag and a frame end flag to the tail of the frame time sequence to generate a frame sequence, and using the frame sequence as the video synchronization information; wherein the check frame flag includes time information of the video currently played by the main head mounted device; Then, the process of judging whether the current video frame currently being played is consistent with the target video frame based on the video synchronization information is as follows: obtaining the target frame time corresponding to the video currently being played by the main head mounted device based on the frame start flag and the check frame flag in the frame sequence; obtaining the current frame time corresponding to the current video frame currently being played; and judging whether the current frame time is consistent with the target frame time.
5. A video frame synchronization device between multiple head-mounted devices, characterized in that: Applied to head mounted devices, including: A receiving module, configured to receive video synchronization information sent by a primary head mounted device, wherein the video synchronization information includes a target video frame of a video currently played by the primary head mounted device; wherein the video synchronization information is obtained after the primary head mounted device processes the target video according to a preset rule; A judgment module, used for judging whether the current video frame being played is consistent with the target video frame according to the video synchronization information, and triggering an update module if they are inconsistent; The updating module is used to update the current video frame to the target video frame and play the updated current video frame; wherein: The process of processing the target video according to the preset rule is as follows: adding a corresponding frame time flag to each video frame of the target video to obtain each frame queue element respectively; sorting each frame queue element in time order to obtain a frame queue; the frame queue includes a plurality of frame queue elements arranged in time order; extracting each frame time flag in the frame queue to form a frame time sequence; adding a frame start flag to the head of the frame time sequence, and adding a check frame flag and a frame end flag to the tail of the frame time sequence to generate a frame sequence, and using the frame sequence as the video synchronization information; wherein the check frame flag includes time information of the video currently played by the main head mounted device; Then, the judgment module is used to obtain the target frame time corresponding to the video currently played by the main head-mounted device according to the frame start flag and the check frame flag in the frame sequence; obtain the current frame time corresponding to the current video frame currently being played; and judge whether the current frame time is consistent with the target frame time.
6. A head mounted device, characterized in that: include: Memory for storing computer programs; A processor, configured to implement the steps of the method for synchronizing video frames between multiple head-mounted devices as described in any one of claims 1 to 2 or the steps of the method for synchronizing video frames between multiple head-mounted devices as described in claim 4 when executing the computer program.
7. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by the processor, the steps of the method for synchronizing video frames between multiple head-mounted devices as described in any one of claims 1 to 2 are implemented, or the steps of the method for synchronizing video frames between multiple head-mounted devices as described in claim 4 are implemented.
Citation Information
Patent Citations
Method and system of displaying video simultaneously
CN103151058A
Information processing method and server
CN104317898A