Data sharing method, device, computer, storage medium and program product
By establishing communication links and data sharing instances between wearable virtual display devices, synchronous sharing and control of media data are achieved, which solves the viewing problems caused by insufficient user interactivity and network instability, and enhances the sharing experience and sense of participation.
Patent Information
- Application Number
- CN202411599002.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-08
- Publication Date
- 2025-09-16
- Estimated Expiration
- 2044-11-08
AI Technical Summary
Existing video sharing methods lack user interactivity and participation, and when the network is unstable, it is easy for participants to be unable to view the screen normally, affecting the real-time interactive experience.
By establishing a communication link between wearable virtual display devices, creating shared activity objects and data sharing instances, synchronous sharing and control operations of media data are achieved, allowing participants to synchronize playback status and resource information in real time.
It improves user interactivity and sharing experience, ensures that participants can still display media data normally when the network is unstable, and provides a consistent playback experience and enhanced sense of participation.
Smart Images

Figure CN119544699B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a data sharing method, device, computer, storage medium, and program product. Background Art
[0002] With the advancement of science and technology, a variety of extended reality (XR) products have emerged. Users can use XR products to make video calls and watch videos. They can also share their screens while video chatting with other users and watch the same video together. However, video sharing through screen sharing is typically one-way, allowing only the initiator of screen sharing to control the viewing progress, pause, play, and other information of the video. Other users in the video call can only passively watch the video according to the initiator's operations. In other words, one person shares their own video, while others can only watch. This one-way interaction limits the interactivity and participation of other users. Moreover, since the participants can only see the screen of the screen sharing initiator, if the network connection is unstable during the sharing process, the participants may not be able to see the normal screen, which will affect the real-time interactive experience of the participants. Summary of the Invention
[0003] The embodiments of the present application provide a video sharing method, device, computer, storage medium and program product, which can enhance user interactivity and experience during data synchronization and sharing, and can improve the display effect of data synchronization and sharing.
[0004] On the one hand, an embodiment of the present application provides a data sharing method, the method comprising:
[0005] establishing a communication link with the second wearable virtual display device through a communication application of the first wearable virtual display device;
[0006] When a first business application of the first wearable virtual display device is obtained and the first system player is called to initiate a sharing request for first media data, a shared activity object is created based on the sharing request for the first media data, and first shared data information is generated in the first system player based on the shared activity object; the shared activity object includes resource information of the first media data; the first shared data information includes first playback status information; the first media data is media data required to be played in the first business application;
[0007] Creating a first data sharing instance associated with the first system player and the first shared data information in the first service application;
[0008] A group session instance is created on a communication link, and a shared interaction relationship is established between a first data sharing instance and a second data sharing instance created by a second wearable virtual display device through the group session instance; the group session instance is used to share data transmission of a shared activity object and a first playback status information between the first data sharing instance and the second data sharing instance in which a shared interaction relationship has been established; the second data sharing instance is used to control the second business application to play the first media data synchronously with the first wearable virtual display device according to the resource information and the first playback status information in the shared activity object obtained through sharing.
[0009] On the one hand, an embodiment of the present application provides another data sharing method, which includes:
[0010] In response to a communication operation in a communication application, a session page for communicating with a second wearable virtual display device is displayed in a virtual display interface of the first wearable virtual display device;
[0011] In response to a triggering operation of a first switching sharing component in a first data playback page in a first business application in a virtual display interface, sharing the first playback content in the first data playback page with a second wearable virtual display device with which a communication connection has been established in a session page;
[0012] When it is detected that the second wearable virtual display device performs a control operation on the shared first playback content, the control operation is synchronously performed on the first playback content in the first data playback page in the first business application.
[0013] In one aspect, an embodiment of the present application provides a data sharing device, the device comprising:
[0014] a communication connection module, configured to establish a communication link with the second wearable virtual display device through a communication application of the first wearable virtual display device;
[0015] An activity object creation module is configured to, upon acquiring a first business application of a first wearable virtual display device and invoking a first system player to initiate a sharing request for first media data, create a shared activity object based on the sharing request for the first media data, and generate first shared data information in the first system player based on the shared activity object; the shared activity object includes resource information of the first media data; the first shared data information includes first playback status information; and the first media data is media data required to be played in the first business application;
[0016] A data sharing instance creation module, configured to create a first data sharing instance associated with a first system player and first shared data information in a first business application;
[0017] A shared interaction relationship establishment module is used to create a group session instance on a communication link, and to establish a shared interaction relationship between a first data sharing instance and a second data sharing instance created by a second wearable virtual display device through the group session instance; the group session instance is used to share data transmission of a shared activity object and a first playback status information between the first data sharing instance and the second data sharing instance in which a shared interaction relationship has been established; the second data sharing instance is used to control the second business application to play the first media data synchronously with the first wearable virtual display device according to the resource information and the first playback status information in the shared activity object obtained through sharing.
[0018] In a possible implementation, the shared interaction relationship establishing module is further configured to perform the following operations:
[0019] The shared activity object and the first playback status information are transmitted to the group session instance through the first data sharing instance; the second data sharing instance is used to obtain the shared activity object and the first playback status information during the detection of the group session instance; the second data sharing instance is also used to call the second system player in the second business application, and the second system player plays the first media data synchronously with the first wearable virtual display device according to the shared activity object and the first playback status information.
[0020] In one possible implementation, the second system player is configured to generate second shared data information associated with the first media data being synchronously played; the second shared data information includes resource information of the first media data and second playback state information of the first media data in the second service application; and the shared interaction relationship establishment module is further configured to perform the following operations:
[0021] In the process of detecting the group conversation instance, obtaining second shared data information sent by the second data sharing instance to the group conversation instance;
[0022] When it is detected that the first playback state information and the second playback state information in the second shared data information are different, calling the target control operation instruction that is the same as the control operation instruction in the second playback state information through the first data sharing instance, and synchronously performing the control operation indicated by the target control operation instruction on the first media data through the first system player;
[0023] The first shared data information is updated through the target control operation instruction, and the updated first shared data information is transmitted to the group session instance.
[0024] In one possible implementation, the shared interaction relationship establishment module is configured to call, through the first data sharing instance, a target control operation instruction that is identical to the control operation instruction in the second playback state information. When the first system player synchronously performs the control operation indicated by the target control operation instruction on the first media data, the shared interaction relationship establishment module is specifically configured to perform the following operations:
[0025] calling, through the first data sharing instance, a target control operation instruction that is the same as the control operation instruction in the second playback state information;
[0026] If the target control operation instruction is a pause playback control instruction, the first system player synchronously pauses playback of the first media data;
[0027] If the target control operation instruction is a playback rate control instruction, then synchronously adjusting the playback rate of the first media data to the target playback rate indicated by the playback rate control instruction through the first system player;
[0028] If the target control operation instruction is a progress adjustment instruction, the playback progress of the first media data is synchronously adjusted to the progress playback position indicated by the progress adjustment instruction through the first system player.
[0029] In a possible implementation, the first media data belongs to a shared media data set; and the shared interaction relationship establishing module is further configured to perform the following operations:
[0030] When the first data sharing instance detects, through the group session instance, a change in a shared activity attribute in the second data sharing instance, the first data sharing instance calls a media data loading function to obtain the second media data based on resource information of the second media data indicated by the changed shared activity attribute; the shared activity attribute in the second data sharing instance is obtained by the second data sharing instance from the group session instance, and the shared activity attribute in the group session instance is determined by a shared activity object; the changed shared activity attribute is determined by switching the second media data to be shared in the second business application; the second media data belongs to the shared media data set;
[0031] In the process of detecting the group conversation instance, obtaining third data sharing information sent by the second data sharing instance to the group conversation instance; the third data sharing information includes third playback state information for the second media data;
[0032] The first system player is called through the first data sharing instance, and the first system player switches the first media data to the second media data according to the third playback state information.
[0033] In a possible implementation, the shared interaction relationship establishing module is further configured to perform the following operations:
[0034] When it is detected that the second wearable virtual display device has created an update group session instance for updating media data on the communication link, establishing a new sharing interaction relationship between the first data sharing instance and the second data sharing instance through the update group session instance;
[0035] In the process of detecting the update group conversation instance, obtaining the update sharing activity object and the update data sharing information sent by the second data sharing instance having established a new sharing interaction relationship to the update group conversation instance; the update sharing activity object includes the update resource information of the updated media data; the update data sharing information includes the update playback status information of the updated media data;
[0036] The first system player is called through the first data sharing instance, the first media data is replaced with the updated media data through the first system player, and the updated media data is played synchronously with the second wearable virtual display device according to the updated playback state information.
[0037] In one possible implementation, the activity object creation module is configured to, when acquiring the first business application of the first wearable virtual display device and invoking the first system player to initiate a sharing request for the first media data, create a shared activity object based on the sharing request for the first media data. When generating the first shared data information based on the shared activity object in the first system player, the activity object creation module is specifically configured to perform the following operations:
[0038] In response to a triggering operation on a first switching sharing component in a first service application, calling a first system player through the first service application, and generating a sharing request for the first media data through the first system player;
[0039] Acquire media attribute information associated with the first media data from a sharing request for the first media data, create a media data object based on the media attribute information, and create a shared activity object based on the media data object;
[0040] In the first system player, the first media data is loaded based on the shared activity object, first playback state information of the first media data in the first system player is obtained, and first shared data information is generated based on the first playback state information.
[0041] In a possible implementation, when the active object creation module is used to create a shared active object according to the media data object, the active object creation module is specifically used to perform the following operations:
[0042] Encapsulate the data type, data name, preview image, and resource information of the first media data in the media data object into metadata; the preview image refers to a target video frame randomly obtained from the first media data;
[0043] A shared activity object is created based on the first media data and the metadata.
[0044] In one possible implementation, when the sharing interaction relationship establishment module is used to establish a sharing interaction relationship between the first data sharing instance and the second data sharing instance created by the second wearable virtual display device through the group session instance, the sharing interaction relationship establishment module is specifically used to perform the following operations:
[0045] passing the group session instance as a first sharing parameter to the first data sharing instance through the session coordination method, and establishing a sharing interaction relationship between the first data sharing instance and the group session instance according to the first sharing parameter;
[0046] The group conversation instance is passed to the second wearable virtual display device through the communication link provided by the communication application, so that the second data sharing instance in the second wearable virtual display device uses the acquired group conversation instance as the second sharing parameter through the session coordination method, and establishes a shared interaction relationship between the group conversation instance and the second data sharing instance according to the second sharing parameter.
[0047] In one aspect, an embodiment of the present application provides another data sharing device, the device comprising:
[0048] A conversation page display module, configured to display, in a virtual display interface of the first wearable virtual display device, a conversation page for communicating with the second wearable virtual display device in response to a communication operation in the communication application;
[0049] A shared playback module is configured to respond to a triggering operation of a first switching sharing component in a first data playback page in a first business application in a virtual display interface, and share the playback content in the first data playback page with a second wearable virtual display device that has established a communication connection in a session page;
[0050] The synchronous display module is used to synchronously perform a control operation on the playback content in the first data playback page in the first business application when it is detected that the second wearable virtual display device performs a control operation on the shared playback content.
[0051] In a possible implementation, the shared playback module is further configured to perform the following operations:
[0052] Obtaining the cumulative number of triggering times for triggering the first switching sharing component, and if the cumulative number of triggering times is less than a sharing times threshold, displaying a sharing prompt pop-up interface for the first business application on the virtual display interface;
[0053] In response to the triggering operation of the opening component in the sharing prompt pop-up interface, the sharing prompt pop-up interface is closed, and the first playback content in the first data playback page is shared and played to the second wearable virtual display device with which a communication connection has been established in the session page.
[0054] In a possible implementation, the synchronous display module is further configured to perform the following operations:
[0055] When a sharing request for updated playback content in a second data playback page is detected to be initiated by a second wearable virtual display device, and the updated playback content is different from the first playback content in the shared playback of the first data playback page, a playback replacement prompt content interface is displayed in the first data playback page of the first business application; the second data playback page refers to the playback page in the second business application in the second wearable virtual display device;
[0056] In response to a triggering operation on a replacement component in the playback replacement prompt content interface, the playback replacement prompt content interface is closed, the first playback content is replaced in the first data playback page, and the updated playback content is shared with the second wearable virtual display device.
[0057] On the one hand, an embodiment of the present application provides a computer device, including a processor, a memory, and an input and output interface;
[0058] The processor is connected to the memory and the input and output interface respectively, wherein the input and output interface is used to receive and output data, the memory is used to store the computer program, and the processor is used to call the computer program so that the computer device including the processor executes the method in one aspect of the embodiment of the present application.
[0059] On one hand, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. The computer program is suitable for being loaded and executed by a processor so that a computer device having the processor executes the method in one aspect of the embodiment of the present application.
[0060] In one aspect, an embodiment of the present application provides a computer program product, comprising a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium and executes the computer program, causing the computer device to perform the methods provided in various optional embodiments of the present application. In other words, when the computer program is executed by the processor, the methods provided in various optional embodiments of the present application are implemented.
[0061] In an embodiment of the present application, a communication link is established with a second wearable virtual display device through a communication application of a first wearable virtual display device; when a first business application of the first wearable virtual display device is obtained and a first system player is called to initiate a sharing request for first media data, a shared activity object is created based on the sharing request for the first media data, and first shared data information is generated in the first system player based on the shared activity object; the shared activity object includes resource information of the first media data; the first shared data information includes first playback status information; the first media data is media data required to be played in the first business application; a first data sharing instance associated with the first system player and the first shared data information is created in the first business application; a group session instance is created on the communication link, and a shared interaction relationship is established between the first data sharing instance and the second data sharing instance created by the second wearable virtual display device through the group session instance; the group session instance is used to share data transmission of the shared activity object and the first playback status information between the first data sharing instance and the second data sharing instance with which the shared interaction relationship has been established; the second data sharing instance is used to control the second business application to play the first media data synchronously with the first wearable virtual display device according to the resource information and the first playback status information in the shared activity object obtained by sharing. Through the above process, a group session instance, a first data sharing instance, and a second data sharing instance are created. A shared interactive relationship is established between the first wearable virtual display device and the second wearable virtual display device through the group session instance, and a shared connection is realized between the first wearable virtual display device and the second wearable virtual display. Thus, the resource information and the first playback status information of the first media data are transmitted between the first data sharing instance and the second data sharing instance through the group session instance, so that the participant is no longer passively displaying the screen sharing picture of the initiator, but directly plays the first media data shared by the initiator, and synchronizes the playback picture of the initiator through the first playback status information, providing the participant with the possibility of controlling the media data. Due to the real-time synchronous transmission of the first playback status information by the first data sharing instance and the second data sharing instance, both parties (the initiator and the participant) can initiate control to change the first media data and synchronize it to the other party's device to provide a consistent playback experience, thereby increasing the sense of participation and interactivity of both parties. Moreover, since the participant is no longer passively displaying the shared screen picture, even if the network is unstable, the participant can still display the played first media data normally, ensuring the display effect of data sharing. BRIEF DESCRIPTION OF THE DRAWINGS
[0062] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0063] Figure 1 This is a network interaction architecture diagram provided by an embodiment of the present application;
[0064] Figure 2 This is a scenario diagram of a data sharing method provided by an embodiment of the present application. Figure 1 ;
[0065] Figure 3 This is a scenario diagram of a data sharing method provided by an embodiment of the present application. Figure 2 ;
[0066] Figure 4 This is a flow diagram of a data sharing method provided in an embodiment of the present application. Figure 1 ;
[0067] Figure 5 This is a schematic diagram of the architecture of a data sharing method provided in an embodiment of the present application;
[0068] Figure 6 This is a flow diagram of a data sharing method provided in an embodiment of the present application. Figure 2 ;
[0069] Figure 7 This is a flow diagram of a data sharing method provided in an embodiment of the present application. Figure 3 ;
[0070] Figure 8 This is a scenario diagram of a data sharing method provided by an embodiment of the present application. Figure 3 ;
[0071] Figure 9 This is a scenario diagram of a data sharing method provided by an embodiment of the present application. Figure 4 ;
[0072] Figure 10 This is a scenario diagram of a data sharing method provided by an embodiment of the present application. Figure 5 ;
[0073] Figure 11 This is a schematic diagram of a data sharing device provided in an embodiment of the present application. Figure 1 ;
[0074] Figure 12 This is a schematic diagram of a data sharing device provided in an embodiment of the present application. Figure 2 ;
[0075] Figure 13 It is a structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0076] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.
[0077] Among them, if it is necessary to collect object (such as user, etc.) data in this application, a prompt interface or pop-up window will be displayed before or during the collection. The prompt interface or pop-up window is used to remind the user that certain data is currently being collected. Only after the user confirms the prompt interface or pop-up window, the relevant steps for data acquisition will be started, otherwise the process will end. Moreover, the acquired user data will be used in reasonable and legal scenarios or purposes. Optionally, in some scenarios where user data needs to be used but has not been authorized by the user, authorization can be requested from the user, and the user data can be used when the authorization is passed.
[0078] It is understandable that in the specific implementation of this application, the user data involved, when the following embodiments of this application are applied to specific products or technologies, needs to obtain user permission or consent, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of the relevant regions.
[0079] In the examples of this application, see Figure 1 , Figure 1 This is a network interaction architecture diagram provided by an embodiment of the present application, such as Figure 1As shown, the network interaction architecture diagram may include a terminal device cluster, and the terminal device cluster may include terminal device 101a, terminal device 101b, ..., terminal device 101n. Terminal device 101a, terminal device 101b, ..., terminal device 101n can all be a wearable virtual display device, or can be said to be a computer device. Among them, the wearable virtual display device can be an XR (Extended Reality) device, and the XR device can include a VR device (such as VR glasses), AR (Augmented Reality) device, MR (Mixed Reality) device, etc. There can be a communication connection between the terminal device clusters (for example, a communication link can be established through a communication application). For example, there is a communication connection between terminal device 101a and terminal device 101b, a communication connection between terminal device 101a and terminal device 101n, and a communication connection between terminal device 101b and terminal device 101n.
[0080] It should be understood that Figure 1 Any terminal device in the terminal device cluster shown can be installed with a communication application with a communication function. When the communication application is running in each terminal device, a communication link can be established between each terminal device through the communication application. The following will be explained by taking the terminal device 101a as the first wearable virtual display device (the device corresponding to the initiator) as an example. The terminal device 101a can establish a communication link with the second wearable virtual display device through the installed communication application. Among them, the communication application can be a video call software, such as FaceTime, etc., then the communication link can be understood as the network link on which the video call between the first wearable virtual display device and the second wearable virtual display device depends. Among them, the number of second wearable virtual display devices (devices corresponding to the participants) can be one or more, for example, it can include Figure 1 The terminal devices 101b, ..., and 101n shown in FIG. Figure 1The terminal device 101b in the example is described as the second wearable virtual display device. When the terminal device 101a obtains the first business application calling the first system player to initiate a sharing request for the first media data, the terminal device 101a can establish a shared interaction relationship with the terminal device 101b, and pass the resource information of the first media data (such as the source address of the first media data) and the first playback status information (such as the current playback progress of the first media data) to the terminal device 101b through the shared interaction relationship. The terminal device 101b can play the first media data synchronously with the terminal device 101a based on the obtained resource information and first playback status information of the first media data. At the same time, when the terminal device 101b performs a control operation on the first media data (such as a pause operation), it can change the first playback status information of the first media data, and then pass the changed first playback status information to the terminal device 101a through the shared interaction relationship. The terminal device 101a can then perform a synchronization operation on the first media data (such as a synchronous pause operation) based on the changed first playback status information.
[0081] Through the above process, a shared interactive relationship can be established between the first wearable virtual display device and the second wearable virtual display device. Through the shared interactive relationship, the resource information and the first playback status information of the first media data can be synchronized in real time between the first wearable virtual display device and the second wearable virtual display device, so that the sharing parties (the initiator and the participant) can maintain the synchronized playback of the first media data in real time. At the same time, the possibility of control operation is provided to the participant, so that the sharing parties are no longer just sharing the screen image, but sharing the first playback status information, so that both sharing parties can initiate control operations and maintain sharing synchronization based on the control operations in real time.
[0082] For details, see Figure 2 , Figure 2 This is a scenario diagram of a data sharing method provided by an embodiment of the present application. Figure 1 This scene shows Figure 1 It can be used to illustrate the change process of the virtual display interface of the terminal device 101a, that is, the first wearable virtual display device. Figure 2As shown, the virtual display interface 201 of the terminal device 101a may include a communication application A1 and a first business application A2. The terminal device 101a responds to the communication operation for the communication application and may initiate a communication request to the second wearable virtual display device through the communication account of the second wearable virtual display device. After the communication request is passed, a communication link is established with the second wearable virtual display device, and a session page for communicating with the second wearable virtual display device is displayed in the virtual display interface, as shown in the session page 2021 in the virtual display interface 202. When the user corresponding to the second wearable virtual display device turns on the camera, the display area 2021a in the session page 2021 may display the content captured by the camera of the second wearable virtual display device, such as portraits and objects captured by the second wearable virtual display device.
[0083] Terminal device 101a can respond to a trigger operation on first business application A2, open first business application A2, respond to a play operation on drama A_01 in first business application A2, and display a first data playback page 2031 of first business application A2 in virtual display interface 203. Furthermore, terminal device 101a can respond to a trigger operation on a first switching sharing component 2031a in first data playback page 2031, and share first playback content 2031b in first data playback page 2031 with a second wearable virtual display device with which a communication connection has been established in the conversation page. It is understood that the display content and display location in the virtual display interface are determined by the user. For example, conversation page 2021 in virtual display interface 203 may not be displayed, the communication conversation may run in the background of terminal device 101a, or conversation page 2021 may be reduced to a floating window display, without limitation herein.
[0084] For further information, please see Figure 3 , Figure 3 This is a scenario diagram of a data sharing method provided by an embodiment of the present application. Figure 2 Taking the terminal device 101b as the second wearable virtual display device as an example, the scenario shows Figure 2It can be used to illustrate the change process of the virtual display interface of the terminal device 101b, that is, the second wearable virtual display device. Before the terminal device 101a shares the first playback content 2031b in the first data playback page 2031 with the terminal device 101b, the terminal device 101b needs to receive the communication request initiated by the terminal device 101a through the communication application A3, and respond to the communication request to establish a communication link with the terminal device 101a. Furthermore, the terminal device 101b can open the second business application A4, respond to the playback operation for a certain episode, open a playback page, and in the playback page, can respond to the trigger operation for the second switching sharing component 3012a, and establish a shared interactive relationship with the terminal device 101a. The terminal device 101b can receive the media data corresponding to the first playback content 2031b through the shared interactive relationship (for example, it can be Figure 1 The resource information and playback status information of the first media data mentioned in the embodiment (for example, the first playback status information corresponding to the first media data). The terminal device 101b can determine the first playback content 2031b shared by the terminal device 101a through the resource information and playback status information, and display the first playback content 3012b in the second data playback page 3012. Among them, the first playback content 2031b and the first playback content 3012b respectively represent the content played synchronously by the first business application and the second business application. At this time, the terminal device 101a and the terminal device 101b synchronously play the episode A_01 to 1 minute and 15 seconds (01:15). As Figure 3 As shown, when the user corresponding to the terminal device 101a turns on the camera, the display area 3011a in the conversation page 3011 can display the content captured by the camera of the terminal device 101a, such as portraits, objects, etc. captured by the terminal device 101a.
[0085] Furthermore, since the terminal device 101b synchronizes the first playback content 2031b through the resource information and playback status information of the media data, the first playback content 2031b shared by the terminal device 101a can be displayed and played in the terminal device 101b, thereby enabling the terminal device 101b to adjust the first playback content 2031b. Therefore, when the terminal device 101b performs a control operation on the shared first playback content 2031b, the control operation performed on the first playback content 2031b can be synchronized to the terminal device 101a. When the terminal device 101a detects that the terminal device 101b performs a control operation on the shared first playback content, the terminal device 101a can synchronously perform the control operation on the first playback content 2031b in the first data playback page 2031 in the first business application A2. Among them, the control operation may include a pause playback operation. For details, please refer to Figure 3The virtual display interface 302 includes a second data playback page 3021, and the second data playback page 3021 includes the first playback content 3021a that is being played to 3 minutes and 15 seconds (03:15). At this time, the terminal device 101b responds to the trigger operation of the playback control component 3021b in the second data playback page 3021 and performs a pause operation on the first playback content 3021a. Figure 3 As shown in the second data playback page 3031 of the virtual display interface 303 in the video, the first playback content 3021a is paused at 03:15, and the playback control component 3021b changes to the pause control component 3031a. The playback control component 3021b is used to indicate that the display status of the first playback content 3021a is in the playing state; the pause control component 3031a is used to indicate that the display status of the first playback content 3021a is in the paused playback state. At the same time, the terminal device 101b can synchronize the pause playback operation to the terminal device 101a through the shared interactive relationship. For further information, please refer to Figure 2 When terminal device 101a detects that terminal device 101b has paused the shared first playback content, terminal device 101a can synchronously perform the pause operation on first playback content 2031b on first data playback page 2031 in first service application A2. Specifically, as shown in virtual display interface 204 of terminal device 101a, playback control component 2031c can be changed to pause control component 2041a on first data playback page 2041. At this time, first playback content 2041b is synchronously paused at 03:15.
[0086] Through the above process, it is possible to ensure that the first playback content in the first wearable virtual display device and the second wearable virtual display device is synchronized, that is, it can support users to share and watch videos (i.e., the first playback content), and the playback progress and playback status of the video are also synchronized, enhancing the user's shared experience. At the same time, the participant corresponding to the second wearable virtual display device is no longer passively displaying the shared screen image, but directly displays and plays the first playback content. Both parties can trigger the control component to change the playback status of the first media data and synchronize it to the other party's device to provide a consistent playback experience, increasing the interactivity of both parties. The number of second wearable virtual display devices can be one or more (i.e., the number of participants can be one or more), which can support multiple users to share and watch videos at the same time. Each user can share the video with other users in their corresponding wearable virtual display device, and can interact with other users in real time through the conversation page, for example, to make comments or share feelings, etc., which can further enhance the user experience.
[0087] Further, see Figure 4 , Figure 4 This is a flow diagram of a data sharing method provided in an embodiment of the present application. Figure 1 The data sharing method may be executed by a computer device, which may be Figure 1 The terminal device 101a shown is the first wearable virtual display device. The following will be described using the data sharing method executed by the first wearable virtual display device as an example. The data processing method may include at least the following steps S401 to S404:
[0088] Step S401: establishing a communication link with a second wearable virtual display device through a communication application of the first wearable virtual display device.
[0089] In an embodiment of the present application, taking the first wearable virtual display device as the initiator of a sharing activity as an example, the number of participants in the sharing activity can be one or more, that is, the data sharing method can enable multiple users to participate in data sharing. The following is an explanation using the second wearable virtual display device as an example of a participant in the sharing activity. The first wearable virtual display device can obtain the communication account information associated with the user corresponding to the second wearable virtual display device, and can use the installed communication application and the communication account information to initiate a communication request to the second wearable virtual display device. When the second wearable virtual display device receives the communication request and responds to the communication request, the first wearable virtual display device can establish a communication link with the second wearable virtual display device. The communication application can be a video call application, such as FaceTime. Both the first wearable virtual display device and the second wearable virtual display device can be XR glasses, such as Vision Pro, which can provide users with an immersive experience.
[0090] Step S402: When the first business application of the first wearable virtual display device is obtained and the first system player is called to initiate a sharing request for the first media data, a shared activity object is created based on the sharing request for the first media data, and in the first system player, first shared data information is generated based on the shared activity object; the shared activity object includes resource information of the first media data; the first shared data information includes first playback status information; the first media data is the media data required to be played in the first business application.
[0091] In an embodiment of the present application, a user corresponding to a first wearable virtual display device can start a first business application, trigger a first switching sharing component in the first business application, and call a first system player (AVPlayer1) to generate a sharing request for the first media data. At this time, the first wearable virtual display device can obtain the sharing request for the first media data. The first wearable virtual display device can obtain resource data related to the first media data from the sharing request for the first media data. For example, the resource data can include the data name, resource information, preview image, etc. of the first media data. The first wearable virtual display device creates a shared activity object associated with the first media data based on the data name, resource information, and preview image of the first media data. The shared activity object refers to an entity used to describe the sharing activity for sharing the first media data. It can provide metadata of the shared content, for example, it can include the title, subtitle, resource information of the first media data, etc. The title of the shared activity can be the data name of the first media data. For example, if the first media data is a movie, the title of the shared activity is the movie name; if the first media data is a movie or the first episode of TV series A, the title of the shared activity can be TV series A_01. The subtitle of the shared activity may be a supplementary description of the first media data (for example, keywords or key information extracted from the introduction of the first media data, etc.), used to provide more information about the first media data. The resource information may be a Uniform Resource Locator (URL). Furthermore, the first wearable virtual display device may generate first shared data information (AVPlayerItem1) in the first system player based on the shared activity object. The first media data is the media data required to be played in the first business application. It can be understood that the first business application may be a video application, and the first business application plays the video (that is, the first media data) through AVPlayer1. AVPlayer1 uses AVPlayerItem1 to represent the content to be played. It represents a separate media resource, which may be an audio, video, or other type of media file. AVPlayer1 is used to control the playback of the video, while AVPlayerItem1 provides detailed information about the first media data and the first playback status information.Among them, the first playback status information refers to the playback status information of the first media data in the first system player. For example, when the first media data is paused in the first system player to 3 minutes and 15 seconds, the current playback time (currentTime) in the first playback status information can be indicated as "CMTimeMakeWithSeconds(195, 1)", that is, 195 seconds (3 minutes and 15 seconds); the playback status (status) in the first playback status information can be indicated as "AVPlayerStatusPaused", which indicates a paused state.
[0092] Step S403: Create a first data sharing instance associated with the first system player and the first shared data information in the first service application.
[0093] In an embodiment of the present application, the first wearable virtual display device can create a first data sharing instance (AVPlayerPlaybackCoordinator1) associated with the first system player and the first shared data information in the first business application. Among them, AVPlayerPlaybackCoordinator1 is used to manage the playback behavior and playback status of AVPlayer1. AVPlayerPlaybackCoordinator1 obtains playback information from AVPlayer1 and AVPlayerItem1, that is, the first playback status information of the first media data. Please refer to Figure 5 , Figure 5 This is a schematic diagram of the architecture of a data sharing method provided in an embodiment of the present application. Figure 5 As shown, the system includes a first wearable virtual display device 501a and a second wearable virtual display device 501b. The first wearable virtual display device 501a uses a first service application to call a first system player to play first media data, and generates first shared data information for the first media data based on the playback status of the first media data in the first system player. Furthermore, a first data sharing instance is created in the first service application, which is associated with both the first system player and the first shared data information.
[0094] At the same time, the user corresponding to the second wearable virtual display device 501b can run the same video application as the first business application, that is, the second business application. In the second business application, a media data X can be randomly selected to enter the playback page for the media data X. Further, the second switching sharing component in the playback page for the media data X can be triggered. At this time, the second wearable virtual display device 501b can obtain the shared activity object for the first media data through the communication link, call the second system player (AVPlayer2) based on the first media data in the shared activity object, generate the second shared data information (AVPlayerItem2), and create a second data sharing instance (AVPlayerPlaybackCoordinator2) associated with the second system player and the second shared data information in the second business application. It can be understood that at this time, the first playback status information in the first wearable virtual display device is temporarily not synchronized in AVPlayerItem2.
[0095] Step S404: create a group session instance on the communication link, and establish a shared interaction relationship between the first data sharing instance and the second data sharing instance created by the second wearable virtual display device through the group session instance; the group session instance is used to share data transmission of the shared activity object and the first playback status information between the first data sharing instance and the second data sharing instance in which the shared interaction relationship has been established; the second data sharing instance is used to control the second business application to play the first media data synchronously with the first wearable virtual display device according to the resource information and the first playback status information in the shared activity object obtained by sharing.
[0096] In an embodiment of the present application, a first wearable virtual display device may create a group session instance (GroupSession) on a communication link, establish a shared interaction relationship between the group session instance and a first data sharing instance, and establish a shared interaction relationship between the group session instance and a second data sharing instance created by a second wearable virtual display device, thereby establishing a shared interaction relationship between the first data sharing instance and the second data sharing instance through the group session instance. The group session instance is used to share data transmission of a shared activity object and first playback state information between the first data sharing instance and the second data sharing instance having established a shared interaction relationship.
[0097] Specifically, the first data sharing instance in the first wearable virtual display device can transmit the first playback status information of the first media data to the group session instance. At this point, the second data sharing instance in the second wearable virtual display device obtains the first playback status information of the first media data by real-time monitoring of the group session instance. Furthermore, the second wearable virtual display device can control the second business application, through the second data sharing instance, to play the first media data synchronously with the first wearable virtual display device according to the resource information and the first playback status information in the obtained shared activity object. Specifically, the second wearable virtual display device can synchronize the first playback status information in the first wearable virtual display device with AVPlayerItem2 through the second data sharing instance in the second business application, obtain the first media data based on the resource information of the first media data, and control the second system player (AVPlayer2) to play the first media data according to the synchronized first playback status information in AVPlayerItem2. At this point, AVPlayer1 and AVPlayer2 can play the first media data synchronously, and the information in AVPlayerItem1 and AVPlayerItem2 is also synchronized, i.e., AVPlayerItem1 and AVPlayerItem2 are identical.
[0098] That is to say, the AVPlayerPlaybackCoordinator (the above-mentioned AVPlayerPlaybackCoordinator1) in the first wearable virtual display device can receive the first playback status information and media data (for example, the first media data) of the second wearable virtual display device through the group session instance (GroupSession). The AVPlayerPlaybackCoordinator (the above-mentioned AVPlayerPlaybackCoordinator2) in the second wearable virtual display device receives the first playback status information and media data of the first wearable virtual display device through GroupSession. The AVPlayerPlaybackCoordinators of the two wearable virtual display devices coordinate the playback process based on the received information (first playback status information, media data) to ensure that the media playback on the two wearable virtual display devices is synchronized, thereby realizing synchronous sharing of the video.
[0099] See also Figure 5 ,like Figure 5As shown, the first wearable virtual display device 501a can create a group session instance on the communication link, and establish a shared interaction relationship between the first data sharing instance and the second data sharing instance created by the second wearable virtual display device 501b through the group session instance, so as to realize the sharing of the first media data played in the first system player or the second system player between the first data sharing instance and the second data sharing instance through the group session instance, as well as the sharing of the playback status information recorded in the first shared data information and the second shared data information respectively. Among them, the second data sharing instance is used to control the second business application to play the first media data synchronously with the first wearable virtual display device 501a according to the resource information and the first playback status information (from the first data sharing instance) in the shared activity object obtained by sharing. At the same time, when the first playback status information of the first media data in the second shared data information changes, the second wearable virtual display device 501b can synchronize the changed first playback status information to the first data sharing instance of the first wearable virtual display device 501a through the group session instance. At this time, the first data sharing instance can control the first business application to play the first media data synchronously with the second wearable virtual display device 501b according to the obtained changed first playback status information.
[0100] Through the above process, a group session instance, a first data sharing instance, and a second data sharing instance are created. A shared interactive relationship is established between the first wearable virtual display device and the second wearable virtual display device through the group session instance, and a shared connection is realized between the first wearable virtual display device and the second wearable virtual display. Thus, the resource information and the first playback status information of the first media data are transmitted between the first data sharing instance and the second data sharing instance through the group session instance, so that the participant is no longer passively displaying the screen sharing picture of the initiator, but directly plays the first media data shared by the initiator, and synchronizes the playback picture of the initiator through the first playback status information, providing the participant with the possibility of controlling the media data. Due to the real-time synchronous transmission of the first playback status information by the first data sharing instance and the second data sharing instance, both parties (the initiator and the participant) can initiate control to change the first playback status information of the first media data and synchronize it to the other party's device to provide a consistent playback experience, thereby increasing the sense of participation and interactivity of both parties. Moreover, since the participant is no longer passively displaying the shared screen picture, even if the network is unstable, the participant can still display the played first media data normally, ensuring the display effect of data sharing. The number of the second wearable virtual display device can be one or more, that is, the data sharing method can support multiple people to share videos synchronously, thereby enhancing social interactivity.
[0101] Further, see Figure 6 , Figure 6 This is a flow diagram of a data sharing method provided in an embodiment of the present application. Figure 2 The data sharing method may be executed by a computer device, which may be Figure 1 The terminal device 101a shown is the first wearable virtual display device. The following will be described using the data sharing method executed by the first wearable virtual display device as an example. The data processing method may include at least the following steps S601 to S607:
[0102] Step S601: establishing a communication link with a second wearable virtual display device through a communication application of the first wearable virtual display device.
[0103] In the embodiment of the present application, the specific implementation process of step S601 can be found in Figure 4 The specific description process in step S401 is not repeated here.
[0104] Step S602, when responding to the trigger operation of the first switching sharing component in the first business application, generates a sharing request for the first media data, creates a shared activity object associated with the first media data, obtains the first playback status information of the first media data in the first system player, and generates first shared data information based on the first playback status information.
[0105] In an embodiment of the present application, when responding to a trigger operation for a first switching sharing component in a first business application, the first wearable virtual display device can call the first system player through the first business application, and generate a sharing request for the first media data through the first system player. Furthermore, the first wearable virtual display device can obtain media attribute information associated with the first media data from the sharing request for the first media data, thereby creating a media data object (for example, a video object) based on the media attribute information, and creating a shared activity object (GroupActivity object) based on the media data object. Among them, the media attribute information may include basic information such as the data type, data name, preview image and resource information (video source, such as the URL of the first media data), data size (used to define the width and height of the video player) of the first media data. A media data object refers to a data collection object that includes media attribute information, that is, the relevant basic information of the first media data can be directly passed in through the media data object.
[0106] Specifically, the specific implementation process of the first wearable virtual display device creating a shared activity object based on the media data object can be: encapsulating the data type, data name, preview image, and resource information of the first media data in the media data object into metadata; and creating a shared activity object based on the first media data and metadata. The preview image refers to a target video frame randomly obtained from the first media data. For example, the video content corresponding to the first media data includes video frames 1 to video frames 1000, and a video frame (for example, video frame 399) is randomly obtained. In this case, the target video frame is video frame 399, and the first wearable virtual display device can determine video frame 399 as the preview image. Optionally, the preview image can be used to indicate the representative content of the first media data. The first wearable virtual display device can also extract video frame features of each video frame, then obtain summary text for the first media data, such as an introduction to the first media data, perform feature similarity matching on the video frame features with text features of the summary text, and determine the video frame corresponding to the video frame feature that best matches the text features of the summary text as the preview image. Among them, the instruction encapsulated into metadata (i.e., metadata) can be "var metadata:GroupActivityMetadata{varmetadata=GroupActivityMetadata(); metadata.type=watchTogether; metadata.title=video.title; metadata.previewImage=previewImage; metadata.fallbackURL=fallbackURL; metadata.supportsContinuationOnTV=true; return metadata;}" wherein metadata.type is used to indicate the data type, metadata.title is used to indicate the data name; metadata.previewImage is used to indicate the preview image; metadata.fallbackURL is used to indicate the URL of the first media data.
[0107] It is understandable that after the shared activity object is created, it needs to be activated. The first wearable virtual display device can determine whether to activate the shared activity object through the result returned by the prepareForActivation() method. The specific instruction can be "switch await activity.prepareForActivation(){case.activationPreferred:do{_=try await activity.activate()}catch{logger.debug("Unable to activate the activity:\(error)")}case.activationDisabled:sharedVideo=nil;default:break}". Among them, when the prepareForActivation() method returns ".activationDisabled", it means that the user does not want to share the activity or the current environment is not suitable for sharing (for example, the network is inactive or disconnected). At this time, local playback or other operations can be performed. When the prepareForActivation() method returns ".activationPreferred", it means that the user needs to share this activity and can activate the shared activity object. At this time, the activate() method can be called to activate the shared activity object, as shown in "activity.activate()" in the above instruction.
[0108] Furthermore, the first wearable virtual display device can load the first media data in the first system player based on the activated shared activity object, obtain first playback status information of the first media data in the first system player, and generate first shared data information based on the first playback status information. The first shared data information (i.e., AVPlayerItem1) can be used to record playback status information of the first media data in the first system player, resource information associated with the first media data, and the total playback time of the first media data.
[0109] Step S603: Create a first data sharing instance associated with the first system player and the first shared data information in the first service application.
[0110] In the embodiment of the present application, the specific implementation process of step S603 can be found in FIG. Figure 4 The specific description process in step S403 is not repeated here.
[0111] Step S604: create a group session instance on the communication link, establish a shared interaction relationship between the group session instance and the first data sharing instance through the session coordination method, and pass the group session instance to the second wearable virtual display device through the communication link provided by the communication application, so that the second data sharing instance in the second wearable virtual display device establishes a shared interaction relationship between the group session instance and the second data sharing instance through the session coordination method.
[0112] In an embodiment of the present application, after the shared activity object is activated, the first wearable virtual display device can create and asynchronously return a group session instance (GroupSession) through the sessions() method on the communication link. Furthermore, the group session instance can be passed to the first data sharing instance as the first shared parameter through the session coordination method, and the first wearable virtual display device can establish a shared interaction relationship between the first data sharing instance and the group session instance based on the first shared parameter. Among them, the instruction for the session coordination method can be "coordinateWithSession()", and the specific instruction for establishing a shared interaction relationship between the first data sharing instance and the group session instance based on the first shared parameter can be "private var GroupSession:GroupSession <videowatchingactivity>? {didSet{guardlet GroupSession else{return}playbackCoordinator.coordinateWithSession(GroupSession)}}". Among them, the GroupSession in the instruction is the first shared parameter corresponding to the group session instance, and playbackCoordinator is used to indicate the first data sharing instance.
[0113] Furthermore, the first wearable virtual display device can pass the group conversation instance to the second wearable virtual display device through the communication link provided by the communication application, so that the second data sharing instance in the second wearable virtual display device uses the acquired group conversation instance as the second sharing parameter through the session coordination method, and the second wearable virtual display device can establish a shared interaction relationship between the group conversation instance and the second data sharing instance according to the second sharing parameter. Among them, the second wearable virtual display device can detect and obtain the group conversation instance in real time through the communication link. Among them, the specific implementation instructions of the second wearable virtual display device establishing a shared interaction relationship between the group conversation instance and the second data sharing instance according to the second sharing parameter can refer to the specific instructions of the first wearable virtual display device establishing a shared interaction relationship between the first data sharing instance and the group conversation instance according to the first sharing parameter, which will not be repeated here.
[0114] After establishing a shared interactive relationship between the first data sharing instance and the second data sharing instance through the group session instance, the first wearable virtual display device can transmit the shared activity object and the first playback status information to the group session instance through the first data sharing instance. It can be understood that the second wearable virtual display device needs to detect the group session instance (GroupSession) in real time through the "session()" method. The specific execution instruction can be "forawait session in VideoWatchingActivity.sessions(){cleanUPSession(groupSession); GroupSession=session}". Among them, "cleanUPSession()" is used to clean up the old session, that is, when the second wearable virtual display device obtains the GroupSession in real time, when the obtained GroupSession changes, the last obtained GroupSession is cleaned up. Among them, the second data sharing instance in the second wearable virtual display device is used to obtain the shared active object and the first playback status information on the group session instance during the detection of the group session instance; the second data sharing instance is also used to call the second system player in the second business application, and the second system player plays the first media data synchronously with the first wearable virtual display device according to the shared active object and the first playback status information.
[0115] Specifically, the second wearable virtual display device can call the second system player in the second business application through the second data sharing instance, obtain the resource information of the first media data indicated in the shared activity object, obtain the first media data, and play the first media data synchronously with the first wearable virtual display device through the second system player in the second business application according to the first playback state information. For example, at this time, the first business application in the first wearable virtual display device plays the first media data (for example, the film and television series A_01) to 3 minutes and 15 seconds, then after the second business application in the second wearable virtual display device obtains the film and television series A_01, it synchronously plays the film and television series A_01 to 3 minutes and 15 seconds in the second business application.
[0116] Step S605: During the detection of the group session instance, the second shared data information sent by the second data sharing instance to the group session instance is obtained; when it is detected that the first playback status information and the second playback status information in the second shared data information are different, the target control operation instruction that is the same as the control operation instruction in the second playback status information is called through the first data sharing instance, and the first media data in the first system player is operated based on the target control operation instruction.
[0117] In an embodiment of the present application, the second system player is configured to generate second shared data information (AVPlayerItem2) associated with the first media data being synchronously played; the second shared data information includes resource information of the first media data and second playback state information of the first media data in the second service application. The first wearable virtual display device can obtain the second shared data information sent by the second data sharing instance to the group session instance during detection of the group session instance. It can be understood that when the first system player and the second system player play the first media data synchronously, the first shared data information (AVPlayerItem1) associated with the first system player and the second shared data information (AVPlayerItem2) associated with the second system player are the same, that is, the first playback status information is the same as the second playback status information. When the second system player receives a control operation for the first media data (such as a fast-forward operation), the second playback status information in AVPlayerItem2 may include a fast-forward operation instruction, that is, AVPlayerItem2 changes. At this time, the first playback status information is different from the second playback status information, that is, AVPlayerItem1 and AVPlayerItem2 are different. The playbackCoordinator2 instance can automatically intercept calls that affect the transmission control state, that is, the control operation instructions generated by the control operation for the first media data, and pass the above instructions to the group session instance.
[0118] When the first wearable virtual display device detects, through real-time detection of a group conversation instance, that the first playback state information and the second playback state information in the second shared data information are different, the first data sharing instance can be used to call a target control operation instruction identical to the control operation instruction in the second playback state information, and the first system player can synchronously perform the control operation indicated by the target control operation instruction on the first media data. Specifically, the first wearable virtual display device can call a target control operation instruction identical to the control operation instruction in the second playback state information through the first data sharing instance; if the target control operation instruction is a pause playback control instruction, the first media data can be synchronously paused through the first system player. The pause playback control instruction can be "pause()".
[0119] Optionally, if the target control operation instruction is a playback rate control instruction, the playback rate of the first media data is synchronously adjusted to the target playback rate indicated by the playback rate control instruction through the first system player. The playback rate control instruction can be "setRate(_:time:atHostTime:)". The target playback rate can be 1.25x, 1.5x, 2x, 3x, etc., 1.25x is used to indicate 1.25 times the speed, 1.5x is used to indicate 1.5 times the speed, 2x is used to indicate 2 times the speed, and 3x is used to indicate 3 times the speed. When the target playback rate is 2x, the first wearable virtual display device can synchronously adjust the playback rate of the first media data to 2 times the speed through the first system player, that is, play the first media data at 2 times the speed in the first business application.
[0120] Optionally, if the target control operation instruction is a progress adjustment instruction, the playback progress of the first media data is synchronously adjusted to the progress playback position indicated by the progress adjustment instruction through the first system player. The progress adjustment instruction can be "seek(to:completionHandler:)". Furthermore, the first wearable virtual display device can update the first shared data information through the target control operation instruction, and transmit the updated first shared data information to the group session instance. It can be understood that at this time, the updated AVPlayerItem1 is the same as the changed AVPlayerItem2. Therefore, through the above process, it is possible to confirm in real time whether the two devices maintain synchronous playback. If one device detects that the two devices are playing synchronously, no adjustment is required; if one device detects that the two devices are not playing synchronously, the playback status information on the other device is obtained, and adjustments are made in the own device according to the playback status information to achieve synchronous playback with the other device.
[0121] Step S606: When the first data sharing instance detects through the group session instance that the shared activity attribute in the second data sharing instance has changed, the media data loading function is called to obtain the second media data; in the process of detecting the group session instance, the third data sharing information sent by the second data sharing instance to the group session instance is obtained; and the first system player switches the first media data to the second media data according to the third playback status information.
[0122] In an embodiment of the present application, a first wearable virtual display device can detect changes in the shared activity attributes in a second data sharing instance by using the "awaitcoordinator.$sharedVideo" command, where "sharedVideo" indicates the shared activity attributes. The shared activity attributes in the second data sharing instance indicate the media data currently being played in the second service application. For example, when the second service application plays the first media data synchronously with the first service application, the shared activity attributes in the second data sharing instance may include resource information for the first media data. When the second service application switches to playing the second media data, the shared activity attributes in the second data sharing instance are updated to include the resource information for the second media data. It should be noted that both the first and second media data belong to a shared media data set. For example, if the shared media data set is TV series A (consisting of 30 episodes), and the first media data can be TV series A_01, the second media data can be any episode of the 30 episodes except the first. It is understood that when the second service application in the second wearable virtual display device switches to playing the second media data, only the shared data in the shared activity is changed, without the need to initiate a new shared activity.
[0123] When the first data sharing instance in the first wearable virtual display device detects a change in the shared activity attributes in the second data sharing instance through the group session instance, the media data loading function can be called to obtain the second media data. The specific instruction for calling the media data loading function to obtain the second media data can be "self.loadVideo(video,presentation:.fullWindow)", where the video in the instruction is used to indicate the video object corresponding to the second media data. That is, when the second wearable virtual display device responds to the trigger operation for the episode replacement component, it can obtain the second media data determined by the user-triggered episode component, play the second media data in the second business application in the second wearable virtual display device, and pass the resource information related to the second media data (for example, a URL) into sharedVideo, which is then passed to the sharedVideo in the first wearable virtual display device through the group session instance for synchronization, so that when the first wearable virtual display device detects a change in sharedVideo, it can call the media data loading function to obtain the second media data. The first media data belongs to a shared media data set; the shared activity attribute in the second data sharing instance is obtained by the second data sharing instance from the group session instance, and the shared activity attribute in the group session instance is determined by the shared activity object; the changed shared activity attribute is determined by switching the second media data to be shared in the second business application, and the second media data belongs to the shared media data set. For example, the shared media data set can be a 30-episode TV series A, the first media data can be the first episode of TV series A, and the second media data can be any episode of the 30 episodes other than the first, for example, generally the second episode. In this case, the shared activity attribute in the group session instance mentioned above indicates that the first media data, that is, the first episode of TV series A (TV series A_01), is currently playing, and the shared activity attribute in the second data sharing instance also indicates that TV series A_01 is currently playing. When the user corresponding to the second wearable virtual display device switches to playing TV series A_02, the changed shared activity attribute now indicates that TV series A_02 is currently playing. That is, the first wearable virtual display device detects the shared activity attributes transmitted from the second wearable virtual display device in real time through the group session instance. When the shared activity attributes change (that is, shared activity attributes that are different from the shared activity attributes in this device are obtained), the playback sharing adjustment can be performed through the changed shared activity attributes.
[0124] Furthermore, the first wearable virtual display device can obtain the third data sharing information sent by the second data sharing instance to the group session instance through the first data sharing instance during the detection of the group session instance. The third data sharing information includes third playback status information for the second media data. The first wearable virtual display device can call the first system player through the first data sharing instance, and switch the first media data to the second media data according to the third playback status information through the first system player. At this time, the first business application and the second business application play the second media data synchronously. For example, the second media data in the second business application is playing to 12 minutes and 31 seconds, and the second media data in the first business application is also playing to 12 minutes and 31 seconds.
[0125] Step S607: When it is detected that the second wearable virtual display device has created an update group session instance for the updated media data on the communication link, a new shared interaction relationship is established between the first data sharing instance and the second data sharing instance through the update group session instance; in the process of detecting the update group session instance, the updated shared activity object and the updated data sharing information are obtained; the first media data is replaced with the updated media data through the first system player, and the updated media data is played synchronously with the second wearable virtual display device according to the updated playback status information.
[0126] In an embodiment of the present application, when the first wearable virtual display device detects that the second wearable virtual display device has created an update group session instance for updating media data on the communication link, a new sharing interaction relationship is established between the first data sharing instance and the second data sharing instance through the update group session instance. That is, when the second wearable virtual display device initiates a new sharing activity for updating media data, for example, at this time, the first media data associated with the group session instance is film and television series A, and the second wearable virtual display device initiates a sharing activity for film and television series B, and creates an update group session instance for the sharing activity of film and television series B. At this time, the first wearable virtual display device can detect the update group session instance through the communication link, and establish a new sharing interaction relationship between the group session instance and the first data sharing instance, so as to achieve the establishment of a new sharing interaction relationship between the first data sharing instance and the second data sharing instance through the update group session instance. It can be understood that the updated media data generally refers to an episode in film and television series B. It should be noted that the above process is used to illustrate that when multiple users are watching TV series A synchronously, when one of the users wants to share watching TV series B with other users, it is necessary to recreate a new group session instance (i.e., update the group session instance) and establish a new sharing interaction relationship through the ongoing communication link, that is, the user initiates a new sharing activity.
[0127] Furthermore, during the process of detecting the update group session instance, the first wearable virtual display device can obtain the updated shared activity object and updated data sharing information sent to the update group session instance by the second data sharing instance that has established a new shared interaction relationship. Among them, the updated shared activity object includes updated resource information of the updated media data; the updated data sharing information includes updated playback status information of the updated media data. The specific implementation method of the second wearable display device creating the updated shared activity object can be found in the specific description of the first wearable virtual display device creating the shared activity object in step S602, which will not be repeated here. The first wearable virtual display device can call the first system player through the first data sharing instance, replace the first media data with the updated media data through the first system player, and play the updated media data synchronously with the second wearable virtual display device according to the updated playback status information.
[0128] Through the above process, a group session instance, a first data sharing instance, and a second data sharing instance are created. A shared interactive relationship is established between the first wearable virtual display device and the second wearable virtual display device through the group session instance, and a shared connection is realized between the first wearable virtual display device and the second wearable virtual display. Thus, the resource information and the first playback status information of the first media data are transmitted between the first data sharing instance and the second data sharing instance through the group session instance, so that the participant is no longer passively displaying the screen sharing picture of the initiator, but directly plays the first media data shared by the initiator, and synchronizes with the initiator's playback picture through the first playback status information, providing the participant with the possibility of controlling the media data. Due to the real-time synchronous transmission of the first playback status information by the first data sharing instance and the second data sharing instance, both parties (the initiator and the participant) can initiate control to change the first media data or the first playback status information of the first media data, and synchronize it to the other party's device to provide a consistent playback experience, thereby increasing the sense of participation and interactivity of both parties. Moreover, since the participant is no longer passively displaying the shared screen picture, even if the network is unstable, the participant can still display the played first media data normally, ensuring the display effect of data sharing. Both parties can also initiate and control a new sharing activity, thereby establishing a new sharing interaction relationship. Through a new group session instance, a first data sharing instance, and a second data sharing instance, resource information and playback status information of the media data in the new sharing activity can be synchronously shared. The number of second wearable virtual display devices can be one or more, that is, this data sharing method can support simultaneous video sharing among multiple people, enhancing social interactivity.
[0129] Further, see Figure 7 , Figure 7 This is a flow diagram of a data sharing method provided in an embodiment of the present application. Figure 3 The data sharing method may be executed by a computer device, which may be Figure 1 The terminal device 101a shown is the first wearable virtual display device. The following will be described using the data sharing method executed by the first wearable virtual display device as an example. The data processing method may include at least the following steps S701 to S703:
[0130] Step S701: In a virtual display interface of a first wearable virtual display device, in response to a communication operation in a communication application, a session page for communicating with a second wearable virtual display device is displayed in the virtual display interface.
[0131] In the embodiments of this application, please refer to Figure 2 In the virtual display interface 201 of the first wearable virtual display device, the first wearable virtual display device can respond to a communication operation in the communication application and display a conversation page 2021 for communicating with the second wearable virtual display device in the virtual display interface 202. The display area 2021a of the conversation page 2021 can display content captured by the camera of the second wearable virtual display device, such as a portrait or object captured by the second wearable virtual display device.
[0132] Step S702, in response to the triggering operation of the first switching sharing component in the first data playback page in the first business application in the virtual display interface, the first playback content in the first data playback page is shared with the second wearable virtual display device with which a communication connection has been established in the session page.
[0133] In the embodiment of the present application, the first wearable virtual display device can respond to the triggering operation of the first switching sharing component 2031a in the first data playback page 2031 in the first business application in the virtual display interface 203, and share the first playback content 2031a in the first data playback page 2031 with the second wearable virtual display device that has established a communication connection in the session page 2021. That is, the virtual display interface of the second wearable virtual display device is as follows: Figure 3 As shown in the virtual display interface 301 in FIG, the first playback content 2031a is played synchronously with the first wearable virtual display device (ie, the first wearable virtual display device) to 01:15. Among them, the first playback content 2031a can be Figure 4 The first media data mentioned in the embodiment.
[0134] Optionally, when the first wearable virtual display device responds to the triggering operation of the first switching sharing component 2031a in the first data playback page 2031, the first wearable virtual display device can obtain the cumulative triggering times of the first switching sharing component 2031a. If the cumulative triggering times are less than the sharing times threshold, a sharing prompt pop-up interface for the first business application is displayed on the virtual display interface. The sharing times threshold can be set manually. For example, when the sharing times threshold is 1, the cumulative triggering times are less than 1, which means that the first business application in the first wearable virtual display device responds to the triggering operation of the first switching sharing component 2031a for the first time, that is, the first time a shared playback activity is initiated. Please refer to Figure 8 , Figure 8 This is a scenario diagram of a data sharing method provided by an embodiment of the present application. Figure 3 ,like Figure 8 As shown, it includes a virtual display interface 801 and a virtual display interface 203, Figure 8 The virtual display interface 203 in Figure 2 The virtual display interface 203 in the virtual display interface 801 includes a conversation page 2021 and a display area 2021a. If the cumulative trigger count is less than the sharing count threshold, the first wearable virtual display device displays a sharing prompt pop-up interface 8011 for the first business application in the virtual display interface 801. The cumulative trigger count refers to the number of times a user triggers the first switching sharing component 2031a to complete shared playback with the second wearable virtual display device. If a user triggers the first switching sharing component 2031a but cancels shared playback with the second wearable virtual display device, this is not counted in the cumulative trigger count. For example, if user A triggers the first switching sharing component 2031a and has performed synchronous sharing with user B 5 times, the cumulative number of triggers is 5. When the sharing number threshold is 1, the first wearable virtual display device does not display the sharing prompt pop-up interface 8011 in the virtual display interface 801, and directly displays the first playback content 2031b in the virtual display interface 203, and the cumulative number of triggers increases to 6; if user A does not trigger the first switching sharing component 2031a and has performed synchronous sharing with user B, the cumulative number of triggers is 0. When the sharing number threshold is 1, the first wearable virtual display device displays the sharing prompt pop-up interface 8011 in the virtual display interface 801, and the cumulative number of triggers increases to 1.
[0135] Furthermore, if the user cancels the shared playback activity by clicking the ignore component 8011a in the sharing prompt pop-up interface 8011, the first wearable virtual display device, in response to the triggering operation on the ignore component 8011a, cancels the shared playback of the first playback content 2031b in the first data playback page 2031 with the second wearable virtual display device with which a communication connection has been established in the session page 2021. It should be noted that when the user cancels the sharing activity, the cumulative trigger count for the first switching sharing component 2031a is not accumulated. If the user starts the shared playback activity by clicking the start component 8011b in the sharing prompt pop-up interface 8011, the first wearable virtual display device, in response to the triggering operation on the start component 8011b, closes the sharing prompt pop-up interface 8011 and shares the first playback content 2031b in the first data playback page 2031 with the second wearable virtual display device with which a communication connection has been established in the session page 2021. At this time, the virtual display interface in the first wearable virtual display device is shown as virtual display interface 203, and the virtual display interface in the second wearable virtual display device is shown as Figure 3 As shown in the virtual display interface 301 in .
[0136] It can be understood that due to the functions of the first wearable virtual display device (XR device) and the second wearable virtual display device themselves, different virtual environments can be provided for users to watch videos, and their spatial audio technology can provide an immersive sound experience, making users feel that the sound comes from all directions, thereby increasing the fun and immersion of watching movies.
[0137] Step S703: When it is detected that the second wearable virtual display device performs a control operation on the shared first playback content, a control operation is synchronously performed on the first playback content in the first data playback page in the first business application.
[0138] In the embodiment of the present application, the control operation may include a pause operation, a progress adjustment operation, and a play rate control operation. Taking the terminal device 101b as the second wearable virtual display device as an example, see Figure 3 In the virtual display interface 302 in FIG. 302, when the second wearable virtual display device responds to the trigger operation of the playback control component 3021b in the second data playback page 3021 and performs a pause operation on the first playback content 3021a, the first wearable virtual display device can detect the pause operation performed by the second wearable virtual display device on the shared first playback content 3021a. Figure 2 The first wearable virtual display device can synchronously pause the first playback content 2041b on the first data playback page 2041 in the first business application. At this time, the first playback content 2041b is paused at 03:15, and the playback control component 2031c on the first data playback page 2031 changes to the pause control component 2041a on the first data playback page 2041.
[0139] Optional, see Figure 3 In the virtual display interface 302 in the second data playback page 3021, when the second wearable virtual display device responds to the trigger operation of the progress control component 3021c in the second data playback page 3021 and performs a progress adjustment operation on the first playback content 3021a, for example, when the playback progress of the first playback content 3021a is dragged from 03:15 to 11:35, the first wearable virtual display device can detect the progress adjustment operation performed by the second wearable virtual display device on the shared first playback content 3021a. Please also refer to Figure 9 , Figure 9 This is a scenario diagram of a data sharing method provided by an embodiment of the present application. Figure 4 , Figure 9 Used to indicate the changing scene of the virtual display interface in the first wearable virtual display device. Figure 9 As shown in the virtual display interface 901 in the first business application, the first wearable virtual display device can synchronously perform a progress adjustment operation on the first playback content 9011a on the first data playback page 9011, that is, drag the progress control component 9011c in the progress bar from 03:15 to 11:35. As shown in the progress control component 9021b at 11:35 on the progress bar of the first data playback page 9021 in the virtual display interface 902, the first playback content 9021a on the first data playback page 9021 is now the content at 11 minutes and 35 seconds of the video content corresponding to episode A_01.
[0140] Optional, see Figure 3 In the virtual display interface 302 in the second data playback page 3021, when the second wearable virtual display device responds to the trigger operation of the rate control component 3021d in the second data playback page 3021 and determines the target playback rate of the first playback content 3021a, when the playback rate control operation is performed on the first playback content 3021a, for example, the target playback rate is 2x, that is, the first playback content 3021a is played at 2 times the speed. The first wearable virtual display device can detect the playback rate control operation performed by the second wearable virtual display device on the shared first playback content 3021a, and further trigger the following Figure 9 The rate control component 9011d shown in the figure adjusts the playback rate of the first playback content 9011a to the target playback rate, that is, the first playback content 3021a is played at 2 times the speed in the second wearable virtual display device, and the first playback content 9011a is also played at 2 times the speed in the first wearable virtual display device.
[0141] Optional, see Figure 3 In the virtual display interface 302 in the second data playback page 3021, when the second wearable virtual display device responds to the trigger operation of the selection control component 3021f in the second data playback page 3021 and determines to perform the episode switching control operation on the specific playback content in the first playback content 3021a, that is, when the specific content of the first playback content 3021a is switched from the first media data to the second media data, for example, the specific content of the first playback content 3021a is switched from episode A_01 to episode A_03. The first wearable virtual display device can detect the episode switching control operation performed by the second wearable virtual display device on the shared first playback content 3021a, and further trigger the following operation: Figure 9 The selection control component 9011f shown in FIG. 1 switches the first playback content 9011a to the first playback content 9031a shown in the first data playback page 9031 in the virtual display interface 903. At this time, the first playback content 9031a is the drama A_03.
[0142] Optional, see Figure 10 , Figure 10 This is a scenario diagram of a data sharing method provided by an embodiment of the present application. Figure 5 ,like Figure 10 As shown, it includes a virtual display interface 203, a virtual display interface 1001 and a virtual display interface 1002. The virtual display interface 203 is Figure 2 The virtual display interface 203 shown in . When the first wearable virtual display device detects that the second wearable virtual display device initiates a sharing request for updated playback content in the second data playback page, and the updated playback content is different from the first playback content in the shared playback of the first data playback page, the first wearable virtual display device can detect the sharing request for updated media data and display a playback replacement prompt content interface in the first data playback page in the first business application, wherein the second data playback page refers to the playback page in the second business application in the second wearable virtual display device. For example, when the first wearable virtual display device and the second wearable virtual display device share the first media data (for example, it can be episode A) in the shared media data set (for example, it can be episode A), the second wearable virtual display device re-initiates a sharing request for updated media data (for example, it can be episode B_01). At this time, the first wearable virtual display device can detect the sharing request for updated media data and display a playback replacement prompt content interface as shown in the following example. Figure 10 The first data play page 2031 of the virtual display interface 1001 displays a play replacement prompt content interface 10011 .
[0143] Furthermore, when the user corresponding to the first wearable virtual display device disagrees with the second wearable virtual display device sharing updated media data with the first wearable virtual display device, the user can click the cancel component 10011a in the play replacement prompt content interface 10011. In this case, the sharing request initiated by the second wearable virtual display device for the updated media data cannot be completed. When the user corresponding to the first wearable virtual display device agrees with the second wearable virtual display device sharing updated media data with the first wearable virtual display device, the user can click the replace component 10011b in the play replacement prompt content interface 10011. In this case, the first wearable virtual display device responds to the triggering operation of the replace component in the play replacement prompt content interface 10011, closes the play replacement prompt content interface 10011, replaces the first playback content 2031b on the first data playback page 2031, and shares the updated playback content with the second wearable virtual display device. For example, as shown in the virtual display interface 1002, the first wearable virtual display device shares the updated playback content 10021a with the second wearable virtual display device on the first data playback page 10021.
[0144] It can be understood that the first wearable virtual display device and the second wearable virtual display device can realize the synchronous playback of media data between the first wearable virtual display device and the second wearable virtual display device through the first data sharing instance, the second numerical control sharing instance and the group session instance. The specific implementation process and the meaning of the first data sharing instance, the second numerical control sharing instance and the group session instance can be found in the above Figure 4 、 Figure 6 and Figure 7 The specific description in the corresponding embodiment will not be repeated here.
[0145] Through the above process, it is possible to ensure that the first playback content in the first wearable virtual display device and the second wearable virtual display device is synchronized, that is, it can support users to share and watch videos (i.e., the first playback content), and the playback progress and playback status of the video are also synchronized, enhancing the user's shared experience. At the same time, the participant corresponding to the second wearable virtual display device is no longer passively displaying the shared screen image, but directly displays and plays the first playback content. Both parties can trigger the control component to change the playback status of the first media data or the first media data, and synchronize it to the other party's device to provide a consistent playback experience, increasing the interactivity of both parties. The number of second wearable virtual display devices can be one or more (i.e., the number of participants can be one or more), which can support multiple users to share and watch videos at the same time. Each user can share the video with other users in their corresponding wearable virtual display device, and can interact with other users in real time through the conversation page, for example, to make comments or share feelings, etc., which can further enhance the user experience.
[0146] Further, see Figure 11 , Figure 11 This is a schematic diagram of a data sharing device provided in an embodiment of the present application. Figure 1 The data sharing device 1100 may be a computer program running on a computer device, for example, the data sharing device 1100 may be an application software; the data sharing device 1100 may be used to execute the corresponding steps of the method provided in the embodiment of the present application. Figure 11 As shown, the data sharing device 1100 can be used to Figure 4 、 Figure 6 and Figure 7 The computer device in the corresponding embodiment, specifically, the data sharing apparatus 1100 may include: a communication connection module 11 , an active object creation module 12 , a data sharing instance creation module 13 , and a sharing interaction relationship establishment module 14 .
[0147] The communication connection module 11 is configured to establish a communication link with the second wearable virtual display device through the communication application of the first wearable virtual display device;
[0148] The activity object creation module 12 is configured to, upon acquiring a first business application of the first wearable virtual display device and invoking a first system player to initiate a sharing request for first media data, create a shared activity object based on the sharing request for the first media data, and generate first shared data information in the first system player based on the shared activity object; the shared activity object includes resource information of the first media data; the first shared data information includes first playback status information; and the first media data is media data required to be played in the first business application;
[0149] A data sharing instance creation module 13 is configured to create, in a first service application, a first data sharing instance associated with a first system player and first shared data information;
[0150] The shared interaction relationship establishment module 14 is used to create a group session instance on the communication link, and establish a shared interaction relationship between the first data sharing instance and the second data sharing instance created by the second wearable virtual display device through the group session instance; the group session instance is used to share data transmission of the shared activity object and the first playback status information between the first data sharing instance and the second data sharing instance in which the shared interaction relationship has been established; the second data sharing instance is used to control the second business application to play the first media data synchronously with the first wearable virtual display device according to the resource information and the first playback status information in the shared activity object obtained by sharing.
[0151] In a possible implementation, the sharing interaction relationship establishing module 14 is further configured to perform the following operations:
[0152] The shared activity object and the first playback status information are transmitted to the group session instance through the first data sharing instance; the second data sharing instance is used to obtain the shared activity object and the first playback status information during the detection of the group session instance; the second data sharing instance is also used to call the second system player in the second business application, and the second system player plays the first media data synchronously with the first wearable virtual display device according to the shared activity object and the first playback status information.
[0153] In one possible implementation, the second system player is configured to generate second shared data information associated with the first media data being synchronously played; the second shared data information includes resource information of the first media data and second playback state information of the first media data in the second service application; and the shared interaction relationship establishing module 14 is further configured to perform the following operations:
[0154] In the process of detecting the group conversation instance, obtaining second shared data information sent by the second data sharing instance to the group conversation instance;
[0155] When it is detected that the first playback state information and the second playback state information in the second shared data information are different, calling the target control operation instruction that is the same as the control operation instruction in the second playback state information through the first data sharing instance, and synchronously performing the control operation indicated by the target control operation instruction on the first media data through the first system player;
[0156] The first shared data information is updated through the target control operation instruction, and the updated first shared data information is transmitted to the group session instance.
[0157] In one possible implementation, the shared interaction relationship establishing module 14 is configured to call, through the first data sharing instance, a target control operation instruction identical to the control operation instruction in the second playback state information. When the first system player synchronously performs the control operation indicated by the target control operation instruction on the first media data, the shared interaction relationship establishing module 14 is specifically configured to perform the following operations:
[0158] calling, through the first data sharing instance, a target control operation instruction that is the same as the control operation instruction in the second playback state information;
[0159] If the target control operation instruction is a pause playback control instruction, the first system player synchronously pauses playback of the first media data;
[0160] If the target control operation instruction is a playback rate control instruction, then synchronously adjusting the playback rate of the first media data to the target playback rate indicated by the playback rate control instruction through the first system player;
[0161] If the target control operation instruction is a progress adjustment instruction, the playback progress of the first media data is synchronously adjusted to the progress playback position indicated by the progress adjustment instruction through the first system player.
[0162] In a possible implementation, the first media data belongs to a shared media data set; and the shared interaction relationship establishing module 14 is further configured to perform the following operations:
[0163] When the first data sharing instance detects, through the group session instance, a change in a shared activity attribute in the second data sharing instance, the first data sharing instance calls a media data loading function to obtain the second media data based on resource information of the second media data indicated by the changed shared activity attribute; the shared activity attribute in the second data sharing instance is obtained by the second data sharing instance from the group session instance, and the shared activity attribute in the group session instance is determined by a shared activity object; the changed shared activity attribute is determined by switching the second media data to be shared in the second business application; the second media data belongs to the shared media data set;
[0164] In the process of detecting the group conversation instance, obtaining third data sharing information sent by the second data sharing instance to the group conversation instance; the third data sharing information includes third playback state information for the second media data;
[0165] The first system player is called through the first data sharing instance, and the first system player switches the first media data to the second media data according to the third playback state information.
[0166] In a possible implementation, the sharing interaction relationship establishing module 14 is further configured to perform the following operations:
[0167] When it is detected that the second wearable virtual display device has created an update group session instance for updating media data on the communication link, establishing a new sharing interaction relationship between the first data sharing instance and the second data sharing instance through the update group session instance;
[0168] In the process of detecting the update group conversation instance, obtaining the update sharing activity object and the update data sharing information sent by the second data sharing instance having established a new sharing interaction relationship to the update group conversation instance; the update sharing activity object includes the update resource information of the updated media data; the update data sharing information includes the update playback status information of the updated media data;
[0169] The first system player is called through the first data sharing instance, the first media data is replaced with the updated media data through the first system player, and the updated media data is played synchronously with the second wearable virtual display device according to the updated playback state information.
[0170] In one possible implementation, the activity object creation module 12 is configured to, when acquiring the first business application of the first wearable virtual display device and invoking the first system player to initiate a sharing request for the first media data, create a shared activity object based on the sharing request for the first media data. When generating the first shared data information based on the shared activity object in the first system player, the activity object creation module 12 is specifically configured to perform the following operations:
[0171] In response to a triggering operation on a first switching sharing component in a first service application, calling a first system player through the first service application, and generating a sharing request for the first media data through the first system player;
[0172] Acquire media attribute information associated with the first media data from a sharing request for the first media data, create a media data object based on the media attribute information, and create a shared activity object based on the media data object;
[0173] In the first system player, the first media data is loaded based on the shared activity object, first playback state information of the first media data in the first system player is obtained, and first shared data information is generated based on the first playback state information.
[0174] In a possible implementation, when the active object creation module 12 is used to create a shared active object according to the media data object, the active object creation module 12 is specifically used to perform the following operations:
[0175] Encapsulate the data type, data name, preview image, and resource information of the first media data in the media data object into metadata; the preview image refers to a target video frame randomly obtained from the first media data;
[0176] A shared activity object is created based on the first media data and the metadata.
[0177] In one possible implementation, when the shared interaction relationship establishing module 14 is used to establish a shared interaction relationship between the first data sharing instance and the second data sharing instance created by the second wearable virtual display device through the group session instance, the shared interaction relationship establishing module 14 is specifically used to perform the following operations:
[0178] passing the group session instance as a first sharing parameter to the first data sharing instance through the session coordination method, and establishing a sharing interaction relationship between the first data sharing instance and the group session instance according to the first sharing parameter;
[0179] The group conversation instance is passed to the second wearable virtual display device through the communication link provided by the communication application, so that the second data sharing instance in the second wearable virtual display device uses the acquired group conversation instance as the second sharing parameter through the session coordination method, and establishes a shared interaction relationship between the group conversation instance and the second data sharing instance according to the second sharing parameter.
[0180] Further, see Figure 12 , Figure 12 This is a schematic diagram of a data sharing device provided in an embodiment of the present application. Figure 2 The data sharing device 1200 may be a computer program running on a computer device, for example, the data sharing device 1200 may be an application software; the data sharing device 1200 may be used to execute the corresponding steps of the method provided in the embodiment of the present application. Figure 12 As shown, the data sharing device 1200 can be used to Figure 4 、 Figure 6 and Figure 7 The computer device in the corresponding embodiment, specifically, the data sharing device 1100 may include: a session page display module 21 , a shared playback module 22 , and a synchronous display module 23 .
[0181] The conversation page display module 21 is configured to display a conversation page for communicating with the second wearable virtual display device in the virtual display interface in response to a communication operation in the communication application in the virtual display interface of the first wearable virtual display device;
[0182] The shared playback module 22 is configured to respond to a triggering operation of a first switching sharing component in a first data playback page in a first business application in a virtual display interface, and share the playback content in the first data playback page with a second wearable virtual display device with which a communication connection has been established in a session page;
[0183] The synchronous display module 23 is used to synchronously perform a control operation on the playback content in the first data playback page in the first business application when it is detected that the second wearable virtual display device performs a control operation on the shared playback content.
[0184] In a possible implementation, the shared playback module 22 is further configured to perform the following operations:
[0185] Obtaining the cumulative number of triggering times for triggering the first switching sharing component, and if the cumulative number of triggering times is less than a sharing times threshold, displaying a sharing prompt pop-up interface for the first business application on the virtual display interface;
[0186] In response to the triggering operation of the opening component in the sharing prompt pop-up interface, the sharing prompt pop-up interface is closed, and the first playback content in the first data playback page is shared and played to the second wearable virtual display device with which a communication connection has been established in the session page.
[0187] In a possible implementation, the synchronization display module 23 is further configured to perform the following operations:
[0188] When a sharing request for updated playback content in a second data playback page is detected to be initiated by a second wearable virtual display device, and the updated playback content is different from the first playback content in the shared playback of the first data playback page, a playback replacement prompt content interface is displayed in the first data playback page of the first business application; the second data playback page refers to the playback page in the second business application in the second wearable virtual display device;
[0189] In response to a triggering operation on a replacement component in the playback replacement prompt content interface, the playback replacement prompt content interface is closed, the first playback content is replaced in the first data playback page, and the updated playback content is shared with the second wearable virtual display device.
[0190] Through the above process, a group session instance, a first data sharing instance, and a second data sharing instance are created. A shared interactive relationship is established between the first wearable virtual display device and the second wearable virtual display device through the group session instance, and a shared connection is realized between the first wearable virtual display device and the second wearable virtual display. Thus, the resource information and the first playback status information of the first media data are transmitted between the first data sharing instance and the second data sharing instance through the group session instance, so that the participant is no longer passively displaying the screen sharing picture of the initiator, but directly plays the first media data shared by the initiator, and synchronizes with the initiator's playback picture through the first playback status information, providing the participant with the possibility of controlling the media data. Due to the real-time synchronous transmission of the first playback status information by the first data sharing instance and the second data sharing instance, both parties (the initiator and the participant) can initiate control to change the first media data or the first playback status information of the first media data, and synchronize it to the other party's device to provide a consistent playback experience, thereby increasing the sense of participation and interactivity of both parties. Moreover, since the participant is no longer passively displaying the shared screen picture, even if the network is unstable, the participant can still display the played first media data normally, ensuring the display effect of data sharing. Both parties can also initiate and control a new sharing activity, thereby establishing a new sharing interaction relationship. Through a new group session instance, a first data sharing instance, and a second data sharing instance, resource information and playback status information of the media data in the new sharing activity can be synchronously shared. The number of second wearable virtual display devices can be one or more, that is, this data sharing method can support simultaneous video sharing among multiple people, enhancing social interactivity.
[0191] See Figure 13 , Figure 13 This is a schematic diagram of the structure of a computer device provided in an embodiment of the present application. Figure 13 As shown, the computer device 1300 in the embodiment of the present application may include: a processor 1301, a network interface 1304 and a memory 1305. In addition, the above-mentioned computer device 1300 may also include: a user interface 1303, and at least one communication bus 1302. Among them, the communication bus 1302 is used to realize the connection and communication between these components. Among them, the user interface 1303 may include a display screen (Display), a keyboard (Keyboard), and the optional user interface 1303 may also include a standard wired interface and a wireless interface. The network interface 1304 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1305 may be a high-speed RAM memory, or it may be a non-volatile memory (non-volatile memory), such as at least one disk storage. The memory 1305 may optionally also be at least one storage device located away from the aforementioned processor 1301. As Figure 13 As shown, the memory 1305 as a computer-readable storage medium may include an operating system, a network communication module, a user interface module, and a computer program.
[0192] The network interface 1304 can provide network communication network elements; the user interface 1303 is mainly used to provide an interface for user input; and the processor 1301 can be used to call the computer program stored in the memory 1305, specifically for executing Figure 4 、 Figure 6 and Figure 7 Each step in the embodiment.
[0193] In addition, it should be noted that: the embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, the computer program is suitable for being loaded and executed by the processor Figure 4 、 Figure 6 and Figure 7 For details on the methods provided in each step, please refer to the Figure 4 、 Figure 6 and Figure 7 The implementation methods provided in each step will not be repeated here. In addition, the description of the beneficial effects of adopting the same method will not be repeated. For technical details not disclosed in the computer-readable storage medium embodiment involved in this application, please refer to the description of the method embodiment of this application. As an example, the computer program can be deployed to be executed on one computer device, or on multiple computer devices located in one location, or on multiple computer devices distributed in multiple locations and interconnected by a communication network.
[0194] The computer-readable storage medium may be the device provided in any of the aforementioned embodiments or the internal storage unit of the computer device, such as the hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a smart memory card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the computer device. Furthermore, the computer-readable storage medium may also include both the internal storage unit of the computer device and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by the computer device. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.
[0195] The present application also provides a computer program product, which includes a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device performs Figure 4 、 Figure 6 and Figure 7 The methods provided in the various optional methods are therefore not described in detail here.
[0196] The terms "first," "second," and the like in the description, claims, and drawings of the embodiments of this application are used to distinguish between different objects, rather than to describe a specific order. Furthermore, the terms "comprises" and "comprising" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product, or device comprising a series of steps or units is not limited to the listed steps or modules, but may optionally include steps or modules not listed, or may optionally include other steps and units inherent to such process, method, apparatus, product, or device.
[0197] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories), or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the functions of the module or unit.
[0198] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in this description according to their functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0199] The methods and related devices provided in the embodiments of the present application are described with reference to the method flow charts and / or structural diagrams provided in the embodiments of the present application. Specifically, each process and / or block in the method flow charts and / or structural diagrams, as well as the combination of processes and / or blocks in the flow charts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable device to generate a machine, so that the instructions executed by the processor of the computer or other programmable device generate instructions for implementing the steps in the process. Figure 1 Schematic diagram of one or more processes and / or structures Figure 1 These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable device to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device, or are transmitted through a computer-readable storage medium. Computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The instruction device is implemented in the process Figure 1 Schematic diagram of one or more processes and / or structures Figure 1 These computer program instructions can also be loaded onto a computer or other programmable device so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 The flow or flows and / or structures illustrate the steps of the functions specified in one block or multiple blocks.
[0200] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.
[0201] The modules in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.
[0202] The above disclosure is only a preferred embodiment of the present application, and certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.< / videowatchingactivity>
Claims
1. A data sharing method, characterized in that: The method comprises: establishing a communication link with the second wearable virtual display device through a communication application of the first wearable virtual display device; When a first business application of the first wearable virtual display device is acquired and a first system player is called to initiate a sharing request for first media data, a shared activity object is created based on the sharing request for the first media data, and first shared data information is generated in the first system player based on the shared activity object; the shared activity object includes resource information of the first media data; the first shared data information includes first playback status information; and the first media data is media data required to be played in the first business application; Creating a first data sharing instance associated with the first system player and the first shared data information in the first service application; A group session instance is created on the communication link, and a shared interaction relationship is established between the first data sharing instance and the second data sharing instance created by the second wearable virtual display device through the group session instance; the group session instance is used to share data transmission of the shared activity object and the first playback status information between the first data sharing instance and the second data sharing instance that have established the shared interaction relationship; the second data sharing instance is used to control the second business application to play the first media data synchronously with the first wearable virtual display device according to the resource information and the first playback status information in the shared activity object obtained by sharing; the second business application refers to a video application that is the same as the first business application and can be run in the second wearable virtual display device.
2. The method according to claim 1, characterized in that The method further comprises: The shared activity object and the first playback status information are transmitted to the group session instance through the first data sharing instance; the second data sharing instance is used to obtain the shared activity object and the first playback status information during the detection of the group session instance; the second data sharing instance is also used to call the second system player in the second business application, and the second system player plays the first media data synchronously with the first wearable virtual display device according to the shared activity object and the first playback status information.
3. The method according to claim 2, characterized in that The second system player is configured to generate second shared data information associated with the first media data to be played synchronously; the second shared data information includes resource information of the first media data and second playback status information of the first media data in the second service application; the method further comprising: In a process of detecting the group conversation instance, obtaining the second shared data information sent by the second data sharing instance to the group conversation instance; When it is detected that the first playback state information and the second playback state information in the second shared data information are different, calling, through the first data sharing instance, a target control operation instruction that is the same as the control operation instruction in the second playback state information, and synchronously performing, through the first system player, a control operation indicated by the target control operation instruction on the first media data; The first shared data information is updated through the target control operation instruction, and the updated first shared data information is transmitted to the group session instance.
4. The method according to claim 3, characterized in that The calling, through the first data sharing instance, a target control operation instruction identical to the control operation instruction in the second playback state information, and synchronously performing, through the first system player, the control operation indicated by the target control operation instruction on the first media data, includes: calling, through the first data sharing instance, a target control operation instruction that is the same as the control operation instruction in the second playback state information; If the target control operation instruction is a pause playback control instruction, the first system player synchronously pauses playback of the first media data; If the target control operation instruction is a playback rate control instruction, synchronously adjusting the playback rate of the first media data to the target playback rate indicated by the playback rate control instruction through the first system player; If the target control operation instruction is a progress adjustment instruction, the playback progress of the first media data is synchronously adjusted to the progress playback position indicated by the progress adjustment instruction through the first system player.
5. The method according to claim 1, wherein The first media data belongs to a shared media data set; the method further includes: When the first data sharing instance detects, through the group session instance, a change in the shared activity attribute in the second data sharing instance, the first data sharing instance calls a media data loading function to obtain the second media data based on the resource information of the second media data indicated by the changed shared activity attribute; the shared activity attribute in the second data sharing instance is obtained by the second data sharing instance from the group session instance, and the shared activity attribute in the group session instance is determined by the shared activity object; the changed shared activity attribute is determined by switching the second media data to be shared in the second business application; the second media data belongs to the shared media data set; In the process of detecting the group conversation instance, obtaining third data sharing information sent by the second data sharing instance to the group conversation instance; the third data sharing information includes third playback state information for the second media data; The first system player is called through the first data sharing instance, and the first system player switches the first media data to the second media data according to the third playback state information.
6. The method according to claim 1, wherein The method further comprises: When it is detected that the second wearable virtual display device has created an update group session instance for updating media data on the communication link, establishing a new sharing interaction relationship between the first data sharing instance and the second data sharing instance through the update group session instance; In the process of detecting the update group conversation instance, obtaining an updated shared activity object and updated data sharing information sent by the second data sharing instance with which a new shared interaction relationship has been established to the update group conversation instance; the updated shared activity object includes updated resource information of the updated media data; the updated data sharing information includes updated playback status information of the updated media data; The first system player is called through the first data sharing instance, the first media data is replaced with the updated media data through the first system player, and the updated media data is played synchronously with the second wearable virtual display device according to the updated playback status information.
7. The method according to claim 1, characterized in that When the first service application of the first wearable virtual display device is acquired and the first system player is called to initiate a sharing request for the first media data, a shared activity object is created based on the sharing request for the first media data, and first shared data information is generated in the first system player based on the shared activity object, including: In response to a triggering operation on a first switching sharing component in the first service application, calling a first system player through the first service application, and generating a sharing request for first media data through the first system player; Acquire media attribute information associated with the first media data from the sharing request for the first media data, create a media data object based on the media attribute information, and create a shared activity object according to the media data object; In the first system player, the first media data is loaded based on the shared activity object, first playback status information of the first media data in the first system player is obtained, and first shared data information is generated based on the first playback status information.
8. The method according to claim 7, characterized in that The creating a shared activity object according to the media data object comprises: Encapsulating the data type, data name, preview image, and resource information of the first media data in the media data object into metadata; the preview image refers to a target video frame randomly obtained from the first media data; A shared activity object is created based on the first media data and the metadata.
9. The method according to claim 1, characterized in that The establishing, through the group session instance, a sharing interaction relationship between the first data sharing instance and a second data sharing instance created by the second wearable virtual display device includes: passing the group session instance as a first sharing parameter to the first data sharing instance through a session coordination method, and establishing a sharing interaction relationship between the first data sharing instance and the group session instance according to the first sharing parameter; The group conversation instance is passed to the second wearable virtual display device through the communication link provided by the communication application, so that the second data sharing instance in the second wearable virtual display device uses the acquired group conversation instance as the second sharing parameter through the session coordination method, and establishes a shared interaction relationship between the group conversation instance and the second data sharing instance according to the second sharing parameter.
10. A data sharing device, characterized in that: The device comprises: a communication connection module, configured to establish a communication link with the second wearable virtual display device through a communication application of the first wearable virtual display device; An activity object creation module is configured to, upon acquiring a first business application of the first wearable virtual display device and invoking a first system player to initiate a sharing request for first media data, create a shared activity object based on the sharing request for the first media data, and generate first shared data information in the first system player based on the shared activity object; the shared activity object includes resource information of the first media data; the first shared data information includes first playback status information; and the first media data is media data required to be played in the first business application; a data sharing instance creation module, configured to create, in the first service application, a first data sharing instance associated with the first system player and the first shared data information; A shared interaction relationship establishment module is used to create a group session instance on the communication link, and establish a shared interaction relationship between the first data sharing instance and the second data sharing instance created by the second wearable virtual display device through the group session instance; the group session instance is used to share data transmission of the shared activity object and the first playback status information between the first data sharing instance and the second data sharing instance that have established the shared interaction relationship; the second data sharing instance is used to control the second business application to play the first media data synchronously with the first wearable virtual display device according to the resource information and the first playback status information in the shared activity object obtained by sharing; the second business application refers to a video application that is the same as the first business application and can be run in the second wearable virtual display device.
11. A computer device, characterized in that: Includes processor, memory, input and output interfaces; The processor is connected to the memory and the input / output interface respectively, wherein the input / output interface is used to receive and output data, the memory is used to store a computer program, and the processor is used to call the computer program so that the computer device executes the method according to any one of claims 1 to 9.
12. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which is suitable for being loaded and executed by a processor, so that a computer device having the processor executes the method according to any one of claims 1 to 9.
13. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 9 is implemented.
Citation Information
Patent Citations
Video playing processing method and device, electronic equipment and storage medium
CN113225605A
Location sharing method, device and equipment
CN114205321A