Data sharing method and device, computer, storage medium and program product
By establishing a communication link and shared interaction relationship between wearable virtual display devices in XR products, two-way control of video is achieved, and the problem of insufficient unidirectionality and interactivity of video sharing in the prior art is solved, and the display effect of user experience and data sharing is improved.
Patent Information
- Application Number
- CN202411599002.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-08
- Publication Date
- 2025-02-28
- Estimated Expiration
- 2044-11-08
AI Technical Summary
In the prior art, video sharing is usually one-way in Extended Reality (XR) products, allowing only screen sharing initiators to control the playback progress, pause and play of the video, and other users can only watch passively, resulting in insufficient interaction and sense of participation.
By establishing a communication link between the first wearable virtual display device and the second wearable virtual display device, creating a shared active object and a data sharing instance, establishing a shared interactive relationship using group session instances, real-time synchronous transmission of resource information and playback status information of the first media data is realized, allowing participants to control the shared video.
It enhances the user's interaction and experience, provides two-way video control capabilities, ensures that even if the network is unstable, participants can display and control videos normally, and improves the display effect of data synchronization and sharing.
Smart Images

Figure CN119544699A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a data sharing method, device, computer, storage medium and program product. Background Art
[0002] With the development of science and technology, various extended reality (XR) products have emerged in an endless stream. Users can use XR products to make video calls and watch videos. They can also watch the same video with the user who is on the video call by sharing the screen while making a video call with other users. However, the way of sharing videos through screen sharing is usually one-way, and only the initiator of screen sharing can control the viewing progress, pause, play and other information of the video. Other users who are on the video call can only passively watch the video according to the initiator's operation. That is, one person shares his own video, and others can only watch it. This one-way interaction limits the interactivity and participation of other users. Moreover, since the people participating in the sharing can only see the screen of the initiator of the screen sharing, if the network connection is unstable during the sharing process, it may cause the people participating in the sharing to be unable to see the normal screen, which will affect the real-time interactive experience of the people participating in the sharing. Summary of the invention
[0003] The embodiments of the present application provide a video sharing method, device, computer, storage medium and program product, which can enhance the user's interactivity and experience during the data synchronization and sharing process, and can enhance the display effect of the data synchronization and sharing.
[0004] On the one hand, an embodiment of the present application provides a data sharing method, the method comprising:
[0005] Establishing a communication link with the second wearable virtual display device through a communication application of the first wearable virtual display device;
[0006] When a first business application of a first wearable virtual display device is acquired and a first system player is called to initiate a sharing request for first media data, a shared activity object is created based on the sharing request for the first media data, and first shared data information is generated in the first system player based on the shared activity object; the shared activity object includes resource information of the first media data; the first shared data information includes first playback state information; the first media data is media data required to be played in the first business application;
[0007] Creating a first data sharing instance associated with the first system player and the first shared data information in the first service application;
[0008] A group session instance is created on a communication link, and a shared interaction relationship is established between a first data sharing instance and a second data sharing instance created by a second wearable virtual display device through the group session instance; the group session instance is used to share data transmission of a shared activity object and a first playback status information between the first data sharing instance and the second data sharing instance having established a shared interaction relationship; the second data sharing instance is used to control a second business application to play the first media data synchronously with the first wearable virtual display device according to the resource information and the first playback status information in the shared activity object obtained by sharing.
[0009] On the one hand, an embodiment of the present application provides another data sharing method, the method comprising:
[0010] In a virtual display interface in the first wearable virtual display device, in response to a communication operation in the communication application, a session page for communicating with the second wearable virtual display device is displayed in the virtual display interface;
[0011] In response to a triggering operation of a first switching sharing component in a first data playback page in a first business application in a virtual display interface, sharing a first playback content in the first data playback page with a second wearable virtual display device with which a communication connection has been established in a session page;
[0012] When it is detected that the second wearable virtual display device performs a control operation on the shared first playback content, a control operation is synchronously performed on the first playback content in the first data playback page in the first business application.
[0013] An embodiment of the present application provides a data sharing device, the device comprising:
[0014] A communication connection module, configured to establish a communication link with a second wearable virtual display device through a communication application of the first wearable virtual display device;
[0015] An activity object creation module is used to, when acquiring a first business application of a first wearable virtual display device and invoking a first system player to initiate a sharing request for first media data, create a shared activity object based on the sharing request for the first media data, and generate first shared data information in the first system player based on the shared activity object; the shared activity object includes resource information of the first media data; the first shared data information includes first playback status information; the first media data is media data required to be played in the first business application;
[0016] A data sharing instance creation module, used to create a first data sharing instance associated with a first system player and first shared data information in a first business application;
[0017] A shared interaction relationship establishment module is used to create a group session instance on a communication link, and to establish a shared interaction relationship between a first data sharing instance and a second data sharing instance created by a second wearable virtual display device through the group session instance; the group session instance is used to share data transmission of a shared activity object and a first playback status information between the first data sharing instance and the second data sharing instance with which a shared interaction relationship has been established; the second data sharing instance is used to control a second business application to play the first media data synchronously with the first wearable virtual display device according to the resource information and the first playback status information in the shared activity object obtained through sharing.
[0018] In a possible implementation, the shared interaction relationship establishment module is further configured to perform the following operations:
[0019] The shared activity object and the first playback status information are transmitted to the group session instance through the first data sharing instance; the second data sharing instance is used to obtain the shared activity object and the first playback status information during the detection of the group session instance; the second data sharing instance is also used to call the second system player in the second business application, and the second system player plays the first media data synchronously with the first wearable virtual display device according to the shared activity object and the first playback status information.
[0020] In a possible implementation, the second system player is used to generate second shared data information associated with the first media data played synchronously; the second shared data information includes resource information of the first media data and second playback state information of the first media data in the second business application; and the shared interaction relationship establishment module is further used to perform the following operations:
[0021] In the process of detecting the group session instance, obtaining second shared data information sent by the second data sharing instance to the group session instance;
[0022] When it is detected that the first play state information and the second play state information in the second shared data information are different, a target control operation instruction identical to the control operation instruction in the second play state information is called through the first data sharing instance, and the control operation indicated by the target control operation instruction is synchronously performed on the first media data through the first system player;
[0023] The first shared data information is updated through the target control operation instruction, and the updated first shared data information is transmitted to the group session instance.
[0024] In a possible implementation, the shared interaction relationship establishment module is used to call the target control operation instruction that is the same as the control operation instruction in the second playback state information through the first data sharing instance, and when the control operation indicated by the target control operation instruction is synchronously executed on the first media data through the first system player, the shared interaction relationship establishment module is specifically used to perform the following operations:
[0025] calling, through the first data sharing instance, a target control operation instruction that is the same as the control operation instruction in the second playback state information;
[0026] If the target control operation instruction is a pause playback control instruction, the first system player synchronously pauses playback of the first media data;
[0027] If the target control operation instruction is a playback rate control instruction, the playback rate of the first media data is synchronously adjusted to the target playback rate indicated by the playback rate control instruction through the first system player;
[0028] If the target control operation instruction is a progress adjustment instruction, the playback progress of the first media data is synchronously adjusted to the progress playback position indicated by the progress adjustment instruction through the first system player.
[0029] In a possible implementation, the first media data belongs to a shared media data set; and the shared interaction relationship establishing module is further configured to perform the following operations:
[0030] When the first data sharing instance detects through the group session instance that the shared activity attribute in the second data sharing instance has changed, the media data loading function is called to obtain the second media data based on the resource information of the second media data indicated by the changed shared activity attribute; the shared activity attribute in the second data sharing instance is obtained by the second data sharing instance from the group session instance, and the shared activity attribute in the group session instance is determined by the shared activity object; the changed shared activity attribute is determined by switching the second media data to be shared in the second business application; the second media data belongs to the shared media data set;
[0031] In the process of detecting the group conversation instance, obtaining third data sharing information sent by the second data sharing instance to the group conversation instance; the third data sharing information includes third playback state information for the second media data;
[0032] The first system player is called through the first data sharing instance, and the first system player switches the first media data to the second media data according to the third playback state information.
[0033] In a possible implementation, the shared interaction relationship establishment module is further configured to perform the following operations:
[0034] When it is detected that the second wearable virtual display device has created an update group session instance for updating media data on the communication link, a new sharing interaction relationship is established between the first data sharing instance and the second data sharing instance through the update group session instance;
[0035] In the process of detecting the update group conversation instance, obtaining the update sharing activity object and the update data sharing information sent by the second data sharing instance having established a new sharing interaction relationship to the update group conversation instance; the update sharing activity object includes the update resource information of the update media data; the update data sharing information includes the update playback status information of the update media data;
[0036] The first system player is called through the first data sharing instance, the first media data is replaced with the updated media data through the first system player, and the updated media data is played synchronously with the second wearable virtual display device according to the updated playback state information.
[0037] In a possible implementation, the activity object creation module is used to create a shared activity object based on the sharing request for the first media data when the first business application of the first wearable virtual display device is acquired and the first system player is called to initiate a sharing request for the first media data. In the first system player, when the first shared data information is generated based on the shared activity object, the activity object creation module is specifically used to perform the following operations:
[0038] In response to a triggering operation on a first switching sharing component in a first business application, calling a first system player through the first business application, and generating a sharing request for first media data through the first system player;
[0039] Acquire media attribute information associated with the first media data from a sharing request for the first media data, create a media data object based on the media attribute information, and create a shared activity object according to the media data object;
[0040] In the first system player, the first media data is loaded based on the shared activity object, first play state information of the first media data in the first system player is obtained, and first shared data information is generated based on the first play state information.
[0041] In a possible implementation, when the activity object creation module is used to create a shared activity object according to the media data object, the activity object creation module is specifically used to perform the following operations:
[0042] Encapsulate the data type, data name, preview image and resource information of the first media data in the media data object into metadata; the preview image refers to a target video frame randomly obtained from the first media data;
[0043] A shared activity object is created based on the first media data and the metadata.
[0044] In a possible implementation, when the shared interaction relationship establishment module is used to establish a shared interaction relationship between the first data sharing instance and the second data sharing instance created by the second wearable virtual display device through the group session instance, the shared interaction relationship establishment module is specifically used to perform the following operations:
[0045] Passing the group session instance as a first sharing parameter to the first data sharing instance through the session coordination method, and establishing a sharing interaction relationship between the first data sharing instance and the group session instance according to the first sharing parameter;
[0046] The group conversation instance is passed to the second wearable virtual display device through the communication link provided by the communication application, so that the second data sharing instance in the second wearable virtual display device uses the acquired group conversation instance as the second sharing parameter through the session coordination method, and establishes a shared interaction relationship between the group conversation instance and the second data sharing instance according to the second sharing parameter.
[0047] In one aspect, an embodiment of the present application provides another data sharing device, the device comprising:
[0048] A conversation page display module, configured to display, in a virtual display interface in the first wearable virtual display device, a conversation page for communicating with the second wearable virtual display device in the virtual display interface in response to a communication operation in the communication application;
[0049] A shared playback module, configured to respond to a triggering operation of a first switching sharing component in a first data playback page in a first business application in a virtual display interface, and share the playback content in the first data playback page with a second wearable virtual display device that has established a communication connection in a session page;
[0050] The synchronous display module is used to synchronously perform a control operation on the playback content in the first data playback page in the first business application when it is detected that the second wearable virtual display device performs a control operation on the shared playback content.
[0051] In a possible implementation, the shared playback module is further configured to perform the following operations:
[0052] Obtaining the cumulative number of triggering times for triggering the first switching sharing component, and if the cumulative number of triggering times is less than the sharing times threshold, displaying a sharing prompt pop-up window interface for the first business application on the virtual display interface;
[0053] In response to the triggering operation of the opening component in the sharing prompt pop-up window interface, the sharing prompt pop-up window interface is closed, and the first playback content in the first data playback page is shared and played to the second wearable virtual display device with which a communication connection has been established in the session page.
[0054] In a possible implementation, the synchronous display module is further configured to perform the following operations:
[0055] When it is detected that the second wearable virtual display device initiates a sharing request for the updated playback content in the second data playback page, and the updated playback content is different from the first playback content in the shared playback of the first data playback page, a playback replacement prompt content interface is displayed in the first data playback page of the first business application; the second data playback page refers to the playback page in the second business application in the second wearable virtual display device;
[0056] In response to a triggering operation on a replacement component in the playback replacement prompt content interface, the playback replacement prompt content interface is closed, the first playback content is replaced in the first data playback page, and the playback update content is shared with the second wearable virtual display device.
[0057] On the one hand, an embodiment of the present application provides a computer device, including a processor, a memory, and an input and output interface;
[0058] The processor is connected to the memory and the input / output interface respectively, wherein the input / output interface is used to receive and output data, the memory is used to store a computer program, and the processor is used to call the computer program so that a computer device including the processor executes the method in one aspect of an embodiment of the present application.
[0059] On the one hand, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program, and the computer program is suitable for being loaded and executed by a processor so that a computer device having the processor executes the method in one aspect of the embodiment of the present application.
[0060] In one aspect, an embodiment of the present application provides a computer program product, which includes a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device executes the method provided in various optional ways in one aspect of the embodiment of the present application. In other words, when the computer program is executed by the processor, the method provided in various optional ways in one aspect of the embodiment of the present application is implemented.
[0061] In an embodiment of the present application, a communication link is established with a second wearable virtual display device through a communication application of a first wearable virtual display device; when a first business application of the first wearable virtual display device is obtained and a first system player is called to initiate a sharing request for first media data, a shared activity object is created based on the sharing request for the first media data, and first shared data information is generated in the first system player based on the shared activity object; the shared activity object includes resource information of the first media data; the first shared data information includes first playback status information; the first media data is media data required to be played in the first business application; a first data sharing instance associated with the first system player and the first shared data information is created in the first business application; a group session instance is created on the communication link, and a shared interaction relationship is established between the first data sharing instance and the second data sharing instance created by the second wearable virtual display device through the group session instance; the group session instance is used to share data transmission of the shared activity object and the first playback status information between the first data sharing instance and the second data sharing instance that have established a shared interaction relationship; the second data sharing instance is used to control the second business application to play the first media data synchronously with the first wearable virtual display device according to the resource information and the first playback status information in the shared activity object obtained by sharing. Through the above process, a group session instance, a first data sharing instance and a second data sharing instance are created, and a shared interactive relationship is established between the first wearable virtual display device and the second wearable virtual display device through the group session instance, so as to realize the shared connection between the first wearable virtual display device and the second wearable virtual display, thereby realizing the resource information and the first playback state information of the first media data being transmitted between the first data sharing instance and the second data sharing instance through the group session instance, so that the participant is no longer passively displaying the screen sharing picture of the initiator, but directly plays the first media data shared by the initiator, and synchronizes with the initiator's playback picture through the first playback state information, which provides the possibility for the participant to control the media data. Due to the real-time synchronous transmission of the first playback state information by the first data sharing instance and the second data sharing instance, both parties (the initiator and the participant) can initiate control to change the first media data, and synchronize it to the other party's device to provide a consistent playback experience, thereby increasing the participation and interactivity of both parties. Moreover, since the participant is no longer passively displaying the shared screen picture, even if the network is unstable, the participant can still display the played first media data normally, ensuring the display effect of data sharing. BRIEF DESCRIPTION OF THE DRAWINGS
[0062] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0063] Figure 1 This is a network interaction architecture diagram provided by an embodiment of the present application;
[0064] Figure 2 This is a scenario diagram of a data sharing method provided in an embodiment of the present application. Figure 1 ;
[0065] Figure 3 This is a scenario diagram of a data sharing method provided in an embodiment of the present application. Figure 2 ;
[0066] Figure 4 This is a schematic diagram of a data sharing method provided in an embodiment of the present application. Figure 1 ;
[0067] Figure 5 It is a schematic diagram of the architecture of a data sharing method provided in an embodiment of the present application;
[0068] Figure 6 This is a schematic diagram of a data sharing method provided in an embodiment of the present application. Figure 2 ;
[0069] Figure 7 This is a schematic diagram of a data sharing method provided in an embodiment of the present application. Figure 3 ;
[0070] Figure 8 This is a scenario diagram of a data sharing method provided in an embodiment of the present application. Figure 3 ;
[0071] Fig. 9 This is a scenario diagram of a data sharing method provided in an embodiment of the present application. Figure 4 ;
[0072] Fig.10 This is a scenario diagram of a data sharing method provided in an embodiment of the present application. Figure 5 ;
[0073] Fig.11 This is a schematic diagram of a data sharing device provided in an embodiment of the present application. Figure 1 ;
[0074] Fig.12 This is a schematic diagram of a data sharing device provided in an embodiment of the present application. Figure 2 ;
[0075] Fig.13 It is a structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0076] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0077] Among them, if it is necessary to collect object (such as user, etc.) data in this application, a prompt interface or pop-up window will be displayed before or during the collection. The prompt interface or pop-up window is used to prompt the user that certain data is currently being collected. Only after the user confirms the prompt interface or pop-up window, the relevant steps of data acquisition will be started, otherwise the process will end. Moreover, the acquired user data will be used in reasonable and legal scenarios or purposes. Optionally, in some scenarios where user data needs to be used but has not been authorized by the user, authorization can be requested from the user, and the user data can be used when the authorization is passed.
[0078] It is understandable that in the specific implementation of this application, the user data involved, when the following embodiments of this application are applied to specific products or technologies, needs to obtain user permission or consent, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of the relevant regions.
[0079] In the examples of this application, see Figure 1 , Figure 1 is a network interaction architecture diagram provided by an embodiment of the present application, such as Figure 1As shown, the network interaction architecture diagram may include a terminal device cluster, and the terminal device cluster may include terminal device 101a, terminal device 101b, ..., terminal device 101n. Terminal device 101a, terminal device 101b, ..., terminal device 101n can all be a wearable virtual display device, or a computer device. Among them, the wearable virtual display device can be an XR (Extended Reality) device, and the XR device can include a VR device (such as VR glasses), an AR (Augmented Reality, i.e., augmented reality) device, an MR (Mixed Reality, i.e., mixed reality) device, etc. There may be a communication connection between the terminal device clusters (for example, a communication link can be established through a communication application). For example, there is a communication connection between terminal device 101a and terminal device 101b, there is a communication connection between terminal device 101a and terminal device 101n, and there is a communication connection between terminal device 101b and terminal device 101n.
[0080] It should be understood that Figure 1 Any terminal device in the terminal device cluster shown can be installed with a communication application with communication function. When the communication application is running in each terminal device, a communication link can be established between each terminal device through the communication application. The following will take the terminal device 101a as the first wearable virtual display device (the device corresponding to the initiator) as an example for explanation. The terminal device 101a can establish a communication link with the second wearable virtual display device through the installed communication application. Among them, the communication application can be a video call software, such as FaceTime, etc., then the communication link can be understood as the network link on which the video call between the first wearable virtual display device and the second wearable virtual display device depends. Among them, the number of second wearable virtual display devices (devices corresponding to the participating parties) can be one or more, for example, it can include Figure 1 The terminal devices 101b, ..., and 101n shown in FIG. Figure 1The terminal device 101b in the example is described as the second wearable virtual display device. When the terminal device 101a obtains that the first business application calls the first system player to initiate a sharing request for the first media data, the terminal device 101a can establish a sharing interaction relationship with the terminal device 101b, and pass the resource information of the first media data (such as the source address of the first media data) and the first playback status information (such as the current playback progress of the first media data) to the terminal device 101b through the sharing interaction relationship. The terminal device 101b can play the first media data synchronously with the terminal device 101a based on the resource information and the first playback status information of the first media data obtained. At the same time, when the terminal device 101b performs a control operation on the first media data (such as a pause operation), the first playback status information of the first media data can be changed, and then the changed first playback status information is passed to the terminal device 101a through the sharing interaction relationship, and the terminal device 101a can perform a synchronization operation on the first media data (such as a synchronous pause operation) based on the changed first playback status information.
[0081] Through the above process, a shared interactive relationship between the first wearable virtual display device and the second wearable virtual display device can be established. Through the shared interactive relationship, the resource information and the first playback status information of the first media data can be synchronized in real time between the first wearable virtual display device and the second wearable virtual display device, so that the sharing parties (the initiator and the participant) can maintain the synchronous playback of the first media data in real time. At the same time, the possibility of control operation is provided to the participant, so that the sharing parties are no longer just sharing the screen image, but sharing the first playback status information, so that both sharing parties can initiate control operations and keep sharing synchronization based on the control operations in real time.
[0082] For details, see Figure 2 , Figure 2 This is a scenario diagram of a data sharing method provided in an embodiment of the present application. Figure 1 The scene shows Figure 1 It can be used to illustrate the change process of the virtual display interface of the terminal device 101a, that is, the first wearable virtual display device. Figure 2As shown, the virtual display interface 201 of the terminal device 101a may include a communication application A1 and a first business application A2. The terminal device 101a responds to the communication operation for the communication application and may initiate a communication request to the second wearable virtual display device through the communication account of the second wearable virtual display device. After the communication request is passed, a communication link is established with the second wearable virtual display device, and a session page for communicating with the second wearable virtual display device is displayed in the virtual display interface, as shown in the session page 2021 in the virtual display interface 202. When the user corresponding to the second wearable virtual display device turns on the camera, the display area 2021a in the session page 2021 may display the content captured by the camera of the second wearable virtual display device, such as portraits and objects captured by the second wearable virtual display device.
[0083] The terminal device 101a can respond to the trigger operation for the first business application A2, open the first business application A2, respond to the play operation for the drama A_01 in the first business application A2, display the first data play page 2031 in the first business application A2 in the virtual display interface 203, and further respond to the trigger operation for the first switching sharing component 2031a in the first data play page 2031, and share the first play content 2031b in the first data play page 2031 with the second wearable virtual display device that has established a communication connection in the session page. It can be understood that the display content and display position in the virtual display interface are determined by the user. For example, the session page 2021 in the virtual display interface 203 may not be displayed, the communication session may run in the background of the terminal device 101a, or the session page 2021 may be reduced to a floating window display, which is not limited here.
[0084] For further information, please see Figure 3 , Figure 3 This is a scenario diagram of a data sharing method provided in an embodiment of the present application. Figure 2 Taking the terminal device 101b as the second wearable virtual display device as an example, the scenario shows Figure 2It can be used to illustrate the change process of the virtual display interface of the terminal device 101b, that is, the second wearable virtual display device. Before the terminal device 101a shares the first playback content 2031b in the first data playback page 2031 with the terminal device 101b, the terminal device 101b needs to receive the communication request initiated by the terminal device 101a through the communication application A3, and respond to the communication request to establish a communication link with the terminal device 101a. Further, the terminal device 101b can open the second business application A4, respond to the playback operation for a certain episode, open a playback page, and in the playback page can respond to the trigger operation for the second switching sharing component 3012a, and establish a shared interactive relationship with the terminal device 101a. The terminal device 101b can receive the media data corresponding to the first playback content 2031b through the shared interactive relationship (for example, it can be Figure 1 The resource information and playback status information of the first media data mentioned in the embodiment (for example, the first playback status information corresponding to the first media data). The terminal device 101b can determine the first playback content 2031b shared by the terminal device 101a through the resource information and the playback status information, and display the first playback content 3012b in the second data playback page 3012. Among them, the first playback content 2031b and the first playback content 3012b respectively represent the content played synchronously by the first business application and the second business application. At this time, the terminal device 101a and the terminal device 101b synchronously play the episode A_01 to 1 minute and 15 seconds (01:15). Figure 3 As shown, when the user corresponding to the terminal device 101a turns on the camera, the display area 3011a in the conversation page 3011 can display the content captured by the camera of the terminal device 101a, such as portraits, objects, etc. captured by the terminal device 101a.
[0085] Furthermore, since the terminal device 101b synchronizes the first playback content 2031b through the resource information and playback status information of the media data, the first playback content 2031b shared by the terminal device 101a can be displayed and played in the terminal device 101b, so that the terminal device 101b has the possibility to adjust the first playback content 2031b. Therefore, when the terminal device 101b performs a control operation on the shared first playback content 2031b, the control operation performed on the first playback content 2031b can be synchronized to the terminal device 101a. When the terminal device 101a detects that the terminal device 101b performs a control operation on the shared first playback content, the terminal device 101a can synchronously perform the control operation on the first playback content 2031b in the first data playback page 2031 in the first business application A2. Among them, the control operation may include a pause playback operation. For details, please refer to Figure 3The virtual display interface 302 includes a second data playback page 3021, and the second data playback page 3021 includes a first playback content 3021a that is being played to 3 minutes and 15 seconds (03:15). At this time, the terminal device 101b responds to the trigger operation of the playback control component 3021b in the second data playback page 3021, and performs a pause playback operation on the first playback content 3021a. For details, see Figure 3 As shown in the second data playback page 3031 in the virtual display interface 303 in the video, the first playback content 3021a is paused to 03:15, and the playback control component 3021b changes to the pause control component 3031a. The playback control component 3021b is used to indicate that the display state of the first playback content 3021a is in the playback state; the pause control component 3031a is used to indicate that the display state of the first playback content 3021a is in the paused playback state. At the same time, the terminal device 101b can synchronize the pause playback operation to the terminal device 101a through the shared interactive relationship. For further information, please refer to Figure 2 When the terminal device 101a detects that the terminal device 101b performs a pause operation on the shared first playback content, the terminal device 101a can synchronously perform the pause operation on the first playback content 2031b in the first data playback page 2031 in the first service application A2. Specifically, as shown in the virtual display interface 204 in the terminal device 101a, the playback control component 2031c can be changed to be displayed as a pause control component 2041a in the first data playback page 2041, and the first playback content 2041b is synchronously paused to 03:15.
[0086] Through the above process, it can be ensured that the first playback content in the first wearable virtual display device and the second wearable virtual display device is synchronized, that is, it can support users to share and watch videos (i.e., the first playback content), and the playback progress and playback status of the video are also synchronized, which enhances the user's common experience. At the same time, the participant corresponding to the second wearable virtual display device is no longer a passive display of the shared screen, but directly displays and plays the first playback content. Both parties can trigger the control component to change the playback status of the first media data, and synchronize it to the other party's device to provide a consistent playback experience, increasing the interactivity of both parties. And the number of the second wearable virtual display device can be one or more (i.e., the participant can be one or more), which can support multiple users to share and watch videos at the same time. Each user can share and watch videos with other users in their corresponding wearable virtual display device, and can interact with other users in real time through the conversation page, for example, to make comments or share feelings, etc., which can further enhance the user experience.
[0087] For further information, see Figure 4 , Figure 4 This is a schematic diagram of a data sharing method provided in an embodiment of the present application. Figure 1 The data sharing method may be executed by a computer device, which may be Figure 1 The terminal device 101a shown is the first wearable virtual display device. The following will take the data sharing method executed by the first wearable virtual display device as an example for explanation. The data processing method may at least include the following steps S401-S404:
[0088] Step S401: establishing a communication link with a second wearable virtual display device through a communication application of the first wearable virtual display device.
[0089] In an embodiment of the present application, taking the first wearable virtual display device as the initiator of a sharing activity as an example, the number of participants in the sharing activity can be one or more, that is, the data sharing method can enable multiple users to participate in data sharing. The following is an example of a second wearable virtual display device as a participant in the sharing activity. The first wearable virtual display device can obtain the communication account information associated with the user corresponding to the second wearable virtual display device, and can initiate a communication request to the second wearable virtual display device through the installed communication application and the communication account information. When the second wearable virtual display device receives the communication request and responds to the communication request, the first wearable virtual display device can establish a communication link with the second wearable virtual display device. Among them, the communication application can be a video call application, such as FaceTime and other applications. Among them, the first wearable virtual display device and the second wearable virtual display device can both be a kind of XR glasses, such as Vision Pro, etc., which can provide users with an immersive experience.
[0090] Step S402: When the first business application of the first wearable virtual display device is obtained and the first system player is called to initiate a sharing request for the first media data, a shared activity object is created based on the sharing request for the first media data, and in the first system player, first shared data information is generated based on the shared activity object; the shared activity object includes resource information of the first media data; the first shared data information includes first playback status information; the first media data is the media data required to be played in the first business application.
[0091] In an embodiment of the present application, the user corresponding to the first wearable virtual display device can start the first business application, trigger the first switching sharing component in the first business application, and call the first system player (AVPlayer1) to generate a sharing request for the first media data. At this time, the first wearable virtual display device can obtain the sharing request for the first media data, and the first wearable virtual display device can obtain resource data related to the first media data from the sharing request for the first media data. For example, the resource data may include the data name, resource information, preview image and other contents of the first media data, and create a shared activity object associated with the first media data through the data name, resource information and preview image of the first media data. Among them, the shared activity object refers to an entity used to describe the sharing activity for sharing the first media data, and can provide meta information of the shared content, for example, it can include the title, subtitle and resource information of the first media data of the shared activity. Among them, the title of the shared activity can be the data name of the first media data. For example, if the first media data is a movie, the title of the shared activity is the name of the movie; if the first media data is a movie and the first episode of the film and television drama A, the title of the shared activity can be the film and television drama A_01. The subtitle of the shared activity may be a supplementary description of the first media data (for example, it may be keywords or key information extracted from the introduction of the first media data, etc.), which is used to provide more information about the first media data. The resource information may be a Uniform Resource Locator (URL). Furthermore, the first wearable virtual display device may generate first shared data information (AVPlayerItem1) in the first system player based on the shared activity object. Among them, the first media data is the media data required to be played in the first business application. It can be understood that the first business application may be a video application, and the first business application plays the video (that is, the first media data) through AVPlayer1. AVPlayer1 uses AVPlayerItem1 to represent the content to be played. It represents a separate media resource, which may be an audio, video or other type of media file. AVPlayer1 is used to control the playback of the video, and AVPlayerItem1 provides detailed information about the first media data and the first playback status information.Among them, the first playback status information refers to the playback status information of the first media data in the first system player. For example, when the first media data is paused in the first system player to 3 minutes and 15 seconds, the current playback time (currentTime) in the first playback status information can be indicated as "CMTimeMakeWithSeconds(195, 1)", that is, 195 seconds (3 minutes and 15 seconds); the playback status (status) in the first playback status information can be indicated as "AVPlayerStatusPaused", which indicates a paused state.
[0092] Step S403: Create a first data sharing instance associated with the first system player and the first shared data information in the first business application.
[0093] In an embodiment of the present application, the first wearable virtual display device can create a first data sharing instance (AVPlayerPlaybackCoordinator1) associated with the first system player and the first shared data information in the first business application. AVPlayerPlaybackCoordinator1 is used to manage the playback behavior and playback status of AVPlayer1. AVPlayerPlaybackCoordinator1 obtains playback information from AVPlayer1 and AVPlayerItem1, that is, the first playback status information of the first media data. Please refer to Figure 5 , Figure 5 is a schematic diagram of the architecture of a data sharing method provided in an embodiment of the present application, such as Figure 5 As shown, it includes a first wearable virtual display device 501a and a second wearable virtual display device 501b. The first wearable virtual display device 501a calls the first system player through the first business application to play the first media data, and generates first shared data information for the first media data based on the play status of the first media data in the first system player. Further, a first data sharing instance associated with the first system player and the first shared data information is created in the first business application.
[0094] At the same time, the user corresponding to the second wearable virtual display device 501b can run the same video application as the first business application, that is, the second business application. In the second business application, a media data X can be randomly selected to enter the playback page for the media data X. Further, the second switching sharing component in the playback page for the media data X can be triggered. At this time, the second wearable virtual display device 501b can obtain the shared activity object for the first media data through the communication link, call the second system player (AVPlayer2) based on the first media data in the shared activity object, generate the second shared data information (AVPlayerItem2), and create a second data sharing instance (AVPlayerPlaybackCoordinator2) associated with the second system player and the second shared data information in the second business application. It can be understood that at this time, the first playback status information in the first wearable virtual display device is temporarily not synchronized in AVPlayerItem2.
[0095] Step S404, create a group session instance on the communication link, and establish a shared interaction relationship between the first data sharing instance and the second data sharing instance created by the second wearable virtual display device through the group session instance; the group session instance is used to share data transmission of the shared activity object and the first playback status information between the first data sharing instance and the second data sharing instance with which the shared interaction relationship has been established; the second data sharing instance is used to control the second business application to play the first media data synchronously with the first wearable virtual display device according to the resource information and the first playback status information in the shared activity object obtained by sharing.
[0096] In an embodiment of the present application, the first wearable virtual display device can create a group session instance (GroupSession) on the communication link, establish a shared interaction relationship between the group session instance and the first data sharing instance, and establish a shared interaction relationship between the group session instance and the second data sharing instance created by the second wearable virtual display device, thereby establishing a shared interaction relationship between the first data sharing instance and the second data sharing instance through the group session instance. The group session instance is used to share data transmission of the shared activity object and the first playback state information between the first data sharing instance and the second data sharing instance that have established a shared interaction relationship.
[0097] Specifically, the first data sharing instance in the first wearable virtual display device can pass the first playback state information of the first media data to the group session instance. At this time, the second data sharing instance in the second wearable virtual display device obtains the first playback state information of the first media data by detecting the group session instance in real time. Further, the second wearable virtual display device can control the second business application through the second data sharing instance to play the first media data synchronously with the first wearable virtual display device according to the resource information and the first playback state information in the acquired shared activity object. Specifically, the second wearable virtual display device can synchronize the first playback state information in the first wearable virtual display device in AVPlayerItem2 through the second data sharing instance in the second business application, obtain the first media data through the resource information of the first media data, and control the second system player (AVPlayer2) to play the first media data according to the synchronized first playback state information in AVPlayerItem2. At this time, AVPlayer1 and AVPlayer2 can play the first media data synchronously, and the information in AVPlayerItem1 and AVPlayerItem2 is also synchronized, that is, AVPlayerItem1 and AVPlayerItem2 are the same.
[0098] That is to say, the AVPlayerPlaybackCoordinator in the first wearable virtual display device (the above-mentioned AVPlayerPlaybackCoordinator1) can receive the first playback status information and media data (for example, the first media data) of the second wearable virtual display device through the group session instance (GroupSession). The AVPlayerPlaybackCoordinator in the second wearable virtual display device (the above-mentioned AVPlayerPlaybackCoordinator2) receives the first playback status information and media data of the first wearable virtual display device through GroupSession. The AVPlayerPlaybackCoordinators of the two wearable virtual display devices coordinate the playback process based on the received information (first playback status information, media data) to ensure that the media playback on the two wearable virtual display devices is synchronized, thereby realizing synchronous sharing of the video.
[0099] See also Figure 5 ,like Figure 5As shown, the first wearable virtual display device 501a can create a group session instance on the communication link, and establish a sharing interaction relationship between the first data sharing instance and the second data sharing instance created by the second wearable virtual display device 501b through the group session instance, so as to realize sharing of the first media data played in the first system player or the second system player between the first data sharing instance and the second data sharing instance through the group session instance, and sharing of the playback status information recorded in the first shared data information and the second shared data information respectively. Among them, the second data sharing instance is used to control the second business application to play the first media data synchronously with the first wearable virtual display device 501a according to the resource information and the first playback status information (from the first data sharing instance) in the shared activity object obtained by sharing. At the same time, when the first playback status information of the first media data in the second shared data information changes, the second wearable virtual display device 501b can synchronize the changed first playback status information to the first data sharing instance of the first wearable virtual display device 501a through the group session instance. At this time, the first data sharing instance can control the first business application to play the first media data synchronously with the second wearable virtual display device 501b according to the acquired changed first playback status information.
[0100] Through the above process, a group session instance, a first data sharing instance and a second data sharing instance are created, and a shared interactive relationship is established between the first wearable virtual display device and the second wearable virtual display device through the group session instance, so as to realize the shared connection between the first wearable virtual display device and the second wearable virtual display, thereby realizing the resource information and the first playback state information of the first media data being transmitted between the first data sharing instance and the second data sharing instance through the group session instance, so that the participant is no longer passively displaying the screen sharing picture of the initiator, but directly plays the first media data shared by the initiator, and synchronizes with the initiator's playback picture through the first playback state information, which provides the possibility for the participant to control the media data. Due to the real-time synchronous transmission of the first playback state information by the first data sharing instance and the second data sharing instance, both parties (the initiator and the participant) can initiate control to change the first playback state information of the first media data, and synchronize it to the device of the other party to provide a consistent playback experience, thereby increasing the participation and interactivity of both parties. Moreover, since the participant is no longer passively displaying the shared screen picture, even if the network is unstable, the participant can still display the played first media data normally, ensuring the display effect of data sharing. The number of the second wearable virtual display devices may be one or more, that is, the data sharing method can support multiple people to synchronously share videos, thereby enhancing social interactivity.
[0101] For further information, see Figure 6 , Figure 6 This is a schematic diagram of a data sharing method provided in an embodiment of the present application. Figure 2 The data sharing method may be executed by a computer device, which may be Figure 1 The terminal device 101a shown is the first wearable virtual display device. The following will take the data sharing method executed by the first wearable virtual display device as an example for explanation. The data processing method may at least include the following steps S601-S607:
[0102] Step S601: establishing a communication link with a second wearable virtual display device through a communication application of the first wearable virtual display device.
[0103] In the embodiment of the present application, the specific implementation process of step S601 can be referred to as follows. Figure 4 The specific description process in step S401 is not repeated here.
[0104] Step S602, when responding to the trigger operation of the first switching sharing component in the first business application, generates a sharing request for the first media data, creates a shared activity object associated with the first media data, obtains the first playback status information of the first media data in the first system player, and generates first shared data information based on the first playback status information.
[0105] In an embodiment of the present application, when responding to a trigger operation for a first switching sharing component in a first business application, the first wearable virtual display device can call the first system player through the first business application, and generate a sharing request for the first media data through the first system player. Further, the first wearable virtual display device can obtain media attribute information associated with the first media data from the sharing request for the first media data, thereby creating a media data object (for example, a video object) based on the media attribute information, and creating a shared activity object (GroupActivity object) based on the media data object. Among them, the media attribute information may include basic information such as the data type, data name, preview image and resource information (video source, such as the URL of the first media data), data size (used to define the width and height of the video player) of the first media data. A media data object refers to a data collection object that includes media attribute information, that is, the relevant basic information of the first media data can be directly passed through the media data object.
[0106] Specifically, the specific implementation process of the first wearable virtual display device creating a shared activity object according to the media data object may be: encapsulating the data type, data name, preview image and resource information of the first media data in the media data object into metadata; creating a shared activity object based on the first media data and metadata. Wherein, the preview image refers to a target video frame randomly obtained from the first media data, for example, the video content corresponding to the first media data includes video frames 1 to video frames 1000, and a video frame (for example, it can be video frame 399) is randomly obtained. At this time, the target video frame is video frame 399, and the first wearable virtual display device can determine video frame 399 as a preview image. Optionally, the preview image can be used to indicate the representative content of the first media data, and the first wearable virtual display device can also extract the video frame features of each video frame, and then obtain the summary text for the first media data, such as the introduction of the first media data, etc., and match the video frame features with the text features of the summary text for feature similarity, and determine the video frame corresponding to a video frame feature that best matches the text features of the summary text as the preview image. Among them, the instruction encapsulated into metadata (i.e. metadata) can be "var metadata:GroupActivityMetadata{varmetadata=GroupActivityMetadata(); metadata.type=watchTogether; metadata.title=video.title; metadata.previewImage=previewImage; metadata.fallbackURL=fallbackURL; metadata.supportsContinuationOnTV=true; return metadata;}" wherein metadata.type is used to indicate the data type, metadata.title is used to indicate the data name; metadata.previewImage is used to indicate the preview image; metadata.fallbackURL is used to indicate the URL of the first media data.
[0107] It can be understood that after the shared activity object is created, it needs to be activated. The first wearable virtual display device can determine whether to activate the shared activity object through the result returned by the prepareForActivation() method. The specific instruction can be "switch await activity.prepareForActivation(){case.activationPreferred:do{_=try await activity.activate()}catch{logger.debug("Unable to activate the activity:\(error)")}case.activationDisabled:sharedVideo=nil;default:break}". Among them, when the prepareForActivation() method returns ".activationDisabled", it means that the user does not want to share the activity or the current environment is not suitable for sharing (for example, the network is inactive or disconnected). At this time, local playback or other operations can be performed. When the prepareForActivation() method returns ".activationPreferred", it means that the user needs to share this activity and can activate the shared activity object. At this time, the activate() method can be called to activate the shared activity object, as shown in the "activity.activate()" in the above instruction.
[0108] Furthermore, the first wearable virtual display device can load the first media data in the first system player based on the activated shared activity object, obtain the first playback state information of the first media data in the first system player, and generate the first shared data information based on the first playback state information. The first shared data information (i.e., AVPlayerItem1) can be used to record the playback state information of the first media data in the first system player, the resource information associated with the first media data, and the total playback time of the first media data.
[0109] Step S603: Create a first data sharing instance associated with the first system player and the first shared data information in the first business application.
[0110] In the embodiment of the present application, the specific implementation process of step S603 can be referred to as follows. Figure 4 The specific description process in step S403 is not repeated here.
[0111] Step S604, create a group session instance on the communication link, establish a shared interaction relationship between the group session instance and the first data sharing instance through the session coordination method, and pass the group session instance to the second wearable virtual display device through the communication link provided by the communication application, so that the second data sharing instance in the second wearable virtual display device establishes a shared interaction relationship between the group session instance and the second data sharing instance through the session coordination method.
[0112] In an embodiment of the present application, after the shared activity object is activated, the first wearable virtual display device can create and asynchronously return a group session instance (GroupSession) through the sessions() method on the communication link. Furthermore, the group session instance can be passed to the first data sharing instance as a first shared parameter through the session coordination method, and the first wearable virtual display device can establish a shared interaction relationship between the first data sharing instance and the group session instance according to the first shared parameter. Among them, the instruction for the session coordination method can be "coordinateWithSession()", and the specific instruction for establishing a shared interaction relationship between the first data sharing instance and the group session instance according to the first shared parameter can be "private var GroupSession:GroupSession <videowatchingactivity>? {didSet{guardlet GroupSession else{return}playbackCoordinator.coordinateWithSession(GroupSession)}}". The GroupSession in the instruction is the first shared parameter corresponding to the group session instance, and playbackCoordinator is used to indicate the first data sharing instance.
[0113] Further, the first wearable virtual display device can pass the group conversation instance to the second wearable virtual display device through the communication link provided by the communication application, so that the second data sharing instance in the second wearable virtual display device uses the acquired group conversation instance as the second sharing parameter through the session coordination method, and the second wearable virtual display device can establish a shared interaction relationship between the group conversation instance and the second data sharing instance according to the second sharing parameter. Among them, the second wearable virtual display device can detect and obtain the group conversation instance in real time through the communication link. Among them, the specific implementation instructions of the second wearable virtual display device establishing a shared interaction relationship between the group conversation instance and the second data sharing instance according to the second sharing parameter can refer to the specific instructions of the first wearable virtual display device establishing a shared interaction relationship between the first data sharing instance and the group conversation instance according to the first sharing parameter, which will not be repeated here.
[0114] After establishing a shared interactive relationship between the first data sharing instance and the second data sharing instance through the group session instance, the first wearable virtual display device can transmit the shared activity object and the first playback status information to the group session instance through the first data sharing instance. It can be understood that the second wearable virtual display device needs to detect the group session instance (GroupSession) in real time through the "session()" method, and the specific execution instruction can be "forawait session in VideoWatchingActivity.sessions(){cleanUPSession(groupSession); GroupSession=session}". Among them, "cleanUPSession()" is used to clean up old sessions, that is, when the second wearable virtual display device obtains the GroupSession in real time, when the obtained GroupSession changes, clean up the last obtained GroupSession. Among them, the second data sharing instance in the second wearable virtual display device is used to obtain the shared active object and the first playback status information on the group session instance during the detection of the group session instance; the second data sharing instance is also used to call the second system player in the second business application, and the second system player plays the first media data synchronously with the first wearable virtual display device according to the shared active object and the first playback status information.
[0115] Specifically, the second wearable virtual display device can call the second system player in the second business application through the second data sharing instance, obtain the resource information of the first media data indicated in the shared activity object, obtain the first media data, and play the first media data synchronously with the first wearable virtual display device through the second system player in the second business application according to the first playback state information. For example, at this time, the first business application in the first wearable virtual display device plays the first media data (for example, the film and television series A_01) to 3 minutes and 15 seconds, then after the second business application in the second wearable virtual display device obtains the film and television series A_01, it synchronously plays the film and television series A_01 to 3 minutes and 15 seconds in the second business application.
[0116] Step S605, in the process of detecting the group conversation instance, obtain the second shared data information sent by the second data sharing instance to the group conversation instance; when it is detected that the first playback status information and the second playback status information in the second shared data information are different, call the target control operation instruction that is the same as the control operation instruction in the second playback status information through the first data sharing instance, and operate the first media data in the first system player based on the target control operation instruction.
[0117] In an embodiment of the present application, the second system player is used to generate second shared data information (AVPlayerItem2) associated with the first media data to be played synchronously; the second shared data information includes resource information of the first media data and second playback state information of the first media data in the second business application. The first wearable virtual display device can obtain the second shared data information sent by the second data sharing instance to the group session instance during the detection of the group session instance. It can be understood that when the first system player and the second system player play the first media data synchronously, the first shared data information (AVPlayerItem1) associated with the first system player and the second shared data information (AVPlayerItem2) associated with the second system player are the same, that is, the first playback status information is the same as the second playback status information. When the second system player receives a control operation on the first media data (such as a fast forward operation), the second playback status information in AVPlayerItem2 may include a fast forward operation instruction, that is, AVPlayerItem2 changes. At this time, the first playback status information is different from the second playback status information, that is, AVPlayerItem1 and AVPlayerItem2 are different. The playbackCoordinator2 instance can automatically intercept calls that affect the transmission control state, that is, the control operation instructions generated by the control operation on the first media data, and pass the above instructions to the group session instance.
[0118] When the first wearable virtual display device detects that the first playback state information and the second playback state information in the second shared data information are different through the real-time detection group session instance, the target control operation instruction identical to the control operation instruction in the second playback state information can be called through the first data sharing instance, and the control operation indicated by the target control operation instruction can be synchronously performed on the first media data through the first system player. Specifically, the first wearable virtual display device can call the target control operation instruction identical to the control operation instruction in the second playback state information through the first data sharing instance; if the target control operation instruction is a pause playback control instruction, the first media data is synchronously paused through the first system player. The pause playback control instruction can be "pause()".
[0119] Optionally, if the target control operation instruction is a playback rate control instruction, the playback rate of the first media data is synchronously adjusted to the target playback rate indicated by the playback rate control instruction through the first system player. The playback rate control instruction may be "setRate(_:time:atHostTime:)". The target playback rate may be 1.25x, 1.5x, 2x, 3x, etc., 1.25x is used to indicate 1.25 times the speed, 1.5x is used to indicate 1.5 times the speed, 2x is used to indicate 2 times the speed, and 3x is used to indicate 3 times the speed. When the target playback rate is 2x, the first wearable virtual display device may synchronously adjust the playback rate of the first media data to 2 times the speed through the first system player, that is, play the first media data at 2 times the speed in the first business application.
[0120] Optionally, if the target control operation instruction is a progress adjustment instruction, the playback progress of the first media data is synchronously adjusted to the progress playback position indicated by the progress adjustment instruction through the first system player. Among them, the progress adjustment instruction can be "seek(to:completionHandler:)". Further, the first wearable virtual display device can update the first shared data information through the target control operation instruction, and transmit the updated first shared data information to the group session instance. It can be understood that at this time, the updated AVPlayerItem1 is the same as the changed AVPlayerItem2. Therefore, through the above process, it is possible to confirm in real time whether the two devices maintain synchronous playback. If one device detects that the two devices are playing synchronously, no adjustment is required; if one device detects that the two devices are not playing synchronously, the playback status information on the other device is obtained, and adjustments are made in the own device according to the playback status information to achieve synchronous playback with the other device.
[0121] Step S606, when the first data sharing instance detects through the group session instance that the shared activity attribute in the second data sharing instance has changed, the media data loading function is called to obtain the second media data; in the process of detecting the group session instance, the third data sharing information sent by the second data sharing instance to the group session instance is obtained; and the first system player switches the first media data to the second media data according to the third playback status information.
[0122] In an embodiment of the present application, the first wearable virtual display device can detect the change of the shared activity attribute in the second data sharing instance by detecting the instruction "awaitcoordinator.$sharedVideo", wherein "sharedVideo" is used to indicate the shared activity attribute. The shared activity attribute in the second data sharing instance is used to indicate the media data being played in the second business application. For example, when the second business application plays the first media data synchronously with the first business application, the shared activity attribute in the second data sharing instance may include the resource information of the first media data, etc.; when the second business application switches to play the second media data, the shared activity attribute in the second data sharing instance is updated to the resource information of the second media data, etc. It should be noted that the first media data and the second media data both belong to the shared media data set. For example, when the shared media data set is a TV series A (including 30 episodes), the first media data may be a TV series A_01, and the second media data may be any episode of the 30 episodes except the first episode. It can be understood that when the second business application in the second wearable virtual display device switches to play the second media data, only the shared data in the shared activity is changed, and there is no need to re-initiate a new shared activity.
[0123] When the first data sharing instance in the first wearable virtual display device detects a change in the shared activity attribute in the second data sharing instance through the group session instance, the media data loading function can be called to obtain the second media data. The specific instruction for calling the media data loading function to obtain the second media data can be "self.loadVideo(video,presentation:.fullWindow)", wherein the video in the instruction is used to indicate the video object corresponding to the second media data. That is, when the second wearable virtual display device responds to the trigger operation for the episode replacement component, the second media data determined by the episode component triggered by the user can be obtained, and the second media data can be played in the second business application in the second wearable virtual display device, and the resource information related to the second media data (for example, URL) is passed into sharedVideo, and is passed to the sharedVideo in the first wearable virtual display device through the group session instance for synchronization, so that the first wearable virtual display device can call the media data loading function to obtain the second media data when detecting a change in sharedVideo. Among them, the first media data belongs to the shared media data set; the shared activity attribute in the second data sharing instance is obtained by the second data sharing instance from the group session instance, and the shared activity attribute in the group session instance is determined by the shared activity object; the changed shared activity attribute is determined by switching the second media data to be shared in the second business application, and the second media data belongs to the shared media data set. For example, the shared media data set can be a film and television series A containing 30 episodes, the first media data can be the first episode in the film and television series A, and the second media data can be any episode of the 30 episodes except the first episode, for example, it can generally be the second episode. At this time, the shared activity attribute in the group session instance mentioned above indicates that the first media data is being played, that is, the first episode in the film and television series A (film and television series A_01), and the shared activity attribute in the second data sharing instance also indicates that the film and television series A_01 is being played. When the user corresponding to the second wearable virtual display device changes to play the film and television series A_02, the changed shared activity attribute indicates that the film and television series A_02 is being played. That is, the first wearable virtual display device detects the shared activity attributes transmitted from the second wearable virtual display device in real time through the group session instance. When the shared activity attributes change (that is, shared activity attributes that are different from the shared activity attributes in this device are obtained), the playback sharing adjustment can be performed according to the changed shared activity attributes.
[0124] Furthermore, during the detection of the group session instance, the first wearable virtual display device can obtain, through the first data sharing instance, the third data sharing information sent by the second data sharing instance to the group session instance. The third data sharing information includes third playback status information for the second media data. The first wearable virtual display device can call the first system player through the first data sharing instance, and switch the first media data to the second media data according to the third playback status information through the first system player. At this time, the first business application and the second business application play the second media data synchronously. For example, the second media data in the second business application is playing to 12 minutes and 31 seconds, and the second media data in the first business application is also playing to 12 minutes and 31 seconds.
[0125] Step S607, when it is detected that the second wearable virtual display device has created an update group session instance for updating media data on the communication link, a new shared interaction relationship is established between the first data sharing instance and the second data sharing instance through the update group session instance; in the process of detecting the update group session instance, the updated shared activity object and the updated data sharing information are obtained; the first media data is replaced with the updated media data through the first system player, and the updated media data is played synchronously with the second wearable virtual display device according to the updated playback status information.
[0126] In an embodiment of the present application, when the first wearable virtual display device detects that the second wearable virtual display device has created an update group session instance for updating media data on the communication link, a new sharing interaction relationship is established between the first data sharing instance and the second data sharing instance through the update group session instance. That is, when the second wearable virtual display device initiates a new sharing activity for updating media data, for example, at this time, the first media data associated with the group session instance is film and television series A, and the second wearable virtual display device initiates a sharing activity for film and television series B, and creates an update group session instance for the sharing activity of film and television series B. At this time, the first wearable virtual display device can detect the update group session instance through the communication link, and establish a new sharing interaction relationship between the group session instance and the first data sharing instance, so as to achieve the establishment of a new sharing interaction relationship between the first data sharing instance and the second data sharing instance through the update group session instance. It can be understood that the updated media data generally refers to an episode in film and television series B. It should be noted that the above process is used to illustrate that when multiple users are watching TV series A synchronously, when one of the users wants to share watching TV series B with other users, it is necessary to recreate a new group session instance (i.e., update the group session instance) and establish a new sharing interaction relationship through the ongoing communication link, that is, the user has initiated a new sharing activity.
[0127] Furthermore, during the process of detecting the update group session instance, the first wearable virtual display device can obtain the updated shared activity object and updated data sharing information sent to the update group session instance by the second data sharing instance that has established a new shared interaction relationship. Among them, the updated shared activity object includes updated resource information of the updated media data; the updated data sharing information includes updated playback status information of the updated media data. The specific implementation method of the second wearable display device creating the updated shared activity object can refer to the specific description of the first wearable virtual display device creating the shared activity object in step S602, which will not be repeated here. The first wearable virtual display device can call the first system player through the first data sharing instance, replace the first media data with the updated media data through the first system player, and play the updated media data synchronously with the second wearable virtual display device according to the updated playback status information.
[0128] Through the above process, a group session instance, a first data sharing instance, and a second data sharing instance are created. A shared interactive relationship is established between the first wearable virtual display device and the second wearable virtual display device through the group session instance, and a shared connection between the first wearable virtual display device and the second wearable virtual display is realized, so that the resource information and the first playback state information of the first media data are transmitted between the first data sharing instance and the second data sharing instance through the group session instance, so that the participant is no longer passively displaying the screen sharing picture of the initiator, but directly plays the first media data shared by the initiator, and synchronizes with the initiator's playback picture through the first playback state information, which provides the participant with the possibility of controlling the media data. Due to the real-time synchronous transmission of the first playback state information by the first data sharing instance and the second data sharing instance, both parties (the initiator and the participant) can initiate control to change the first media data or the first playback state information of the first media data, and synchronize to the other party's device to provide a consistent playback experience, thereby increasing the participation and interactivity of both parties. Moreover, since the participant is no longer passively displaying the shared screen picture, even if the network is unstable, the participant can still display the played first media data normally, ensuring the display effect of data sharing. Both parties can also initiate control to initiate a new sharing activity, thereby establishing a new sharing interaction relationship, and realize synchronous sharing of resource information and playback status information of media data in the new sharing activity through a new group session instance, a first data sharing instance, and a second data sharing instance. The number of the second wearable virtual display device can be one or more, that is, the data sharing method can support multiple people to synchronously share videos, thereby enhancing social interactivity.
[0129] For further information, see Figure 7 , Figure 7 This is a schematic diagram of a data sharing method provided in an embodiment of the present application. Figure 3 The data sharing method may be executed by a computer device, which may be Figure 1 The terminal device 101a shown is the first wearable virtual display device. The following will take the data sharing method executed by the first wearable virtual display device as an example for explanation. The data processing method may at least include the following steps S701-S703:
[0130] Step S701: In a virtual display interface of a first wearable virtual display device, in response to a communication operation in a communication application, a session page for communicating with a second wearable virtual display device is displayed in the virtual display interface.
[0131] In the embodiments of this application, please refer to Figure 2 In the virtual display interface 201 in the first wearable virtual display device, the first wearable virtual display device can respond to the communication operation in the communication application and display a conversation page 2021 for communicating with the second wearable virtual display device in the virtual display interface 202. The display area 2021a in the conversation page 2021 can display the content captured by the camera of the second wearable virtual display device, such as a portrait, an object, etc. captured by the second wearable virtual display device.
[0132] Step S702, in response to the triggering operation of the first switching sharing component in the first data playback page in the first business application in the virtual display interface, the first playback content in the first data playback page is shared with the second wearable virtual display device with which a communication connection has been established in the session page.
[0133] In the embodiment of the present application, the first wearable virtual display device can respond to the triggering operation of the first switching sharing component 2031a in the first data playback page 2031 in the first business application in the virtual display interface 203, and share the first playback content 2031a in the first data playback page 2031 with the second wearable virtual display device that has established a communication connection in the session page 2021. That is, the virtual display interface of the second wearable virtual display device is as follows: Figure 3 As shown in the virtual display interface 301 in FIG. 1 , the first playback content 2031a is played synchronously with the first wearable virtual display device (ie, the first wearable virtual display device) to 01:15. The first playback content 2031a may be Figure 4 The first media data mentioned in the embodiment.
[0134] Optionally, when the first wearable virtual display device responds to the trigger operation of the first switching sharing component 2031a in the first data playback page 2031, the first wearable virtual display device can obtain the cumulative trigger times of triggering the first switching sharing component 2031a. If the cumulative trigger times are less than the sharing times threshold, a sharing prompt pop-up window interface for the first business application is displayed on the virtual display interface. The sharing times threshold can be set manually. For example, when the sharing times threshold is 1, the cumulative trigger times are less than 1, that is, the first business application in the first wearable virtual display device responds to the trigger operation of the first switching sharing component 2031a for the first time, that is, the first shared playback activity is initiated. See Figure 8 , Figure 8 This is a scenario diagram of a data sharing method provided in an embodiment of the present application. Figure 3 ,like Figure 8 As shown, it includes a virtual display interface 801 and a virtual display interface 203, Figure 8 The virtual display interface 203 in Figure 2 The virtual display interface 203 in the virtual display interface 801. The virtual display interface 801 includes a session page 2021 and a display area 2021a. If the cumulative triggering times are less than the sharing times threshold, the first wearable virtual display device displays a sharing prompt pop-up interface 8011 for the first business application in the virtual display interface 801. The cumulative triggering times refer to the times when the user triggers the first switching sharing component 2031a and completes the shared playback with the second wearable virtual display device. If the user triggers the first switching sharing component 2031a but cancels the shared playback with the second wearable virtual display device, it is not counted in the cumulative triggering times. For example, if user A triggers the first switching sharing component 2031a and has performed synchronous sharing with user B 5 times, the cumulative number of triggers is 5. When the sharing number threshold is 1, the first wearable virtual display device does not display the sharing prompt pop-up interface 8011 in the virtual display interface 801, and directly displays the first playback content 2031b in the virtual display interface 203, and the cumulative number of triggers increases to 6; if user A does not trigger the first switching sharing component 2031a and has performed synchronous sharing with user B, the cumulative number of triggers is 0. When the sharing number threshold is 1, the first wearable virtual display device displays the sharing prompt pop-up interface 8011 in the virtual display interface 801, and the cumulative number of triggers increases to 1.
[0135] Further, if the user cancels the shared playback activity and clicks the ignore component 8011a in the sharing prompt pop-up interface 8011, the first wearable virtual display device responds to the trigger operation for the ignore component 8011a, cancels the shared playback of the first playback content 2031b in the first data playback page 2031 to the second wearable virtual display device with which the communication connection has been established in the session page 2021. It should be noted that when the user cancels the sharing activity, the cumulative number of triggers for the first switching sharing component 2031a is not accumulated. If the user starts the shared playback activity and clicks the start component 8011b in the sharing prompt pop-up interface 8011, the first wearable virtual display device responds to the trigger operation for the start component 8011b, closes the sharing prompt pop-up interface 8011, and shares the first playback content 2031b in the first data playback page 2031 to the second wearable virtual display device with which the communication connection has been established in the session page 2021. At this time, the virtual display interface in the first wearable virtual display device is shown as virtual display interface 203, and the virtual display interface in the second wearable virtual display device is shown as Figure 3 As shown in the virtual display interface 301 in .
[0136] It can be understood that due to the functions of the first wearable virtual display device (XR device) and the second wearable virtual display device themselves, different virtual environments can be provided for users to watch videos, and their spatial audio technology can provide an immersive sound experience, making users feel that the sound comes from all directions, thereby increasing the fun and immersion of watching movies.
[0137] Step S703: When it is detected that the second wearable virtual display device performs a control operation on the shared first playback content, a control operation is synchronously performed on the first playback content in the first data playback page in the first business application.
[0138] In the embodiment of the present application, the control operation may include a pause operation, a progress adjustment operation, and a play rate control operation. Taking the terminal device 101b as the second wearable virtual display device as an example, see Figure 3 In the virtual display interface 302 in the second data playback page 3021, when the second wearable virtual display device responds to the trigger operation of the playback control component 3021b in the second data playback page 3021 and performs a pause playback operation on the first playback content 3021a, the first wearable virtual display device can detect the pause playback operation performed by the second wearable virtual display device on the shared first playback content 3021a. Figure 2 , the first wearable virtual display device can synchronously perform a pause operation on the first playback content 2041b in the first data playback page 2041 in the first business application. At this time, the first playback content 2041b is paused to 03:15, and the playback control component 2031c in the first data playback page 2031 changes to the pause control component 2041a in the first data playback page 2041.
[0139] Optional, see Figure 3 In the virtual display interface 302 in FIG. 302, when the second wearable virtual display device responds to the trigger operation of the progress control component 3021c in the second data playback page 3021 and performs a progress adjustment operation on the first playback content 3021a, for example, when the playback progress of the first playback content 3021a is dragged from 03:15 to 11:35, the first wearable virtual display device can detect the progress adjustment operation performed by the second wearable virtual display device on the shared first playback content 3021a. Please also refer to Fig. 9 , Fig. 9 This is a scenario diagram of a data sharing method provided in an embodiment of the present application. Figure 4 , Fig. 9 Used to indicate the change scene of the virtual display interface in the first wearable virtual display device. Fig. 9 As shown in the virtual display interface 901 in the first business application, the first wearable virtual display device can synchronously perform a progress adjustment operation on the first playback content 9011a in the first data playback page 9011, that is, drag the progress control component 9011c in the progress bar from 03:15 to 11:35 of the progress bar. As shown in the progress control component 9021b at 11:35 of the progress bar in the first data playback page 9021 in the virtual display interface 902. At this time, the first playback content 9021a in the first data playback page 9021 is the content at 11 minutes and 35 seconds of the video content corresponding to the episode A_01.
[0140] Optional, see Figure 3 In the virtual display interface 302 in the second data playback page 3021, when the second wearable virtual display device responds to the trigger operation of the rate control component 3021d in the second data playback page 3021, determines the target playback rate of the first playback content 3021a, and performs the playback rate control operation on the first playback content 3021a, for example, the target playback rate is 2x, that is, the first playback content 3021a is played at 2 times the speed. The first wearable virtual display device can detect the playback rate control operation performed by the second wearable virtual display device on the shared first playback content 3021a, and further can trigger the following Fig. 9 The rate control component 9011d shown in the figure adjusts the playback rate of the first playback content 9011a to the target playback rate, that is, the first playback content 3021a is played at 2 times the speed in the second wearable virtual display device, and the first playback content 9011a is also played at 2 times the speed in the first wearable virtual display device.
[0141] Optional, see Figure 3 In the virtual display interface 302 in the second data playback page 3021, when the second wearable virtual display device responds to the trigger operation of the selection control component 3021f in the second data playback page 3021, and determines to perform the episode switching control operation on the specific playback content in the first playback content 3021a, that is, when the specific content of the first playback content 3021a is switched from the first media data to the second media data, for example, the specific content of the first playback content 3021a is switched from episode A_01 to episode A_03. The first wearable virtual display device can detect the episode switching control operation performed by the second wearable virtual display device on the shared first playback content 3021a, and further can trigger the following operation: Fig. 9 The selection control component 9011f shown in the figure switches the first playback content 9011a to the first playback content 9031a shown in the first data playback page 9031 in the virtual display interface 903. At this time, the first playback content 9031a is the drama A_03.
[0142] Optional, see Fig.10 , Fig.10 This is a scenario diagram of a data sharing method provided in an embodiment of the present application. Figure 5 ,like Fig.10 As shown, it includes a virtual display interface 203, a virtual display interface 1001 and a virtual display interface 1002, and the virtual display interface 203 is Figure 2 The virtual display interface 203 shown in . When the first wearable virtual display device detects that the second wearable virtual display device has initiated a sharing request for updated playback content in the second data playback page, and the updated playback content is different from the first playback content in the shared playback of the first data playback page, the first wearable virtual display device can detect the sharing request for updated media data, and display a playback replacement prompt content interface in the first data playback page of the first business application, wherein the second data playback page refers to the playback page in the second business application in the second wearable virtual display device. For example, when the first wearable virtual display device and the second wearable virtual display device share the first media data (for example, it can be episode A_01) in the shared media data set (for example, it can be episode A), the second wearable virtual display device re-initiates a sharing request for updated media data (for example, it can be episode B_01). At this time, the first wearable virtual display device can detect the sharing request for updated media data, and display a playback replacement prompt content interface in the first data playback page of the first business application. Fig.10 The first data play page 2031 of the virtual display interface 1001 shown displays a play replacement prompt content interface 10011 .
[0143] Further, when the user corresponding to the first wearable virtual display device does not agree that the second wearable virtual display device shares the updated media data with the first wearable virtual display device, the user can click the cancel component 10011a in the play replacement prompt content interface 10011, and the sharing request for the updated media data initiated by the second wearable virtual display device cannot be completed. When the user corresponding to the first wearable virtual display device agrees that the second wearable virtual display device shares the updated media data with the first wearable virtual display device, the user can click the replacement component 10011b in the play replacement prompt content interface 10011, and the first wearable virtual display device responds to the trigger operation of the replacement component in the play replacement prompt content interface 10011, closes the play replacement prompt content interface 10011, replaces the first play content 2031b in the first data play page 2031, and shares the play update play content with the second wearable virtual display device. For example, as shown in the virtual display interface 1002, the first wearable virtual display device shares the play update play content 10021a with the second wearable virtual display device in the first data play page 10021.
[0144] It can be understood that the first wearable virtual display device and the second wearable virtual display device can realize the synchronous playback of media data between the first wearable virtual display device and the second wearable virtual display device through the first data sharing instance, the second numerical control sharing instance and the group session instance. The specific implementation process and the meaning of the first data sharing instance, the second numerical control sharing instance and the group session instance can be seen in the above Figure 4 , Figure 6 and Figure 7 The specific description in the corresponding embodiment will not be repeated here.
[0145] Through the above process, it can be ensured that the first playback content in the first wearable virtual display device and the second wearable virtual display device is synchronized, that is, it can support users to share and watch videos (i.e., the first playback content), and the playback progress and playback status of the video are also synchronized, which enhances the user's common experience. At the same time, the participant corresponding to the second wearable virtual display device is no longer a passive display of the shared screen, but directly displays and plays the first playback content. Both parties can trigger the control component to change the playback status of the first media data or the first media data, and synchronize it to the other party's device to provide a consistent playback experience, increasing the interactivity of both parties. And the number of the second wearable virtual display device can be one or more (i.e., the participant can be one or more), which can support multiple users to share and watch videos at the same time. Each user can share and watch videos with other users in their corresponding wearable virtual display device, and can interact with other users in real time through the conversation page, for example, to make comments or share feelings, etc., which can further enhance the user experience.
[0146] For further information, see Fig.11 , Fig.11 This is a schematic diagram of a data sharing device provided in an embodiment of the present application. Figure 1 The data sharing device 1100 may be a computer program running in a computer device, for example, the data sharing device 1100 may be an application software; the data sharing device 1100 may be used to execute the corresponding steps of the method provided in the embodiment of the present application. Fig.11 As shown, the data sharing device 1100 can be used for Figure 4 , Figure 6 and Figure 7 The computer device in the corresponding embodiment, specifically, the data sharing device 1100 may include: a communication connection module 11, an active object creation module 12, a data sharing instance creation module 13, and a sharing interaction relationship establishment module 14.
[0147] The communication connection module 11 is used to establish a communication link with the second wearable virtual display device through the communication application of the first wearable virtual display device;
[0148] The activity object creation module 12 is used to create a shared activity object based on the sharing request for the first media data when the first business application of the first wearable virtual display device is acquired and the first system player is called to initiate a sharing request for the first media data, and in the first system player, generate first shared data information based on the shared activity object; the shared activity object includes resource information of the first media data; the first shared data information includes first playback state information; the first media data is the media data required to be played in the first business application;
[0149] A data sharing instance creation module 13, configured to create, in a first service application, a first data sharing instance associated with a first system player and first shared data information;
[0150] A shared interaction relationship establishing module 14 is used to create a group session instance on a communication link, and to establish a shared interaction relationship between a first data sharing instance and a second data sharing instance created by a second wearable virtual display device through the group session instance; the group session instance is used to share data transmission of a shared activity object and a first playback status information between the first data sharing instance and the second data sharing instance with which a shared interaction relationship has been established; the second data sharing instance is used to control the second business application to play the first media data synchronously with the first wearable virtual display device according to the resource information and the first playback status information in the shared activity object obtained through sharing.
[0151] In a possible implementation, the sharing interaction relationship establishing module 14 is further configured to perform the following operations:
[0152] The shared activity object and the first playback status information are transmitted to the group session instance through the first data sharing instance; the second data sharing instance is used to obtain the shared activity object and the first playback status information during the detection of the group session instance; the second data sharing instance is also used to call the second system player in the second business application, and the second system player plays the first media data synchronously with the first wearable virtual display device according to the shared activity object and the first playback status information.
[0153] In a possible implementation, the second system player is used to generate second shared data information associated with the first media data played synchronously; the second shared data information includes resource information of the first media data and second play state information of the first media data in the second service application; the shared interaction relationship establishment module 14 is further used to perform the following operations:
[0154] In the process of detecting the group session instance, obtaining second shared data information sent by the second data sharing instance to the group session instance;
[0155] When it is detected that the first play state information and the second play state information in the second shared data information are different, a target control operation instruction identical to the control operation instruction in the second play state information is called through the first data sharing instance, and the control operation indicated by the target control operation instruction is synchronously performed on the first media data through the first system player;
[0156] The first shared data information is updated through the target control operation instruction, and the updated first shared data information is transmitted to the group session instance.
[0157] In a possible implementation, the shared interactive relationship establishing module 14 is used to call the target control operation instruction that is the same as the control operation instruction in the second playback state information through the first data sharing instance, and when the first system player synchronously performs the control operation indicated by the target control operation instruction on the first media data, the shared interactive relationship establishing module 14 is specifically used to perform the following operations:
[0158] calling, through the first data sharing instance, a target control operation instruction that is the same as the control operation instruction in the second playback state information;
[0159] If the target control operation instruction is a pause playback control instruction, the first system player synchronously pauses playback of the first media data;
[0160] If the target control operation instruction is a playback rate control instruction, the playback rate of the first media data is synchronously adjusted to the target playback rate indicated by the playback rate control instruction through the first system player;
[0161] If the target control operation instruction is a progress adjustment instruction, the playback progress of the first media data is synchronously adjusted to the progress playback position indicated by the progress adjustment instruction through the first system player.
[0162] In a possible implementation, the first media data belongs to a shared media data set; the shared interaction relationship establishing module 14 is further configured to perform the following operations:
[0163] When the first data sharing instance detects through the group session instance that the shared activity attribute in the second data sharing instance has changed, the media data loading function is called to obtain the second media data based on the resource information of the second media data indicated by the changed shared activity attribute; the shared activity attribute in the second data sharing instance is obtained by the second data sharing instance from the group session instance, and the shared activity attribute in the group session instance is determined by the shared activity object; the changed shared activity attribute is determined by switching the second media data to be shared in the second business application; the second media data belongs to the shared media data set;
[0164] In the process of detecting the group conversation instance, obtaining third data sharing information sent by the second data sharing instance to the group conversation instance; the third data sharing information includes third playback state information for the second media data;
[0165] The first system player is called through the first data sharing instance, and the first system player switches the first media data to the second media data according to the third playback state information.
[0166] In a possible implementation, the sharing interaction relationship establishing module 14 is further configured to perform the following operations:
[0167] When it is detected that the second wearable virtual display device has created an update group session instance for updating media data on the communication link, a new sharing interaction relationship is established between the first data sharing instance and the second data sharing instance through the update group session instance;
[0168] In the process of detecting the update group conversation instance, obtaining the update sharing activity object and the update data sharing information sent by the second data sharing instance having established a new sharing interaction relationship to the update group conversation instance; the update sharing activity object includes the update resource information of the update media data; the update data sharing information includes the update playback status information of the update media data;
[0169] The first system player is called through the first data sharing instance, the first media data is replaced with the updated media data through the first system player, and the updated media data is played synchronously with the second wearable virtual display device according to the updated playback state information.
[0170] In a possible implementation, the activity object creation module 12 is used to, when acquiring the first business application of the first wearable virtual display device and calling the first system player to initiate a sharing request for the first media data, create a shared activity object based on the sharing request for the first media data. In the first system player, when generating the first shared data information based on the shared activity object, the activity object creation module 12 is specifically used to perform the following operations:
[0171] In response to a triggering operation on a first switching sharing component in a first business application, calling a first system player through the first business application, and generating a sharing request for first media data through the first system player;
[0172] Acquire media attribute information associated with the first media data from a sharing request for the first media data, create a media data object based on the media attribute information, and create a shared activity object according to the media data object;
[0173] In the first system player, the first media data is loaded based on the shared activity object, first play status information of the first media data in the first system player is obtained, and first shared data information is generated based on the first play status information.
[0174] In a possible implementation, when the activity object creation module 12 is used to create a shared activity object according to the media data object, the activity object creation module 12 is specifically used to perform the following operations:
[0175] Encapsulate the data type, data name, preview image and resource information of the first media data in the media data object into metadata; the preview image refers to a target video frame randomly obtained from the first media data;
[0176] A shared activity object is created based on the first media data and the metadata.
[0177] In a possible implementation, when the shared interaction relationship establishing module 14 is used to establish a shared interaction relationship between the first data sharing instance and the second data sharing instance created by the second wearable virtual display device through the group session instance, the shared interaction relationship establishing module 14 is specifically used to perform the following operations:
[0178] Passing the group session instance as a first sharing parameter to the first data sharing instance through the session coordination method, and establishing a sharing interaction relationship between the first data sharing instance and the group session instance according to the first sharing parameter;
[0179] The group conversation instance is passed to the second wearable virtual display device through the communication link provided by the communication application, so that the second data sharing instance in the second wearable virtual display device uses the acquired group conversation instance as the second sharing parameter through the session coordination method, and establishes a shared interaction relationship between the group conversation instance and the second data sharing instance according to the second sharing parameter.
[0180] For further information, see Fig.12 , Fig.12 This is a schematic diagram of a data sharing device provided in an embodiment of the present application. Figure 2 The data sharing device 1200 may be a computer program running in a computer device, for example, the data sharing device 1200 may be an application software; the data sharing device 1200 may be used to execute the corresponding steps of the method provided in the embodiment of the present application. Fig.12 As shown, the data sharing device 1200 can be used for Figure 4 , Figure 6 and Figure 7 The computer device in the corresponding embodiment, specifically, the data sharing device 1100 may include: a session page display module 21, a shared playback module 22, and a synchronous display module 23.
[0181] The conversation page display module 21 is used to display a conversation page for communicating with the second wearable virtual display device in the virtual display interface in response to a communication operation in the communication application in the virtual display interface of the first wearable virtual display device;
[0182] The shared playback module 22 is used to respond to the triggering operation of the first switching sharing component in the first data playback page of the first business application in the virtual display interface, and share the playback content in the first data playback page with the second wearable virtual display device with which the communication connection has been established in the session page;
[0183] The synchronous display module 23 is used to synchronously perform a control operation on the playback content in the first data playback page in the first business application when it is detected that the second wearable virtual display device performs a control operation on the shared playback content.
[0184] In a possible implementation, the shared playback module 22 is further configured to perform the following operations:
[0185] Obtaining the cumulative number of triggering times for triggering the first switching sharing component, and if the cumulative number of triggering times is less than the sharing times threshold, displaying a sharing prompt pop-up window interface for the first business application on the virtual display interface;
[0186] In response to the triggering operation of the opening component in the sharing prompt pop-up window interface, the sharing prompt pop-up window interface is closed, and the first playback content in the first data playback page is shared and played to the second wearable virtual display device with which a communication connection has been established in the session page.
[0187] In a possible implementation, the synchronization display module 23 is further configured to perform the following operations:
[0188] When it is detected that the second wearable virtual display device initiates a sharing request for the updated playback content in the second data playback page, and the updated playback content is different from the first playback content in the shared playback of the first data playback page, a playback replacement prompt content interface is displayed in the first data playback page of the first business application; the second data playback page refers to the playback page in the second business application in the second wearable virtual display device;
[0189] In response to a triggering operation on a replacement component in the playback replacement prompt content interface, the playback replacement prompt content interface is closed, the first playback content is replaced in the first data playback page, and the playback update content is shared with the second wearable virtual display device.
[0190] Through the above process, a group session instance, a first data sharing instance, and a second data sharing instance are created. A shared interactive relationship is established between the first wearable virtual display device and the second wearable virtual display device through the group session instance, and a shared connection between the first wearable virtual display device and the second wearable virtual display is realized, so that the resource information and the first playback state information of the first media data are transmitted between the first data sharing instance and the second data sharing instance through the group session instance, so that the participant is no longer passively displaying the screen sharing picture of the initiator, but directly plays the first media data shared by the initiator, and synchronizes with the initiator's playback picture through the first playback state information, which provides the participant with the possibility of controlling the media data. Due to the real-time synchronous transmission of the first playback state information by the first data sharing instance and the second data sharing instance, both parties (the initiator and the participant) can initiate control to change the first media data or the first playback state information of the first media data, and synchronize to the other party's device to provide a consistent playback experience, thereby increasing the participation and interactivity of both parties. Moreover, since the participant is no longer passively displaying the shared screen picture, even if the network is unstable, the participant can still display the played first media data normally, ensuring the display effect of data sharing. Both parties can also initiate control to initiate a new sharing activity, thereby establishing a new sharing interaction relationship, and realize synchronous sharing of resource information and playback status information of media data in the new sharing activity through a new group session instance, a first data sharing instance, and a second data sharing instance. The number of the second wearable virtual display device can be one or more, that is, the data sharing method can support multiple people to synchronously share videos, thereby enhancing social interactivity.
[0191] See also Fig.13 , Fig.13 Schematic diagram of the structure of a computer device provided in an embodiment of the present application. Fig.13 As shown, the computer device 1300 in the embodiment of the present application may include: a processor 1301, a network interface 1304 and a memory 1305. In addition, the above-mentioned computer device 1300 may also include: a user interface 1303, and at least one communication bus 1302. Among them, the communication bus 1302 is used to realize the connection and communication between these components. Among them, the user interface 1303 may include a display screen (Display), a keyboard (Keyboard), and the optional user interface 1303 may also include a standard wired interface and a wireless interface. The network interface 1304 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1305 may be a high-speed RAM memory, or it may be a non-volatile memory (non-volatile memory), such as at least one disk storage. The memory 1305 may optionally also be at least one storage device located away from the aforementioned processor 1301. As Fig.13 As shown, the memory 1305 as a computer-readable storage medium may include an operating system, a network communication module, a user interface module, and a computer program.
[0192] The network interface 1304 can provide network communication network elements; the user interface 1303 is mainly used to provide an input interface for the user; and the processor 1301 can be used to call the computer program stored in the memory 1305, specifically for executing Figure 4 , Figure 6 and Figure 7 Each step in the embodiment.
[0193] In addition, it should be noted that: the embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, the computer program is suitable for being loaded and executed by the processor Figure 4 , Figure 6 and Figure 7 For details on the methods provided in each step, please refer to the Figure 4 , Figure 6 and Figure 7 The implementation methods provided in each step are not repeated here. In addition, the description of the beneficial effects of adopting the same method is not repeated. For technical details not disclosed in the computer-readable storage medium embodiment involved in this application, please refer to the description of the method embodiment of this application. As an example, the computer program can be deployed to execute on one computer device, or on multiple computer devices located in one place, or on multiple computer devices distributed in multiple locations and interconnected by a communication network.
[0194] The computer-readable storage medium may be the device provided in any of the aforementioned embodiments or the internal storage unit of the computer device, such as the hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a smart memory card (smart media card, SMC), a secure digital (secure digital, SD) card, a flash card (flash card), etc. equipped on the computer device. Further, the computer-readable storage medium may also include both the internal storage unit of the computer device and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by the computer device. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.
[0195] The present application also provides a computer program product, which includes a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device executes Figure 4 , Figure 6 and Figure 7 The methods provided in the various optional methods are therefore not described in detail here.
[0196] The terms "first", "second", etc. in the description, claims, and drawings of the embodiments of the present application are used to distinguish different objects, rather than to describe a specific order. In addition, the term "comprising" and any variation thereof are intended to cover non-exclusive inclusions. For example, a process, method, device, product, or equipment that includes a series of steps or units is not limited to the listed steps or modules, but may optionally include steps or modules that are not listed, or may optionally include other step units inherent to these processes, methods, devices, products, or equipment.
[0197] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories) or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.
[0198] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in this description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0199] The method and related apparatus provided by the embodiment of the present application are described with reference to the method flow chart and / or structural diagram provided by the embodiment of the present application. Specifically, each process and / or box in the method flow chart and / or structural diagram, as well as the combination of the processes and / or boxes in the flow chart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable device to generate a machine, so that the instructions executed by the processor of the computer or other programmable device generate instructions for implementing the process in the process. Figure 1 A process or multiple processes and / or structures Figure 1 The computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including the instruction device, or are transmitted through a computer-readable storage medium. Computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The instruction device is implemented in the process Figure 1 A process or multiple processes and / or structures Figure 1 These computer program instructions can also be loaded onto a computer or other programmable device so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide the functions for implementing the process. Figure 1 A flow or multiple flows and / or structures illustrate the steps of the functions specified in one block or multiple blocks.
[0200] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.
[0201] The modules in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.
[0202] The above disclosure is only the preferred embodiment of the present application, which certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.< / videowatchingactivity>
Claims
1. A data sharing method, characterized in that: The method comprises: Establishing a communication link with the second wearable virtual display device through a communication application of the first wearable virtual display device; When the first business application of the first wearable virtual display device is acquired and the first system player is called to initiate a sharing request for the first media data, a shared activity object is created based on the sharing request for the first media data, and in the first system player, first shared data information is generated based on the shared activity object; the shared activity object includes resource information of the first media data; the first shared data information includes first playback state information; the first media data is the media data required to be played in the first business application; Creating a first data sharing instance associated with the first system player and the first shared data information in the first service application; A group session instance is created on the communication link, and a shared interaction relationship is established between the first data sharing instance and the second data sharing instance created by the second wearable virtual display device through the group session instance; the group session instance is used to share data transmission of the shared activity object and the first playback status information between the first data sharing instance and the second data sharing instance that have established the shared interaction relationship; the second data sharing instance is used to control the second business application to play the first media data synchronously with the first wearable virtual display device according to the resource information in the shared activity object and the first playback status information obtained by sharing.
2. The method according to claim 1, characterized in that The method further comprises: The shared activity object and the first playback status information are transmitted to the group session instance through the first data sharing instance; the second data sharing instance is used to obtain the shared activity object and the first playback status information during the detection of the group session instance; the second data sharing instance is also used to call the second system player in the second business application, and the second system player plays the first media data synchronously with the first wearable virtual display device according to the shared activity object and the first playback status information.
3. The method according to claim 2, characterized in that The second system player is used to generate second shared data information associated with the first media data played synchronously; the second shared data information includes resource information of the first media data and second play status information of the first media data in the second service application; the method further includes: In the process of detecting the group conversation instance, acquiring the second shared data information sent by the second data sharing instance to the group conversation instance; When it is detected that the first playback state information is different from the second playback state information in the second shared data information, calling the target control operation instruction that is the same as the control operation instruction in the second playback state information through the first data sharing instance, and synchronously performing the control operation indicated by the target control operation instruction on the first media data through the first system player; The first shared data information is updated through the target control operation instruction, and the updated first shared data information is transmitted to the group session instance.
4. The method according to claim 3, characterized in that The calling, through the first data sharing instance, a target control operation instruction identical to the control operation instruction in the second playback state information, and synchronously performing the control operation indicated by the target control operation instruction on the first media data through the first system player, includes: calling, through the first data sharing instance, a target control operation instruction that is the same as the control operation instruction in the second playback state information; If the target control operation instruction is a pause playback control instruction, the first system player synchronously pauses playback of the first media data; If the target control operation instruction is a playback rate control instruction, the playback rate of the first media data is synchronously adjusted to the target playback rate indicated by the playback rate control instruction through the first system player; If the target control operation instruction is a progress adjustment instruction, the playback progress of the first media data is synchronously adjusted to the progress playback position indicated by the progress adjustment instruction through the first system player.
5. The method according to claim 1, characterized in that The first media data belongs to a shared media data set; the method further includes: When the first data sharing instance detects through the group session instance that the shared activity attribute in the second data sharing instance has changed, the media data loading function is called to obtain the second media data based on the resource information of the second media data indicated by the changed shared activity attribute; the shared activity attribute in the second data sharing instance is obtained by the second data sharing instance from the group session instance, and the shared activity attribute in the group session instance is determined by the shared activity object; the changed shared activity attribute is determined by switching the second media data to be shared in the second business application; the second media data belongs to the shared media data set; In the process of detecting the group conversation instance, obtaining third data sharing information sent by the second data sharing instance to the group conversation instance; the third data sharing information includes third playback state information for the second media data; The first system player is called through the first data sharing instance, and the first system player switches the first media data to the second media data according to the third playback state information.
6. The method according to claim 1, characterized in that The method further comprises: When it is detected that the second wearable virtual display device has created an update group session instance for updating media data on the communication link, establishing a new sharing interaction relationship between the first data sharing instance and the second data sharing instance through the update group session instance; In the process of detecting the update group conversation instance, obtaining the update sharing activity object and the update data sharing information sent by the second data sharing instance with which a new sharing interaction relationship has been established to the update group conversation instance; the update sharing activity object includes the update resource information of the update media data; the update data sharing information includes the update playback status information of the update media data; The first system player is called through the first data sharing instance, the first media data is replaced with the updated media data through the first system player, and the updated media data is played synchronously with the second wearable virtual display device according to the updated playback state information.
7. The method according to claim 1, characterized in that When the first service application of the first wearable virtual display device is acquired and the first system player is called to initiate a sharing request for the first media data, a shared activity object is created based on the sharing request for the first media data, and in the first system player, first shared data information is generated based on the shared activity object, including: In response to a triggering operation on a first switching sharing component in the first service application, calling a first system player through the first service application, and generating a sharing request for first media data through the first system player; Acquire media attribute information associated with the first media data from the sharing request for the first media data, create a media data object based on the media attribute information, and create a shared activity object according to the media data object; In the first system player, the first media data is loaded based on the shared activity object, first playback state information of the first media data in the first system player is obtained, and first shared data information is generated based on the first playback state information.
8. The method according to claim 7, characterized in that The creating a shared activity object according to the media data object comprises: Encapsulating the data type, data name, preview image and resource information of the first media data in the media data object into metadata; the preview image refers to a target video frame randomly obtained from the first media data; A shared activity object is created based on the first media data and the metadata.
9. The method according to claim 1, characterized in that: The establishing a sharing interaction relationship between the first data sharing instance and the second data sharing instance created by the second wearable virtual display device through the group session instance includes: Passing the group session instance as a first sharing parameter to the first data sharing instance through a session coordination method, and establishing a sharing interaction relationship between the first data sharing instance and the group session instance according to the first sharing parameter; The group conversation instance is passed to the second wearable virtual display device through the communication link provided by the communication application, so that the second data sharing instance in the second wearable virtual display device uses the acquired group conversation instance as the second sharing parameter through the session coordination method, and establishes a shared interaction relationship between the group conversation instance and the second data sharing instance according to the second sharing parameter.
10. A data sharing method, characterized in that: The method comprises: In a virtual display interface in the first wearable virtual display device, in response to a communication operation in the communication application, a session page for communicating with the second wearable virtual display device is displayed in the virtual display interface; In response to a triggering operation of a first switching sharing component in a first data playback page in a first business application in the virtual display interface, sharing a first playback content in the first data playback page with the second wearable virtual display device with which a communication connection has been established in the session page; When it is detected that the second wearable virtual display device performs a control operation on the shared first playback content, the control operation is synchronously performed on the first playback content in the first data playback page in the first business application.
11. The method according to claim 10, characterized in that The method further comprises: Acquire the cumulative number of triggering times for triggering the first switching sharing component, and if the cumulative number of triggering times is less than a sharing times threshold, display a sharing prompt pop-up window interface for the first business application on the virtual display interface; In response to the triggering operation of the opening component in the sharing prompt pop-up window interface, the sharing prompt pop-up window interface is closed, and the first playback content in the first data playback page is shared and played to the second wearable virtual display device with which a communication connection has been established in the session page.
12. The method according to claim 10, characterized in that The method further comprises: When it is detected that the second wearable virtual display device initiates a sharing request for updated playback content in the second data playback page, and the updated playback content is different from the first playback content in the shared playback of the first data playback page, a playback replacement prompt content interface is displayed in the first data playback page in the first business application; the second data playback page refers to a playback page in the second business application in the second wearable virtual display device; In response to a triggering operation on a replacement component in the playback replacement prompt content interface, the playback replacement prompt content interface is closed, the first playback content is replaced in the first data playback page, and the updated playback content is shared with the second wearable virtual display device.
13. A data sharing device, characterized in that: The device comprises: A communication connection module, configured to establish a communication link with a second wearable virtual display device through a communication application of the first wearable virtual display device; An activity object creation module is used for, when acquiring a first business application of the first wearable virtual display device and invoking a first system player to initiate a sharing request for first media data, creating a shared activity object based on the sharing request for the first media data, and generating first shared data information in the first system player based on the shared activity object; the shared activity object includes resource information of the first media data; the first shared data information includes first playback status information; the first media data is media data required to be played in the first business application; A data sharing instance creation module, used to create a first data sharing instance associated with the first system player and the first shared data information in the first business application; A shared interaction relationship establishment module, used to create a group session instance on the communication link, and establish a shared interaction relationship between the first data sharing instance and the second data sharing instance created by the second wearable virtual display device through the group session instance; the group session instance is used to share data transmission of the shared activity object and the first playback status information between the first data sharing instance and the second data sharing instance that have established the shared interaction relationship; the second data sharing instance is used to control the second business application to play the first media data synchronously with the first wearable virtual display device according to the resource information in the shared activity object and the first playback status information obtained by sharing.
14. A data sharing device, characterized in that: The device comprises: A conversation page display module, configured to display, in a virtual display interface in a first wearable virtual display device, a conversation page for communicating with a second wearable virtual display device in response to a communication operation in a communication application; A shared playback module, configured to respond to a triggering operation of a first switching sharing component in a first data playback page in a first business application in the virtual display interface, and share the playback content in the first data playback page with the second wearable virtual display device with which a communication connection has been established in the session page; A synchronous display module is used to synchronously perform the control operation on the playback content in the first data playback page in the first business application when it is detected that the second wearable virtual display device performs a control operation on the shared playback content.
15. A computer device, characterized in that: Includes processor, memory, input and output interfaces; The processor is connected to the memory and the input / output interface respectively, wherein the input / output interface is used to receive and output data, the memory is used to store a computer program, and the processor is used to call the computer program so that the computer device executes the method described in any one of claims 1-12.
16. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is suitable for being loaded and executed by a processor, so that a computer device having the processor executes the method according to any one of claims 1 to 12.
17. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 12 is implemented.
Citation Information
Patent Citations
Video playing processing method and device, electronic equipment and storage medium
CN113225605A
Location sharing method, device and equipment
CN114205321A
Multimedia data progress control method and device and readable storage medium
CN114584838A
Player instance configuration method and device, electronic equipment and storage medium
CN118250521A
File sharing method and terminal device
WO2023151377A1