Method and device for watching videos on multiple devices simultaneously

Abstract

The present application discloses a method and apparatus for watching videos simultaneously on multiple devices, which is used to solve the problem of how to efficiently and conveniently realize watching videos simultaneously on multiple devices. The solution provided by the present application is applied to a cloud set-top box platform, including: receiving a first simultaneous viewing request sent by a first playback device, the first simultaneous viewing request carrying information of the first playback device; generating a simultaneous viewing link corresponding to the information of the first playback device, and responding to the first simultaneous viewing request with the simultaneous viewing link; receiving a second simultaneous viewing request sent by at least one second playback device based on the simultaneous viewing link; obtaining the video playback progress information of the first playback device, and responding to the second simultaneous viewing request with the video playback progress information, wherein the video playback progress information is used by the at least one second playback device to synchronously play the video content of the first playback device.

Description

Technical Field

[0001] The present application relates to the field of communications, and in particular to a method and apparatus for watching videos on multiple devices simultaneously. Background Art

[0002] In the field of video playback, the client of the cloud set-top box can use cloud processing resources to process business needs, which is conducive to improving the richness of available functions on user terminals and reducing dependence on the performance of user terminals.

[0003] When users are watching rich video content, they may want to share the video they are watching with others so that multiple people can watch the video remotely and synchronously. However, for the sharer, it is necessary to provide accurate video information, which is cumbersome. For the recipient, it is necessary to search for video content according to the video information, which is also very cumbersome.

[0004] How to efficiently and conveniently realize watching videos on multiple devices at the same time is the technical problem to be solved by this application. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide a method and apparatus for watching videos on multiple devices simultaneously, so as to realize watching videos on multiple devices simultaneously efficiently and conveniently.

[0006] In a first aspect, a method for watching videos on multiple devices at the same time is provided, which is applied to a cloud set-top box platform, including: receiving a first co-watching request sent by a first playback device, where the first co-watching request carries information of the first playback device; generating a co-watching link corresponding to the information of the first playback device, and responding to the first co-watching request with the co-watching link; receiving a second co-watching request sent by at least one second playback device based on the co-watching link; The progress information of the video content played by the first playback device is obtained, and the second co-watching request is responded to with the progress information of the video content, wherein the progress information of the video content is used for the playback device to synchronously play the video content.

[0007] In a second aspect, a device for watching videos on multiple devices at the same time is provided, which is applied to a cloud set-top box platform, including: A first receiving module receives a first co-watching request sent by a first playback device, where the first co-watching request carries information about the first playback device; A first response module generates a co-viewing link corresponding to the information of the first playback device, and responds to the first co-viewing request with the co-viewing link; A second receiving module receives a second co-watching request sent by at least one second playback device based on the co-watching link; The second response module obtains progress information of the video content played by the first playback device, and responds to the second simultaneous viewing request with the progress information of the video content, wherein the progress information of the video content is used for the playback device to synchronously play the video content.

[0008] According to a third aspect, an electronic device is provided. The electronic device comprises a processor, a memory, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, the steps of the method according to the first aspect are implemented.

[0009] According to a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method according to the first aspect are implemented.

[0010] In a fifth aspect, a computer program product is provided, the computer program product comprising a non-transitory computer-readable storage medium storing a computer program, the computer program being operable to cause a computer to execute part or all of the steps of the method of the first aspect.

[0011] In an embodiment of the present application, first, a first co-watching request sent by a first playback device is received, and the first co-watching request carries information of the first playback device; then, a co-watching link corresponding to the information of the first playback device is generated, and the first co-watching request is responded to with the co-watching link; then, a second co-watching request sent by at least one second playback device based on the co-watching link is received; then, the progress information of the video content played by the first playback device is obtained, and the second co-watching request is responded to with the progress information of the video content, wherein the progress information of the video content is used for the playback device to play the video content synchronously. In this scheme, the generated co-watching link has a corresponding relationship with the first co-watching request, which can ensure that the second playback device that initiates the second co-watching request based on the co-watching link has an associated relationship with the first playback device. Subsequently, the progress information of the video content of the first playback device is used to respond to the second co-watching request, which can facilitate the second playback device to quickly and conveniently play the video content of the first playback device synchronously. Through this scheme, the first playback device can generate a co-watching link by sending the first co-watching request, and the co-watching link can facilitate users to quickly perform sharing. The second playback device can quickly and synchronously play the video content of the first playback device through the same viewing link, and ensure the same playback progress, so that the user of the second playback device can easily see the content played synchronously by the first playback device without manually selecting videos or manually adjusting the playback progress. Through this solution, it is possible to efficiently and conveniently realize multi-device simultaneous video viewing, solving the problem of complicated operations for the sharer to manually share video information and complicated operations for the sharee BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings: Figure 1a This is a functional interaction diagram of a cloud-based set-top box platform for a method for watching videos on multiple devices simultaneously in one embodiment of the present application; Figure 1b This is one of the flowcharts of a method for watching videos on multiple devices simultaneously according to an embodiment of the present application; Figure 2 This is a second flow chart of a method for watching videos on multiple devices simultaneously according to an embodiment of the present application; Figure 3a This is a flowchart of a method for watching videos on multiple devices simultaneously according to an embodiment of the present application; Figure 3b This is a schematic diagram of the interaction of functional modules of a cloud-based set-top box platform in a method for watching videos on multiple devices simultaneously according to an embodiment of the present application; Figure 4a This is a fourth flowchart of a method for watching videos on multiple devices simultaneously according to an embodiment of the present application; Figure 4b This is a flowchart of a method for watching videos on multiple devices simultaneously, which is a fifth embodiment of the present application; Figure 5 This is a sixth flowchart of a method for watching videos on multiple devices simultaneously according to an embodiment of the present application; Figure 6 This is a sixth flowchart of a method for watching videos on multiple devices simultaneously according to an embodiment of the present application; Figure 7 It is a structural schematic diagram of an apparatus for watching videos on multiple devices simultaneously according to an embodiment of the present application. DETAILED DESCRIPTION

[0013] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application. The numbering of the drawings in this application is only used to distinguish the various steps in the scheme, and is not used to limit the execution order of the various steps. The specific execution order is subject to the description in the specification.

[0014] Cloud-based set-top boxes, also known as smart cloud boxes, are widely used in the field of video playback. Cloud-based set-top boxes only need to retain the core decoding and peripheral interface capabilities on the user client side, and the remaining business requirements are transferred to cloud processing, effectively reducing the performance requirements for user devices.

[0015] From a functional point of view, the smart cloud box set-top box can connect to the Internet to realize the online viewing of massive content. Whether it is movies, TV series, or various variety shows, users can watch their favorite content anytime and anywhere through the smart cloud box set-top box, which greatly improves the convenience of viewing.

[0016] In the application scenario of home video playback, the cloud set-top box technology solution also supports GPU (Graphics Processing Unit) virtualization. It can use the GPU to accelerate instance image rendering, stream the instance desktop screen in real time to the remote client for display, and effectively provide the 3D (3-Dimensional) acceleration capability required by games.

[0017] Compared with small-screen and mobile smart terminals, large-screen devices still have a unique position and advantages in the home. Specifically, large-screen devices have large and clear screens, which are very friendly to the elderly and children, which is not available in small-screen mobile devices.

[0018] like Figure 1a As shown in the figure, the functions of the virtual Set Top Box (vSTB) can be implemented based on the vSTB platform, which can be used to implement various functions such as application management, graphics rendering, streaming media, encryption, etc. It can also connect to various types of services such as UI (User Interface Design), EPG (Electrical Program Guide), games, VR (Virtual Reality), etc. based on business flows.

[0019] On the user terminal side, by installing the vSTB client in the set-top box and smart TV, the smart TV and the set-top box can be connected to the vSTB platform through the network. When the user needs to watch live or on-demand video, the content delivery network (CDN) provides the required video to the user's smart TV through the media stream for playback. The vSTB can widely meet the needs of various applications such as 3D games, interactive education, animation music, dance and opera, and home medical care.

[0020] Specifically, the video playback part is still played on the vSTB end of the user side, and the UI interface runs in the cloud. The system intercepts the playback instructions of the APP (Application) and transfers the playback instructions to the STB for processing. Among them, the data of various processes queried by the APP in the vSTBNode node will be transparently transmitted to the STB for execution through the signaling channel. Since the APP in the vSTBNode cannot sense whether it is running in an instance or a physical set-top box, for the APP, the cloud operating environment is the same as the physical set-top box, and cloud migration is barrier-free.

[0021] The embodiment of the present application combines the advantages of large-screen services to provide a method for watching videos on multiple devices at the same time, which can be used to achieve synchronous playback on multiple devices, allowing multiple people to watch the same video content on different devices simultaneously.

[0022] This solution is conducive to user social interaction and enables the function of watching movies with friends. It can meet the needs of watching movies together, watching the Spring Festival Gala together, watching online classes together, etc. This solution is based on cloud-based set-top boxes to increase social attributes, enhance user stickiness, increase activity, and help improve video experience and operation efficiency.

[0023] In order to solve the problems existing in the related art, the embodiment of the present application provides a method for watching videos on multiple devices at the same time, which is applied to a cloud set-top box platform, such as Figure 1b As shown, including: S11: receiving a first co-viewing request sent by a first playback device, where the first co-viewing request carries information about the first playback device.

[0024] In the embodiment of the present application, the playback device may be a device with display and playback functions such as a television or a projector. The information of the first playback device carried in the first same-view request is used by the cloud set-top box vSTB platform to identify different users, and may be in the form of a vSTB identifier, a user identifier, etc.

[0025] In actual applications, the first playback device can be operated, and the user can select the TV co-watching virtual button on the EPG page displayed by the first playback device, thereby sending the first co-watching request to the vSTB platform through the first playback device.

[0026] Optionally, the first co-watching request may also carry identity information, which is used to indicate whether the user is a sharer initiating co-watching or a recipient of co-watching. The vSTB platform may manage control permissions based on identity information, for example, the sharer has video playback control permissions, while the recipient does not have video playback control permissions.

[0027] S12: Generate a co-watching link corresponding to the information of the first playback device, and respond to the first co-watching request with the co-watching link.

[0028] The vSTB platform generates a corresponding co-watching link for the information of the first playback device in the first co-watching request. The co-watching link can be presented in a variety of forms such as a QR code, an address link, and a graphic code. In this step, the first co-watching request is responded to with a co-watching link, specifically, the co-watching link can be sent to the first playback device for display, or the co-watching link can be sent to an associated device of the first playback device for display. Among them, the associated device of the first playback device can be, for example, a smart device such as a mobile phone pre-bound to the first playback device.

[0029] After responding to the first co-watching request with a co-watching link, the sharer can share the co-watching link with the sharee through social software or other means. If the co-watching link is sent directly to the sharee's mobile phone, the sharer can directly send the co-watching link in any display form to the sharee. If the co-watching link is displayed on the smart TV in the form of an image such as a QR code, the sharer can capture the image by scanning the code or taking a photo and send it to the sharee. If the co-watching link is displayed on the smart TV in the form of a string of numbers, letters, symbols, etc., the sharer can manually enter the string, or use a mobile phone to take a photo and recognize the string in the image, and then send the string to the sharee.

[0030] S13: Receive a second co-watching request sent by at least one second playback device based on the co-watching link.

[0031] The shared person can use the co-watching link to send a second co-watching request, and based on the co-watching link and the second co-watching request, a co-watching relationship between the second playback device and the first playback device can be established, that is, the user of the second playback device is the user invited by the user of the first playback device to participate in the co-watching.

[0032] The second playback device may be a communication device such as a mobile phone of the person being shared, and the device used to synchronously play the video content may be another device other than the communication device. For example, the sharer sends a QR code-based co-watching link to the person being shared through social software or the like. After the person being shared receives the QR code on his mobile phone, he can scan the QR code to send a second co-watching request through the mobile phone. The second co-watching request can be used to request co-watching on a TV or other device associated with the mobile phone.

[0033] The second playback device may be a device for synchronously playing video content, for example, it may be a smart TV of the person being shared. For example, the sharer sends a same-watching link in the form of a same-watching code containing multiple characters to the mobile phone of the person being shared through social software or the like. After the person being shared receives the same-watching code on the mobile phone, the person being shared enters the same-watching code into the smart TV through manual entry, voice entry or other entry methods, so as to send a second same-watching request corresponding to the same-watching code through the smart TV. The second same-watching request can be used to request to execute same-watching playback on the smart TV of the person being shared. Alternatively, the second playback device may also be a communication device such as a mobile phone of the person being shared, that is, the person being shared receives the same-watching link on the mobile phone, and sends a second same-watching request through the mobile phone based on the same-watching link, so as to request to execute same-watching playback on the mobile phone.

[0034] S14: Acquire progress information of the video content played by the first playback device, and respond to the second co-watching request with the progress information of the video content, wherein the progress information of the video content is used for the playback device to synchronously play the video content.

[0035] After the cloud-based set-top box platform generates a co-watching link, the progress information of the video content played by the first playback device can be obtained, or the above progress information can be obtained after the cloud-based set-top box platform receives a second co-watching request.

[0036] After the progress information is acquired, the second co-watching request is responded to according to the progress information, so that the video content being played by the first playback device is synchronously played on the playback device corresponding to the second co-watching request.

[0037] For example, if the second simultaneous viewing request carries a playback device identifier, the cloud-based set-top box corresponding to the playback device identifier can perform playback according to the progress information. Alternatively, the playback progress can be sent to the playback device so that the playback device can request the corresponding video content from the CDN based on the playback progress.

[0038] Alternatively, if the second co-watching request carries the terminal identifier of the terminal sending the second co-watching request, the playback device corresponding to the terminal identifier can be queried, and then the cloud-based set-top box corresponding to the identifier of the playback device can perform playback according to the progress information. Alternatively, the playback progress can be sent to the playback device so that the playback device can request the corresponding video content from the CDN based on the playback progress.

[0039] Optionally, the first co-watching request or the second co-watching request in the embodiment of the present application may carry attribute information related to the co-watching video requirement. For example, the attribute information includes device information for co-watching, information about the video content to be played synchronously, and the time period for co-watching. In addition, co-watching users can also enable social functions such as voice, chat room, bullet screen comment, and expression interaction according to actual needs, so that the playback device can play the video content synchronously while also meeting the real-time social needs between users.

[0040] In this solution, the generated co-watching link has a corresponding relationship with the first co-watching request, which can ensure that the second playback device that initiates the second co-watching request based on the co-watching link has an associated relationship with the first playback device. Subsequently, the progress information of the video content of the first playback device is used to respond to the second co-watching request, which can facilitate the second playback device to quickly and conveniently play the video content of the first playback device synchronously. Through this solution, the first playback device can generate a co-watching link by sending the first co-watching request, and the co-watching link can facilitate users to quickly perform sharing. The second playback device can quickly and synchronously play the video content of the first playback device through the co-watching link, and ensure that the playback progress is consistent, so that the user of the second playback device can conveniently see the content played synchronously by the first playback device without manually selecting the video or manually adjusting the playback progress. Through this solution, it is possible to efficiently and conveniently realize multi-device co-watching of videos, solving the problem of complicated operations for the sharer to manually share video information and complicated operations for the sharee to manually select videos and progress.

[0041] Based on the solution provided in the above embodiment, optionally, Figure 2 As shown, in the above step S12, generating a co-watching link corresponding to the information of the first playback device, and responding to the first co-watching request with the co-watching link includes: S21: Create a cloud virtual room with the first playback device as a main control device, and respond to the first co-viewing request with a link to the cloud virtual room.

[0042] In this step, a cloud virtual room is created based on the above-mentioned first co-watching request, and the cloud virtual room is used for the first playback device and other playback devices participating in the co-watching to achieve synchronous playback of video content. Among them, the first playback device that sends the first co-watching request has the master control authority in the cloud virtual room, and serves as the master control device. Other playback devices invited to co-watch may have lower permissions than the master control authority, such as sending and receiving barrage, comments, emoticons and other functions.

[0043] In a cloud virtual room, the permissions of multiple playback devices can be allocated and adjusted by the master device according to preset levels. For example, when the user of the master device wants to quit watching together, he can designate a playback device from the multiple playback devices in the cloud virtual room as the next master device. In this way, after the first master device quits watching together, the second master device will continue to host the cloud virtual room and continue watching together.

[0044] In this step, the link of the cloud virtual room is used as the co-watching link to respond to the first co-watching request. Through this link, the user invited to co-watch can enter the cloud virtual room with preset identity permissions and participate in the video co-watching.

[0045] Wherein, after the above step S13, that is, after receiving the second co-watching request sent by at least one second playback device based on the co-watching link, the method further includes: S22: Based on the information of the third playback device carried in the second co-watching request, a signaling link is established between the first playback device and the third playback device, where the signaling link is used to transmit progress information of the video content.

[0046] In this example, the second co-watching request carries information about a playback device used to play the co-watching video content. The third playback device may be the same as or different from the second playback device.

[0047] For example, assume that the second playback device and the third playback device are the same playback device, such as the mobile phone of the user who is invited to watch the video together. Then in the actual implementation process, the invitee receives the watch-together link through the mobile phone, and generates a second watch-together request based on the mobile phone's own information through the watch-together link. Subsequently, the cloud set-top box platform receives the second watch-together request carrying the invitee's mobile phone information, and establishes a signaling link between the invitee's mobile phone and the above-mentioned first playback device, so that the invitee's mobile phone can obtain the progress information of the video content, thereby playing the above-mentioned video content synchronously through the invitee's mobile phone.

[0048] For another example, suppose that the second playback device and the third playback device are two different playback devices, for example, the second playback device is the invitee's mobile phone, and the third playback device is the invitee's smart TV. Then in the actual execution process, the invitee receives the co-watching link through the mobile phone, and sends a second co-watching request carrying the smart TV information through the mobile phone. Subsequently, the cloud set-top box platform receives the second co-watching request carrying the invitee's smart TV information, and establishes a signaling link between the invitee's smart TV and the above-mentioned first playback device, so that the invitee's smart TV can obtain the progress information of the video content, thereby synchronously playing the above-mentioned video content through the invitee's smart TV.

[0049] Among them, the mobile phone of the invitee can store the information of the smart TV, so that the second co-watching request carrying the information of the smart TV can be sent through the mobile phone. Alternatively, the mobile phone of the invitee can be pre-bound with the smart TV of the invitee, and the cloud set-top box platform can pre-store the binding relationship between the devices. Based on this, the mobile phone of the invitee can send a second co-watching request carrying its own information, and then the cloud set-top box platform can query the information of the associated smart TV based on the binding relationship. Alternatively, the mobile phone can interact with the cloud set-top box platform through the Internet, query to obtain the information of the smart TV associated with itself, and thus generate a second co-watching request carrying the information of the smart TV. In practical applications, the generation and sending of the second co-watching request can be flexibly executed according to actual needs.

[0050] S23: Send a synchronization device list to the first playback device, where the synchronization device list includes information about the third playback device with which a signaling link has been established.

[0051] In this step, the information of each third playback device in the room can be synchronized with the first playback device based on the cloud virtual room, so as to show the host who initiated the video co-watching which users participated in the co-watching. Based on the synchronized device list, the host can perform other operations based on his own authority, such as grouping multiple third playback devices, sending information to each third playback device, and removing a specific third playback device from the room.

[0052] Through the solution provided in the embodiment of the present application, the first playback device can establish a signaling link with multiple playback devices participating in the video viewing through the cloud virtual room, thereby transmitting the progress information of the video content and realizing the synchronous video playback of multiple playback devices. The cloud virtual room can also facilitate the user of the first playback device to view the devices participating in the video viewing, which is conducive to the user to flexibly perform control operations.

[0053] Next, this solution is further explained in combination with actual user operation interactions.

[0054] Based on the method for watching videos on multiple devices simultaneously provided in the embodiment of the present application, the following steps can be performed to achieve synchronous playback of video content on multiple devices: Step 1: The cloud-based set-top box platform generates a QR code through the service management platform and displays it on the user's playback device page for the user's mobile phone to scan and bind to the TV set-top box. The link accessed by scanning the code can be encrypted. A new mobile device only needs to be bound once, in order to associate the user's mobile phone with the user's TV.

[0055] Among them, the host who initiates the joint viewing and the viewers who accept the joint viewing need to be bound. If the bound device needs to be changed, the user can re-scan the QR code on the playback device page. The new device information will overwrite the old device information to update the association between the playback device and the user's mobile terminal.

[0056] Step 2: The playback device can display a TV co-watching button on the EPG page. The host can click the TV co-watching button, enter or select his / her own host role, and generate a co-watching link. The host role is used to indicate that the user is the party initiating the co-watching video, and has control rights such as video playback control, invitation or exclusion of co-watchers, etc.

[0057] The co-watching link can be generated in many ways. For example, one sharing method is to generate a TV co-watching code for the host to share through social software or communication tools. Another sharing method is to directly generate a co-watching link, and the multimedia message exchange system (MES) of the cloud set-top box platform receives the host's click on the sharing link and pushes the co-watching message to the user. In actual applications, co-watching links in other forms can also be generated by other methods. The actual generation method can be flexibly set according to needs.

[0058] Step 3: The MES of the cloud set-top box platform receives the co-viewing role and co-viewing code information input by the co-viewer, establishes a co-viewing virtual room in the cloud, and establishes a signaling link for realizing synchronous video playback.

[0059] Step 4: MES receives the sharing command input by the host, and shares the relevant information of the video playback progress with the co-viewers through the established signaling link channel. After receiving the information, the co-viewers' terminals automatically play the video or live channel on the TV, realizing multi-device viewing.

[0060] The video stream can be played through CDN. For example, after a user joins the same viewer, MES pushes the host's video playback progress to the same viewer, and the terminal of the same viewer initiates a request to CDN based on the video playback progress. CDN provides video streams to the same viewer based on the video playback progress, so that the terminal of the same viewer and the terminal of the host play the same video content synchronously.

[0061] During the co-viewing process, for the host's playback control operations such as pause, fast forward, and fast rewind, the cloud set-top box platform can forward the host's operations to other co-viewing devices in the co-viewing room through MES messages. Each co-viewing device will synchronously perform the same playback control operations according to the corresponding operation messages.

[0062] Optionally, the MES of the cloud set-top box platform receives the command input by the host, for example, including a request message and a response message. The format of the request message can extend the UPnP (Universal Plug and Play) message header, and the format of the response message is the UPnP standard protocol. In the extended part of the request message, UserToken can be passed in so that the target device can perform authority authentication before executing the control command, and the rest can be defined as a standard UPnP message.

[0063] Based on the solution provided in the above embodiment, optionally, Figure 3a As shown, in the above step S21, creating a cloud virtual room with the first playback device as the main control device includes: S31: Allocate cloud resources through the cloud set-top box node module of the cloud set-top box platform to create a cloud virtual room with the first playback device as the main control device.

[0064] Figure 3b The diagram shows the interaction of functional modules of a cloud set-top box platform, including the cloud set-top box node module vSTB Node, the cloud set-top box management module vSTB Manager, the multimedia message interaction system MES, the service management platform, the easy monitoring system, EPG, CDN and other functional modules. Figure 3b The set-top box shown in specifically refers to a set-top box on the user side.

[0065] Among them, multiple unit units can be set in the cloud set-top box node module vSTB Node node module, which are responsible for all operations related to vSTB user services such as resource creation, vSTB application module loading, UI / APP processing, media playback control, etc.

[0066] The vSTB management module can be used for STB authentication, global load balancing, resource allocation, management, statistics, and monitoring related functions.

[0067] The service management platform can be used to implement IPTV / OTT service functions such as service authentication, authorization, and user binding.

[0068] The easy monitoring module can be used to implement system health status monitoring and alarm.

[0069] MES can be used for multi-screen interaction and message distribution between terminals and other related operations, which can specifically include Import Server and Push Server. Among them, Import Server is responsible for access control of vSTB and loads users to the specified Push Server. Push Server is responsible for building proxy channels between multiple terminals to forward instructions and messages.

[0070] EPG can be used to display the user interface.

[0071] CDN can be used to provide users with video streaming playback.

[0072] In this step, the cloud resources are deployed through the vSTB Node to create a cloud virtual room, and the first playback device is set as the master control device of the cloud virtual room.

[0073] In the above step S22, based on the information of the third playback device carried in the second co-watching request, establishing a signaling link between the first playback device and the third playback device includes: S32: Loading the third playback device to the push server corresponding to the cloud virtual room through the import server of the multimedia message interaction system.

[0074] In this example, the multimedia message interaction system MES may specifically include an import server Import Server, which is used to load the third playback device participating in the co-watching to the push server Push Server corresponding to the cloud virtual room, and then participate in entering the cloud virtual room.

[0075] S33: establishing a proxy channel between the first playback device and the third playback device through the push server.

[0076] In this step, a signaling link is established between the first playback device and the third playback device in the form of a proxy channel. The proxy channel can be used to send and receive progress information of the video content, thereby achieving synchronous video playback of multiple devices.

[0077] Among them, in the above step S14, responding to the second co-watching request with the progress information of the video content includes: S34: Sending the progress information of the video content to the third playback device through the proxy channel based on the push server, wherein the progress information of the video content is used by the third playback device to request the content distribution network to obtain the video content.

[0078] In this step, the progress information of the video content of the first playback video is sent to the third playback device through the established proxy channel. Then, the third playback device initiates a video content acquisition request to the content distribution network CDN based on the progress information to obtain the video with the same progress and content as the first playback device for synchronous playback.

[0079] The solution provided by the embodiment of the present application is based on the development trend of cloud set-top boxes and the demand for large-screen co-viewing services, and can realize multi-user synchronous viewing. The functions that can be realized by the embodiment of the present application include: generation and authentication of co-viewing codes, selection of co-viewing role permissions, one-key exit of the co-viewing function, sending and receiving emoticons between users, synchronous broadcast control video function, invitation or removal of co-viewers, sending and receiving comments and likes, voice interaction, automatic closing of co-viewing based on preset conditions, etc.

[0080] In one embodiment, for mobile phones and set-top boxes, MES plays the role of a SOCKS 5 proxy server, i.e., a message transmission channel. Therefore, before executing video synchronous playback, a channel needs to be established between the multi-screen terminal and the MES and the set-top box in order to implement subsequent functions.

[0081] Based on the solution provided in the above embodiment, optionally, Figure 4a As shown, before the above step S11, that is, before receiving the first co-watching request sent by the first playback device, it also includes: S41: Receive a first binding request sent by a playback device to be bound, where the first binding request carries information of a cloud-based set-top box corresponding to the playback device to be bound.

[0082] In this example, the playback device to be bound can specifically be the user's smart TV. Before the user wants to initiate a video co-watching, the smart TV is first bound to the control device held by the user. This makes it easier for the user to share the co-watching link with the invitees, and also facilitates interactive operations such as comments, voice, and expressions between users participating in the co-watching.

[0083] S42: Generate a binding link corresponding to the information of the cloud set-top box, and instruct the playback device to be bound to display the binding link.

[0084] The cloud set-top box platform generates a corresponding binding link based on the cloud set-top box information in the first binding request, and sends the binding link to the playback device to be bound for display. In actual applications, the binding link can be displayed on the smart TV to be bound in the form of a string or a QR code.

[0085] S43: Receive a second binding request sent by the control device through the binding link, where the second binding request carries information of the control device.

[0086] In this step, the second binding request is sent by the control device, which can be, for example, the mobile phone of the host who initiates the video co-watching. In actual applications, the host uses the mobile phone to be bound to obtain the information of the cloud set-top box by taking a photo or scanning, and then generates a second binding request and sends it to the cloud set-top box platform.

[0087] S44: storing a binding relationship between the cloud-based set-top box corresponding to the playback device to be bound and the control device based on the information of the control device.

[0088] The cloud set-top box platform associates and stores the information of the control device carried in the second binding request with the cloud set-top box information of the playback device to be bound corresponding to the binding link, thereby enabling binding between the cloud set-top box, the first playback device and the control device.

[0089] The association relationship between the above control device, playback device, and cloud set-top box can be interactively set by the cloud set-top box platform. Based on the stored association relationship, the cloud set-top box platform can perform command transmission and information interaction between the associated devices.

[0090] For example, the control device can be used to conveniently implement playback control on the playback device. The above-mentioned playback control function can be that the control device generates an instruction and sends it to the cloud set-top box platform, and the cloud set-top box platform queries the binding relationship to determine the cloud set-top box to be controlled, and then instructs the cloud set-top box to perform playback control on the associated playback device.

[0091] Figure 4b A flow chart of an example of the present application is shown, which shows the process of initiating link establishment from a multi-screen terminal to an MES proxy forwarding module, including the following steps: Step 1. The host clicks the TV Watch button and selects the host role. VSTB automatically establishes a TCP connection with MES.

[0092] Step 2: Scan the QR code with your mobile phone to join and establish a websocket link with MES.

[0093] Step 3: The mobile phone sends a SOCKS version and authentication method negotiation request to MES, and MES returns whether to accept the connection and authentication method.

[0094] Step 4: Once the negotiation process is completed, the multi-screen terminal can send detailed business instructions (MES transparent transmission) and send a request message to the specified target device (specified control set-top box) through the SOCKS CONNECT command.

[0095] In addition, when data transmission needs to be terminated, the relevant data communication link can be directly disconnected. The mechanism for executing the communication disconnection can be flexibly set, for example, including: Mechanism 1: The terminal actively disconnects the link, and the MES will disconnect the link with the set-top box accordingly; Mechanism 2: disconnect the link according to the time interval of information interaction. That is, if there is no message interaction on the link for a long time, MES will actively disconnect the link with the terminal and set-top box. The time can be flexibly configured, for example, the default time is 15 minutes.

[0096] Based on the solution provided in the above embodiment, optionally, Figure 5 As shown, after the above step S14, that is, after responding to the second co-watching request with the video playback progress information, it also includes: S51: Receive a control instruction from a fourth playback device, where the control instruction carries identity information.

[0097] In an embodiment of the present application, during the process of multiple playback devices executing simultaneous viewing of video content, any user participating in the simultaneous viewing of the video can execute operations related to simultaneous viewing of the video through control instructions via a control device pre-associated with a fourth playback device that synchronously plays the video, or the fourth playback device itself can also generate the above-mentioned control instructions.

[0098] In this example, the fourth playback device can be the playback device of the host who is watching the video together, or the playback device of the invitee who is invited to watch the video together. The control device bound to the fourth playback device can be, for example, a mobile phone, a laptop computer, a smart watch, a smart remote control, etc. Among them, the fourth playback device can be bound to one or more control devices, and the above control instructions can be sent through any control device.

[0099] The control instruction carries identity information, which may specifically refer to information about the control device itself, user information corresponding to the control device, information about the playback device corresponding to the control device, information about the cloud set-top box corresponding to the control device, etc. The above identity information is used for subsequent authentication by the cloud set-top box platform, and the identity information may include at least one of the multiple types of device information pre-associated and stored by the cloud set-top box platform.

[0100] S52: Perform control authentication on the playback device corresponding to the identity information based on the stored binding relationship.

[0101] In this step, the cloud set-top box platform performs control authentication on the playback device corresponding to the identity information in the above control instruction based on the stored binding relationship. Specifically, based on the identity information, determine which authority the playback device has in this video viewing. The authority can be pre-set in the form of a level or attribute table. Based on the authority corresponding to the identity information, determine whether the playback device of the identity information has the authority to execute the control operation intended to be executed in the control instruction. If it has the authority to execute, it is determined that the control authentication is passed.

[0102] S53: If the control authentication is passed, an operation matching the control instruction is performed on the playback device that synchronously plays the video content.

[0103] If the control authority is determined to be passed, the control instruction is executed. The control instruction can perform control operations on all playback devices participating in the video viewing. If the control instruction carries information of the target playback device, the operation matching the control instruction is performed for the target playback device.

[0104] Optionally, in the process of executing multi-user synchronous viewing, the format of the request message can extend the UPnP message header for sending control instructions such as playback control, playback progress synchronization, and multi-screen interaction, and the format of the response message can be the UPnP standard protocol. Among them, the UserToken is passed in the request message so that the target device can perform permission authentication before executing the control instruction, and the rest is defined by the standard UPnP message.

[0105] Through the solution provided by the embodiment of the present application, users who participate in the video co-watching can flexibly perform control operations on the video co-watching through control instructions according to actual needs. For example, it includes social operations between users, video playback control operations, etc. In this example, identity authentication can effectively determine whether the user has the right to perform control operations, which can be conducive to the reasonable control of the video co-watching function.

[0106] Based on the solution provided in the above embodiment, optionally, Figure 6 As shown, in the above step S53, the operation matching the control instruction is performed on the playback device that synchronously plays the video content, including: S61: When the control instruction includes a playback control instruction, performing an operation matching the playback control instruction on the video content; or, S62: When the control instruction includes a device control instruction, executing an operation matching the device control instruction on a target playback device specified by the device control instruction; or, S63: When the control instruction includes visualization information, synchronously display the visualization information to each playback device that synchronously plays the video content.

[0107] In the present application example, the control instruction may include one or more of a playback control instruction (play control instruction), a device control instruction, and visual information. During the video co-watching process, users can flexibly implement basic playback control operations such as fast forward, rewind, and pause of multiple playing videos at the same time, which can ensure that the progress of multiple users participating in the co-watching is consistent in real time.

[0108] In this example, the playback control instruction may refer to an instruction to perform playback control on the playback content, such as pause, fast forward, fast rewind, etc. The device control instruction may include the function of setting the permission of the playback device, and may also include operations such as banning and removing devices. Visual information may specifically include information in various forms such as text, pictures, and emoticons, which may be displayed through bullet screens, sidebars, pop-up windows, etc.

[0109] In actual applications, the functions implemented by the control instructions can be flexibly set according to actual needs. For example, the specific functions that can be implemented are shown in the following table:

[0110] In addition, when watching a video together, users can also perform the following operations based on their actual needs: Operation 1: The host can fast forward, rewind, pause and other operations. During the operation, the TVs of other viewers will automatically synchronize with these operations to ensure consistent viewing.

[0111] Operation 2: During the viewing process, the screen will display a list of people currently viewing the program. To reduce the complexity of system processing and resource usage, you can preset the upper limit of the number of people who can view the program at the same time. Optionally, the total number of people who can view the program at the same time by default does not exceed 10.

[0112] Operation 3: During the viewing process, the host can click the "Share / End Sharing" virtual button on the page to change the content being played. Optionally, when the host is selecting content, the screens of other users participating in the viewing can display a default viewing poster image and a friendly reminder "Content is being selected".

[0113] Operation 4: During the viewing process, click the "Exit" button in the lower left corner. The host can end the viewing at any time, and other participants can freely exit the viewing at any time.

[0114] Operation 5: In order to improve resource utilization and reduce resource waste, if the system detects that no one other than the host has entered a single virtual viewing room within 15 minutes, or no content has been played within 15 minutes, the room and corresponding system resources can be automatically released.

[0115] Operation 6. During the viewing process, everyone can send voice or text at any time through the TV or associated mobile terminal or TV remote control and other control devices to achieve user interaction.

[0116] The interactive methods may include, for example: Case 1: Input voice through the remote control and convert it to text or send voice directly.

[0117] Case 2: Use the mobile phone bound to the set-top box to input the data.

[0118] Case three: The sharing code can be used to synchronously generate a social software group, and interactions can be carried out in the social software group.

[0119] The solution provided by the embodiment of the present application can flexibly divide the role permissions of the host and the invitee according to the needs of the same audience, and associate and bind them by scanning a QR code. Among them, the information can be transmitted in encrypted form to improve the security of the data transmission process.

[0120] In addition, you can also record information during the binding process and automatically update the information. After completing a binding, the bound device does not need to be bound again. If you need to replace the bound device, use the new device to re-scan the code, automatically overwrite the original device information, invalidate the previous binding information, and update the bound device.

[0121] For request messages in the data interaction process, the solution provided by the embodiment of the present application can achieve extended optimization. Based on the technology defined by the standard UPnP message, the UserToken is passed in so that the target device can perform permission authentication before executing the control instruction.

[0122] In addition, after MES receives the co-viewing role and co-viewing code information input by the co-viewers, it builds a virtual room in the cloud and establishes a signaling link between different users, thereby achieving synchronous viewing by entering the virtual room together.

[0123] In terms of rational use of resources, the threshold for the number of people watching movies simultaneously can be set according to actual needs, and automatic judgment can be used to control the complexity of the system and the use of resources. At the same time, the release conditions of the virtual room can be set according to the use of the system, and the rational use of system resources can be guaranteed through time judgment and subjective disconnection mode.

[0124] The solution provided in the embodiment of the present application, combined with the development of cloud technology, only retains the core decoding and peripheral interface capabilities of the terminal set-top box, and puts business requirements on the cloud for processing, completely breaking through the performance bottleneck on the user side of the set-top box. At the same time, based on the needs of large-screen co-viewing services, a multi-user synchronous viewing system based on a cloud-based set-top box is constructed on the basis of the platform capabilities of the IPTV / OTT service itself. Through the linkage of multiple screens, multiple people can watch the same program on the large TV screen at the same time, increase social attributes, enhance user stickiness, improve activity, and help improve video experience and operation efficiency.

[0125] Compared with the terminal screen projection operation that requires users to perform complicated operations, the embodiment of the present application combines virtualization technology to divide the roles of host and co-viewer according to the needs of co-viewing, and binds devices by scanning QR codes. At the same time, a virtual room is established, and by entering the cloud virtual room, multi-user and multi-terminal synchronous viewing is performed, effectively simplifying the operations of multi-device co-viewing and remote device co-viewing.

[0126] Driven by user demand and market economy, this application is based on the development of cloud technology, and gradually moves the mode of data processing and analysis performed by local terminals to the cloud, realizing the cloudification of terminal set-top box services, reducing the investment in terminal hardware costs, and improving economic value while meeting market development trends. In addition, this application starts from the application needs of video interaction, and formulates services around the behavioral habits of users in the market as a whole. Based on the platform capabilities of the IPTV / OTT service itself, it enables multiple users to watch at the same time through the linkage of multiple screens. At the same time, it focuses on the main audio-visual scene, increases social attributes, enhances user stickiness, and improves activity, helping to improve video experience and operational efficiency. Therefore, it meets the public's expectations for products, fits the market development trend, and has high commercial value.

[0127] In order to solve the problems existing in the related art, the embodiment of the present application also provides a device 70 for watching videos on multiple devices at the same time, such as Figure 7 As shown in the figure, it is applied to the cloud set-top box platform, including: A first receiving module 71 receives a first co-watching request sent by a first playback device, where the first co-watching request carries information about the first playback device; A first response module 72 generates a co-viewing link corresponding to the information of the first playback device, and responds to the first co-viewing request with the co-viewing link; A second receiving module 73 receives a second co-watching request sent by at least one second playback device based on the co-watching link; The second response module 74 obtains progress information of the video content played by the first playback device, and responds to the second simultaneous viewing request with the progress information of the video content, wherein the progress information of the video content is used by the playback device to synchronously play the video content.

[0128] Through the device provided in the embodiment of the present application, the generated co-watching link has a corresponding relationship with the first co-watching request, which can ensure that the second playback device that initiates the second co-watching request based on the co-watching link has an associated relationship with the first playback device. Subsequently, the progress information of the video content of the first playback device is used to respond to the second co-watching request, which can facilitate the second playback device to quickly and conveniently play the video content of the first playback device synchronously. Through this solution, the first playback device can generate a co-watching link by sending the first co-watching request, and the co-watching link can facilitate users to quickly perform sharing. The second playback device can quickly and synchronously play the video content of the first playback device through the co-watching link, and ensure that the playback progress is consistent, so that the user of the second playback device can conveniently see the content played synchronously by the first playback device without manually selecting the video or manually adjusting the playback progress. Through this solution, it is possible to efficiently and conveniently realize multi-device co-watching of videos, solving the problem of complicated operations for the sharer to manually share video information and complicated operations for the sharee to manually select videos and progress.

[0129] Among them, the above modules in the device provided by the embodiment of the present application can also implement the method steps provided by the above method embodiment. Alternatively, the device provided by the embodiment of the present application can also include other modules in addition to the above modules to implement the method steps provided by the above method embodiment. And the device provided by the embodiment of the present application can achieve the technical effects that can be achieved by the above method embodiment.

[0130] Preferably, an embodiment of the present application also provides an electronic device, including a processor, a memory, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, the various processes of the above-mentioned method embodiment for watching videos on multiple devices at the same time are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0131] The embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, each process of the above-mentioned method embodiment of watching videos on multiple devices at the same time is implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. The computer-readable storage medium is, for example, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0132] An embodiment of the present application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program. The computer program can be operated to enable a computer to execute part or all of the steps of the above-mentioned method embodiment for watching videos on multiple devices at the same time, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0133] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0134] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate a device for implementing the functions specified in one process or multiple processes in the flowchart and / or one box or multiple boxes in the block diagram.

[0135] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0136] These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0137] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0138] Memory may include non-permanent storage in a computer-readable medium, in the form of random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0139] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0140] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0141] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems or computer program products. Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0142] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A method for watching videos on multiple devices simultaneously, characterized in that: Applied to cloud set-top box platforms, including: receiving a first co-watching request sent by a first playback device, where the first co-watching request carries information of the first playback device; generating a co-watching link corresponding to the information of the first playback device, and responding to the first co-watching request with the co-watching link; receiving a second co-watching request sent by at least one second playback device based on the co-watching link; The progress information of the video content played by the first playback device is obtained, and the second co-watching request is responded to with the progress information of the video content, wherein the progress information of the video content is used for the playback device to synchronously play the video content.

2. The method according to claim 1, characterized in that Generating a co-watching link corresponding to the information of the first playback device, and responding to the first co-watching request with the co-watching link, includes: Creating a cloud virtual room with the first playback device as a main control device, and responding to the first co-viewing request with a link to the cloud virtual room; After receiving a second co-viewing request sent by at least one second playback device based on the co-viewing link, the method further includes: Based on the information of the third playback device carried in the second co-watching request, establishing a signaling link between the first playback device and the third playback device, wherein the signaling link is used to transmit progress information of the video content; A synchronization device list is sent to the first playback device, where the synchronization device list includes information about a third playback device with which a signaling link has been established.

3. The method according to claim 2, characterized in that Creating a cloud virtual room with the first playback device as a main control device includes: Deploying cloud resources through the cloud set-top box node module of the cloud set-top box platform to create a cloud virtual room with the first playback device as the main control device; The step of establishing a signaling link between the first playback device and the third playback device based on the information of the third playback device carried in the second co-watching request includes: Loading the third playback device to the push server corresponding to the cloud virtual room through the import server of the multimedia message interaction system; Establishing a proxy channel between the first playback device and the third playback device through the push server; The step of responding to the second co-watching request with the progress information of the video content includes: The push server sends the progress information of the video content to the third playback device through the proxy channel, wherein the progress information of the video content is used by the third playback device to request the content distribution network to obtain the video content.

4. The method according to any one of claims 1 to 3, characterized in that Before receiving the first co-watching request sent by the first playback device, the method further includes: Receiving a first binding request sent by a playback device to be bound, where the first binding request carries information of a cloud-based set-top box corresponding to the playback device to be bound; Generate a binding link corresponding to the information of the cloud set-top box, and instruct the playback device to be bound to display the binding link; receiving a second binding request sent by a control device through the binding link, where the second binding request carries information of the control device; Based on the information of the control device, a binding relationship between the cloud set-top box corresponding to the playback device to be bound and the control device is stored.

5. The method according to claim 4, characterized in that After responding to the second co-watching request with the video playback progress information, the method further includes: receiving a control instruction of a fourth playback device, wherein the control instruction carries identity information; Performing control authentication on the playback device corresponding to the identity information based on the stored binding relationship; If the control authentication is passed, an operation matching the control instruction is performed on the playback device that synchronously plays the video content.

6. The method according to claim 5, characterized in that The operation matching the control instruction is performed on a playback device that synchronously plays the video content, including: In the case where the control instruction includes a playback control instruction, performing an operation matching the playback control instruction on the video content; or, In the case where the control instruction includes a device control instruction, performing an operation matching the device control instruction on a target playback device specified by the device control instruction; or, In the case where the control instruction includes visualization information, the visualization information is synchronously displayed to each playback device that synchronously plays the video content.

7. A device for watching videos on multiple devices simultaneously, characterized in that: Applied to cloud set-top box platforms, including: A first receiving module receives a first co-watching request sent by a first playback device, where the first co-watching request carries information about the first playback device; A first response module generates a co-viewing link corresponding to the information of the first playback device, and responds to the first co-viewing request with the co-viewing link; A second receiving module receives a second co-watching request sent by at least one second playback device based on the co-watching link; The second response module obtains progress information of the video content played by the first playback device, and responds to the second simultaneous viewing request with the progress information of the video content, wherein the progress information of the video content is used for the playback device to synchronously play the video content.

8. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program implements the steps of the method according to any one of claims 1 to 6 when executed by the processor.

9. A non-transitory computer-readable storage medium, characterized in that: The non-transitory computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, characterized in that The computer program product comprises a non-transitory computer-readable storage medium storing a computer program, the computer program being operable to cause a computer to perform the steps of the method according to any one of claims 1 to 6.

Images