Split-screen playback method and related devices

Abstract

The present application provides a split-screen playback method and related devices. By performing a selection operation on the split-screen type, a corresponding split-screen interface is displayed in the current interface. The selection operation of the split-screen type enables the free switching of the number of split-screen areas. Then, the selected playback channel is dragged to the corresponding split-screen area through a drag operation, and the video corresponding to the playback channel is played in the split-screen area according to the playback channel information of the selected playback channel, so that the playback channel and the video can correspond one by one, thereby realizing the simultaneous viewing of videos in multiple split-screen areas without being affected by the data mutual exclusion of the videos corresponding to different playback channels, and improving the user viewing experience.

Description

Technical Field

[0001] This application relates to the field of intelligent display technology, and particularly to a split-screen playback method and related devices. Background Art

[0002] During the existing video playback process, only single-channel video playback is supported. For example, when the display interface is currently showing the data of the video corresponding to the playback channel, if the data of the video corresponding to another playback channel is received at this time, since the data of the videos corresponding to the two playback channels are mutually exclusive, generally, the playback of the data of the current video is default terminated, and the data of the video corresponding to the other playback channel is automatically started, affecting the user viewing experience. Summary of the Invention

[0003] In view of this, the purpose of this application is to propose a split-screen playback method and related devices to solve or partially solve the above technical problems.

[0004] Based on the above purpose, the first aspect of this application provides a split-screen playback method, including:

[0005] In response to receiving a selection instruction for a target split-screen type among multiple split-screen types displayed on the current interface, display a split-screen interface corresponding to the target split-screen type in the current interface, where the split-screen interface includes at least one split-screen area;

[0006] In response to receiving a first drag instruction for a first playback channel among multiple playback channels displayed on the current interface and the release position of the first drag instruction is in a first split-screen area among the at least one split-screen area, obtain the playback channel information of the first playback channel;

[0007] Play the first video corresponding to the first playback channel in the first split-screen area according to the playback channel information of the first playback channel.

[0008] The second aspect of this application provides a split-screen playback device, including:

[0009] A split-screen interface display module, configured to display a split-screen interface corresponding to the target split-screen type in the current interface in response to receiving a selection instruction for a target split-screen type among multiple split-screen types displayed on the current interface, where the split-screen interface includes at least one split-screen area;

[0010] A playback channel information acquisition module, configured to obtain the playback channel information of the first playback channel in response to receiving a first drag instruction for a first playback channel among multiple playback channels displayed on the current interface and the release position of the first drag instruction is in a first split-screen area among the at least one split-screen area;

[0011] A playback module, configured to play a first video corresponding to the first playback channel in the first split-screen area according to the playback channel information of the first playback channel.

[0012] A third aspect of the present application provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein when the processor executes the program, the method described in the first aspect is implemented.

[0013] A fourth aspect of the present application provides a non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute the method described in the first aspect.

[0014] A fifth aspect of the present application provides a computer program product including computer program instructions that, when run on a computer, cause the computer to execute the method described in the first aspect.

[0015] As can be seen from the above, the split-screen playback method and related devices provided by the present application display a corresponding split-screen interface on the current interface through a selection operation of the split-screen type. The number of split-screen areas can be freely switched by using the selection operation of the split-screen type. Then, the selected playback channel is dragged to the corresponding split-screen area, and the video corresponding to the selected playback channel is played in the split-screen area according to the playback channel information of the selected playback channel, so that the playback channel and the video can correspond one by one, thereby realizing the simultaneous viewing of videos in multiple split-screen areas without being affected by the data mutual exclusion of videos corresponding to different playback channels, and improving the user viewing experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the present application or related technologies, the following will briefly introduce the drawings required for use in the description of the embodiments or related technologies. Obviously, the drawings in the following description are only the embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0017] Figure 1 It is a flowchart of the split-screen playback method according to an embodiment of the present application;

[0018] Figure 2A It is a schematic diagram of an exemplary interface according to an embodiment of the present application;

[0019] Figure 2B It is a schematic diagram of an exemplary interface according to an embodiment of the present application;

[0020] Figure 2C It is a schematic diagram of an exemplary interface according to an embodiment of the present application;

[0021] Figure 2D Schematic diagram of data transmission for the http protocol of the embodiment of the present application;

[0022] Figure 2E Schematic diagram of data transmission for the websocket protocol of the embodiment of the present application;

[0023] Figure 2F Expanded schematic diagram of step 103;

[0024] Figure 2G Schematic diagram of establishing an association relationship between the video stream and the split screen area in the embodiment of the present application;

[0025] Figure 2H Schematic diagram of an exemplary interface in the embodiment of the present application;

[0026] Figure 2I Schematic diagram of an exemplary interface in the embodiment of the present application;

[0027] Figure 3 Schematic diagram of the structure of the split screen playback device in the embodiment of the present application;

[0028] Figure 4 Schematic diagram of the electronic device in the embodiment of the present application. Detailed implementation manners

[0029] To make the objectives, technical solutions and advantages of the present application clearer and more understandable, the following further describes the present application in detail with reference to specific embodiments and the accompanying drawings.

[0030] It should be noted that unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present application should have the ordinary meanings understood by those of ordinary skill in the field to which the present application belongs. The "first", "second" and similar terms used in the embodiments of the present application do not indicate any order, quantity or importance, but are only used to distinguish different components. The terms such as "including" or "comprising" mean that the elements or objects appearing before this word cover the elements or objects listed after this word and their equivalents, without excluding other elements or objects. The terms such as "connected" or "coupled" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The terms such as "upper", "lower", "left" and "right" are only used to represent relative positional relationships, and when the absolute position of the object being described changes, the relative positional relationship may also change accordingly.

[0031] To solve the problem of data mutual exclusion for videos corresponding to different playback channels, thus only supporting single-channel video playback, an embodiment of the present application provides a split screen playback method.

[0032] Figure 1 The flowchart of the exemplary split-screen playback method provided by the embodiments of the present application is shown.

[0033] As Figure 1 shown, the split-screen playback method may further include the following steps:

[0034] Step 101, in response to receiving a selection instruction for a target split-screen type among a plurality of split-screen types displayed on the current interface, display a split-screen interface corresponding to the target split-screen type in the current interface, where the split-screen interface includes at least one split-screen area.

[0035] In this step, Figure 2A the schematic diagram of an exemplary interface 200 according to the embodiments of the present application is shown. As Figure 2A shown, the current interface 200 may include a split-screen interface 201, the split-screen interface 201 includes at least one split-screen area 2011, and at least one icon 202 for triggering a selection instruction for the target split-screen type among a plurality of split-screen types may be arranged below the split-screen interface 201.

[0036] As Figure 2A shown, the icon 202 may further include icons 2021, 2022, and 2023, which respectively represent different split-screen types. For example, one split-screen, four split-screens, nine split-screens, etc. Here, the number of icons representing different split-screen types is not specifically limited.

[0037] It can be understood that when the current interface 200 is displayed through a browser, the current interface 200 may further include basic elements of the browser. For the sake of simplicity in drawing, these elements are omitted here, which does not mean that the current interface 200 implemented by the present application does not include these elements.

[0038] When the user triggers any one of the icons 2021, 2022, and 2023, a split-screen interface corresponding to the triggered icon is displayed in the current interface 200. For example, if the triggered icon represents a four split-screen, a four split-screen interface is displayed in the current interface 200. If the triggered icon represents a nine split-screen, the split-screen interface is switched, and a nine split-screen interface is displayed in the current interface 200, thereby realizing free switching of split-screen types.

[0039] Step 102, in response to receiving a first drag instruction for a first playback channel among a plurality of playback channels displayed on the current interface and the release position of the first drag instruction is in a first split-screen area among the at least one split-screen area, obtain the playback channel information of the first playback channel.

[0040] In this step, as Figure 2BAs shown, the current interface 200 may further include a play channel icon 203, and the icon 203 may further include an icon 2031 and an icon 2032. Here, the number of play channel icons is not specifically limited.

[0041] For example, as Figure 2B shown, when the selected play channel icon among multiple play channels is triggered and dragged to the selected split-screen area 2011 in the currently displayed split-screen interface 201, the current interface is as Figure 2C shown, and the play channel information of the play channel is obtained in the split-screen area 2011.

[0042] In some embodiments, the selected play channel icon can be dragged to the selected split-screen area 2011 in the currently displayed split-screen interface 201 by long pressing it.

[0043] Among them, the implementation of dragging the play channel icon 203 is based on the ondragstart (target starts to drag), ondragend (target drag ends), and ondrag (during the process of target dragging) methods of elements in H5 (mobile web page) to drag the element to be dragged to the specified area to complete the corresponding operation and complete the encapsulation of the drag component. The encapsulation of the drag component is mainly based on the interaction between two components, the target and the container. The events for the target component are as follows:

[0044] ondragstart: The target starts to drag

[0045] ondrag: During the process of target dragging

[0046] ondragend: The target drag ends

[0047] The events for the container (i.e., the split-screen area 2011) are as follows:

[0048] ondragenter: The target enters the container

[0049] ondragover: The target moves in the container. Here, it should be noted that in the current H5 version, its default event also needs to be prevented, otherwise the ondrop (the target is released in the container) will fail.

[0050] ondragleave: The target leaves the container

[0051] ondrop: The target is released in the container

[0052] The API (Application Program Interface) for data transfer between components (i.e., the dragged play channel icon and the selected split-screen area):

[0053] dataTransfer (Data Transfer): This is an attribute called using an event. It has methods such as setData (Data Setting) and getData (Data Retrieval). The key-value pairs (k-v) here are all of the string (reference type) type.

[0054] In some embodiments, the current interface 200 may further include at least one camera node icon. When a selected camera node icon is triggered, a playback channel icon 203 corresponding to the camera node icon is displayed in the current interface 200, where the playback channel icon 203 corresponding to the camera node icon includes at least one playback channel icon.

[0055] Step 103, play the first video corresponding to the first playback channel in the first split-screen area according to the playback channel information of the first playback channel.

[0056] In this step, as Figure 2C shown, play the video corresponding to the selected playback channel in the dragged split-screen area according to the playback channel information of the selected playback channel.

[0057] In some embodiments, when the current interface 200 is displayed through a browser, after establishing a connection between the browser client and the server, data transfer is performed through the webSocket (Full-duplex Communication Protocol) protocol.

[0058] Figure 2D As shown, only the http (Hyper Text Transfer Protocol) protocol is used to establish a connection and perform data transfer between the browser and the server. However, the http protocol has the following problems:

[0059] (1) Only one request can be sent over one connection, and the request can only start from the client.

[0060] (2) The client cannot receive instructions other than responses. The request / response headers are sent without compression, and the more header information there is, the greater the delay.

[0061] (3) Sending long headers, and sending the same headers each time causes a lot of waste.

[0062] (4) Data compression formats can be arbitrarily selected, and compression is not mandatory for sending.

[0063] (5) Considering web security, the browser limits the maximum number of concurrent same-origin http requests to 6. That is, when implementing split-screen video playback, the maximum number of windows available for playback in the split-screen area is 6.

[0064] Figure 2E After establishing a connection between the browser and the server through the http protocol, data transmission is carried out through the webSocket protocol, enabling the client where the browser is located and the corresponding server to actively send data to each other. Among them, the webSocket protocol is based on the http (HyperText Transfer Protocol) protocol, reusing the handshake channel of the http protocol. After establishing a connection between the browser and the server, data transmission does not require the use of the http protocol, thus solving the problem of being restricted by the number of split-screen areas and improving the user viewing experience.

[0065] Among them, Figure 2D In it, Ajax (Asynchronous Javascript And XML, a data interaction method) polling only makes continuous requests, while Figure 2E In it, the server-side active push is real-time in the true sense, achieving high real-time performance.

[0066] Figure 2D In it, http protocol requests generally have a relatively long header, while the data that needs to be updated in real-time may be only a little bit, which causes a lot of unnecessary consumption of bandwidth. While Figure 2E In it, the header of the ws (webSocket) protocol control data packet is relatively small, generally only about ten bytes, achieving high energy efficiency.

[0067] Figure 2E In it, the ws (webSocket) protocol defines extensions, and users can extend the protocol or implement custom sub-protocols, achieving the function of supporting extensions.

[0068] Figure 2E In it, it is not an xhr (XMLHttpRequest, which sends and receives data between the browser and the server through http) request and is not restricted by the same-origin policy. Therefore, it can solve the problem of being restricted by the number of split-screen areas, and thus can achieve the purpose of improving the user viewing experience.

[0069] As an optional embodiment, as Figure 2F shown, step 103 may further include:

[0070] Step 1031, obtain the video stream address corresponding to the first video according to the play channel information of the first play channel.

[0071] Step 1032, obtain the video stream corresponding to the first video according to the video stream address corresponding to the first video and play the video stream in the first split-screen area.

[0072] In the above solution, the corresponding video stream address is obtained according to the play channel information of the play channel, the video stream addresses coming from each play channel are stored, and the video stream coming through the play channel is played in the split screen area where the play channel is located, so that the split screen area and the video stream can be in one-to-one correspondence.

[0073] In some embodiments, the video stream may be a live stream, which can be applied to live streaming platforms and applications for real-time video processing.

[0074] As an alternative embodiment, step 1032 may further include:

[0075] According to the play channel information of the first play channel, search for the video stream address corresponding to the first video in the target storage space.

[0076] In the above solution, when the video stream is being played in real time, the video stream address to be played in the split screen area where the play channel is located can be searched from the address pool (i.e., the target storage space) created in the memory according to the play channel information of the corresponding play channel.

[0077] As an alternative embodiment, after obtaining the video stream address corresponding to the first video in step 1031, the method further includes:

[0078] In response to determining that the video stream address corresponding to the first video is not stored in the target storage space, store the video stream address corresponding to the first video in the target storage space.

[0079] In the above solution, as Figure 2G shown, it is considered in the design here that if there are too many split screen areas, problems such as cache coverage or address storage failure will inevitably occur. To solve this problem, when the current interface 200 is displayed through a browser, the browser client will create an address pool (i.e., the target storage space) in the memory when obtaining the video stream address, which is used to store the stream address corresponding to the current play channel. When a full-duplex connection is established for a certain play channel, the video stream address is obtained from the server and stored in the address pool.

[0080] As an alternative embodiment, the method further includes:

[0081] Store the association relationship between the first split screen area and the video stream address corresponding to the first video in the target storage space.

[0082] In the above solution, as Figure 2GAs shown, when designing, it is considered that if there are too many split screens, problems such as cache overwrite or address storage failure will inevitably occur. To solve this problem, when the current interface 200 is displayed through a browser, when the client where the browser is located obtains the video stream address, it will create an address pool (i.e., the target storage space) in the memory to store the video stream address corresponding to the current channel, and then associate it with the split screen area (i.e., the association relationship). In this way, a relationship network is formed, maintaining a series of relationship chains. When a full-duplex communication is established for a certain playback channel, first, the client obtains the video stream address from the address pool, corresponding to its respective playback channel and split screen area, forming a current relationship chain.

[0083] In some embodiments, it further includes:

[0084] In response to receiving a close instruction for the first split screen area, stop playing the first video in the first split screen area;

[0085] Delete the association relationship between the first split screen area and the video stream address corresponding to the first video from the target storage space.

[0086] In the above solution, if you want to end the video stream playback of the selected split screen area, send a request instruction to cut off the video stream to the server. After the request is successful, first close the playback of the video in the selected split screen area on the browser side, and restore to the original interface when it was not playing.

[0087] Then, clear the association relationship between the split screen area and the video stream address in the address pool (i.e., the target storage space), and thus a relationship chain is deleted.

[0088] Finally, when managing the entire split screen interface 201, garbage collection will also be performed to complete the release and destruction of the address pool, facilitating the creation of the address pool next time.

[0089] In some embodiments, the method further includes:

[0090] In response to receiving a delete instruction for the first playback channel among the multiple playback channels displayed on the current interface, delete the first playback channel from the current interface and delete the video stream address corresponding to the first video from the target storage space.

[0091] In the above solution, when receiving a delete instruction for the corresponding playback channel, delete the playback channel from the current interface, restore to the original unplayed screen, and delete the corresponding video stream address from the address pool (i.e., the target storage space) to release the storage space of the address pool, facilitating the storage of video stream addresses corresponding to other playback channels.

[0092] In some embodiments, the method further includes:

[0093] In response to receiving a second drag instruction for a second playback channel among a plurality of playback channels displayed on the current interface and the release position of the second drag instruction being in a second split-screen area among the at least one split-screen area, obtain the playback channel information of the second playback channel;

[0094] Play a second video corresponding to the second playback channel in the second split-screen area according to the playback channel information of the second playback channel.

[0095] In the above solution, as Figure 2H shown, when triggering a selected playback channel icon among a plurality of playback channels, drag the selected playback channel icon to a selected split-screen area 2011 in the currently displayed split-screen interface 201, and the current interface after dragging is as Figure 2I shown, obtain the playback channel information of this playback channel in this split-screen area 2011.

[0096] Play a video corresponding to the selected playback channel in the dragged split-screen area according to the playback channel information of the selected playback channel.

[0097] In some embodiments, the first drag instruction or the second drag instruction is a long-press drag instruction.

[0098] In the above solution, the implementation of dragging the playback channel icon 203 is based on the ondragstart (target starts to drag), ondragend (target drag ends), and ondrag (during the process of target dragging) methods of elements in H5 (mobile web page) to drag the element to be dragged to a specified area to complete the corresponding operation and complete the encapsulation of the drag component. The encapsulation of the drag component is mainly based on the interaction between two components, the target and the container. The events for the target component are as follows:

[0099] ondragstart: The target starts to drag

[0100] ondrag: During the process of target dragging

[0101] ondragend: The target drag ends

[0102] The events for the container (i.e., the split-screen area 2011) are as follows:

[0103] ondragenter: The target enters the container

[0104] ondragover: The target moves in the container. Here, it should be noted that in the current H5 version, it is also necessary to prevent its default event, otherwise the ondrop (the target is released in the container) will fail.

[0105] ondragleave: The target leaves the container

[0106] ondrop: The target is dropped inside the container

[0107] API (Application Program Interface) for data transfer between components (i.e., the dragged play channel icon and the selected split screen area):

[0108] dataTransfer (data transfer): This is a property called using event. It has methods such as setData (data setting) and getData (data retrieval). The key-value pairs (k-v) here are all of string (reference type) type.

[0109] In related technologies, data transfer often uses the http protocol. Considering network security, for example, browsers limit the maximum number of concurrent same-origin http requests to 6. That is, when playing split-screen videos, the maximum number of windows available for playing in the split screen area is 6, and video playback with more than 6 windows cannot be achieved.

[0110] In order to be able to view videos in multiple split screen areas simultaneously without being restricted by the number of split screen areas and to be able to freely switch the number of split screen areas, the present application provides the split screen playback method of the following embodiments, specifically as follows:

[0111] In some embodiments, the method further includes: establishing a communication connection with the server based on WebSocket;

[0112] The obtaining the video stream corresponding to the first video according to the video stream address corresponding to the first video and playing the video stream in the first split screen area includes:

[0113] Obtaining the video stream corresponding to the first video from the server based on WebSocket according to the video stream address corresponding to the first video.

[0114] In the above solution, after establishing a connection between the browser and the server through the http protocol, data transfer is performed through the webSocket protocol, enabling both the client where the browser is located and the corresponding server to actively send data to each other. Thus, the server can actively send the corresponding video stream. Among them, the webSocket protocol is based on the http (HyperTextTransferProtocol) protocol and reuses the handshake channel of the http protocol. After establishing a connection between the browser and the server, data transfer does not need to use the http protocol, thereby solving the problem of being restricted by the number of split screen areas and improving the user viewing experience.

[0115] In some embodiments, a communication connection and data transmission are established with a server by using a flash (memory chip) browser plug-in.

[0116] Through the above solution, the corresponding split-screen interface is displayed on the current interface by selecting the split-screen type. The number of split-screen areas can be freely switched by selecting the split-screen type. Then, the selected playback channel is dragged to the corresponding split-screen area by a drag operation, and the video corresponding to the playback channel is played in the split-screen area according to the playback channel information of the selected playback channel, so that the playback channel and the video can correspond one by one, thereby realizing the simultaneous viewing of videos in multiple split-screen areas without being limited by the number of split-screen areas, and improving the user viewing experience.

[0117] It should be noted that the method of the embodiment of the present application can be executed by a single device, such as a computer or a server. The method of this embodiment can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In this case of a distributed scenario, one of the multiple devices can only execute one or more steps of the method of the embodiment of the present application, and these multiple devices will interact with each other to complete the described method.

[0118] It should be noted that some embodiments of the present application are described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be executed in a different order than in the above embodiments and still achieve the desired results. Additionally, the processes depicted in the figures do not necessarily require the specific order or sequential order shown to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0119] Based on the same inventive concept, corresponding to the method of any of the above embodiments, the present application further provides a split-screen playback device.

[0120] Referring to Figure 3 , the split-screen playback device includes:

[0121] A split-screen interface display module 301, configured to display a split-screen interface corresponding to the target split-screen type in the current interface in response to receiving a selection instruction for the target split-screen type among a plurality of split-screen types displayed on the current interface, where the split-screen interface includes at least one split-screen area;

[0122] The playback channel information acquisition module 302 is configured to acquire the playback channel information of the first playback channel in response to receiving a first drag instruction for the first playback channel among the multiple playback channels displayed on the current interface and the release position of the first drag instruction being in the first split screen area among the at least one split screen area;

[0123] The playback module 303 is configured to play the first video corresponding to the first playback channel in the first split screen area according to the playback channel information of the first playback channel.

[0124] In some embodiments, the playback module 303 includes:

[0125] The video stream address acquisition unit is configured to acquire the video stream address corresponding to the first video according to the playback channel information of the first playback channel;

[0126] The video stream acquisition unit is configured to acquire the video stream corresponding to the first video according to the video stream address corresponding to the first video and play the video stream in the first split screen area.

[0127] In some embodiments, the video stream acquisition unit is specifically configured to:

[0128] Search for the video stream address corresponding to the first video in the target storage space according to the playback channel information of the first playback channel.

[0129] In some embodiments, the split screen playback device further includes a video stream address storage module, which is specifically configured to:

[0130] After acquiring the video stream address corresponding to the first video, the method further includes:

[0131] In response to determining that the video stream address corresponding to the first video is not stored in the target storage space, store the video stream address corresponding to the first video in the target storage space.

[0132] In some embodiments, the split screen playback device further includes an association relationship storage module, which is specifically configured to:

[0133] Store the association relationship between the first split screen area and the video stream address corresponding to the first video in the target storage space.

[0134] In some embodiments, the split screen playback device further includes a video stream address deletion module, which is specifically configured to:

[0135] In response to receiving a deletion instruction for a first playback channel among a plurality of playback channels displayed on the current interface, delete the first playback channel from the current interface and delete the video stream address corresponding to the first video from the target storage space.

[0136] In some embodiments, the split-screen playback device further includes a video playback module, which is specifically configured to:

[0137] In response to receiving a second drag instruction for a second playback channel among the plurality of playback channels displayed on the current interface and the release position of the second drag instruction is in a second split-screen area among the at least one split-screen area, obtain the playback channel information of the second playback channel;

[0138] Play the second video corresponding to the second playback channel in the second split-screen area according to the playback channel information of the second playback channel.

[0139] In some embodiments, the first drag instruction or the second drag instruction is a long-press drag instruction.

[0140] In some embodiments, the split-screen playback device further includes a communication connection module, which is specifically configured to:

[0141] Establish a communication connection with the server based on WebSocket;

[0142] A video stream acquisition unit, which is specifically configured to:

[0143] Based on WebSocket, obtain the video stream corresponding to the first video from the server according to the video stream address corresponding to the first video.

[0144] For the convenience of description, when describing the above device, various modules are described separately according to their functions. Of course, when implementing the present application, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0145] The device in the above embodiments is used to implement the corresponding split-screen playback method in any of the foregoing embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be elaborated here.

[0146] Based on the same inventive concept, corresponding to the method in any of the above embodiments, the present application further provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the program, it implements the split-screen playback method described in any of the above embodiments.

[0147] Figure 4FIG. 0 shows a more specific schematic diagram of the hardware structure of the electronic device provided in this embodiment. The device may include: a processor 401, a memory 402, an input / output interface 403, a communication interface 404, and a bus 405. Among them, the processor 401, the memory 402, the input / output interface 403, and the communication interface 404 are communicatively connected to each other inside the device through the bus 405.

[0148] The processor 401 may be implemented in the form of a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, etc., and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.

[0149] The memory 402 may be implemented in the form of a ROM (Read Only Memory), a RAM (Random Access Memory), a static storage device, a dynamic storage device, etc. The memory 402 may store an operating system and other application programs. When implementing the technical solutions provided in the embodiments of this specification through software or firmware, the relevant program codes are stored in the memory 402 and are called and executed by the processor 401.

[0150] The input / output interface 403 is used to connect to an input / output module to implement information input and output. The input / output module may be configured as a component in the device (not shown in the figure) or externally connected to the device to provide corresponding functions. Among them, the input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.

[0151] The communication interface 404 is used to connect to a communication module (not shown in the figure) to implement communication interaction between this device and other devices. Among them, the communication module may implement communication through a wired method (such as USB, network cable, etc.) or through a wireless method (such as a mobile network, WIFI, Bluetooth, etc.).

[0152] The bus 405 includes a path for transmitting information between various components of the device (such as the processor 401, the memory 402, the input / output interface 403, and the communication interface 404).

[0153] It should be noted that although the above device only shows the processor 401, the memory 402, the input / output interface 403, the communication interface 404, and the bus 405, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, those skilled in the art can understand that the above device may also only include the components necessary to implement the solution of the embodiments of this specification, and does not necessarily include all the components shown in the figure.

[0154] The electronic device in the above embodiment is used to implement the corresponding split-screen playback method in any of the foregoing embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be elaborated here.

[0155] Based on the same inventive concept, corresponding to the method in any of the above embodiments, the present application also provides a non-transitory computer-readable storage medium. The non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to cause the computer to execute the split-screen playback method described in any of the foregoing embodiments.

[0156] The computer-readable medium in this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. The information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette tapes, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device.

[0157] The computer instructions stored in the storage medium in the above embodiment are used to cause the computer to execute the split-screen playback method described in any of the foregoing embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be elaborated here.

[0158] Those of ordinary skill in the art should understand that: the discussion of any of the above embodiments is only exemplary, and is not intended to imply that the scope of the present application (including the claims) is limited to these examples; under the concept of the present application, the technical features in the above embodiments or different embodiments can also be combined, the steps can be implemented in any order, and there are many other variations in different aspects of the embodiments of the present application as described above, and they are not provided in detail for the sake of brevity.

[0159] In addition, for simplicity of explanation and discussion, and in order not to make the embodiments of the present application difficult to understand, well-known power / ground connections to integrated circuit (IC) chips and other components may or may not be shown in the provided drawings. Further, the devices may be shown in block diagram form in order to avoid making the embodiments of the present application difficult to understand, and this also takes into account the fact that details of the implementation of these block diagram devices are highly dependent on the platform on which the embodiments of the present application are to be implemented (i.e., these details should be entirely within the understanding of those skilled in the art). In cases where specific details (such as circuits) are set forth to describe exemplary embodiments of the present application, it will be apparent to those skilled in the art that the embodiments of the present application may be practiced without these specific details or with variations of these specific details. Accordingly, these descriptions should be considered illustrative rather than restrictive.

[0160] Although the present application has been described in connection with specific embodiments thereof, many alternatives, modifications, and variations of these embodiments will be apparent to those of ordinary skill in the art in light of the foregoing description. For example, other memory architectures (such as dynamic RAM (DRAM)) may be used with the embodiments discussed.

[0161] Embodiments of the present application are intended to cover all such alternatives, modifications, and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc., made within the spirit and principle of the embodiments of the present application shall be included within the protection scope of the present application.

Claims

1. A split-screen playback method, characterized in that, Including: In response to receiving a selection instruction for a target split - screen type among multiple split - screen types displayed on the current interface, display a split - screen interface corresponding to the target split - screen type in the current interface, where the split - screen interface includes at least one split - screen area; In response to receiving a first drag - and - drop instruction for a first playback channel among multiple playback channels displayed on the current interface and the release position of the first drag - and - drop instruction being in a first split - screen area among the at least one split - screen area, obtain the playback channel information of the first playback channel; Play a first video corresponding to the first playback channel in the first split - screen area according to the playback channel information of the first playback channel; The playing of the first video corresponding to the first playback channel in the first split - screen area according to the playback channel information of the first playback channel includes: Obtain the video stream address corresponding to the first video according to the playback channel information of the first playback channel; Obtain the video stream corresponding to the first video according to the video stream address corresponding to the first video and play the video stream in the first split - screen area, where the video stream includes a live stream.

2. The method according to claim 1, wherein The obtaining of the video stream address corresponding to the first video according to the playback channel information of the first playback channel includes: Search for the video stream address corresponding to the first video in a target storage space according to the playback channel information of the first playback channel.

3. The method according to claim 1, wherein After obtaining the video stream address corresponding to the first video, the method further includes: In response to determining that the video stream address corresponding to the first video is not stored in the target storage space, store the video stream address corresponding to the first video in the target storage space.

4. The method according to claim 2 or 3, characterized in that The method further includes: Store the association relationship between the first split - screen area and the video stream address corresponding to the first video in the target storage space.

5. The method according to claim 4, wherein Also including: In response to receiving a close instruction for the first split - screen area, stop playing the first video in the first split - screen area; Delete the association relationship between the first split - screen area and the video stream address corresponding to the first video from the target storage space.

6. The method according to claim 5, characterized in that, The method further includes: In response to receiving a delete instruction for the first playback channel among multiple playback channels displayed on the current interface, delete the first playback channel from the current interface and delete the video stream address corresponding to the first video from the target storage space.

7. The method according to claim 1, characterized in that, The method further includes: In response to receiving a second drag - and - drop instruction for a second playback channel among multiple playback channels displayed on the current interface and the release position of the second drag - and - drop instruction being in a second split - screen area among the at least one split - screen area, obtain the playback channel information of the second playback channel; Play a second video corresponding to the second playback channel in the second split - screen area according to the playback channel information of the second playback channel.

8. The method according to claim 1 or 7, characterized in that, The first drag - and - drop instruction or the second drag - and - drop instruction is a long - press drag - and - drop instruction.

9. The method according to claim 1, characterized in that, The method further includes: establishing a communication connection with a server based on WebSocket; Obtaining the video stream corresponding to the first video according to the video stream address corresponding to the first video and playing the video stream in the first split-screen area includes: Obtaining the video stream corresponding to the first video from the server based on the video stream address corresponding to the first video according to WebSocket.

10. A split-screen playback device, characterized in that, Including: A split-screen interface display module, configured to respond to a selection instruction for a target split-screen type among a plurality of split-screen types displayed on the current interface, and display a split-screen interface corresponding to the target split-screen type on the current interface, where the split-screen interface includes at least one split-screen area; A playback channel information acquisition module, configured to respond to a first drag instruction for a first playback channel among a plurality of playback channels displayed on the current interface and the release position of the first drag instruction being in a first split-screen area among the at least one split-screen area, and acquire the playback channel information of the first playback channel; A playback module, configured to play the first video corresponding to the first playback channel in the first split-screen area; playing the first video corresponding to the first playback channel in the first split-screen area according to the playback channel information of the first playback channel is used to obtain the video stream address corresponding to the first video according to the playback channel information of the first playback channel; obtaining the video stream corresponding to the first video according to the video stream address corresponding to the first video and playing the video stream in the first split-screen area, where the video stream includes a live stream.

11. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the method according to any one of claims 1 to 9.

12. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, The computer instructions are used to cause a computer to execute the method according to any one of claims 1 to 9.

13. A computer program product, including computer program instructions, when the computer program instructions run on a computer, causing the computer to execute the method according to any one of claims 1-9.

Images