A video window roaming method, device, equipment and storage medium

CN115119034BActive Publication Date: 2025-02-18ZHEJIANG UNIVIEW TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202110285783.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-03-17
Publication Date
2025-02-18
Estimated Expiration
2041-03-17

Smart Images

  • Figure CN115119034B_ABST
    Figure CN115119034B_ABST
Patent Text Reader

Abstract

The present invention discloses a video window roaming method, device, equipment and storage medium. A first device is cascaded with a second device. The first device receives a video stream from a data source and displays it in its own display window. The first device receives a roaming instruction from the first device to the second device, unbinds the video stream from its own display window, and closes its own display window. The first device obtains the receiving node information of the second device and forwards the video stream to the second device so that the second device receives the video stream and displays it in its newly created display window. The technical solution of the present invention avoids the process in which the device negotiates with the data source before roaming to stop sending the video stream, and then the device negotiates with the data source after roaming to establish the video stream, thereby improving the efficiency of roaming between devices and enhancing the visual effect.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of video image display, and in particular relates to a video window roaming method, device, equipment and storage medium. Background Art

[0002] With the development of the times and the continuous progress of science and technology, people have higher and higher requirements for visual effects. In the application of video security, more personalized requirements are also put forward for the display device to display video windows. Among them, window roaming is a personalized demand. Users hope to be able to move a video window with live services on the display device at will and place the video window at any position on the display device without affecting the display of other windows on the display device. The picture can be played uninterruptedly on the same display device, giving users an excellent visual experience. When the window roams, the video window moves on the display device, and the video picture moves with the movement of the video window in the fixed video window.

[0003] However, in many specific application scenarios, one display device cannot meet the needs of users, and multiple display devices need to be cascaded. In the case of cascaded display devices, when roaming between display devices, the original display device needs to negotiate with the data source to stop sending the video stream, and then the destination display device negotiates with the data source to establish the sending of the video stream, which will cause image interruptions when roaming between display devices, and a black screen will appear for a period of time after roaming, resulting in a decrease in the user's visual experience. Summary of the invention

[0004] The purpose of the present application is to provide a video window roaming method, apparatus, device and storage medium to solve the problem of image discontinuity when window roaming in the case of device cascading.

[0005] In order to achieve the above purpose, the technical solution of this application is as follows:

[0006] A video window roaming method, a first device is cascaded with a second device, the first device receives a video stream from a data source and displays it in its own display window, the video window roaming method is applied to the first device, and includes:

[0007] receiving a roaming instruction from the first device to the second device, unbinding the video stream from its own display window, and closing its own display window;

[0008] The stream receiving node information of the second device is obtained, and the video stream is forwarded to the second device, so that the second device receives the video stream and displays it in a newly created display window.

[0009] Furthermore, the video window roaming method further includes:

[0010] receiving a roaming instruction from the second device to the first device, and creating a corresponding display window on the first device;

[0011] Stop forwarding the video stream to the second device, bind the video stream to the newly created display window on the first device, and display the video stream in the newly created display window.

[0012] Furthermore, the first device and the second device are further cascaded with a third device, and the video window roaming method further includes:

[0013] receiving a roaming instruction from the second device to the third device, and stopping forwarding the video stream to the second device;

[0014] The receiving node information of the third device is obtained, and the video stream is forwarded to the third device, so that the third device receives the video stream and displays it in its newly created display window.

[0015] Furthermore, the roaming instruction includes a destination roaming device and destination display window information. After receiving the roaming instruction, the destination roaming device establishes a corresponding display window according to the destination display window information.

[0016] Furthermore, the target roaming device includes a first device and a plurality of second devices, the target display window information includes a first display area on the first device and a second display area on each of the second devices, and the video window roaming method further includes:

[0017] receiving a roaming instruction from the first device to the first device and the plurality of second devices, and scaling the own display window so that the scaled own display window is consistent with the first display area;

[0018] The stream receiving node information of each second device is obtained, and the video stream is forwarded to each second device, so that each second device receives the video stream and displays it in the second display area of ​​each second device.

[0019] The present application also proposes a video window roaming device, wherein a first device is cascaded with a second device, the first device receives a video stream from a data source and displays it in its own display window, and the video window roaming device is applied to the first device, comprising:

[0020] A roaming instruction receiving module, used to receive a roaming instruction from the first device to the second device, unbind the video stream from its own display window, and close its own display window;

[0021] The forwarding module is used to obtain the stream receiving node information of the second device and forward the video stream to the second device so that the second device receives the video stream and displays it in its newly created display window.

[0022] Furthermore, the roaming instruction receiving module is further used to receive a roaming instruction from the second device to the first device, and to create a corresponding display window;

[0023] The forwarding module is further used to stop forwarding the video stream to the second device, bind the video stream to the newly created display window, and display the video stream in the newly created display window.

[0024] Furthermore, the roaming instruction receiving module is further used to receive a roaming instruction from the second device to the third device, and stop forwarding the video stream to the second device;

[0025] The forwarding module is further used to obtain the stream receiving node information of the third device and forward the video stream to the third device, so that the third device receives the video stream and displays it in its newly created display window.

[0026] The present application also proposes an electronic device, comprising a processor and a memory storing a plurality of computer instructions, wherein the computer instructions implement the steps of the above-mentioned video window roaming method when executed by the processor.

[0027] The present application also proposes a computer-readable storage medium on which computer instructions are stored. The computer instructions are executed by a processor to implement the steps of the above-mentioned video window roaming method.

[0028] The present application proposes a video window roaming method, apparatus, device and storage medium. When roaming between cascaded devices, the device before roaming directly forwards the existing video stream to the device after roaming, thereby avoiding the process in which the device before roaming first negotiates with the data source to stop sending the video stream, and then the device after roaming negotiates with the data source to establish the video stream, thereby improving the efficiency of roaming between devices and enhancing the visual effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 This is a flow chart of the video window roaming method according to an embodiment of the present application;

[0030] Figure 2 A schematic diagram of a first embodiment of roaming in this application;

[0031] Figure 3 A schematic diagram of a second embodiment of roaming for this application;

[0032] Figure 4 Schematic diagram of the third embodiment of roaming in this application

[0033] Figure 5 A schematic diagram of a spliced ​​display roaming of an embodiment of the present application;

[0034] Figure 6 This is a schematic diagram of the structure of the video window roaming device according to an embodiment of the present application;

[0035] Figure 7 This is a schematic diagram of the structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0036] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0037] Video window roaming refers to the process of moving the target window from the current position of the display screen to another specified position. Video window roaming in multi-device cascade mode is generally understood as a device consisting of a decoding device and a display screen. The process of moving the target window from the display screen of one device to the display screen of another device is roaming in cascade mode. The device receives the video stream and decodes it and displays it in the display window on the display screen.

[0038] In response to the existing problems, the present application displays that when the window roams between cascaded devices, the device before roaming (the device that receives the video stream from the data source) directly forwards the existing video stream to the device after roaming, thereby avoiding the process in which the device before roaming first negotiates with the data source to stop sending the video stream, and then the device after roaming negotiates with the data source to establish the video stream, thereby improving the efficiency of roaming between devices and enhancing the visual effect.

[0039] In one embodiment, Figure 1 As shown, a video window roaming method is provided, a first device is cascaded with a second device, the first device receives a video stream from a data source and displays it in its own display window, and the video window roaming method is applied to the first device, including:

[0040] Step S110: receiving a roaming instruction from the first device to the second device, unbinding the video stream from its own display window, and closing its own display window.

[0041] In this embodiment, the first device is cascaded with the second device. The first device is a pre-roaming device, which receives a video stream from a data source and displays it in its own display window. The second device is a post-roaming device, also called a destination roaming device. Two devices are cascaded, one of which has a cascade management function. The device with the cascade management function sends a roaming instruction to the cascaded device and transmits signaling between the cascaded devices.

[0042] When roaming is required, the device with the cascade management function sends a roaming instruction to the cascade device, and the roaming instruction at least includes the target roaming device information.

[0043] In this embodiment, after receiving the roaming instruction, the first device obtains the information of the target roaming device, that is, the second device, and compares it with its own device information, thereby knowing that the target roaming device is the second device. At this time, the first device unbinds the video stream from its own display window and closes its own display window.

[0044] As Figure 2 The following is an example of a TV wall formed by cascading four devices, where the four devices are PC1, PC2, PC3, and PC4.

[0045] In this embodiment, the first device is PC1, and the second device is PC2. PC1 receives the live video stream of the network camera IPC. A display window is opened on the display screen of PC1 and bound to the video stream. The video stream is displayed in the display window after being decoded.

[0046] After receiving the roaming instruction, PC1 finds that the target roaming device is not itself, and roaming between cascaded devices occurs. At this time, PC1 unbinds the video stream from its own display window and closes its own display window.

[0047] Step S120: Obtain the stream receiving node information of the second device, and forward the video stream to the second device, so that the second device receives the video stream and displays it in its newly created display window.

[0048] The cascade management device also sends a roaming instruction to the second device. If the second device finds that the target roaming device is itself, it will create a new display window and send its own receiving node information to the cascade management device. The device receiving node information includes its own IP address and receiving port number. The device receiving is provided with receiving node information, which is a relatively mature technology in the field of video security technology and will not be described here. After receiving the receiving node information of the second device, the cascade device sends the receiving node information of the second device to the first device.

[0049] It should be noted that the receiving node information may also be sent directly by the second device to the first device, or forwarded to the first device through other devices, and this application does not impose any limitation on this.

[0050] like Figure 2 As shown, after PC1 obtains the receiving node information of PC2, it forwards the video stream to PC2 according to the receiving node information of PC2. After receiving the roaming instruction, PC2 finds that it is the target roaming device, so it creates a new display window and feeds back its own receiving node information.

[0051] After receiving the video stream, PC2 decodes it and displays it in a newly created display window, completing the roaming of the video window from PC1 to PC2.

[0052] In this embodiment, the first device does not need to negotiate with the data source to stop sending the video stream, and the second device does not need to negotiate with the data source to establish the video, thereby reducing the roaming time, effectively avoiding image interruptions during roaming, and black screen phenomena for a period of time after roaming, thereby improving the user's visual experience.

[0053] In a specific example, the video window roaming method further includes:

[0054] receiving a roaming instruction from the second device to the first device, and creating a corresponding display window on the first device;

[0055] Stop forwarding the video stream to the second device, bind the video stream to the newly created display window on the first device, and display the video stream in the newly created display window.

[0056] Specifically, after roaming to the second device, the first device receives a roaming instruction from the second device to the first device. At this time, the first device is the destination roaming device and needs to create a corresponding display window, stop forwarding the video stream to the second device, bind the video stream to the newly created display window, and display the video stream in the newly created display window.

[0057] For example, Figure 3 As shown, PC1 forwards the video stream to PC2, and the PC2 display window displays the live service. At this time, it receives the roaming instruction again and roams back to PC1 from PC2. After receiving the roaming instruction, PC1 finds that the destination roaming device is itself, so it establishes a new video window. After receiving the roaming instruction, PC2 unbinds the display window from the video stream and closes the display window. PC1 directly receives the video stream, binds the video stream to the newly created display window, and displays the video stream in the newly created display window.

[0058] This example embodies the process of roaming back from the second device to the first device, avoiding the process of the first device negotiating with the data source to establish a video stream, and directly binding the original video stream to the newly created display window.

[0059] In another specific example, the first device and the second device are further cascaded with a third device, and the video window roaming method further includes:

[0060] receiving a roaming instruction from the second device to the third device, and stopping forwarding the video stream to the second device;

[0061] The receiving node information of the third device is obtained, and the video stream is forwarded to the third device, so that the third device receives the video stream and displays it in its newly created display window.

[0062] In this example, there are multiple cascaded devices, for example, a third device is also included. After receiving the roaming instruction from the second device to the third device, the first device stops forwarding the video stream to the second device. The second device unbinds the video stream from the display window and closes the display window. The third device receives the roaming instruction and finds that the destination roaming device is itself, so it creates a new display window and sends its own receiving node information to the first device through the cascade management device.

[0063] After the first device obtains the stream receiving node information of the third device, it forwards the video stream to the third device. The third device receives the video stream and displays it in its newly created display window.

[0064] For example, Figure 4 As shown, PC1, PC2, and PC3 are cascaded, PC1 forwards the video stream to PC2, and PC2 performs roaming display.

[0065] After receiving the roaming instruction, PC2 finds that the target roaming device is not itself, so PC2 unbinds the video stream from its own display window and closes its own display window.

[0066] After receiving the roaming instruction, PC3 finds that it is the target roaming device, so it creates a new display window and feeds back its own receiving node information.

[0067] After receiving the receiving node information of PC3, PC1 forwards the video stream to PC3.

[0068] After receiving the video stream, PC3 decodes it and displays it in a newly created display window, completing the roaming of the video window from PC2 to PC3.

[0069] In this example, the process of negotiating between the third device and the data source to establish a video stream is reduced, thereby reducing the roaming time. This can effectively avoid image interruptions during roaming and a black screen phenomenon that occurs for a period of time after roaming, thereby improving the user's visual experience.

[0070] The above example does not limit the position and size information of the newly created display window on the destination roaming device. The destination roaming device can create a new display window randomly or according to the default settings.

[0071] However, in actual applications, the roaming instruction may include the destination roaming device and the destination display window information. After receiving the roaming instruction, the destination roaming device establishes a corresponding display window according to the destination display window information.

[0072] For example, when roaming from PC1 to PC2, PC2 receives a roaming instruction that defines the location and size of a new display window, and then creates a new display window according to the target display window information in the roaming instruction. During roaming, the new display window is displayed.

[0073] In another specific example, the destination roaming device includes a first device and a plurality of second devices, the destination display window information includes a first display area on the first device and a second display area on each of the second devices, and the video window roaming method further includes:

[0074] receiving a roaming instruction from the first device to the first device and a plurality of second devices, and scaling the own display window so that the scaled own display window is consistent with the first display area;

[0075] The stream receiving node information of each second device is obtained, and the video stream is forwarded to each second device, so that each second device receives the video stream and displays it in the second display area of ​​each second device.

[0076] In this example, the first device is a pre-roaming device, and the second device is a post-roaming device. There may be multiple second devices. At this time, the roaming instruction provides specific destination display window information.

[0077] like Figure 5 As shown, PC1 is the first device, which receives the stream from IPC. PC2, PC3, and PC4 are the second devices. The target display window is the area between the four devices, each occupying a part of their respective display screens.

[0078] At this time, for the first device PC1, the display area of ​​the destination display window on the PC1 device is A. After receiving the roaming instruction, PC1 scales the original display window and moves it to the display area A, aligning it with the display area A, for display.

[0079] For PC2, PC3, and PC4, the target display windows are display areas B, C, and D, respectively. Then, PC2, PC3, and PC4 respectively establish their own display windows and display areas B, C, and D, thereby completing the splicing display after roaming.

[0080] In this example, the roaming process saves the flow negotiation process between PC2, PC3, and PC4 and IPC, and the flow establishment of the four devices only requires PC1 to receive the video stream of IPC, which reduces network bandwidth and packet loss rate.

[0081] Various specific examples of this embodiment can reduce the time for normal image display when roaming from one device to another, improve the roaming effect, and greatly improve the roaming efficiency.

[0082] In another embodiment, Figure 6As shown, the present application also provides a video window roaming device, a first device is cascaded with a second device, the first device receives a video stream from a data source and displays it in its own display window, and the video window roaming device is applied to the first device, including:

[0083] A roaming instruction receiving module, used to receive a roaming instruction from the first device to the second device, unbind the video stream from its own display window, and close its own display window;

[0084] The forwarding module is used to obtain the stream receiving node information of the second device and forward the video stream to the second device so that the second device receives the video stream and displays it in its newly created display window.

[0085] In a specific example, the roaming instruction receiving module is further used to receive a roaming instruction from the second device to the first device, and to create a corresponding display window;

[0086] The forwarding module is further used to stop forwarding the video stream to the second device, bind the video stream to the newly created display window, and display the video stream in the newly created display window.

[0087] In a specific example, the roaming instruction receiving module is further used to receive a roaming instruction from the second device to the third device, and stop forwarding the video stream to the second device;

[0088] The forwarding module is further used to obtain the stream receiving node information of the third device and forward the video stream to the third device, so that the third device receives the video stream and displays it in its newly created display window.

[0089] The specific definition of the video window roaming device can be found in the definition of the video window roaming method above, which will not be repeated here. Each module in the above-mentioned video window roaming device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0090] In another embodiment, Figure 7 As shown, an electronic device is provided. The electronic device provided in this embodiment includes a processor and a memory storing a plurality of computer instructions. When the computer instructions are executed by the processor, the steps of the above-mentioned video window roaming method are implemented.

[0091] The processor in the electronic device may be one or more, and the memory is used to store computer instructions, which may be one or more computer programs. In this embodiment, the computer instructions are executed by the processor, so that the processor implements the video window roaming method described in the embodiment of the present application.

[0092] The electronic device of this embodiment may also include an input device and an output device. The processor, memory, input device and output device in the electronic device may be electrically connected directly or indirectly to achieve data transmission or interaction. For example, these components may be electrically connected to each other through one or more communication buses or signal lines. Figure 7 The example of connecting through bus is taken in the following.

[0093] In another embodiment, the present application also proposes a computer-readable storage medium on which computer instructions are stored. The computer instructions are executed by a processor to implement the steps of the above-mentioned video window roaming method.

[0094] In the above embodiments, the memory and the processor are electrically connected directly or indirectly to realize data transmission or interaction. For example, these elements can be electrically connected to each other through one or more communication buses or signal lines. The memory stores a computer program that can be run on the processor, and the processor implements the network topology layout method in the embodiment of the present invention by running the computer program stored in the memory.

[0095] The memory may be, but is not limited to, a random access memory (RAM), a read only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable read-only memory (EEPROM), etc. The memory is used to store a program, and the processor executes the program after receiving an execution instruction.

[0096] The processor may be an integrated circuit chip with data processing capabilities. The above-mentioned processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc. The methods, steps and logic block diagrams disclosed in the embodiments of the present invention may be implemented or executed. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0097] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A video window roaming method, characterized in that: A first device is cascaded with a second device, the first device receives a video stream from a data source and displays it in its own display window, and the video window roaming method is applied to the first device, comprising: receiving a roaming instruction from the first device to the second device, unbinding the video stream from its own display window, and closing its own display window; Acquire the stream receiving node information of the second device, and forward the video stream to the second device, so that the second device receives the video stream and displays it in a newly created display window; The roaming instruction and the receiving node information are sent through the cascade connection of the first device and the second device.

2. The video window roaming method according to claim 1, characterized in that: The video window roaming method further includes: receiving a roaming instruction from the second device to the first device, and creating a corresponding display window on the first device; Stop forwarding the video stream to the second device, bind the video stream to the newly created display window on the first device, and display the video stream in the newly created display window.

3. The video window roaming method according to claim 1, characterized in that: The first device and the second device are further cascaded with a third device, and the video window roaming method further includes: receiving a roaming instruction from the second device to the third device, and stopping forwarding the video stream to the second device; The receiving node information of the third device is obtained, and the video stream is forwarded to the third device, so that the third device receives the video stream and displays it in its newly created display window.

4. The video window roaming method according to claim 1, characterized in that: The roaming instruction includes a target roaming device and target display window information. After receiving the roaming instruction, the target roaming device establishes a corresponding display window according to the target display window information.

5. The video window roaming method according to claim 4, characterized in that: The target roaming device includes a first device and a plurality of second devices, the target display window information includes a first display area on the first device and a second display area on each of the second devices, and the video window roaming method further includes: receiving a roaming instruction from the first device to the first device and the plurality of second devices, and scaling the own display window so that the scaled own display window is consistent with the first display area; The stream receiving node information of each second device is obtained, and the video stream is forwarded to each second device, so that each second device receives the video stream and displays it in the second display area of ​​each second device.

6. A video window roaming device, characterized in that: A first device is cascaded with a second device, the first device receives a video stream from a data source and displays it in its own display window, and the video window roaming device is applied to the first device, comprising: A roaming instruction receiving module, used to receive a roaming instruction from the first device to the second device, unbind the video stream from its own display window, and close its own display window; A forwarding module, used for acquiring the stream receiving node information of the second device, and forwarding the video stream to the second device, so that the second device receives the video stream and displays it in a newly created display window; The roaming instruction and the receiving node information are sent through the cascade connection of the first device and the second device.

7. The video window roaming device according to claim 6, characterized in that: The roaming instruction receiving module is further used to receive a roaming instruction from the second device to the first device, and to create a corresponding display window; The forwarding module is further used to stop forwarding the video stream to the second device, bind the video stream to the newly created display window, and display the video stream in the newly created display window.

8. The video window roaming device according to claim 6, characterized in that: The roaming instruction receiving module is further used to receive a roaming instruction from the second device to the third device, and stop forwarding the video stream to the second device; The forwarding module is further used to obtain the stream receiving node information of the third device and forward the video stream to the third device, so that the third device receives the video stream and displays it in its newly created display window.

9. An electronic device comprising a processor and a memory storing a plurality of computer instructions, characterized in that: When the computer instructions are executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.

10. A computer-readable storage medium having computer instructions stored thereon, characterized in that: The computer instructions are executed by a processor to implement the steps of the method according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • Method and terminal for video image playing during communication

    CN102957890A