Same-screen display method, device, system and storage medium
By establishing a connection channel between the same-screen display devices, collecting and transmitting video streaming data to achieve seamless switching between devices, the cumbersome problem of operating system switching in the prior art is solved and the user interaction experience is improved.
Patent Information
- Application Number
- CN202211516736.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-29
- Publication Date
- 2025-08-15
- Estimated Expiration
- 2042-11-29
AI Technical Summary
The existing same-screen display technology requires the user to re-initiate the screen recording connection when switching between different operating systems, resulting in cumbersome interaction steps.
By establishing a connection channel between the first device and the second device, collecting screen data to generate video stream data, and storing it to the second device for rendering and displaying, seamless switching between devices is achieved.
It simplifies the user's screen display process between different operating systems, avoids re-initiating screen recording operations, and improves the user experience.
Smart Images

Figure CN115866310B_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present invention relate to the field of same-screen display technology, and in particular to a same-screen display method, device, system and storage medium. Background Art
[0002] At present, with the progress of society and the rapid development of Internet technology, same-screen display technology has been widely used. Same-screen display technology refers to projecting the image displayed on device A to device B in real time to achieve image synchronization between the two devices.
[0003] Existing screen sharing methods generally rely on the MiraCast and AirPlay Mirroring protocols. Miracast is a wireless display standard based on Wi-Fi Direct and is an open protocol for sharing screens. Consumer electronics that support this protocol can share videos and images wirelessly. For example, a mobile phone can use Miracast to play videos or photos directly on a TV or other device without any cables or wireless hotspots. However, because MiraCast currently only supports Android and Windows systems, it does not work on Apple phones and tablets. AirPlay Mirroring is a proprietary protocol developed by Apple for Apple devices (computers, tablets, and mobile phones). Its main function is to wirelessly project the screens of iOS phones, tablets, and other products onto a TV in real time. However, since AirPlay Mirroring is a proprietary protocol, it only works on Apple phones and tablets. Due to the limitations of these proprietary protocols, when users want to switch from one connected device to another for screen sharing, they typically need to disconnect the current device and re-establish the connection with the target device, requiring them to re-initiate the screen recording function.
[0004] In view of this, it is necessary to improve the differences between different screen operating systems in the existing technology and simplify the user's interaction steps during the software use process. This is a technical problem that the industry urgently needs to solve. Summary of the Invention
[0005] The present invention provides a same-screen display method, device, system and storage medium, so as to enable devices transmitting on the same screen to switch rendering devices at will, thereby simplifying the interaction process during user use.
[0006] In a first aspect, an embodiment of the present invention provides a same-screen display method, the method comprising:
[0007] Establishing a connection channel between the first device and the second device according to a preset screen sharing instruction;
[0008] Controlling the collection of current screen data of the first device to generate video stream data;
[0009] Marking and storing the collected video stream data and sending the corresponding mark to the second device;
[0010] controlling the second device to download the video stream data according to the identifier;
[0011] The second device renders the downloaded video stream data and displays it on a screen.
[0012] Optionally, the controlling the collection of current screen data of the first device to generate video stream data includes:
[0013] The screen capture system of the first device is called to collect current screen data to generate the video stream data; wherein the screen capture system includes one or more specified encoding formats and bit rates.
[0014] Optionally, the step of marking and storing the collected video stream data and sending the corresponding mark to the second device includes:
[0015] The first device buffers the video stream data into a storage area using an inter-process communication method;
[0016] The video stream data in the storage area is identified, and the identification is sent to the second device through a pre-established connection channel.
[0017] Optionally, the marking of the video stream data in the storage area includes:
[0018] The video stream data in the storage area is converted into network unit frame data, and the video stream data is identified by the network unit frame data.
[0019] Optionally, controlling the second device to download the video stream data according to the identifier includes:
[0020] The second device downloads the identifier and the network unit frame data through a downloading unit, and sends the downloaded network unit frame data to a decoding unit;
[0021] The decoding unit decodes the received network unit frame data and generates the video stream data.
[0022] Optionally, the video stream data format is an image format supported by a window system of an operating system, including a YUV format and an RGBA format.
[0023] Optionally, the second device renders the downloaded video stream data and displays it on a screen, including:
[0024] The second device applies for a drawing area through a rendering unit, renders the video stream data in the drawing area, and displays the data on a screen.
[0025] In a second aspect, an embodiment of the present invention further provides a same-screen display device, the device comprising:
[0026] A connection module, configured to establish a connection channel between the first device and the second device according to a preset same-screen instruction;
[0027] an acquisition module, configured to control the acquisition of current screen data of the first device to generate video stream data;
[0028] an identification module, configured to identify and store the collected video stream data and send the corresponding identification to the second device;
[0029] a downloading module, configured to control the second device to download the video stream data according to the identifier;
[0030] A rendering module is used for the second device to render the downloaded video stream data and display it on the screen.
[0031] In the third aspect, an embodiment of the present invention also provides a same-screen display system, comprising: one or more processors; a memory for storing one or more programs; when the one or more programs are executed by the one or more processors, the one or more processors implement the same-screen display method as described in the first aspect.
[0032] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the same-screen display method as described in the first aspect.
[0033] The technical solution of the embodiment of the present invention is to establish a connection channel between the first device and the second device according to a preset same-screen instruction, control the collection of the current screen data of the first device to generate video stream data, identify and store the collected video stream data and send the corresponding identifier to the second device, control the second device to download the video stream data according to the identifier, and the second device renders the downloaded video stream data and displays it on the screen. By establishing a connection channel in advance between the devices that need to be displayed on the same screen, the identifier generated by the collected video stream data is transmitted to the rendering end, and the rendering end completes the download and streaming process by downloading. The device that can achieve same-screen transmission can switch the rendering device at will, thereby achieving the purpose of changing the rendering device, without the user having to re-initiate screen recording, thereby simplifying the user's interactive process. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] Figure 1 A flowchart of a same-screen display method provided by an embodiment of the present invention;
[0035] Figure 2 A flowchart of another same-screen display method provided by an embodiment of the present invention;
[0036] Figure 3 A structural block diagram of a same-screen display device provided by an embodiment of the present invention;
[0037] Figure 4 This is a schematic diagram of the hardware structure of a same-screen display system provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0038] The present invention will be further described in detail below with reference to the accompanying drawings and examples. It will be understood that the specific embodiments described herein are intended only to illustrate the present invention and are not intended to limit the present invention. It should also be noted that, for ease of description, the accompanying drawings only illustrate portions relevant to the present invention, not all structures.
[0039] Example 1
[0040] Figure 1 This is a flowchart of a method for simultaneous display provided by an embodiment of the present invention. This embodiment is applicable to achieving simultaneous display between different operating systems. The method can be executed by a simultaneous display device, which can be implemented using software and / or hardware. The device can be configured in a simultaneous display system / server. The method specifically includes steps S110-S150:
[0041] S110. Establish a connection channel between the first device and the second device according to a preset same-screen instruction.
[0042] The first device and the second device are intelligent screen-sharing display systems with screen recording capabilities. They can use the same operating system or different operating systems. For example, the first device can be an iOS phone or tablet, and the second device can be multiple Android or Windows phones, computers, large-screen TVs, etc. The preset screen-sharing command can be triggered by the user opening the app and touching the display screen.
[0043] For example, because the mobile phone screen is too small and the movie viewing experience is not very good, the user can cast the movie to a large-screen display device for viewing. When the user triggers the same screen command on the app of the first device, the control controls the establishment of a connection channel between the first device and the second device. Of course, the first device can establish connection channels with multiple second devices. In this embodiment, the first device and the second device can establish a wireless connection via Bluetooth protocol, WiFi, or UPNP protocol. This embodiment does not specifically limit the connection method between the two.
[0044] S120: Control the collection of current screen data of the first device to generate video stream data.
[0045] Specifically, the collection of video stream data is a data collection method that performs sampling, quantization and other operations on the current screen video signal output by the first device, thereby converting the video signal currently output by the device into digital data to generate video stream data.
[0046] In this embodiment, the video stream data format is an image format supported by the window system of the operating system, including YUV format and RGBA format. Of course, the video stream data format can also be other supported image formats, which is not specifically limited in the present invention.
[0047] S130: Mark and store the collected video stream data and send the corresponding mark to the second device.
[0048] It should be noted that marking the video stream data can be understood as compressing and encoding the video stream data, that is, transforming, encoding and compressing the data while meeting certain fidelity requirements. On the one hand, it removes redundant data to reduce the amount of data required to represent the digital image, so as to facilitate the storage and transmission of the image; on the other hand, it encodes and sorts the data on a frame-by-frame basis so that the subsequent receiving end can render it in order according to the video frame sequence number. In the parallel processing framework, the video stream data can be one channel of video stream data or multiple channels of video stream data. In addition, in this embodiment, the video stream data can be encoded and decoded based on one of the encoding protocols of h264, h265 or h266, and the present invention does not specifically limit this.
[0049] Exemplarily, in this embodiment, the video stream data is identified by the first device based on the h264 / h265 encoding protocol, and multiple video frame data corresponding to the specified packet header are obtained and stored. Each video frame data has a unique identification ID. The identification process can be implemented by the compression coding identification module in the first device. After the video stream data is identified, it is sent to the connected second device to complete the data push process.
[0050] S140: Control the second device to download the video stream data according to the identifier.
[0051] Specifically, in this embodiment, the video stream data can be downloaded according to the identifier by the download module of the second device. Exemplarily, the download module in the second device determines the video stream data to be downloaded based on the packet header of each video frame data, and downloads the video stream data corresponding to the packet header, thereby completing the download and pull process.
[0052] In this embodiment, since the download module in the second device, that is, the rendering end, downloads the video stream data according to the identifier to complete the download and streaming process, the separation of the connection channel and the data transmission channel is achieved. The device transmitting on the same screen can switch the second device at will (for example, switching the real-time same-screen content from a computer to a large-screen TV). Even if the operating systems between the second devices are different, the problem of changing the rendering end can be achieved without the user having to re-initiate the screen recording function.
[0053] S150: The second device renders the downloaded video stream data and displays it on a screen.
[0054] Among them, rendering the video stream data can be understood as the process of generating video digital data into an image file. When the second device, such as a large-screen TV, obtains the downloaded video stream data, it renders the video stream data into an image through the rendering module and displays it on the display screen.
[0055] The technical solution of this embodiment is to establish a connection channel between the first device and the second device according to a preset same-screen instruction, control the collection of the current screen data of the first device to generate video stream data, identify and store the collected video stream data and send the corresponding identifier to the second device, control the second device to download the video stream data according to the identifier, and the second device decodes and renders the downloaded video stream data and displays it on the screen. By establishing a connection channel in advance between the devices that need to be displayed on the same screen, the identifier generated by the collected video stream data is transmitted to the rendering end, and the rendering end completes the download and streaming process by downloading. The device that can achieve same-screen transmission can switch the rendering device at will to achieve the purpose of changing the rendering device without the user having to re-initiate screen recording, thereby simplifying the user's interactive process.
[0056] Based on the above embodiment, controlling the collection of the current screen data of the first device to generate video stream data includes: calling the screenshot system of the first device to collect the current screen data to generate video stream data; wherein the screenshot system includes one or more specified encoding formats and bit rates.
[0057] Specifically, the screenshot system is a screen recording capability in the underlying operating system of the same-screen display system. Its principle is to draw the video data refreshed to the screen on the first device in real time on the virtual display, and perform operations such as sampling and quantization on the data on the current screen through the virtual display, and finally convert the video signal into digital data to generate video stream data.
[0058] It is understood that the screenshot system includes one or more specified encoding formats and bitrates. The encoding format is the video file itself, consisting of audio and video components. The bitrate is a direct factor in determining video clarity; a higher bitrate means higher clarity. Video encoding formats may include Xvid, AVC / h264, MPEG1, MPEG2, and the audio encoding formats may include MP3, AAC, and the like, and this embodiment does not specifically limit these.
[0059] Example 2
[0060] Figure 2 A flowchart of another same-screen display method provided by an embodiment of the present invention. This embodiment is a further refinement of the above technical solution and is applicable to the case where same-screen display is achieved between different operating systems. The method can be executed by a same-screen display device and includes steps S210-S250:
[0061] S210: Establish a connection channel between the first device and the second device according to a preset same-screen instruction.
[0062] S220: Control the collection of current screen data of the first device to generate video stream data.
[0063] S230: The first device buffers the video stream data into a storage area using an inter-process communication method; identifies the video stream data in the storage area, and sends the identification to the second device through a pre-established connection channel.
[0064] It should be noted that inter-process communication can be understood as the transmission or exchange of information between different processes. In practical applications, inter-process communication methods may include pipes, message queues, semaphores, shared memory, sockets, etc., which are not specifically limited in the present invention. Video stream data is buffered in a storage area in data blocks, generally in binary form.
[0065] Exemplarily, after the first device captures the video stream data, it uses a pipe communication method to buffer the video stream data into a storage area corresponding to the first device. At this point, the compression coding module in the first device compresses and codes the video stream data in the storage area based on the h264 / h265 coding protocol, and stores the compression coding code to obtain corresponding multiple video frames. The video frame data includes a header with a specified ID, which facilitates the rendering end to download the video stream data based on the ID. Finally, this ID is sent to the second device through the pre-established connection channel via the connection module to notify the second device to complete the download decoding process.
[0066] On the basis of the above embodiment, the video stream data in the storage area is identified, including: converting the video stream data in the storage area into network unit frame data, and identifying the video stream data through the network unit frame data.
[0067] In actual situations, video stream data is prone to packet loss during data transmission, resulting in the loss of key frames. In this embodiment, before transmitting the identifier to the second device, the conversion module in the first device is used to convert the video stream data in the storage area into network unit frame data suitable for Internet transmission, ensuring the reliability of data transmission and avoiding the downloaded key frames from being discarded, resulting in a screen distortion phenomenon. Furthermore, by identifying the video stream data through the network unit frame data, the video stream data can be effectively compressed and encoded, allowing the remote second device to process the video key frames, thereby improving the display quality of the rendering end.
[0068] S240. The second device downloads the identifier and the network unit frame data through the downloading unit, and sends the downloaded network unit frame data to the decoding unit; the decoding unit decodes the received network unit frame data and generates video stream data.
[0069] Among them, the decoding unit is responsible for re-decoding the network unit frame data into a video stream data format that can be recognized by the drawing system, such as YUV or RGBA, which can be recognized by the operating system, providing necessary support for the subsequent rendering and drawing process.
[0070] Specifically, since the packet header in each video frame data includes a specified identification ID, the download unit in the second device can specify the download of the identification according to the packet header information in the video frame data, and send the identification to the decoding unit. The decoding unit decodes the network unit frame data into a video stream data format that can be recognized by the drawing system, and finally generates the video stream data collected by the first device, thereby completing the download decoding process.
[0071] S250: The second device renders the downloaded video stream data and displays it on a screen.
[0072] Specifically, rendering video stream data can be understood as the process of generating video digital data into an image file. When the second device, such as a large-screen TV, obtains the downloaded video stream data, it renders the video stream data into an image through a rendering module and displays it on the display screen.
[0073] Based on the above embodiment, the second device renders the downloaded video stream data and displays it on the screen, including: the second device applies for a drawing area through a rendering unit, renders the video stream data in the drawing area, and displays it on the screen.
[0074] Specifically, rendering the video stream data can be considered the final step in the same-screen display process, used to output the video digital data as an image file for display. The drawing area is equivalent to the display area of the screen. The middle area, upper area, lower area, or the entire area of the screen can be selected for display. This embodiment does not specifically limit the selection of the drawing area. For example, the second device uses its own rendering unit to display the parsed video stream data directly above the display screen.
[0075] The technical solution of this embodiment is to establish a connection channel in advance between the first device and the second device that need to display on the same screen according to the preset same-screen instruction, identify the video stream data collected in the storage area of the first device, and send the identifier to the second device through the connection channel. The download module of the second device downloads the corresponding identifier, and decodes the downloaded identifier to generate video stream data, thereby completing the process of data push and download. By separating the connection channel and the data transmission channel, the device transmitting on the same screen can switch the rendering device at will. Even if the operating systems of the rendering devices are different, the purpose of changing the rendering device can be achieved without the user having to re-initiate the screen recording function, thereby simplifying the user's interactive process.
[0076] Example 3
[0077] Figure 3 This is a structural block diagram of a same-screen display device provided in an embodiment of the present invention. The same-screen display device can be applied to the same-screen display situation between same-screen display systems, wherein the device can be implemented by software and / or hardware and is generally integrated on the same-screen display system.
[0078] like Figure 3 As shown, the device includes: a connection module 31, a collection module 32, an identification module 33, a download module 34 and a rendering module 35;
[0079] The connection module 31 is configured to establish a connection channel between the first device and the second device according to a preset same-screen instruction;
[0080] The acquisition module 32 is used to control the acquisition of the current screen data of the first device to generate video stream data;
[0081] An identification module 33 is configured to identify and store the collected video stream data and send the corresponding identification to the second device;
[0082] A download module 34, configured to control the second device to download the video stream data according to the identifier;
[0083] The rendering module 35 is used for the second device to render the downloaded video stream data and display it on the screen.
[0084] The technical solution of this embodiment is to establish a connection channel between the first device and the second device according to a preset same-screen instruction, control the collection of the current screen data of the first device to generate video stream data, identify and store the collected video stream data and send the corresponding identifier to the second device, control the second device to download the video stream data according to the identifier, and the second device renders the downloaded video stream data and displays it on the screen. By establishing a connection channel in advance between the devices that need to be displayed on the same screen, the identifier generated by the collected video stream data is transmitted to the rendering end, and the rendering end completes the download and pull process by downloading. The device that can achieve same-screen transmission can switch the rendering device at will, thereby achieving the purpose of changing the rendering device, without the user having to re-initiate screen recording, thereby simplifying the user's interactive process.
[0085] Based on the above embodiment, the acquisition module 32 is specifically used for:
[0086] The screenshot system of the first device is called to collect current screen data to generate video stream data; wherein the screenshot system includes one or more specified encoding formats and bit rates.
[0087] Based on the above embodiment, the identification module 33 includes:
[0088] A data buffer unit, configured for the first device to buffer the video stream data into a storage area using an inter-process communication method;
[0089] The data identification unit is used to identify the video stream data in the storage area and send the identification to the second device through a pre-established connection channel.
[0090] Based on the above embodiment, the data identification unit is specifically used for:
[0091] The video stream data in the storage area is converted into network unit frame data, and the video stream data is identified by the network unit frame data.
[0092] Based on the above embodiment, the download module 34 is specifically used for:
[0093] The second device downloads the identifier and the network unit frame data through the downloading unit, and sends the downloaded network unit frame data to the decoding unit;
[0094] The decoding unit decodes the received network unit frame data and generates video stream data.
[0095] Based on the above embodiment, the download module 34 is further used to:
[0096] The video stream data format is an image format supported by the window system of the operating system, including YUV format and RGBA format.
[0097] Based on the above embodiment, the rendering module 35 is specifically used for:
[0098] The second device applies for a drawing area through a rendering unit, renders the video stream data in the drawing area, and displays it on the screen.
[0099] The same-screen display device provided in an embodiment of the present invention can execute the same-screen display method provided in any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution method.
[0100] Example 4
[0101] Figure 4 This is a hardware structure diagram of a same-screen display system provided by an embodiment of the present invention. Figure 4 As shown, the same-screen display system provided by the fourth embodiment of the present invention includes: one or more processors 41 and a storage device 42; the processor 41 in the same-screen display system can be one or more, Figure 4 A processor 41 is taken as an example; the storage device 42 is used to store one or more programs; the one or more programs are executed by one or more processors 41, so that one or more processors 41 implement the same-screen display method as any one of the embodiments of the present invention.
[0102] The same-screen display system may further include: an input device 43 and an output device 44 .
[0103] The processor 41, storage device 42, input device 43 and output device 44 in the same screen display system can be connected via a bus or other means. Figure 4 The bus connection is taken as an example.
[0104] The storage device 42 in the same-screen display system is a computer-readable storage medium that can be used to store one or more programs. The program can be a software program, a computer executable program, and a module, such as the program instructions / modules corresponding to the same-screen display method provided in the first embodiment of the present invention (for example, the attached Figure 3 The modules in the same-screen display device shown include: a connection module 31, an acquisition module 32, an identification module 33, a download module 34, and a rendering module 35. The processor 41 executes the software programs, instructions, and modules stored in the storage device 42 to perform various functional applications and data processing of the same-screen display system, that is, to implement the same-screen display method in the above method embodiment.
[0105] The storage device 42 may include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function; the data storage area may store data created based on the use of the same-screen display system, etc. In addition, the storage device 42 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state memory device. In some examples, the storage device 42 may further include a memory remotely located relative to the processor 41, and these remote memories may be connected to the device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0106] The input device 43 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the same-screen display system. The output device 44 may include a display device such as a display screen.
[0107] Furthermore, when one or more programs included in the above-mentioned same-screen display system are executed by one or more processors 41, the programs perform the following operations:
[0108] A connection channel is established between the first device and the second device according to the preset same-screen instruction; the current screen data of the first device is controlled to be collected to generate video stream data; the collected video stream data is marked and stored and the corresponding mark is sent to the second device; the second device is controlled to download the video stream data according to the mark; the second device renders the downloaded video stream data and displays it on the screen.
[0109] Example 5
[0110] Embodiment 5 of the present invention further provides a storage medium containing computer-executable instructions. When the computer-executable instructions are executed by a computer processor, they are used to perform a same-screen display method. The method includes:
[0111] Establishing a connection channel between the first device and the second device according to a preset screen sharing instruction;
[0112] Controlling the collection of current screen data of the first device to generate video stream data;
[0113] The collected video stream data is marked and stored and the corresponding mark is sent to the second device;
[0114] controlling the second device to download the video stream data according to the identifier;
[0115] The second device renders the downloaded video stream data and displays it on a screen.
[0116] Of course, the storage medium containing computer-executable instructions provided in an embodiment of the present invention is not limited to the above method operations, and can also execute related operations in the same-screen display method provided in any embodiment of the present invention.
[0117] Through the above description of the implementation methods, those skilled in the art can clearly understand that the present invention can be implemented with the help of software and necessary general-purpose hardware, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as a computer floppy disk, read-only memory (ROM), random access memory (RAM), flash memory (FLASH), hard disk or optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods of various embodiments of the present invention.
[0118] It is worth noting that in the embodiment of the above-mentioned search device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.
[0119] Note that the above are only preferred embodiments of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments, and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments and may include many other equivalent embodiments without departing from the concept of the present invention. The scope of the present invention is determined by the scope of the appended claims.
Claims
1. A same-screen display method, characterized in that: include: Establishing a connection channel between the first device and the second device according to a preset screen sharing instruction; Controlling the collection of current screen data of the first device to generate video stream data; Marking and storing the collected video stream data, and sending the corresponding identification to the second device; controlling the second device to download the video stream data according to the identifier; The second device renders the downloaded video stream data and displays it on a screen; The step of marking and storing the collected video stream data, and sending the corresponding mark to the second device includes: The first device buffers the video stream data into a storage area using an inter-process communication method; Identifying the video stream data in the storage area, obtaining and storing a plurality of video frame data corresponding to the specified packet header, each video frame data having a unique identification ID; and sending the identification to the second device through a pre-established connection channel; The step of marking the video stream data in the storage area includes: The video stream data in the storage area is converted into network unit frame data, and the video stream data is identified by the network unit frame data.
2. The same-screen display method according to claim 1, wherein: The controlling the collection of current screen data of the first device to generate video stream data includes: The screen capture system of the first device is called to collect current screen data to generate the video stream data; wherein the screen capture system includes one or more specified encoding formats and bit rates.
3. The same-screen display method according to claim 1, wherein: The controlling the second device to download the video stream data according to the identifier includes: The second device downloads the identifier and the network unit frame data through a downloading unit, and sends the downloaded network unit frame data to a decoding unit; The decoding unit decodes the received network unit frame data and generates the video stream data.
4. The same-screen display method according to claim 3, wherein: The video stream data format is an image format supported by the window system of the operating system, including YUV format and RGBA format.
5. The same-screen display method according to claim 1, wherein: The second device renders the downloaded video stream data and displays it on a screen, including: The second device applies for a drawing area through a rendering unit, renders the video stream data in the drawing area, and displays the data on a screen.
6. A same-screen display device, characterized in that: include: A connection module, configured to establish a connection channel between the first device and the second device according to a preset same-screen instruction; an acquisition module, configured to control the acquisition of current screen data of the first device to generate video stream data; an identification module, configured to identify and store the collected video stream data and send the corresponding identification to the second device; a downloading module, configured to control the second device to download the video stream data according to the identifier; a rendering module, configured for the second device to render the downloaded video stream data and display it on a screen; The identification module includes: A data buffer unit, configured for the first device to buffer the video stream data into a storage area using an inter-process communication method; A data identification unit is used to identify the video stream data in the storage area, obtain and store a plurality of video frame data corresponding to the specified packet header, each video frame data having a unique identification ID; and send the identification to the second device through a pre-established connection channel; The data identification unit is specifically used for: The video stream data in the storage area is converted into network unit frame data, and the video stream data is identified by the network unit frame data.
7. A same-screen display system, characterized in that: The same-screen display system includes: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the same-screen display method as described in any one of claims 1-5.
8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the same-screen display method as described in any one of claims 1 to 5 is implemented.
Citation Information
Patent Citations
DLNA technology-based screen push implementation method and system
CN105791351A
Mirror image screen projection method, display device and terminal
CN114286137A