Screen projection method, screen projection device, playing device, screen projection system and storage medium

Abstract

This invention discloses a screen casting method, a screen casting device, a playback device, a screen casting system, and a storage medium. The method for the screen casting device, in response to a screen casting command, copies the first frame data from the screen casting frame data to obtain start frame data, and transmits the start frame data and screen casting frame data to the target playback device, ensuring the target playback device receives the required number of frames to perform decoding, thereby playing the screen casting frame data. The method for the playback device, in response to a playback command, decodes and plays screen casting frame data sent by a preset screen casting device, and generates start frame data for screen casting frame data sent by a non-preset screen casting device, and decodes and plays the screen casting frame data. This invention, by transmitting start frame data to the playback device or generating start frame data itself, ensures the playback device receives the required number of frames to perform decoding when decoding the screen casting frame data, thus improving the speed of screen casting and enhancing the user's screen casting experience.

Description

Technical Field

[0001] This invention relates to the field of screen projection technology, and in particular to a screen projection method, screen projection device, playback device, screen projection system, and storage medium. Background Technology

[0002] Currently, screen mirroring functionality is widely used in users' daily lives. Wireless screen mirroring technology enables users to project the screen from one device to another in real time, allowing them to view the same content on different devices.

[0003] However, the screen projection data from the playback device originates from the screen data of the projection device itself. When the projection device projects its screen, the initial amount of screen data is too small, resulting in insufficient data received by the playback device to meet the decoder's requirements. This causes a prolonged black screen and slow image output during the initial projection display. Therefore, improving the projection speed to enhance the user experience is a pressing technical problem that needs to be solved.

[0004] The above content is only used to help understand the technical solution of the present invention and does not represent an admission that the above content is prior art. Summary of the Invention

[0005] The main objective of this invention is to provide a screen projection method, screen projection device, playback device, screen projection system, and storage medium, aiming to solve the technical problems of a long black screen and slow image output speed during the initial screen projection display.

[0006] To achieve the above objectives, the present invention provides a screen projection method for a screen projection device, the method comprising the following steps:

[0007] In response to a screen mirroring command, obtain the identifier of the target playback device corresponding to the screen mirroring command;

[0008] Based on the identifier, copy the first frame data of the screen projection frame data to obtain the startup frame data of the target playback device corresponding to the identifier;

[0009] The start frame data and the projection frame data are sent sequentially to the target playback device so that the target playback device can meet the number of frames required to perform the decoding action when decoding the projection frame data, and play the decoded projection frame data.

[0010] Optionally, the step of copying the first frame of the projection frame data based on the identifier to obtain the startup frame data of the target playback device corresponding to the identifier specifically includes:

[0011] Based on the identifier, the decoding start standard of the target playback device corresponding to the identifier is obtained; wherein, the decoding start standard is the number of frames required for the target playback device to perform the decoding action;

[0012] Copy the first frame of the screen projection frame data to obtain the startup frame data; wherein, the startup frame data is the first frame data whose frame number meets the decoding startup standard.

[0013] Optionally, before the step of copying the first frame data of the projection frame data based on the identifier to obtain the startup frame data of the target playback device corresponding to the identifier, the method further includes:

[0014] Determine whether the target playback device corresponding to the identifier is a preset playback device;

[0015] If so, the screen projection frame data is sent directly to the target playback device, so that the target playback device can obtain the start frame data based on the first frame data of the screen projection frame data, and decode and play the screen projection frame data;

[0016] If not, execute the step of copying the first frame data of the projection frame data based on the identifier to obtain the startup frame data of the target playback device corresponding to the identifier.

[0017] To achieve the above objectives, the present invention also provides a screen projection method for a playback device, the method comprising the following steps:

[0018] In response to a playback command, obtain the identifier of the target projection device corresponding to the playback command;

[0019] Based on the identifier, determine whether the target projection device is a preset projection device;

[0020] If so, upon receiving the start frame data and projection frame data sent by the target projection device, the projection frame data is decoded and played.

[0021] If not, upon receiving the screen projection frame data sent by the target screen projection device, the first frame of the screen projection frame data is copied to obtain the startup frame data, and the startup frame data and the screen projection frame data are decoded and played; wherein, the startup frame data is the first frame data whose frame number meets the decoding startup standard.

[0022] Optionally, before the step of obtaining the identifier of the target projection device corresponding to the playback command in response to the playback command, the method includes:

[0023] Acquire test frame data; wherein, the test frame data is pre-stored frame data;

[0024] Decoding tests are performed using the test frame data to obtain the decoding start standard of the playback device; wherein, the decoding start standard is the number of frames required for the playback device to perform the decoding action.

[0025] Furthermore, to achieve the above objectives, the present invention also provides a screen projection device, the screen projection device comprising:

[0026] The first acquisition module is used to acquire the identifier of the target playback device corresponding to the screen casting command in response to the screen casting command;

[0027] The copying module is used to copy the first frame data of the screen projection frame data based on the identifier, and obtain the start frame data of the target playback device corresponding to the identifier.

[0028] The sending module is used to sequentially send the start frame data and the projection frame data to the target playback device, so that the target playback device can meet the number of frames required to perform the decoding action when decoding the projection frame data, and play the decoded projection frame data.

[0029] Optionally, the copying module is further configured to obtain the decoding start standard of the target playback device corresponding to the identifier based on the identifier; wherein the decoding start standard is the number of frames required for the target playback device to perform the decoding action; and copy the first frame data of the screen projection frame data to obtain the start frame data; wherein the start frame data is the first frame data whose frame number meets the decoding start standard.

[0030] Optionally, the screen projection device further includes a judgment module, which is used to determine whether the target playback device corresponding to the identifier is a preset playback device; if so, the screen projection frame data is directly sent to the target playback device so that the target playback device obtains the start frame data based on the first frame data of the screen projection frame data, and decodes and plays the screen projection frame data; if not, based on the identifier, the first frame data of the screen projection frame data is copied to obtain the start frame data of the target playback device corresponding to the identifier.

[0031] Furthermore, to achieve the above objectives, the present invention also provides a playback device, the playback device comprising:

[0032] The second acquisition module is used to acquire the identifier of the target projection device corresponding to the playback command in response to the playback command;

[0033] The decoding and playback module is used to determine whether the target projection device is a preset projection device based on the identifier; if so, upon receiving the start frame data and projection frame data sent by the target projection device, the module decodes and plays the projection frame data; if not, upon receiving the projection frame data sent by the target projection device, the module copies the first frame data of the projection frame data to obtain the start frame data, and decodes and plays the projection frame data; wherein, the start frame data is the first frame data whose frame number meets the decoding start standard.

[0034] Optionally, the playback device further includes a testing module, which is further used to acquire test frame data; wherein the test frame data is pre-stored frame data; and to perform decoding tests using the test frame data to obtain the decoding start standard of the playback device; wherein the decoding start standard is the number of frames required for the playback device to perform decoding actions.

[0035] Furthermore, to achieve the above objectives, the present invention also provides a screen projection system, the screen projection system comprising:

[0036] At least one screen mirroring device as described above;

[0037] At least one playback device as described above; wherein the projection device and the playback device transmit frame data on the same network.

[0038] In addition, to achieve the above objectives, the present invention also provides a storage medium storing a screen casting program, which, when executed by a processor, implements the steps of the screen casting method for a screen casting device as described above.

[0039] In addition, to achieve the above objectives, the present invention also provides a storage medium storing a screen casting program, which, when executed by a processor, implements the steps of the screen casting method for a playback device as described above.

[0040] This invention proposes a screen mirroring method, screen mirroring device, playback device, screen mirroring system, and storage medium. The method for the screen mirroring device, in response to a screen mirroring command, copies the first frame data from the screen mirroring frame data to obtain start frame data, and transmits the start frame data and screen mirroring frame data to the target playback device. This ensures that the target playback device meets the frame count required for decoding, thereby playing the screen mirroring frame data. The method for the playback device, in response to a playback command, decodes and plays screen mirroring frame data sent by a preset screen mirroring device. For screen mirroring frame data sent by a non-preset screen mirroring device, it generates start frame data and decodes and plays the screen mirroring frame data. This invention improves the speed of screen mirroring and enhances the user's screen mirroring experience by transmitting start frame data to the playback device or generating start frame data itself, ensuring that the playback device meets the frame count required for decoding the screen mirroring frame data. Attached Figure Description

[0041] Figure 1 This is a schematic diagram of the screen projection system in an embodiment of the present invention.

[0042] Figure 2 This is a schematic diagram of the projection device and playback device in an embodiment of the present invention.

[0043] Figure 3This is a flowchart illustrating the first embodiment of the screen projection method of the present invention.

[0044] Figure 4 This is a flowchart illustrating the second embodiment of the screen projection method of the present invention.

[0045] Figure 5 This is a structural block diagram of the screen projection device in an embodiment of the present invention.

[0046] Figure 6 This is a structural block diagram of the playback device in an embodiment of the present invention.

[0047] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0048] It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0049] Currently, screen mirroring is widely used in users' daily lives. Wireless screen mirroring technology allows the screen of a projection device to be projected onto a playback device in real time, making it convenient for users to view the same content displayed on different devices. However, the projection data from the playback device comes from the projection device's screen data. When the projection device initiates projection, the initial amount of screen data is often too small, resulting in insufficient data received by the playback device to meet the decoder's requirements. This causes a prolonged black screen and slow image output during the initial projection display. Therefore, improving the projection speed to enhance the user experience is a pressing technical problem that needs to be solved.

[0050] To address this issue, various embodiments of the screen casting method of this invention are proposed. The screen casting method provided by this invention transmits start-up frame data to the playback device or generates start-up frame data itself, ensuring that the playback device receives the required number of frames for decoding the screen casting frame data, thereby improving the speed of screen casting and enhancing the user's screen casting experience.

[0051] This invention provides a screen projection system, referring to... Figure 1 , Figure 1 This is a schematic diagram of the screen projection system of the present invention.

[0052] In this embodiment, the screen projection system includes:

[0053] At least one screen projection device 100 is configured to, in response to a screen projection command, obtain the identifier of the target playback device corresponding to the screen projection command; based on the identifier, copy the first frame data of the screen projection frame data to obtain the start frame data of the target playback device corresponding to the identifier; and sequentially send the start frame data and the screen projection frame data to the target playback device so that the target playback device, when decoding the screen projection frame data, meets the number of frames required to perform the decoding action and plays the decoded screen projection frame data.

[0054] At least one playback device 200 is configured to, in response to a playback command, obtain the identifier of the target projection device corresponding to the playback command; determine, based on the identifier, whether the target projection device is a preset projection device; if so, upon receiving start frame data and projection frame data sent by the target projection device, decode and play the projection frame data; if not, upon receiving projection frame data sent by the target projection device, copy the first frame data of the projection frame data to obtain start frame data, and decode and play the projection frame data; wherein, the start frame data is the first frame data whose frame number meets the decoding start standard.

[0055] It should be noted that the projection device and the playback device transmit frame data on the same network.

[0056] Figure 2 This is a schematic diagram of the screen projection device and playback device involved in the embodiments of the present invention.

[0057] Screen mirroring devices and playback devices can be user equipment (UE) such as mobile phones, smartphones, laptops, digital broadcast receivers, personal digital assistants (PDAs), and tablet computers (PADs), handheld devices, in-vehicle devices, wearable devices, computing devices or other processing devices connected to a wireless modem, and mobile stations (MS); playback devices can also be televisions. Screen mirroring devices and playback devices may be referred to as user terminals, portable terminals, desktop terminals, etc.

[0058] Typically, the screen mirroring device and playback device include: at least one processor 301, a memory 302, and a screen mirroring program stored on the memory and executable on the processor, the screen mirroring program being configured to implement the steps of the screen mirroring method as described above.

[0059] Processor 301 may include one or more processing cores, such as a quad-core processor or an octa-core processor. Processor 301 may be implemented using at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), or PLA (Programmable Logic Array). Processor 301 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 301 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. Processor 301 may also include an AI (Artificial Intelligence) processor, which handles screen projection operations, enabling the screen projection model to train and learn autonomously, improving efficiency and accuracy.

[0060] The memory 302 may include one or more computer-readable storage media, which may be non-transitory. The memory 302 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 302 are used to store at least one instruction, which is executed by the processor 801 to implement the screen projection method provided in the method embodiments of this application.

[0061] In some embodiments, the terminal may also optionally include a communication interface 303 and at least one peripheral device. The processor 301, memory 302, and communication interface 303 can be connected via a bus or signal line. Each peripheral device can be connected to the communication interface 303 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of a radio frequency circuit 304, a display screen 305, and a power supply 306.

[0062] The communication interface 303 can be used to connect at least one I / O (Input / Output) related peripheral device to the processor 301 and the memory 302. The communication interface 303 is used to receive movement trajectories and other data uploaded by the user from multiple mobile terminals via the peripheral device. In some embodiments, the processor 301, memory 302, and communication interface 303 are integrated on the same chip or circuit board; in other embodiments, any one or two of the processor 301, memory 302, and communication interface 303 can be implemented on separate chips or circuit boards, and this embodiment is not limited to this.

[0063] The radio frequency (RF) circuit 304 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 304 communicates with communication networks and other communication devices via electromagnetic signals, thereby acquiring the movement trajectories and other data of multiple mobile terminals. The RF circuit 304 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 304 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 304 can communicate with other terminals through at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: metropolitan area networks (MANs), various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks (WLANs), and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 304 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.

[0064] Display screen 305 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 305 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 301 for processing. In this case, display screen 305 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, display screen 305 can be a single screen, the front panel of an electronic device; in other embodiments, display screen 305 can be at least two screens, respectively disposed on different surfaces of the electronic device or in a folded design; in still other embodiments, display screen 305 can be a flexible display screen, disposed on a curved or folded surface of the electronic device. Furthermore, display screen 305 can also be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. Display screen 305 can be made of materials such as LCD (Liquid Crystal Display) or OLED (Organic Light-Emitting Diode).

[0065] Power supply 306 is used to supply power to various components in an electronic device. Power supply 306 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power supply 306 includes a rechargeable battery, the rechargeable battery can support wired or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0066] Those skilled in the art will understand that Figure 1 The structure shown does not constitute a limitation on the projection and playback devices, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0067] This invention provides a screen mirroring method for screen mirroring devices, referring to... Figure 3 , Figure 3 This is a flowchart illustrating the first embodiment of the screen projection method of the present invention.

[0068] In this embodiment, the screen projection method is used on a screen projection device, and the screen projection method includes the following steps:

[0069] Step S100: In response to the screen casting command, obtain the identifier of the target playback device corresponding to the screen casting command.

[0070] Specifically, the screen projection method is executed on a screen projection device, which is a user terminal, portable terminal, or desktop terminal used to send screen projection data to a playback device so that the playback device can project the corresponding screen according to the screen projection data. The screen projection device can be a mobile phone, smartphone, laptop, digital broadcast receiver, personal digital assistant (PDA), tablet computer (PAD), or other user equipment (UE), handheld device, in-vehicle device, wearable device, computing device, or other processing device connected to a wireless modem, or a mobile station (MS). The screen projection command can be an operation command transmitted by the user to the screen projection device, including operation commands from the screen projection device itself and / or operation commands generated by a remote device. The screen projection command can also be a trigger command from the screen projection device when preset conditions are met; this embodiment does not limit this.

[0071] As is easily understood, during screen mirroring, the mirroring device, upon receiving the mirroring command, transmits the mirroring frame data to a playback device connected to the same network, and then uses the playback device for screen mirroring and playback. However, the decoder in the playback device, used to decode the received mirroring frame data, has a requirement for the amount of data it can decode. When the amount of mirroring data received by the playback device cannot meet the decoder's requirements, it will not perform the decoding action, resulting in a relatively long period of black screen on the playback device during the initial screen mirroring display, and a slow image loading speed.

[0072] In this embodiment, in response to the screen casting command, the screen casting device first obtains the identifier of the target playback device corresponding to the screen casting command. The screen casting device can use the identifier to know the type of the target playback device currently playing the screen casting frame data, and can obtain the number of decoding frames required for the target playback device to perform the decoding action according to the type of the playback device. Then, it generates start frame data according to the number of decoding frames required to perform the decoding action, thereby meeting the decoding frame number requirements of the target playback device.

[0073] Step S200: Based on the identifier, copy the first frame data of the projection frame data to obtain the start frame data of the target playback device corresponding to the identifier.

[0074] It's easy to understand that during screen mirroring, due to the encoder characteristics of the screen mirroring device, when the screen image on the screen mirroring device does not change, the encoder of the screen mirroring device will not generate the corresponding encoded data. Consequently, the decoder of the playback device does not receive enough encoded data, so the decoder will not perform the decoding action, resulting in the playback device being unable to play the corresponding screen mirrored image.

[0075] In this embodiment, in order to compensate for the insufficient amount of decoding data of the decoder at the initial screen projection display of the playback device, the screen projection frame data is copied to obtain the start frame data. When copying the first frame data in the screen projection frame data, the obtained start frame data is the first frame data that can meet the requirements of the encoder to perform the decoding action.

[0076] Specifically, based on the acquired identifier, the decoding start standard of the target playback device corresponding to the identifier is obtained. The decoding start standard is the number of frames required for the target playback device to perform the decoding action. According to the decoding start standard, the first frame of the projection frame data is copied to obtain the start frame data. Then, when the start frame data is sent to the playback device, the target playback device can perform the decoding action.

[0077] In some embodiments, if the playback device already has a startup frame data generation step, that is, after receiving frame data, the playback device will automatically generate startup frame data for starting the decoder to perform decoding actions; in this case, if the projection frame data is copied again at the projection device to obtain the startup frame data, it will waste unnecessary system resources. Therefore, before copying the first frame data in the projection frame data to obtain the startup frame data, it is necessary to determine whether the target playback device is a preset playback device; wherein, the preset playback device is a preset playback device that can automatically generate startup frame data.

[0078] Specifically, after obtaining the identifier of the target playback device corresponding to the screen casting command, it can be determined whether the target playback device corresponding to the identifier is a preset playback device. If so, the screen casting frame data is sent directly to the target playback device so that the target playback device can obtain the start frame data based on the first frame data of the screen casting frame data and decode and play the screen casting frame data. If not, based on the identifier, the first frame data of the screen casting frame data is copied to obtain the start frame data of the target playback device corresponding to the identifier.

[0079] In simple terms, if the playback device is the default playback device (i.e., it already has the function of generating startup frame data), then the screen mirroring device only needs to transmit the screen mirroring frame data to the playback device. The playback device then directly decodes and plays the acquired screen mirroring frame data. Because the playback device already has the startup frame data generation step, it will automatically copy the first frame data of the screen mirroring frame data after receiving it to obtain the startup frame data used before playing the screen mirroring frame data. If the playback device is not the default playback device (i.e., it does not have the function of generating startup frame data), then the screen mirroring device needs to copy the first frame data in the screen mirroring frame data when it receives the screen mirroring command to obtain the startup frame data used by the playback device for decoding, thus realizing the screen mirroring process.

[0080] Step S300: The start frame data and the projection frame data are sent sequentially to the target playback device so that the target playback device can meet the number of frames required to perform the decoding action when decoding the projection frame data, and play the decoded projection frame data.

[0081] Specifically, after obtaining the start frame data, the projection device sequentially transmits the obtained start frame data and projection frame data to the target playback device. Then, when the target playback device decodes and plays the projection frame data, the decoded frame data can meet the frame count requirements for performing the decoding action.

[0082] For ease of understanding, this embodiment provides a detailed explanation of how the screen projection device sequentially transmits the obtained start frame data and screen projection frame data to the target playback device.

[0083] For target devices that are preset playback devices, the screen casting frame data is directly transmitted to the playback device so that the playback device can automatically generate start frame data based on the screen casting frame data and perform screen casting playback. At this time, the screen casting device only transmits the screen casting frame data. For target devices that are not preset playback devices, before transmitting the screen casting frame data to the playback device, the first frame data in the screen casting frame data is copied to obtain the start frame data used by the decoder to perform decoding actions.

[0084] The startup frame data is the first frame data that meets the decoding startup standard. The decoding startup standard is the number of frames pre-stored by the playback device that can meet the requirements of the target playback device to perform decoding actions. When the screen casting device generates a screen casting command, it can obtain the decoding startup standard of the target playback device, and then transmit the corresponding startup frame data to the playback device according to the decoding startup standard.

[0085] Furthermore, the decoding start standard can be set to a preset ratio of the encoder frame rate. For example, when the preset ratio is 1 / 2 and the encoder frame rate is 30, the decoding start standard is 15. The first frame of the screen projection data is copied to 15 frames, and the first frame of the 15 frames is sent to the playback device as the start frame data to realize decoding start and solve the problem of the playback device having a long black screen and slow screen output speed at the beginning of the screen projection display.

[0086] In this embodiment, upon receiving a screen casting command, the first frame data in the screen casting frame data is copied to obtain the startup frame data. The startup frame data is then transmitted to the target playback device so that the target playback device can play the startup frame data. By transmitting the startup frame data to the playback device, this embodiment ensures that the playback device receives the required number of frames to perform the decoding action when decoding the screen casting frame data, thereby improving the speed of screen casting and enhancing the user's screen casting experience.

[0087] For ease of understanding, please refer to Figure 4 , Figure 4 This is a flowchart illustrating a second embodiment of the screen projection method of the present invention. Based on... Figure 3 The first embodiment of the screen mirroring method shown in this embodiment provides a screen mirroring method for a playback device.

[0088] In this embodiment, the screen casting method is used for a playback device, and the screen casting method includes the following steps:

[0089] Step S400: In response to the playback command, obtain the identifier of the target projection device corresponding to the playback command.

[0090] Specifically, the screen projection method is executed on a playback device, which is a user terminal, portable terminal, or desktop terminal used to receive screen projection data sent by the screen projection device and play the screen corresponding to the screen projection data. The screen projection device can be a user equipment (UE) such as a mobile phone, smartphone, laptop, digital broadcast receiver, personal digital assistant (PDA), tablet computer (PAD), or television, as well as a handheld device, in-vehicle device, wearable device, computing device, or other processing device connected to a wireless modem, or a mobile station (MS). The playback instruction is an instruction generated by the playback device when it detects the screen projection action of the screen projection device.

[0091] It should be noted that, in this embodiment, in response to a playback command, the playback device first obtains the identifier of the target projection device corresponding to the playback command. The playback device can use this identifier to know the type of the target projection device currently performing the projection action, and can determine whether the target projection device is a preset projection device based on the type of the target projection device, and then perform different playback actions for different projection devices.

[0092] Step S500: Based on the identifier, determine whether the target projection device is a preset projection device.

[0093] Specifically, after obtaining the identifier of the target projection device corresponding to the playback command, the system determines whether the target projection device is a preset projection device based on the identifier. The preset projection device is a pre-stored projection device with decoder activation functionality.

[0094] Step S600: If yes, upon receiving the start frame data and projection frame data sent by the target projection device, decode and play the projection frame data.

[0095] Specifically, if the screen projection device is a screen projection device with decoder activation function, the data transmitted by the screen projection device is activation frame data and screen projection frame data. At this time, after receiving the activation frame data and screen projection frame data, the playback device decodes and plays the activation frame data and screen projection frame data in sequence, thereby realizing the playback of the screen projection frame data.

[0096] Step S700: If not, upon receiving the screen projection frame data sent by the target screen projection device, copy the first frame data of the screen projection frame data to obtain the start frame data, and decode and play the screen projection frame data; wherein, the start frame data is the first frame data whose frame number meets the decoding start standard.

[0097] Specifically, if the screen projection device does not have a decoder startup function, the data transmitted by the screen projection device is only screen projection frame data. In this case, after receiving the screen projection frame data, the playback device needs to process the screen projection frame data to obtain the startup frame data for decoder decoding, and then decode and play the startup frame data and screen projection frame data in sequence to achieve fast decoding and playback of the screen projection frame data.

[0098] In some embodiments, if the projection device is one without a decoder startup function, the playback device, after receiving the projection frame data, needs to copy the first frame of the projection frame data to obtain startup frame data that meets the decoding startup standard. The decoding startup standard is the number of frames required for the playback device to perform the decoding action. Therefore, before copying the first frame of the projection frame data, the decoding startup standard needs to be obtained in advance so that the amount of data in the startup frame data can quickly start the playback device's decoder and decode and play the projection frame data following the startup frame data.

[0099] Previously, the playback device needed to obtain the decoding start standard on its own, which is the number of frames required for the decoder to perform the decoding action.

[0100] It should be noted that when obtaining the decoding start standard on its own, the playback device first acquires test frame data, which is frame data pre-stored in the playback device. This test frame data is copied, and then the copied frame data is used for decoding playback test. The frame data that meets the decoding playback test conditions is used as the decoding start standard. This decoding playback test condition is the minimum frame data required to drive the decoder to perform decoding playback. At this time, the decoding start standard is the number of frames that the playback device copies from the first frame data after receiving the screen projection frame data.

[0101] For ease of understanding, this embodiment provides a detailed explanation of how to obtain the decoding start-up criteria that meet the playback test conditions using test frame data.

[0102] Before receiving the screen-casting frame data, the system first obtains the frame data pre-stored in the playback device, copies this frame data to obtain test frame data with two identical frames, and uses the test frame data to perform a playback test to determine whether the playback device's decoder can decode the data and play it. If it can play, the number of frames in the test frame data is the decoding start standard that meets the playback conditions. If it cannot play, the frame data is copied again to obtain test frame data with three identical frames, and the playback test is performed. This process of copying the frame data is repeated until a decoding start standard that can decode the data and play it is obtained.

[0103] As is easy to understand, the decoding start standard obtained before receiving the screen projection frame data is used to copy the first frame data in the screen projection frame data after receiving the screen projection frame data, and obtain the start frame data that meets the decoding start standard. At this time, the obtained start frame data enables the decoder to successfully decode the data and play it by the playback device.

[0104] It should be noted that after receiving the screen casting frame data, the playback device uses the first frame of the screen casting frame data to obtain the start frame data. After that, the playback device plays the start frame data and the screen casting frame data in sequence. By decoding and playing the start frame data before the screen casting frame data, the playback device makes up for the amount of data that the decoder fails to decode at the beginning of the screen casting display, thus improving the speed of screen casting output.

[0105] In this embodiment, by determining whether the target projection device is a preset projection device, if so, the received start frame data and projection frame data are decoded and played; if not, the start frame data is automatically generated based on the projection frame data, and then the start frame data and projection frame data are decoded and played. This allows the playback device to decode the start frame data before playing the projection frame data, thereby improving the speed of projection and enhancing the user's projection experience.

[0106] Reference Figure 5 , Figure 5 The present invention provides a structural block diagram of the projection device and presents embodiments thereof.

[0107] like Figure 5 As shown, the screen projection device proposed in this embodiment of the invention includes:

[0108] The first acquisition module 10 is used to acquire the identifier of the target playback device corresponding to the screen casting command in response to the screen casting command;

[0109] Copying module 20 is used to copy the first frame data of the projection frame data based on the identifier, and obtain the start frame data of the target playback device corresponding to the identifier;

[0110] The sending module 30 is used to send the start frame data and the projection frame data to the target playback device in sequence, so that the target playback device can meet the number of frames required to perform the decoding action when decoding the projection frame data, and play the decoded projection frame data.

[0111] In one implementation, the copying module 20 is further configured to obtain the decoding start standard of the target playback device corresponding to the identifier based on the identifier; wherein the decoding start standard is the number of frames required for the target playback device to perform decoding actions; and copy the first frame data of the screen projection frame data to obtain the start frame data; wherein the start frame data is the first frame data whose frame number meets the decoding start standard.

[0112] In one implementation, the screen projection device further includes a judgment module 40, which is used to determine whether the target playback device corresponding to the identifier is a preset playback device; if so, the screen projection frame data is directly sent to the target playback device so that the target playback device obtains the start frame data based on the first frame data of the screen projection frame data, and decodes and plays the screen projection frame data; if not, based on the identifier, the first frame data of the screen projection frame data is copied to obtain the start frame data of the target playback device corresponding to the identifier.

[0113] The screen casting device provided in this embodiment obtains the start frame data by copying the first frame data in the screen casting frame data when it receives the screen casting command, and transmits the start frame data to the target playback device so that the target playback device can play the start frame data. This embodiment improves the speed of screen casting and enhances the user's screen casting experience by transmitting the start frame data to the playback device so that the playback device can meet the number of frames required for the playback device to perform the decoding action when decoding the screen casting frame data.

[0114] Reference Figure 6 , Figure 6 The diagram below shows the structure of the playback device of the present invention. Based on the above-described screen projection device of the present invention, an embodiment of the playback device of the present invention is proposed.

[0115] like Figure 6 As shown, the playback device proposed in this embodiment of the invention includes:

[0116] The second acquisition module 50 is used to acquire the identifier of the target projection device corresponding to the playback command in response to the playback command;

[0117] The decoding and playback module 60 is used to determine whether the target projection device is a preset projection device based on the identifier; if so, upon receiving the start frame data and projection frame data sent by the target projection device, the module decodes and plays the projection frame data; if not, upon receiving the projection frame data sent by the target projection device, the module copies the first frame data of the projection frame data to obtain the start frame data, and decodes and plays the projection frame data; wherein, the start frame data is the first frame data whose frame number meets the decoding start standard.

[0118] In one embodiment, the playback device further includes a test module 70, which is used to acquire test frame data; wherein the test frame data is pre-stored frame data; and to perform decoding tests using the test frame data to obtain the decoding start standard of the playback device; wherein the decoding start standard is the number of frames required for the playback device to perform decoding actions.

[0119] The playback device provided in this embodiment determines whether the target projection device is a preset projection device. If it is, it decodes and plays the received start frame data and projection frame data. If not, it generates start frame data based on the projection frame data and then decodes and plays the start frame data and projection frame data. This allows the playback device to decode the start frame data before playing the projection frame data, thereby improving the speed of projection and enhancing the user's projection experience.

[0120] Other embodiments or specific implementations of the projection device and playback device of the present invention can be referred to the above-described method embodiments, and will not be repeated here.

[0121] Furthermore, embodiments of the present invention also propose a storage medium storing a screen mirroring program, which, when executed by a processor, implements the steps of the screen mirroring method described above. Therefore, further details will not be repeated here. Additionally, the beneficial effects of using the same method will not be repeated. For technical details not disclosed in the computer-readable storage medium embodiments of this application, please refer to the description of the method embodiments of this application. As an example, program instructions can be deployed to execute on a single computing device, or on multiple computing devices located in one location, or on multiple computing devices distributed across multiple locations and interconnected via a communication network.

[0122] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0123] It should also be noted that the device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Furthermore, in the accompanying drawings of the device embodiments provided by this invention, the connection relationships between modules indicate that they have communication connections, which can be specifically implemented as one or more communication buses or signal lines. Those skilled in the art can understand and implement this without any creative effort.

[0124] Through the above description of the embodiments, those skilled in the art can clearly understand that the present invention can be implemented by means of software plus necessary general-purpose hardware, and of course, it can also be implemented by special hardware including application-specific integrated circuits, special CPUs, special memory, special components, etc. Generally, any function performed by a computer program can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be diverse, such as analog circuits, digital circuits, or special-purpose circuits. However, for the present invention, software program implementation is more often the preferred implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a readable storage medium, such as a computer floppy disk, USB flash drive, portable hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

Claims

1. A screen projection method, characterized in that, For use with screen projection devices, the method includes the following steps: In response to a screen mirroring command, obtain the identifier of the target playback device corresponding to the screen mirroring command; Based on the identifier, copy the first frame data of the screen projection frame data to obtain the startup frame data of the target playback device corresponding to the identifier; The startup frame data and the projection frame data are sent sequentially to the target playback device so that the target playback device can meet the number of frames required to perform the decoding action when decoding the projection frame data, and play the decoded projection frame data. The step of copying the first frame data of the projection frame data based on the identifier to obtain the start frame data of the target playback device corresponding to the identifier specifically includes: Based on the identifier, the decoding start standard of the target playback device corresponding to the identifier is obtained; wherein, the decoding start standard is the number of frames required for the target playback device to perform the decoding action; Copy the first frame of the screen projection frame data to obtain the startup frame data; wherein, the startup frame data is the first frame data whose frame number meets the decoding startup standard; Before the step of copying the first frame data of the projection frame data based on the identifier to obtain the startup frame data of the target playback device corresponding to the identifier, the method further includes: Determine whether the target playback device corresponding to the identifier is a preset playback device; If so, the screen projection frame data is sent directly to the target playback device, so that the target playback device can obtain the start frame data based on the first frame data of the screen projection frame data, and decode and play the screen projection frame data; If not, execute the step of copying the first frame data of the projection frame data based on the identifier to obtain the startup frame data of the target playback device corresponding to the identifier.

2. A screen projection method, characterized in that, For use with a playback device, the method includes the following steps: In response to a playback command, obtain the identifier of the target projection device corresponding to the playback command; Based on the identifier, it is determined whether the target projection device is a preset projection device, wherein the preset projection device is a device that executes the projection method as described in claim 1; If so, upon receiving the start frame data and the projection frame data sent by the target projection device, the start frame data and the projection frame data are decoded and played sequentially. If not, upon receiving the screen projection frame data sent by the target screen projection device, copy the first frame data of the screen projection frame data to obtain the start frame data, and sequentially decode and play the start frame data and the screen projection frame data; wherein, the start frame data is the first frame data whose frame number meets the decoding start standard.

3. The screen projection method as described in claim 2, characterized in that, Before the step of obtaining the identifier of the target projection device corresponding to the playback command in response to the playback command, the method includes: Acquire test frame data; wherein, the test frame data is pre-stored frame data; Decoding tests are performed using the test frame data to obtain the decoding start standard of the playback device; wherein, the decoding start standard is the number of frames required for the playback device to perform the decoding action.

4. A screen projection device, characterized in that, The projection device includes: The first acquisition module is used to acquire the identifier of the target playback device corresponding to the screen casting command in response to the screen casting command; The copying module is used to copy the first frame data of the screen projection frame data based on the identifier, and obtain the start frame data of the target playback device corresponding to the identifier. The sending module is used to send the start frame data and the projection frame data to the target playback device in sequence, so that the target playback device can meet the number of frames required to perform the decoding action when decoding the projection frame data, and play the decoded projection frame data. The copying module is further configured to obtain, based on the identifier, the decoding start standard of the target playback device corresponding to the identifier; wherein, the decoding start standard is the number of frames required for the target playback device to perform decoding actions; and to copy the first frame data of the screen projection frame data to obtain the start frame data; wherein, the start frame data is the first frame data whose frame number meets the decoding start standard. The screen projection device further includes a judgment module, used to determine whether the target playback device corresponding to the identifier is a preset playback device; if so, the screen projection frame data is directly sent to the target playback device, so that the target playback device obtains the start frame data based on the first frame data of the screen projection frame data, and decodes and plays the screen projection frame data; if not, the operation of copying the first frame data of the screen projection frame data based on the identifier to obtain the start frame data of the target playback device corresponding to the identifier is executed.

5. A playback device, characterized in that, The playback device includes: The second acquisition module is used to acquire the identifier of the target projection device corresponding to the playback command in response to the playback command; The decoding and playback module is used to determine, based on the identifier, whether the target projection device is a preset projection device, wherein the preset projection device is a device that executes the projection method as described in claim 1; if yes, upon receiving the start frame data and projection frame data sent by the target projection device, the module sequentially decodes and plays the start frame data and the projection frame data; if no, upon receiving the projection frame data sent by the target projection device, the module copies the first frame data of the projection frame data to obtain the start frame data, and sequentially decodes and plays the start frame data and the projection frame data; wherein the start frame data is the first frame data whose frame number meets the decoding start standard.

6. A screen projection system, characterized in that, The screen projection system includes: At least one screen projection device as described in claim 4; At least one playback device as described in claim 5; wherein the projection device and the playback device transmit frame data on the same network.

7. A storage medium, characterized in that, The storage medium stores a screen mirroring program, which, when executed by the processor, implements the steps of the screen mirroring method as described in claim 1.

8. A storage medium, characterized in that, The storage medium stores a screen mirroring program, which, when executed by the processor, implements the steps of the screen mirroring method as described in claim 2 or 3.

Images