Screen projection method and related device
By caching and generating playback records in the screen mirroring device, the problem of increased device power consumption caused by repeated data format conversion and decoding is solved, resulting in lower power consumption and a clearer picture quality experience.
Patent Information
- Application Number
- CN202211116344.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-09-14
- Publication Date
- 2026-01-06
- Estimated Expiration
- 2042-09-14
AI Technical Summary
In existing screen mirroring technologies, users need to repeatedly use the terminal device to convert and decode data formats each time they view a file, which increases the device's power consumption.
By caching the screen-casting content and generating playback records in the second device, the target screen-casting content can be read directly from the memory the next time it is cast, avoiding repeated use of the terminal device for data format conversion and decoding.
It reduces device power consumption, ensures clear image quality, and improves user experience.
Smart Images

Figure CN115665453B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of communication technology, and in particular to a screen projection method and related equipment. Background Technology
[0002] With the rapid development of communication technology, screen mirroring technology is divided into wired and wireless types, and is widely used in office, teaching, and home scenarios. Currently, users can use screen mirroring technology to project files from their terminal devices onto display devices for a more comfortable viewing experience. However, for some files that users view repeatedly, each time they mirror the file, the terminal device needs to be used repeatedly, and data format conversion and decoding need to be performed again, leading to increased device power consumption. Summary of the Invention
[0003] This application provides a screen mirroring method and related equipment, which enables the storage of screen mirroring content to be directly retrieved for the next screen mirroring attempt, without repeatedly occupying the terminal device or performing data format conversion and decoding again, thereby reducing device power consumption.
[0004] In a first aspect, embodiments of this application provide a screen mirroring method, comprising: a second device receiving and caching current screen mirroring information sent by a first device, the current screen mirroring information including at least one screen mirroring content; sending the current screen mirroring information to a display device for playback, generating a playback record after playback, the playback record including an identifier of at least one screen mirroring content; sending the playback record to the first device, the playback record being used to indicate selecting a target screen mirroring content from the at least one screen mirroring content; receiving a reply message sent by the first device, the reply message including an identifier of the target screen mirroring content; storing the cached target screen mirroring content in a memory according to the identifier of the target screen mirroring content; and retrieving the target screen mirroring content from the memory for screen mirroring the next time screen mirroring is performed. By storing the target screen mirroring content in a memory, the user can directly retrieve the stored screen mirroring content for screen mirroring the next time they view the content, without repeatedly occupying the terminal device or performing data format conversion and decoding again, which can reduce device power consumption, ensure clear image quality, and improve user experience.
[0005] In one possible design, the playback history also includes an identifier for the priority of each castable content among at least one castable content. The priority of each castable content is used to indicate which target castable content to select from the at least one castable content. The playback history is used to allow the user to select the target castable content.
[0006] In another possible design, based on the historical screen-casting information of the first device, the second device builds a predictive model. At least one type of screen-casting content is input into the predictive model to determine the priority of each piece of content. The predictive model is built using historical screen-casting information to pre-determine user preferences.
[0007] In another possible design, an information category is determined for each piece of content within at least one projected content segment. Based on this information category, the priority of each projected content segment is determined. The projected content is then categorized to distinguish the information category of each segment.
[0008] In another possible design, the casting time for each piece of content within at least one casting content is determined, and the priority of each casting content is determined based on the casting time. The casting time is used to distinguish the playback order of each casting content.
[0009] In another possible design, the playback record also includes the playback duration corresponding to the identifier of each cast content within at least one cast content segment. The playback duration is used to indicate the selection of at least one time segment of cast content from the target cast content. The response information includes at least one time segment corresponding to the identifier of the target cast content. Using the playback duration, cast content within a target time segment can be selected from the target cast content and saved.
[0010] In another possible design, after the second device receives the reply information sent by the first device, it deletes at least one piece of screen-casting content other than the target screen-casting content from the cached current screen-casting information. Deleting the screen-casting content other than the target screen-casting content frees up memory.
[0011] Secondly, embodiments of this application provide a screen casting method, comprising: a first device sending current screen casting information to a second device, the current screen casting information being cached by the second device and sent to a display device for playback, and generating a playback record after playback is completed; the current screen casting information including at least one screen casting content; receiving the playback record sent by the second device, the playback record including an identifier of at least one screen casting content; selecting a target screen casting content from the at least one screen casting content according to the playback record; and sending a reply message to the second device, the reply message including an identifier of the target screen casting content, the identifier of the target screen casting content being used to indicate that the cached target screen casting content is stored in a memory, and read from the memory for screen casting the next time screen casting is performed. Storing the target screen casting content in a memory allows the user to directly retrieve the stored screen casting content for screen casting the next time they watch, without repeatedly occupying the terminal device or performing data format conversion and decoding again, thus reducing device power consumption, ensuring clear image quality, and improving user experience.
[0012] In one possible design, the playback history also includes the priority corresponding to the identifier of each of the at least one castable content. Based on the playback history, a target castable content is selected from the at least one castable content. The playback history allows the user to view relevant information for each castable content when selecting the target castable content.
[0013] In another possible design, based on the playback history, a target content is selected from at least one pool of content to be cast. Then, based on the playback duration, at least one time segment of content within the target pool is selected. Using the playback duration, content within the target time segment can be selected from the target pool and saved.
[0014] Thirdly, embodiments of this application provide a screen projection device, including:
[0015] The receiving module is used to receive and cache the current projection information sent by the first device, wherein the current projection information includes at least one projection content.
[0016] The sending module is used to send the current projection information to the display device for playback.
[0017] A processing module is used to generate a playback record after playback is completed, the playback record including the identifier of the at least one projected content.
[0018] The sending module is further configured to send the playback record to the first device, the playback record being used to indicate the selection of target screen-casting content from the at least one screen-casting content.
[0019] The receiving module is further configured to receive a response message sent by the first device, the response message including an identifier of the target projection content.
[0020] The processing module is further configured to store the cached target projection content in a memory according to the identifier of the target projection content.
[0021] The processing module is also used to read the target projection content from the memory and project it the next time projection is performed.
[0022] In one possible design, the playback record also includes a priority corresponding to the identifier of each of the at least one castable content, the priority of each castable content being used to indicate the selection of a target castable content from the at least one castable content.
[0023] In another possible design, the processing module is further configured to establish a prediction model based on the historical screen projection information of the first device; input the at least one screen projection content into the prediction model, and determine the priority of each screen projection content among the at least one screen projection content.
[0024] In another possible design, the processing module is further configured to determine the information category of each of the at least one projected content; and to determine the priority of each projected content based on the information category.
[0025] In another possible design, the processing module is further configured to determine the casting time of each of the at least one casting content; and to determine the priority of each casting content based on the casting time.
[0026] In another possible design, the playback record also includes the playback duration corresponding to the identifier of each of the at least one screen-casting contents, the playback duration being used to indicate the selection of at least one time period of screen-casting content from the target screen-casting content, and the response information including the at least one time period corresponding to the identifier of the target screen-casting content.
[0027] In another possible design, the processing module is further configured to delete, from the cached current projection information, projection content other than the target projection content from the at least one projection content.
[0028] The operation and beneficial effects of the projection device can be found in the method and beneficial effects described in the first aspect above, and will not be repeated here.
[0029] Fourthly, embodiments of this application provide a screen projection device, including:
[0030] The sending module is used to send current projection information to the second device. The current projection information is used by the second device to cache and send it to the display device for playback, and to generate a playback record after playback is completed. The current projection information includes at least one projection content.
[0031] A receiving module is used to receive playback records sent by the second device, wherein the playback records include the identifier of the at least one screen-cast content.
[0032] The processing module is used to select target content for projection from the at least one projection content based on the playback record.
[0033] The sending module is further configured to send a reply message to the second device. The reply message includes an identifier of the target screen projection content. The identifier of the target screen projection content is used to indicate that the cached target screen projection content is stored in the memory and read from the memory for screen projection the next time screen projection is performed.
[0034] In one possible design, the playback record also includes the priority corresponding to the identifier of each of the at least one projected content, and the target projected content is selected from the at least one projected content according to the playback record.
[0035] In another possible design, the processing module is further configured to select the target casting content from the at least one casting content based on the playback record; and to select casting content for at least one time period from the target casting content based on the playback duration.
[0036] The operation and beneficial effects of the projection device can be found in the method and beneficial effects described in the second aspect above, and will not be repeated here.
[0037] Fifthly, this application provides a screen projection device applied in a first device. The screen projection device can be the first device or a chip in the first device. The screen projection device includes a processor, a memory, and a communication bus. The communication bus is used to realize communication between the processor and the memory. The processor executes a program stored in the memory to implement the steps of the second aspect above.
[0038] In a sixth aspect, embodiments of this application provide a screen projection device applied in a second device. The screen projection device can be the second device or a chip in the second device. The screen projection device includes: a processor, a memory, and a communication bus. The communication bus is used to realize communication between the processor and the memory. The processor executes a program stored in the memory to implement the steps of the first aspect described above.
[0039] In a seventh aspect, this application provides a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the methods described above.
[0040] Eighthly, this application provides a computer program product containing instructions that, when run on a computer, causes the computer to perform the methods described above.
[0041] Ninthly, embodiments of this application provide a chip, including a processor, for calling and executing instructions stored in a memory, causing a first device or a second device on which the chip is mounted to perform the method described above.
[0042] In a tenth aspect, embodiments of this application provide another chip, including: an input interface, an output interface, and a processor. Optionally, it also includes a memory. The input interface, output interface, processor, and memory are connected through an internal connection path. The processor is used to execute code in the memory. When the code is executed, the processor is used to execute the method in any of the above aspects.
[0043] In one aspect, embodiments of this application provide a screen projection system, which includes at least one first device and at least one second device. The first device is used to perform the steps in the second aspect described above, and the second device is used to perform the steps in the first aspect described above. Attached Figure Description
[0044] To more clearly illustrate the technical solutions in the embodiments of this application or the background art, the accompanying drawings used in the embodiments of this application or the background art will be described below.
[0045] Figure 1 This is a schematic diagram of the structure of a screen projection system provided in an embodiment of this application;
[0046] Figure 2 This is a flowchart illustrating a screen mirroring method provided in an embodiment of this application;
[0047] Figure 3 This is a schematic diagram of a screen casting selection interface provided in an embodiment of this application;
[0048] Figure 4 This is a schematic diagram of the structure of a screen projection device provided in an embodiment of this application;
[0049] Figure 5 This is a schematic diagram of another screen projection device provided in an embodiment of this application;
[0050] Figure 6 This is a schematic diagram of the structure of a first device provided in an embodiment of this application;
[0051] Figure 7 This is a schematic diagram of the structure of a second device provided in an embodiment of this application. Detailed Implementation
[0052] The embodiments of the present invention will now be described with reference to the accompanying drawings.
[0053] like Figure 1 As shown, Figure 1 This is a schematic diagram of a screen projection system provided in an embodiment of this application. The screen projection system includes a terminal device 101, a screen projection receiving device 102, and a display device 103, wherein:
[0054] Terminal device 101 is configured to send current projection information to projection receiving device 102, wherein the current projection information is cached in a first memory by projection receiving device 102 and sent to a display device for playback, and a playback record is generated after playback is completed. The current projection information includes at least one projection content. Terminal device 101 is configured to receive the playback record sent by projection receiving device 102, wherein the playback record includes an identifier of at least one projection content. Terminal device 101 is configured to select a target projection content from the at least one projection content according to the playback record. Terminal device 101 is configured to send a reply message to projection receiving device 102, wherein the reply message includes an identifier of the target projection content, wherein the identifier of the target projection content is used to indicate that the target projection content cached in the first memory is saved in a second memory, the current projection information cached in the first memory is deleted, and the projection content is read from the second memory for projection the next time projection is performed.
[0055] Specifically, terminal device 101 is a device with processing capabilities and data transmission and reception capabilities. The user uses terminal device 101 to send current screen projection information to screen projection receiving device 102, and selects target screen projection content from the current screen projection information based on the playback history sent by screen projection receiving device 102. Terminal device 101 can be a computer, laptop, tablet, PDA, desktop computer, mobile phone, Ultra-mobile Personal Computer (UMPC), netbook, Personal Digital Assistant (PDA), etc.
[0056] Optionally, terminal device 101 can refer to one of multiple terminal devices. This application embodiment only uses terminal device 101 as an example. A terminal device can be used by one user, or two terminal devices can be used by different users. The number of terminal devices can be more or less. For example, there may be several, dozens, or more terminal devices. This application embodiment does not limit the number or type of terminal devices.
[0057] The screen mirroring receiving device 102 is configured to receive current screen mirroring information sent by the terminal device 101 and cache it in a first memory, the current screen mirroring information including at least one screen mirroring content; send the current screen mirroring information to the display device 103 for playback; generate a playback record after playback is completed, the playback record including an identifier of at least one screen mirroring content; send the playback record to the terminal device 101, the playback record being used to indicate the selection of a target screen mirroring content from at least one screen mirroring content; receive a reply message sent by the terminal device 101, the reply message including an identifier of the target screen mirroring content; according to the identifier of the target screen mirroring content, save the target screen mirroring content cached in the first memory in a second memory, and delete the current screen mirroring information cached in the first memory; and read the target screen mirroring content from the second memory for screen mirroring the next time screen mirroring is performed.
[0058] Specifically, the screen projection receiving device 102 is a device with processing capabilities and data transmission and reception capabilities. The screen projection receiving device 102 converts and decodes the received current screen projection information to obtain the screen projection image, caches the screen projection image in the first memory, and sends it to the display device 103. After playback is completed, it generates a playback record and sends it to the terminal device 101. According to the reply message from the terminal device 101, it saves the target screen projection content cached in the first memory to the second memory and deletes the current screen projection information cached in the first memory. The screen projection receiving device 102 includes a first memory and a second memory. The first memory and the second memory may include volatile memory, such as nonvolatile random access memory (NVRAM), phase change RAM (PRAM), magnetoresistive RAM (MRAM), etc., and may also include non-volatile memory, such as at least one disk storage device, electrically erasable programmable read-only memory (EEPROM), flash memory device, such as NOR flash memory or NAND flash memory, semiconductor device, such as solid state disk (SSD), etc.
[0059] Display device 103 is used to receive the current projection information and target projection content sent by projection receiving device 102 and play them.
[0060] Specifically, the display device 103 is a device with processing capabilities and data transmission and reception capabilities. The display device 103 plays the received current projection information, and after playback is complete, sends a signal to the projection receiving device 102. The display device 103 can be a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light-emitting diode (OLED) display, etc.
[0061] The terminal device 101, the screen projection receiving device 102, and the display device 103 can establish a communication connection through a wired network or a wireless network.
[0062] In this embodiment of the application, when the terminal device 101 and the screen projection receiving device 102 are connected to the same wireless network, or when the terminal device 101 and the screen projection receiving device 102 are connected in communication, the terminal device 101 can access the first memory and the second memory.
[0063] It should be noted that the aforementioned screen mirroring system can be a user-interactive system, which can be a software system, a hardware system, or a combination of both; this application does not impose any specific limitations on this. It should also be noted that... Figure 1 This is merely an illustrative structural diagram of a screen projection system; in practical applications, it can be modified according to specific circumstances. Figure 1 The projection system will be transformed accordingly.
[0064] In this embodiment of the application, terminal device 101 is used as the first device and screen projection receiving device 102 is used as the second device to describe the technical solution of the application, which will not be repeated hereafter.
[0065] like Figure 2 As shown, Figure 2 This is a flowchart illustrating a screen mirroring method provided in an embodiment of this application. The method includes, but is not limited to, the following steps:
[0066] Step S201: The first device sends the current screen projection information to the second device. The current screen projection information includes at least one screen projection content.
[0067] The content that can be projected includes documents, videos, audio, and one or more of the following: images.
[0068] In one implementation, the first device sends the current screen mirroring information to the second device via a wireless network. Specifically, the first and second devices use the same Wi-Fi network or are on the same local area network. They establish a communication connection using the device's file transfer function or by installing third-party software, and then the first device sends the current screen mirroring information to the second device.
[0069] In another implementation, the first device sends the current screen projection information to the second device via a wired network. Specifically, a communication connection is established between the first and second devices using a network cable, and then the first device sends the current screen projection information to the second device.
[0070] Step S202: The second device caches the current projection information in the first memory.
[0071] Optionally, the first memory can be an external memory, meaning the user can replace the memory as needed, or the memory can be integrated into a second device.
[0072] Step S203: The second device sends the current projection information to the display device.
[0073] Optionally, during the playback of the current screen projection information, a replay operation is performed. The second device obtains the moment of the screen projection content corresponding to the replay, and then retrieves the screen projection image at the corresponding moment from the current screen projection information cached in the first memory and sends it to the display device for playback.
[0074] In this embodiment, terminal device 101 and screen projection receiving device 102 are connected to the same WiFi network. Terminal device 101 sends screen projection data in WiFi protocol to screen projection receiving device 102. Then, screen projection receiving device 102 converts the WiFi protocol screen projection data into Universal Serial Bus (USB) protocol encoded data, decodes it through a USB graphic adapter (UGA) to obtain the screen projection image, caches the screen projection image in a first memory, and sends it to display device 103 for playback. If a rewind operation is performed during playback, screen projection receiving device 102 obtains the time of the screen projection content corresponding to the rewind, retrieves the screen projection image at the corresponding time from the screen projection image cached in the first memory, and sends it to display device 103 for playback. Format conversion and decoding of the same image are not required.
[0075] Step S204: The second device generates a playback record after playback is completed. The playback record includes an identifier of at least one screen-cast content.
[0076] Optionally, the playback history also includes the priority corresponding to the identifier of each cast content in at least one cast content, and the priority of each cast content is used to indicate the selection of the target cast content from at least one cast content.
[0077] Optionally, based on the historical screen-casting information of the first device, a prediction model is established, and at least one screen-casting content is input into the prediction model to determine the priority of each screen-casting content among the at least one screen-casting content. Specifically, the screen-casting receiving device 102 can use the term frequency-inverse document frequency (TF-IDF) algorithm to perform text analysis on the screen-casting names of the historical screen-casting information of the terminal device 101 and establish a prediction model. Each screen-casting content in the current screen-casting information is input into the prediction model to obtain the user preference prediction result, and the priority of each screen-casting content is determined according to the user preference prediction result.
[0078] Optionally, an information category for each screen-projected content within at least one projected content is determined, and the priority of each projected content is determined based on the information category. Specifically, the screen-projection receiving device 102 can classify the projected content in the current projected information to obtain the information category of each projected content, and determine the priority of each projected content based on the information category.
[0079] Optionally, the casting time of each casting content in at least one casting content is determined, and the priority of each casting content is determined based on the casting time. Specifically, the casting receiving device 102 can determine the casting order using the casting time of each casting content in the current casting information, and determine the priority of each casting content based on the casting order.
[0080] Optionally, the playback record also includes the playback duration corresponding to the identifier of each screen-casting content in at least one screen-casting content, the playback duration being used to indicate the selection of screen-casting content for at least one time period from the target screen-casting content.
[0081] In one embodiment, the playback record is also used to update the casting history list in the first memory. The casting history list includes the playback duration, casting time, casting name, and first device ID of all casting content from the second device. Specifically, the casting receiving device can receive casting information sent by multiple terminal devices. After each playback is completed, the playback record generated by the casting receiving device updates the casting history list in the first memory. The casting history list records all casting information from the casting receiving device, including the playback duration, casting time, casting name, and terminal device ID corresponding to each casting content. The casting history list can be used to view the historical casting information of each terminal device.
[0082] Step S205: The second device sends the playback record to the first device.
[0083] Step S206: The first device selects the target content to be cast from the current casting information based on the playback history.
[0084] In one implementation, the first device displays a playback history, which includes an identifier for at least one screen-casting content, as shown in Table 1. The first device selects a target screen-casting content from the current screen-casting information based on the identifier of the screen-casting content. Specifically, after playback is complete, the screen-casting receiving device 102 sends the playback history of the current screen-casting information to the terminal device 101. The playback history includes an identifier for each screen-casting content. The user selects a target screen-casting content based on the identifier of each screen-casting content. The terminal device 101 receives the selection command input by the user, responds to the user's selection command, and generates a reply message.
[0085] Table 1
[0086] Playback history logo Screen mirroring content 1 Logo 1 Screen mirroring content 2 Logo 2 Screen mirroring content 3 Mark 3 Screen mirroring content 4 Mark 4 … …
[0087] In another implementation, the first device displays a playback history, which also includes the priority corresponding to the identifier of each screen-casting content, as shown in Table 2. The first device selects a target screen-casting content from the current screen-casting information based on the identifier and its corresponding priority. Specifically, after playback is complete, the screen-casting receiving device 102 sends the playback history of the current screen-casting information to the terminal device 101. The playback history includes the identifier and priority of each screen-casting content. The user selects a target screen-casting content based on the identifier and its corresponding priority. The terminal device 101 receives the selection command input by the user, responds to the user's selection command, and generates a reply message.
[0088] Table 2
[0089] Playback history logo Priority Screen mirroring content 1 Logo 1 Priority 1 Screen mirroring content 2 Logo 2 Priority 2 Screen mirroring content 3 Mark 3 Priority 3 Screen mirroring content 4 Mark 4 Priority 4 … … …
[0090] In another implementation, the first device displays a playback record, which also includes the playback duration corresponding to the identifier of each screen-casting content, as shown in Table 3. The first device selects a target screen-casting content from the current screen-casting information based on the identifier and its corresponding priority, and selects at least one time period of screen-casting content from the target screen-casting content based on the playback duration corresponding to the identifier. Specifically, after playback is complete, the screen-casting receiving device 102 sends the playback record of the current screen-casting information to the terminal device 101. The playback record includes the identifier, priority, and playback duration of each screen-casting content. The user selects a target screen-casting content based on the identifier and its corresponding priority, and then selects at least one time period of screen-casting content from the target screen-casting content based on its playback duration. The terminal device 101 receives the user's selection of at least one time period of screen-casting content for the target screen-casting content's playback duration, responds to the user's selection instruction, and generates a reply message.
[0091] Table 3
[0092] Playback history logo Priority Playtime Screen mirroring content 1 Logo 1 Priority 1 Playback duration 1 Screen mirroring content 2 Logo 2 Priority 2 Playback duration 2 Screen mirroring content 3 Mark 3 Priority 3 Playback duration 3 Screen mirroring content 4 Mark 4 Priority 4 Playback duration 4 … … … …
[0093] In another implementation, the first device also displays the storage category corresponding to each projected content, as shown in Table 4. The storage categories include Class A files and Class B files. Class A files are encrypted files (e.g., trade secrets, important technologies), while Class B files are ordinary files (e.g., online videos). The first device selects target projected content from the current projected information based on the projected content's identifier, the corresponding priority, and the corresponding playback duration. Then, based on the storage category, it determines the confidentiality level of each target projected content. Specifically, after playback is complete, the projected receiving device 102 sends the playback record of the current projected information to the terminal device 101. The playback record includes the identifier, priority, playback duration, and storage category of each projected content. The user selects target projected content from the current projected information based on the projected content's identifier, the corresponding priority, and the corresponding playback duration. Then, based on the storage category, the user selects whether to encrypt and save the target projected content. The terminal device 101 receives the user's selection instruction regarding the target projected content and storage category, responds to the user's selection instruction, and generates a reply message.
[0094] Table 4
[0095] Playback history logo Priority Playtime Storage Class Screen mirroring content 1 Logo 1 Priority 1 Playback duration 1 Storage Category 1 Screen mirroring content 2 Logo 2 Priority 2 Playback duration 2 Storage Category 2 Screen mirroring content 3 Mark 3 Priority 3 Playback duration 3 Storage Category 3 Screen mirroring content 4 Mark 4 Priority 4 Playback duration 4 Storage Category 4 … … … … …
[0096] Step S207: The first device sends a reply message to the second device, which includes the identifier of the target screen-projected content.
[0097] The reply information also includes the target time period of the target screen projection content. Specifically, after receiving the reply information sent by the terminal device 101, the screen projection receiving device 102 connects to the editing software of the terminal device 101 (or the editing function provided by the screen projection receiving device 102) to combine the screen projection content of at least one time period that needs to be saved in each target screen projection content into a new target screen projection content.
[0098] Step S208: The second device saves the cached target projection content in the second memory according to the reply information.
[0099] The second device receives a response from the first device, creates a folder corresponding to the first device in the second storage, and saves the target projection content cached in the first storage to the folder corresponding to the first device in the second storage, and then deletes the current projection information cached in the first storage. Specifically, if the response includes type A target projection content, a subfolder A is created, and the type A target projection content is stored in subfolder A; if the response includes type B target projection content, a subfolder B is created, and the type B target projection content is stored in subfolder B; if the response includes both type A and type B target projection content, subfolders A and B are created, and the type A and type B target projection content are stored in their respective subfolders. The terminal device 101 can set access permissions for subfolder A.
[0100] Optionally, the second memory can be an external memory, meaning the user can replace the memory as needed, or the memory can be integrated into the second device.
[0101] Optionally, the second storage device exists within the first device as a folder (or removable disk), which the user can manage through the first device. Specifically, the user can access or delete files in the folder through a terminal device, and can also store other files directly in the folder.
[0102] Optionally, users can access files stored on different first devices using the device ID of the first device. Specifically, by entering the device ID of terminal device 2 in terminal device 1, users can access subfolder B corresponding to terminal device 2 using terminal device 1. To obtain access permissions for subfolder A corresponding to terminal device 2, access permissions for subfolder A need to be enabled in the settings of terminal device 2.
[0103] Step S209: During the next screen mirroring operation, the second device reads the target screen mirroring content from the second memory.
[0104] Step S210: The second device sends the target projection content to the display device.
[0105] In one embodiment, before the next screen mirroring, the method further includes:
[0106] Send a screen mirroring selection message to the first device.
[0107] Specifically, before the next screen mirroring attempt, the screen mirroring receiving device 102 sends the aforementioned screen mirroring selection message to the terminal device 101. At this time, the screen mirroring selection interface of the terminal device 101 will change as follows: Figure 3 As shown, Figure 3This is a schematic diagram of a screen casting selection interface provided in an embodiment of this application. The terminal device 101 displays a screen casting selection button, which allows the user to choose a screen casting mode before the next screen casting attempt. The screen casting selection button includes a normal screen casting button and a memory screen casting button. If the terminal device 101 receives a click operation from the user on the normal screen casting button and responds to the click operation to enter the normal screen casting mode, then the screen casting system executes steps S201 to S208. If the terminal device 101 receives a click operation from the user on the memory screen casting button and responds to the click operation to enter the memory screen casting mode, then the screen casting system executes steps S209 to S210.
[0108] In this embodiment, by selectively saving the screen-casting content, the stored content can be directly retrieved for the next screen-casting session, eliminating the need to repeatedly occupy the mobile device and perform data format conversion and decoding again. This ensures clear image quality, reduces device power consumption, and improves user experience.
[0109] The methods of the embodiments of this application have been described in detail above. The following is a description of the apparatus provided in the embodiments of this application.
[0110] like Figure 4 As shown, Figure 4 This is a schematic diagram of a screen projection device provided in an embodiment of the present invention. The screen projection device 400 can be a terminal device, or a chip or processing system within a terminal device. The screen projection device 400 can be used to implement any method and function of the terminal device involved in any of the foregoing embodiments. The screen projection device 400 may include a sending module 401, a receiving module 402, and a processing module 403. Optionally, the sending module 401 and the receiving module 402 correspond to the radio frequency circuit and baseband circuit included in the terminal device. A detailed description of each module is as follows.
[0111] The sending module 401 is used to send current projection information to the second device. The current projection information is used by the second device to cache and send it to the display device for playback, and to generate a playback record after playback is completed. The current projection information includes at least one projection content.
[0112] The sending module 401 is further configured to send a reply message to the second device. The reply message includes an identifier of the target screen projection content. The identifier of the target screen projection content is used to indicate that the cached target screen projection content is stored in the memory and read from the memory for screen projection the next time screen projection is performed.
[0113] The receiving module 402 is used to receive the playback record sent by the second device, the playback record including the identifier of the at least one screen-casting content.
[0114] The playback record also includes the priority corresponding to the identifier of each of the at least one screen-casting contents. Based on the playback record, the target screen-casting content is selected from the at least one screen-casting contents.
[0115] The processing module 403 is used to select target screen casting content from the at least one screen casting content according to the playback record.
[0116] Optionally, the processing module 403 is further configured to select the target casting content from the at least one casting content based on the playback record; and to select casting content for at least one time period from the target casting content based on the playback duration.
[0117] It should be noted that the implementation of each module can also correspond to, for example: Figure 2 The corresponding description of the method embodiment shown above describes the execution of the methods and functions performed by the first device in the above embodiments.
[0118] like Figure 5 As shown, Figure 5 This is a schematic diagram of another screen projection device provided in this application embodiment. The screen projection device 500 can be a screen projection receiving device, or a chip or processing system within a screen projection receiving device. The screen projection device 500 can be used to implement any method and function related to the screen projection receiving device in any of the foregoing embodiments. The screen projection device 500 may include a receiving module 501, a processing module 502, and a transmitting module 503. Optionally, the receiving module 501 and the transmitting module 503 correspond to the radio frequency circuit and baseband circuit included in the screen projection receiving device. The detailed description of each module is as follows.
[0119] The receiving module 501 is used to receive and cache the current projection information sent by the first device, wherein the current projection information includes at least one projection content.
[0120] The receiving module 501 is further configured to receive a reply message sent by the first device, the reply message including an identifier of the target projection content.
[0121] The processing module 502 is used to generate a playback record after playback is completed, the playback record including the identifier of the at least one projected content.
[0122] The playback record also includes the priority corresponding to the identifier of each of the at least one screen-casting contents, and the priority of each screen-casting content is used to indicate the selection of target screen-casting content from the at least one screen-casting contents.
[0123] Optionally, the processing module 502 is further configured to establish a prediction model based on the historical screen projection information of the first device; input the at least one screen projection content into the prediction model, and determine the priority of each screen projection content among the at least one screen projection content.
[0124] Optionally, the processing module 502 is further configured to determine the information category of each screen-projected content among the at least one screen-projected content; and determine the priority of each screen-projected content according to the information category.
[0125] Optionally, the processing module 502 is further configured to determine the casting time of each casting content among the at least one casting content; and to determine the priority of each casting content based on the casting time.
[0126] The processing module 502 is further configured to store the cached target projection content in a memory according to the identifier of the target projection content.
[0127] The processing module 502 is also used to read the target projection content from the memory and project it the next time projection is performed.
[0128] The sending module 503 is used to send the current projection information to the display device for playback.
[0129] The sending module 503 is further configured to send the playback record to the first device, the playback record being used to indicate the selection of target screen casting content from the at least one screen casting content.
[0130] It should be noted that the implementation of each module can also correspond to, for example: Figure 2 The corresponding description of the method embodiment shown above describes the methods and functions performed by the second device in the above embodiments.
[0131] like Figure 6 As shown, Figure 6 This is a schematic diagram of the structure of a first device provided in an embodiment of this application. The first device can be a terminal device and may include: at least one processor 601, at least one communication interface 602, at least one memory 603, and at least one communication bus 604.
[0132] The processor 601 can be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a digital signal processor and a microprocessor, etc. The communication bus 604 can be a peripheral component interconnect standard PCI bus or an extended industry standard structure EISA bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 6 The bus is represented by a single thick line, but this does not imply that there is only one bus or one type of bus. The communication bus 604 is used to implement communication between these components. In this embodiment, the communication interface 602 of the device is used for signaling or data communication with other node devices. The memory 603 can be any of the types of memory mentioned above. Optionally, the memory 603 can also be at least one storage device located remotely from the aforementioned processor 601. Optionally, a set of program code can also be stored in the memory 603. Optionally, the processor 601 can also execute the program stored in the memory 603.
[0133] The current projection information is sent to the second device. The current projection information is used by the second device to cache and send it to the display device for playback, and a playback record is generated after playback is completed. The current projection information includes at least one projection content.
[0134] Receive playback records sent by the second device, wherein the playback records include identifiers of the at least one screen-cast content;
[0135] Based on the playback history, select the target content to be projected from the at least one projected content;
[0136] Send a reply message to the second device. The reply message includes an identifier of the target screen projection content. The identifier of the target screen projection content is used to indicate that the cached target screen projection content is stored in the memory and read from the memory for screen projection the next time screen projection is performed.
[0137] Optionally, the processor 601 is also used to perform the following operations:
[0138] Based on the playback record, the target casting content is selected from the at least one casting content, and based on the playback duration, casting content for at least one time period is selected from the target casting content.
[0139] The processor can work with the memory and communication interface to execute any method and function of the first device in the above-described embodiments.
[0140] like Figure 7 As shown, Figure 7 This is a schematic diagram of the structure of a second device proposed in an embodiment of this application. The second device can be a screen projection receiving device, and may include: at least one processor 701, at least one communication interface 702, at least one memory 703, and at least one communication bus 704.
[0141] The processor 701 can be any of the processors mentioned above. The communication bus 704 can be a PCI bus (interconnection standard for peripheral components) or an EISA bus (extended industry standard structure). The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 7 The bus is represented by a single thick line, but this does not imply that there is only one bus or one type of bus. The communication bus 704 is used to implement communication between these components. Specifically, in this embodiment, the communication interface 702 of the device is used for signaling or data communication with other node devices. The memory 703 can be any of the types of memory mentioned above. Optionally, the memory 703 can also be at least one storage device located remotely from the aforementioned processor 701. The memory 703 stores a set of program code, and the processor 701 executes the program in the memory 703.
[0142] Receive and cache the current screen projection information sent by the first device, wherein the current screen projection information includes at least one screen projection content;
[0143] Send the current projection information to the display device for playback;
[0144] A playback record is generated after playback is completed, and the playback record includes the identifier of the at least one screen-cast content;
[0145] Send the playback record to the first device, the playback record being used to indicate the selection of target screen-casting content from the at least one screen-casting content;
[0146] Receive a response message sent by the first device, the response message including an identifier of the target projection content;
[0147] Based on the identifier of the target screen projection content, the cached target screen projection content is saved in the memory;
[0148] The next time screen mirroring is performed, the target screen mirroring content is read from the memory and mirrored.
[0149] Optionally, the processor 701 is also used to perform the following operations:
[0150] Optionally, a prediction model is established based on the historical screen projection information of the first device; the at least one screen projection content is input into the prediction model to determine the priority of each screen projection content among the at least one screen projection content.
[0151] Optionally, the information category of each screen-casting content in the at least one screen-casting content is determined; and the priority of each screen-casting content is determined according to the information category.
[0152] Optionally, the casting time of each of the at least one casting content is determined; and the priority of each casting content is determined based on the casting time.
[0153] Optionally, the screen casting content other than the target screen casting content can be deleted from the cached current screen casting information.
[0154] The processor can work with the memory and communication interface to execute any method and function of the second device in the above-described embodiments.
[0155] This application also provides a chip system including a processor for supporting a first device or a second device to implement the functions involved in any of the above embodiments, such as generating or processing playback records involved in the above methods. In one possible design, the chip system may further include a memory for program instructions and data necessary for the first or second device. This chip system may be composed of chips or may include chips and other discrete devices.
[0156] This application also provides a processor for coupling with a memory to perform any method and function involving the first or second device in any of the above embodiments.
[0157] According to the method provided in the embodiments of this application, this application also provides a computer program product, which includes: a computer program that, when run on a computer, causes the computer to perform... Figure 2 The method of any one of the embodiments shown.
[0158] According to the method provided in the embodiments of this application, this application also provides a computer-readable medium storing a computer program, which, when run on a computer, causes the computer to perform... Figure 2 The method of any one of the embodiments shown.
[0159] This application also provides an apparatus for performing any method and function involving the first or second device in any of the above embodiments.
[0160] This application also provides a screen projection system, which includes at least one first device and at least one second device involved in any of the above embodiments.
[0161] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the projection device, the units or modules within the device described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0162] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The readable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., high-density digital video disc (DVD)), or a semiconductor medium (e.g., SSD), etc.
[0163] In the embodiments of this application, "multiple" refers to two or more.
[0164] The descriptions of "first," "second," etc., appearing in the embodiments of this application are for illustrative purposes and to distinguish the objects being described. They have no order and do not indicate any particular limitation on the number of objects being described in the embodiments of this application. They cannot constitute any limitation on the embodiments of this application.
[0165] It is understood that in the embodiments of this application, the first device and / or the second device may perform some or all of the steps in the embodiments of this application. These steps or operations are merely examples. In the embodiments of this application, other operations or variations of various operations may also be performed. Furthermore, the steps may be performed in different orders as presented in the embodiments of this application, and it is not necessary to perform all the operations in the embodiments of this application.
[0166] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A screen projection method, characterized by, The method comprises the following steps: The second device receives the current screen projection information sent by the first device and caches the current screen projection information, wherein the current screen projection information comprises at least one screen projection content; The second device sends the current screen projection information to a display device for playing, and generates a playing record after the playing is completed, wherein the playing record comprises the identification of the at least one screen projection content; The second device sends the playing record to the first device, wherein the playing record is used to indicate the selection of target screen projection content from the at least one screen projection content; The second device receives the reply information sent by the first device, wherein the reply information is generated based on the selection instruction received by the first device and in response to the selection instruction, and the reply information comprises the identification of the target screen projection content; The second device saves the cached target screen projection content in a storage according to the identification of the target screen projection content; The second device reads the target screen projection content from the storage for screen projection in the next screen projection.
2. The method of claim 1, wherein, The playing record further comprises the priority of the identification of each screen projection content in the at least one screen projection content, and the priority of each screen projection content is used to indicate the selection of target screen projection content from the at least one screen projection content.
3. The method of claim 2, wherein, The second device sends the current screen projection information to a display device for playing, and generates a playing record after the playing is completed, comprising the following steps: Establishing a prediction model based on the historical screen projection information of the first device; Inputting the at least one screen projection content into the prediction model to determine the priority of each screen projection content in the at least one screen projection content.
4. The method of claim 2, wherein, The second device sends the current screen projection information to a display device for playing, and generates a playing record after the playing is completed, comprising the following steps: Determining the information category of each screen projection content in the at least one screen projection content; According to the information category, determining the priority of each screen projection content.
5. The method of claim 2, wherein, The second device sends the current screen projection information to a display device for playing, and generates a playing record after the playing is completed, comprising the following steps: Determining the screen projection time of each screen projection content in the at least one screen projection content; According to the screen projection time, determining the priority of each screen projection content.
6. The method according to any one of claims 1 to 5, characterized in that, The playing record further comprises the playing duration corresponding to the identification of each screen projection content in the at least one screen projection content, and the playing duration is used to indicate the selection of at least one time period of screen projection content from the target screen projection content, and the reply information comprises the identification of the target screen projection content corresponding to the at least one time period.
7. The method according to any one of claims 1 to 5, characterized in that, After the second device receives the reply information sent by the first device, the method comprises the following steps: Deleting the screen projection content other than the target screen projection content from the at least one screen projection content in the cached current screen projection information.
8. A screen projection method, characterized by, The method comprises the following steps: The first device sends the current screen projection information to the second device, wherein the current screen projection information is used for the second device to cache and send to a display device for playing, and to generate a playing record after the playing is completed, and the current screen projection information comprises at least one screen projection content; The first device receives the playing record sent by the second device, wherein the playing record comprises the identification of the at least one screen projection content; The first device selects target screen projection content from the at least one screen projection content according to the play record; The first device receives a selection instruction input by a user and generates reply information in response to the selection instruction, and sends the reply information to the second device, the reply information including an identifier of the target screen projection content, the identifier of the target screen projection content being used to indicate that the target screen projection content cached in a memory is to be saved in the memory and read from the memory for screen projection in the next time.
9. The method of claim 8, wherein, The play record further includes a priority corresponding to an identifier of each of the at least one screen projection content, and the target screen projection content is selected from the at least one screen projection content according to the play record.
10. The method according to claim 8 or 9, characterized in that, The play record further includes a play duration corresponding to an identifier of each of the at least one screen projection content, including: The target screen projection content is selected from the at least one screen projection content according to the play record; At least one time period of screen projection content is selected from the target screen projection content based on the play duration.
Citation Information
Patent Citations
Screen projection recording method and device and computer readable storage medium
CN114501113A
Method and system to control equipments which displayadvertising information through wire and wirelessnetwork
KR1020030026757A