Projection screen control method and system based on distributed soft bus, and terminal

Abstract

The invention discloses a projection screen control method, system and terminal based on a distributed soft bus, and the method comprises the steps: obtaining a device communication protocol of a source device, carrying out the device discovery processing according to the device communication protocol, and obtaining a plurality of target devices in a preset signal range; acquiring a distributed soft bus, and performing networking connection on the source device and the plurality of target devices according to the distributed soft bus; determining a target screen projection device in the plurality of target devices, obtaining a screen projection permission of the target screen projection device, and if the source device satisfies the screen projection permission, establishing a screen projection connection between the source device and the target screen projection device; and obtaining the screen projection content and the screen projection proportion of the source equipment, and performing synchronous screen projection display on the screen projection content on the target screen projection equipment according to the screen projection proportion to obtain a target screen projection picture played on the target screen projection equipment. According to the invention, wireless networking and projection screen connection between devices with different communication protocols can be realized by adopting the distributed soft bus.

Description

Technical Field

[0001] The present invention relates to the field of screen projection control technology, and in particular to a screen projection control method, system, terminal and computer-readable storage medium based on a distributed soft bus. Background Art

[0002] Currently, the widely used device networking communication technologies mainly include wireless local area network (WLAN), wired local area network (such as Ethernet) and short-range wireless communication technology (such as Bluetooth), which use radio waves for data transmission or physical optical fiber as a physical medium for device discovery and networking communication. For example, for mobile communications that require large-scale coverage, cellular networks are the first choice; for local area networks that require high speed and low latency, Ethernet is more suitable.

[0003] There are generally two types of screen projection technologies between devices: wired screen projection and wireless screen projection, and wireless screen projection technology has been widely used due to its convenience and flexibility. However, there are compatibility issues between devices using different communication protocols in the prior art, which results in the inability to communicate and project data between devices, and cannot meet user needs.

[0004] Therefore, the prior art still needs to be improved and developed. Summary of the invention

[0005] The main purpose of the present invention is to provide a screen projection control method, system, terminal and computer-readable storage medium based on a distributed soft bus, aiming to solve the problem in the prior art that there is incompatibility between devices using different communication protocols, which leads to the inability to communicate and project data between devices and cannot meet user needs.

[0006] To achieve the above object, the present invention provides a screen projection control method based on a distributed soft bus, and the screen projection control method based on a distributed soft bus comprises the following steps:

[0007] Acquire a device communication protocol of a source device, and perform device discovery processing according to the device communication protocol to obtain a plurality of target devices within a preset signal range;

[0008] Acquire a distributed soft bus, and network the source device and the plurality of target devices according to the distributed soft bus;

[0009] Determine a target screen projection device among the multiple target devices, and obtain the screen projection permission of the target screen projection device, and if the source device satisfies the screen projection permission, establish a screen projection connection between the source device and the target screen projection device;

[0010] The projection content and projection ratio of the source device are obtained, and the projection content is synchronously projected and displayed on the target projection device according to the projection ratio to obtain the target projection screen played on the target projection device.

[0011] Optionally, the screen projection control method based on the distributed soft bus, wherein the step of acquiring the device communication protocol of the source device and performing device discovery processing according to the device communication protocol to obtain multiple target devices within a preset signal range, specifically includes:

[0012] Acquire a device communication protocol of a source device, and set a device discovery strategy for the source device, wherein the device discovery strategy includes a device discovery frequency, a data reporting frequency, and a scanning period;

[0013] Determine a preset signal range of the source device, send a request message in a broadcast manner within the preset signal range according to the device communication protocol and the device discovery strategy, and receive multiple returned message response information in real time;

[0014] Performing verification processing on the plurality of message response information, and obtaining a plurality of target message response information that pass the verification from the plurality of message response information;

[0015] A plurality of target devices corresponding to the plurality of target message response information are determined, and the plurality of target devices are determined to be networkable devices.

[0016] Optionally, the screen projection control method based on the distributed soft bus, wherein the obtaining of the distributed soft bus and networking the source device and the plurality of target devices according to the distributed soft bus, specifically includes:

[0017] Acquire device node information of the source device and the plurality of target devices, wherein the device node information includes device scanning perception information, device status information, and device attribute information;

[0018] A distributed soft bus is obtained, and the distributed soft bus is used to network the source device and the plurality of target devices according to the device node information.

[0019] Optionally, the screen projection control method based on a distributed soft bus, wherein the distributed soft bus is obtained, and the source device and the plurality of target devices are networked and connected according to the distributed soft bus, and then further comprises:

[0020] When the source device and the plurality of target devices are networked and connected, the distributed soft bus generates a detection heartbeat packet at a preset interval;

[0021] If it is determined according to the detection heartbeat packet that the networking of the source device and the plurality of target devices is abnormal, the source device and the plurality of target devices are re-networked.

[0022] Optionally, the screen projection control method based on the distributed soft bus, wherein the step of determining a target screen projection device among the multiple target devices and obtaining the screen projection permission of the target screen projection device, and establishing a screen projection connection between the source device and the target screen projection device if the source device satisfies the screen projection permission, specifically includes:

[0023] When the source device receives a device screen projection instruction issued by the user, it searches the multiple target devices according to the device screen projection instruction to determine a target screen projection device among the multiple target devices;

[0024] Obtain the screen projection permission of the target screen projection device. If the screen projection permission allows the source device to project the screen and allows the source device to control the screen projection, establish a screen projection connection between the source device and the target screen projection device through the distributed soft bus.

[0025] Optionally, the screen projection control method based on the distributed soft bus, wherein the step of obtaining the projection content and the projection ratio of the source device, and synchronously projecting and displaying the projection content on the target projection device according to the projection ratio, to obtain the target projection screen played on the target projection device, specifically includes:

[0026] Acquire the user's screen projection demand information and the media data of the source device, and select the media data according to the screen projection demand information to obtain the screen projection content;

[0027] Obtaining page ratio information of the target screen projection device, and determining the projection ratio of the projection content on the target screen projection device according to the page ratio information;

[0028] Encoding the projection content through the source device to obtain the encoded projection content, and sending the encoded projection content to the target projection device;

[0029] The encoded projection content is decoded by the target projection device to obtain a target projection picture, and the target projection picture is projected and displayed on the target projection device.

[0030] Optionally, the screen projection control method based on the distributed soft bus, wherein the screen projection content and the screen projection ratio of the source device are obtained, and the screen projection content is synchronously displayed on the target screen projection device according to the screen projection ratio to obtain the target screen projection picture played on the target screen projection device, and then further includes:

[0031] Obtain the first clock information corresponding to the source device and the second clock information of the target projection device, and use the clock technology of the distributed soft bus to correct the second clock information according to the first clock information to control the source device and the target projection device to perform synchronous projection display.

[0032] In addition, to achieve the above-mentioned purpose, the present invention also provides a screen projection control system based on a distributed soft bus, wherein the screen projection control system based on a distributed soft bus includes:

[0033] A device discovery processing module is used to obtain a device communication protocol of a source device and perform device discovery processing according to the device communication protocol to obtain multiple target devices within a preset signal range;

[0034] A device networking connection module, used for acquiring a distributed soft bus, and performing networking connection between the source device and the plurality of target devices according to the distributed soft bus;

[0035] A device screen projection connection module is used to determine a target screen projection device among the multiple target devices and obtain the screen projection permission of the target screen projection device. If the source device satisfies the screen projection permission, a screen projection connection is established between the source device and the target screen projection device.

[0036] The device screen projection display module is used to obtain the projection content and projection ratio of the source device, and synchronously project and display the projection content on the target screen projection device according to the projection ratio to obtain the target projection screen played on the target screen projection device.

[0037] In addition, to achieve the above-mentioned purpose, the present invention also provides a terminal, wherein the terminal includes: a memory, a processor, and a screen projection control program based on a distributed soft bus stored in the memory and runnable on the processor, and when the screen projection control program based on the distributed soft bus is executed by the processor, the steps of the screen projection control method based on the distributed soft bus as described above are implemented.

[0038] In addition, to achieve the above-mentioned purpose, the present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a screen projection control program based on a distributed soft bus, and when the screen projection control program based on a distributed soft bus is executed by a processor, the steps of the screen projection control method based on a distributed soft bus as described above are implemented.

[0039] In the present invention, the device communication protocol of the source device is obtained, and the device discovery process is performed according to the device communication protocol to obtain multiple target devices within the preset signal range; a distributed soft bus is obtained, and the source device and the multiple target devices are networked according to the distributed soft bus; the target screen projection device among the multiple target devices is determined, and the screen projection authority of the target screen projection device is obtained. If the source device satisfies the screen projection authority, a screen projection connection is established between the source device and the target screen projection device; the screen projection content and screen projection ratio of the source device are obtained, and the screen projection content is synchronously projected and displayed on the target screen projection device according to the screen projection ratio, and the target screen projection picture played on the target screen projection device is obtained. The present invention discovers each other between devices with different communication protocols, and uses a distributed soft bus to connect and network different devices. At the same time, based on the networking connection between devices, a screen projection connection between the source device and the target device can be established, and the screen projection display between devices with different communication protocols can be effectively realized. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 It is a flow chart of a preferred embodiment of the screen projection control method based on a distributed soft bus of the present invention;

[0041] Figure 2 It is a structural diagram of a preferred embodiment of the screen projection control system based on a distributed soft bus of the present invention;

[0042] Figure 3 It is a structural diagram of a preferred embodiment of the terminal of the present invention. DETAILED DESCRIPTION

[0043] In order to make the purpose, technical solution and advantages of the present invention clearer and more specific, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0044] Screen projection technology can be divided into two main categories: wired screen projection and wireless screen projection. In recent years, wireless screen projection technology has been widely used due to its convenience and flexibility, such as Miracast, Chromecast and AirPlay. Among them, 1. Miracast is a widely adopted wireless display standard that supports point-to-point connection and can achieve direct communication between devices without access points. Miracast technology can achieve high-definition video streaming and supports audio and touch feedback. In order to achieve small window projection, Miracast can control the display area on the receiving device through custom client software, allowing users to perform other operations on the main screen at the same time. 2. Chromecast is a screen projection technology developed by Google that uses Wi-Fi connection to transmit content from mobile devices or computers to display devices such as TVs. Chromecast supports multiple content sources and can display content in small windows on the receiving end, and users can perform other activities on the same screen. 3. AirPlay is an Apple technology that allows users to wirelessly transmit content on iPhone, iPad or Mac to AppleTV or other supported devices. AirPlay 2 introduces enhanced multi-room audio capabilities and supports small window playback, allowing users to continue playing audio or video content while performing other operations on the main screen. 4. Custom SDK. In addition to the above standard protocols, many manufacturers have also developed their own SDKs to implement small window screen projection functions. These SDKs usually integrate proprietary optimization technologies such as video compression, network bandwidth management, low-latency transmission, etc. to improve user experience. Through these SDKs, developers can easily integrate small window screen projection functions into their applications.

[0045] Although existing screen projection technologies such as Miracast, Chromecast, AirPlay, etc. have brought great convenience to users, there are still the following problems in practical applications: 1. The delay problem in the screen projection process is still a common problem, especially in application scenarios that require real-time interaction, such as online education, remote collaborative meetings, etc., high delay will seriously affect the user experience; 2. The compatibility problem between different devices and platforms is also an issue that cannot be ignored. Due to the different technical standards adopted by various manufacturers, there may be poor compatibility when casting across platforms, which affects the coherence and consistency of the user experience; 3. For small window screen projection technology, although it can achieve multi-tasking to a certain extent, it still needs to be strengthened in resource management and performance optimization, especially when processing high-definition video streams, how to balance picture quality and fluency has become a technical difficulty; 4. Security is also a major challenge facing screen projection technology, especially when using the screen projection function in public places, how to protect the privacy and personal information security of users has become an urgent problem to be solved. In summary, although the existing screen projection technology has made significant progress in many aspects, there is still a lot of room for improvement in delay control, compatibility, resource management, performance optimization and security.

[0046] To solve the above problems, the present invention provides a screen projection control method based on a distributed soft bus, aiming to achieve efficient and low-latency communication and screen projection between devices. Distributed soft bus technology builds a virtual bus network to enable seamless connection between mobile phones, tablets, smart screens and other devices to form a multi-device collaborative whole. During the screen projection process, this technology allows the source device (such as a mobile phone) to establish a direct connection with the target device (such as a smart screen) without the need for complicated configuration steps. Once the connection is successful, the content on the mobile phone or tablet can be quickly and smoothly transmitted to the large-screen device, realizing real-time synchronization of screen content.

[0047] The screen projection control method based on the distributed soft bus described in the preferred embodiment of the present invention is as follows: Figure 1 As shown, the screen projection control method based on the distributed soft bus includes the following steps:

[0048] Step S10: Acquire the device communication protocol of the source device, and perform device discovery processing according to the device communication protocol to obtain multiple target devices within a preset signal range.

[0049] The distributed soft bus builds a virtual bus network that allows different types of devices to discover and establish connections with each other, and on this basis, achieve efficient data exchange. The technology implements its functions through the following key components: 1. Discovery service: responsible for automatic discovery and pairing between devices, based on multiple wireless communication protocols such as Wi-Fi and Bluetooth, to ensure that devices can quickly find each other; 2. Connection management: provides a connection management mechanism between devices, including operations such as connection establishment, maintenance and disconnection, to ensure the stability and reliability of the communication link; 3. Data transmission layer: uses efficient data transmission protocols such as TCP / IP, UDP, etc., to support multiple data types and service quality assurance.

[0050] The implementation logic of the distributed soft bus in the screen projection solution mainly includes four aspects: device discovery and pairing, connection establishment and maintenance, data transmission and synchronization, and interactive control.

[0051] The device discovery and pairing process includes: During the screen projection process, the automatic discovery and pairing between devices must be completed first. This step usually involves the following processes: 1. Device broadcast: The source device (such as a mobile phone) will periodically broadcast its existence information so that surrounding devices can sense its existence; 2. Scanning and monitoring: The target device (such as a TV) is in monitoring mode. When it receives the broadcast information from the source device, it will respond to it and start the pairing process; 3. Pairing authentication: In order to ensure communication security, the devices will perform a pairing authentication process, which may include PIN code verification, certificate exchange, etc.

[0052] Specifically, the device communication protocol of the source device is obtained, and the device discovery strategy of the source device is set, wherein the device discovery strategy includes the device discovery frequency, the data reporting frequency and the scanning period; the preset signal range of the source device is determined, and a request message is sent in a broadcast manner within the preset signal range according to the device communication protocol and the device discovery strategy, and multiple returned message response information is received in real time; the multiple message response information is verified and processed, and multiple target message response information that passes the verification is obtained from the multiple message response information; the multiple target devices corresponding to the multiple target message response information are determined, and the multiple target devices are determined to be networkable devices.

[0053] The source device can be a terminal device with screen projection function such as a smartphone, tablet computer, laptop computer, etc., and the target device can be a terminal device with screen projection function such as a smartphone, tablet computer, laptop computer, etc. The source device is the master device and the target device is the controlled device.

[0054] The source device uses broadcasting to perform device discovery and search. When the target device receives the broadcast information of the source device, it responds and performs pairing verification, wherein the verification method includes PIN code verification or certificate exchange. When the source device discovers multiple target devices, the source device obtains the authentication information of each target device, and parses the authentication information to obtain identification information (i.e., the message response information in the present invention); and obtains the preset identification information input by the user, thereby verifying whether the identification information is the same as the preset identification information; if the verification identification information is the same as the preset identification information, an authentication result of successful authentication is generated; if the verification identification information is not the same as the preset identification information, an authentication result of unsuccessful authentication is generated. For example, if the source device parses the authentication information and obtains the PIN code corresponding to the identification information as 1234; the source device obtains the PIN code corresponding to the preset identification information input by the user as 1234, then it is determined that the identification information is the same as the preset identification information, and generates an authentication result of successful authentication.

[0055] Step S20: Obtain a distributed soft bus, and network the source device and the plurality of target devices according to the distributed soft bus.

[0056] In reality, there are many different ways of communication between multiple devices (WIFI, Bluetooth, etc.), and the use of different communication methods is very different, resulting in many communication problems; at the same time, there are also challenges such as the integration and sharing of communication links between devices and the inability to handle conflicts. The distributed soft bus fully abstracts the details of distributed communication, encapsulates the underlying communication protocol, and provides a simple communication interface to the outside world, so that developers only need to focus on the implementation of business logic and quickly and efficiently complete the networking and communication tasks between devices. The distributed soft bus provides the discovery and connection functions between devices based on the software and hardware collaboration of Ethernet, WIFI and Bluetooth; after the devices discover and connect to each other, the distributed soft bus manages the self-organizing network and topological relationship between the devices. The distributed soft bus realizes the unified distributed communication management capabilities between near-field devices, and provides the discovery, connection, networking and transmission capabilities between devices that do not distinguish between links. The distributed soft bus can connect all system devices in the same local area network, and has the characteristics of self-discovery, self-organizing network, high bandwidth and low latency. In addition to connecting hardware devices in the same network protocol, the soft bus technology also supports networking of heterogeneous networks with different protocols.

[0057] Specifically, device node information of the source device and the multiple target devices is obtained, wherein the device node information includes device scanning perception information, device status information and device attribute information; a distributed soft bus is obtained, and the distributed soft bus is used to network the source device and the multiple target devices according to the device node information.

[0058] Among them, the networking connection relationship between devices is determined by the device node information. According to the channel consumption between the devices corresponding to the device node information, the connection method with the least consumption is selected to build the network.

[0059] When pairing is completed, the connection between the source device and the target device is established through the distributed soft bus; the distributed soft bus technology can realize the unified distributed communication management capability between devices, and provide the ability to discover connections, network and transmit between devices without distinguishing links. Therefore, the master device and the controlled device based on the distributed soft bus can discover each other and establish a connection, so as to realize the transmission of data between the master device and the controlled device, and establish the connection between the master device and the controlled device based on the distributed soft bus, so as to build a projection system.

[0060] Furthermore, after the networking connection between the source device and the multiple target devices is completed, the distributed soft bus generates a detection heartbeat packet at a preset interval; if it is determined that the networking between the source device and the multiple target devices is abnormal based on the detection heartbeat packet, the source device and the multiple target devices are re-networked.

[0061] The connection establishment and maintenance process includes 1. Connection establishment: After the devices are successfully paired, the two parties establish a stable communication connection through the distributed soft bus; 2. Connection maintenance: In order to maintain the stability of the connection, the distributed soft bus will periodically send heartbeat packets, detect the connection status, and re-establish the connection when necessary.

[0062] Step S30, determine the target screen projection device among the multiple target devices, and obtain the screen projection permission of the target screen projection device. If the source device meets the screen projection permission, establish a screen projection connection between the source device and the target screen projection device.

[0063] After the devices are connected to a network, if screen projection between devices is required, the source device also needs to obtain the projection permission of the target projection device. Only when the source device meets the projection permission of the target projection device, the projection content of the source device can be allowed to be projected to the target projection device.

[0064] Specifically, when the source device receives a device screen projection instruction issued by the user, it searches multiple target devices according to the device screen projection instruction to determine the target screen projection device among the multiple target devices; obtains the screen projection permission of the target screen projection device, and if the screen projection permission allows the source device to project the screen and allows the source device to control the screen projection, then establishes a screen projection connection between the source device and the target screen projection device through the distributed soft bus.

[0065] The source device obtains the screen projection permission information of the target screen projection device, and determines whether the source device allows screen projection based on the screen projection permission information; if it is determined that the source device allows screen projection, the collaboration permission information of the target screen projection device is obtained, and determines whether the target screen projection device allows collaboration based on the collaboration permission information; if it is determined that the target screen projection device allows collaboration, the target screen projection device establishes a screen projection connection with the source device through the distributed soft bus, thereby accurately obtaining the permission information of the corresponding device, thereby establishing a screen projection connection between the target screen projection device and the source device.

[0066] Step S40, obtain the projection content and projection ratio of the source device, and synchronously project the projection content on the target projection device according to the projection ratio to obtain the target projection screen played on the target projection device.

[0067] The data transmission and synchronization process includes: 1. Encoding and decoding: the source device encodes and compresses the screen content to meet the requirements of network transmission. After the target device receives the data, it decodes and restores it; 2. Data transmission: use efficient transmission protocols such as TCP / IP or UDP to achieve real-time data stream transmission; 3. Synchronization mechanism: in order to ensure the synchronization of video and audio, the system needs to adopt an accurate time synchronization algorithm to reduce delays in the transmission process.

[0068] Specifically, the user's screen projection demand information and the media data of the source device are obtained, and the media data is selected according to the screen projection demand information to obtain the projection content; the page ratio information of the target screen projection device is obtained, and the projection ratio of the projection content on the target screen projection device is determined according to the page ratio information; the projection content is encoded by the source device to obtain the encoded projection content, and the encoded projection content is sent to the target screen projection device; the encoded projection content is decoded by the target screen projection device to obtain the target projection picture, and the target projection picture is projected and displayed on the target screen projection device.

[0069] Obtain the user's screen projection demand information and the media data of the source device, parse each media stream data in the media data of the source device to obtain the corresponding sound data and video data, select according to the user's screen projection demand information, and use the selected sound data and selected video data as the screen projection content.

[0070] The projection content is encoded and compressed to obtain encoded projection data, and the encoded projection data is sent to the target projection device through a preset transmission protocol (such as TCP / IP and other protocols), and the target projection device decodes the encoded projection data to obtain target projection data, and the target projection data is projected and displayed on the target projection device (wherein, an accurate time synchronization algorithm is required to ensure that the projection content of the target device is consistent with the playback content of the source device, thereby reducing delays in the transmission process).

[0071] Furthermore, the first clock information corresponding to the source device and the second clock information of the target projection device are obtained, and the second clock information is corrected according to the first clock information using the clock technology of the distributed soft bus to control the source device and the target projection device to perform synchronous projection display.

[0072] By using the clock of the source device as the reference clock, the time information of the target projection device that needs to be projected can be corrected based on the distributed soft clock technology, and the synchronization of the source device and the target projection device can be accurately controlled, so that the distributed soft clock accuracy can reach 1ms. Based on the distributed soft clock algorithm and the coordination of the transmission layer, the distributed soft clock accuracy can reach 500us, and based on the distributed soft clock algorithm and the coordination of the transmission layer and the physical layer, the distributed soft clock accuracy is less than 300us, so that after the target projection device receives the projection content sent by the source device, it renders and plays according to the timestamp of the video frame image. Since the clocks of the source device and the target projection device are synchronized, the source device and the target projection device can display the image of the same frame at the same time, avoiding the phenomenon of image asynchrony. Furthermore, after the source device and the target device are connected for projection, the source device can be remotely controlled, such as adjusting the volume and playback control of the projection content.

[0073] Furthermore, when the target screen projection device receives screen projection requests and projection content from multiple source devices, it obtains the timestamps when the multiple source devices send the projection request information, and arranges the projection screens according to the timestamps (giving priority to the projection screens with earlier timestamps); the order in which the source devices send the projection request information to the target screen projection device is determined according to the timestamps, thereby ensuring that the target screen projection device can sort the projection screens normally.

[0074] For the projection interface ratio setting process on the projection interface of the target projection device: obtain the page ratio information of the target projection device, determine the projection ratio of the projection content of the source device according to the page ratio information, and manipulate the corresponding screen of the target projection device through the projection ratio to obtain the projection interface ratio after manipulation and the projection display screen played according to the projection interface ratio.

[0075] Furthermore, when the user performs touch adjustment on the screen projection content of the source device, in order to ensure the synchronization of the content adjustment of the source device and the target screen projection device, the implementation process is as follows: obtain the user's touch event information on the screen projection content in the source device, determine the operation corresponding to the target touch event according to the touch event information, and control the target screen projection device to perform the operation. Among them, in order to realize touch control on the display screen of the target screen projection device, it is necessary to convert the coordinate position of the touch operation received on the source device into the coordinate position in the display screen of the corresponding target screen projection device, determine the corresponding operation at the converted coordinate position on the display screen of the source device, match the touch action on the display screen of the source device with multiple preset touch actions, and determine the target touch action from multiple preset touch actions. Obtain the control information corresponding to the target touch action, and use the control information as the control information corresponding to the touch action on the target screen projection device. In this way, the control information corresponding to the touch action can be accurately determined, so as to realize the reverse control of the source device by the target screen projection device, wherein the target touch action is the touch action with the highest similarity to the touch action on the display screen among the multiple preset touch actions.

[0076] The interactive control process includes: 1. Remote control: In addition to the basic screen projection function, the distributed soft bus also supports remote control function, that is, the user can control the operation of the target device through the source device, such as volume adjustment, playback control, etc.; 2. Multi-screen interaction: support collaborative work between multiple devices, such as displaying different content on multiple screens or working as a whole.

[0077] Technical effects of the present invention:

[0078] 1. Low latency: By optimizing the transmission protocol and adopting efficient encoding and decoding algorithms, the latency of data transmission is significantly reduced.

[0079] 2. High bandwidth: Utilizing high-bandwidth wireless connection technologies, such as Wi-Fi 6 / 6E, ensures the transmission of high-quality video and audio.

[0080] 3. Self-discovery and self-organizing network: simplifies the user operation process and improves the connection efficiency between devices.

[0081] 4. Security: Built-in security mechanism ensures the security of data transmission and prevents unauthorized access.

[0082] In addition, considering the advantages of distributed soft bus technology in small window projection, more technological innovations can be explored to further enhance the user experience. For example, a more intelligent projection experience can be achieved by integrating artificial intelligence technology, such as automatically identifying user behavior and intelligently adjusting the position and size of the projection window; or using machine learning algorithms to optimize data transmission strategies to further reduce latency and improve video quality. In addition, considering the compatibility and interoperability between different devices, the formulation and development of industry standards can be promoted. Through standardization efforts, it can ensure that distributed soft bus technology can be widely accepted and used, promote seamless connections between devices of different brands and models, and further promote technological progress in smart homes, smart offices and other fields.

[0083] The distributed soft bus technology adopted in the present invention realizes a low-latency, high-bandwidth screen projection experience through key technologies such as automatic device discovery and pairing, connection establishment and maintenance, efficient data transmission and synchronization. Especially in the small window screen projection scenario, this technology gives full play to the advantages of the distributed soft bus, allowing users to watch the screen content of the sending device in window mode on the receiving device without occupying the entire screen, thereby realizing multi-tasking. The security of data transmission is guaranteed by the built-in security mechanism, and the interoperability and compatibility between different devices are enhanced by supporting multiple communication protocols, providing users with a flexible and efficient small window screen projection solution. This solution fully utilizes the advantages of the distributed soft bus, which not only greatly improves the user experience, but also lays a solid foundation for the interconnection of devices in the future Internet of Things era. Through optimized discovery, connection management and data transmission mechanisms, this technology not only significantly reduces the delay of data transmission, but also ensures the transmission of high-quality video and audio, so that users can perform other operations while enjoying a smooth screen projection experience, greatly improving work efficiency and entertainment experience.

[0084] Furthermore, if Figure 2 As shown, based on the above-mentioned projection control method based on the distributed soft bus, the present invention also provides a projection control system based on the distributed soft bus, wherein the projection control system based on the distributed soft bus includes:

[0085] The device discovery processing module 51 is used to obtain the device communication protocol of the source device and perform device discovery processing according to the device communication protocol to obtain multiple target devices within a preset signal range;

[0086] The device networking connection module 52 is used to obtain a distributed soft bus and to perform networking connection between the source device and the plurality of target devices according to the distributed soft bus;

[0087] The device screen projection connection module 53 is used to determine a target screen projection device among the multiple target devices and obtain the screen projection permission of the target screen projection device. If the source device satisfies the screen projection permission, a screen projection connection is established between the source device and the target screen projection device.

[0088] The device screen projection display module 54 is used to obtain the projection content and projection ratio of the source device, and synchronously project and display the projection content on the target screen projection device according to the projection ratio to obtain the target projection screen played on the target screen projection device.

[0089] Furthermore, if Figure 3 As shown, based on the above-mentioned screen projection control method and system based on the distributed soft bus, the present invention also provides a terminal accordingly, and the terminal includes a processor 10, a memory 20 and a display 30. Figure 3 Only some components of the terminal are shown, but it should be understood that it is not required to implement all of the components shown, and more or fewer components may be implemented instead.

[0090] In some embodiments, the memory 20 may be an internal storage unit of the terminal, such as a hard disk or memory of the terminal. In other embodiments, the memory 20 may also be an external storage device of the terminal, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), etc. equipped on the terminal. Furthermore, the memory 20 may also include both an internal storage unit of the terminal and an external storage device. The memory 20 is used to store application software and various types of data installed on the terminal, such as the program code of the installation terminal. The memory 20 can also be used to temporarily store data that has been output or is to be output. In one embodiment, a screen projection control program 40 based on a distributed soft bus is stored on the memory 20, and the screen projection control program 40 based on a distributed soft bus can be executed by the processor 10, thereby realizing the screen projection control method based on a distributed soft bus in the present application.

[0091] In some embodiments, the processor 10 may be a central processing unit (CPU), a microprocessor or other data processing chip, used to run the program code or process data stored in the memory 20, such as executing the screen projection control method based on the distributed soft bus.

[0092] In some embodiments, the display 30 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, etc. The display 30 is used to display information on the terminal and to display a visual user interface. The components 10-30 of the terminal communicate with each other via a system bus.

[0093] In one embodiment, when the processor 10 executes the distributed soft bus-based screen projection control program 40 in the memory 20, the following steps are implemented:

[0094] Acquire a device communication protocol of a source device, and perform device discovery processing according to the device communication protocol to obtain a plurality of target devices within a preset signal range;

[0095] Acquire a distributed soft bus, and network the source device and the plurality of target devices according to the distributed soft bus;

[0096] Determine a target screen projection device among the multiple target devices, and obtain the screen projection permission of the target screen projection device, and if the source device satisfies the screen projection permission, establish a screen projection connection between the source device and the target screen projection device;

[0097] The projection content and projection ratio of the source device are obtained, and the projection content is synchronously projected and displayed on the target projection device according to the projection ratio to obtain the target projection screen played on the target projection device.

[0098] The acquiring of the device communication protocol of the source device and performing device discovery processing according to the device communication protocol to obtain multiple target devices within a preset signal range specifically includes:

[0099] Acquire a device communication protocol of a source device, and set a device discovery strategy for the source device, wherein the device discovery strategy includes a device discovery frequency, a data reporting frequency, and a scanning period;

[0100] Determine a preset signal range of the source device, send a request message in a broadcast manner within the preset signal range according to the device communication protocol and the device discovery strategy, and receive multiple returned message response information in real time;

[0101] Performing verification processing on the plurality of message response information, and obtaining a plurality of target message response information that pass the verification from the plurality of message response information;

[0102] A plurality of target devices corresponding to the plurality of target message response information are determined, and the plurality of target devices are determined to be networkable devices.

[0103] The obtaining of a distributed soft bus and networking the source device and the plurality of target devices according to the distributed soft bus specifically includes:

[0104] Acquire device node information of the source device and the plurality of target devices, wherein the device node information includes device scanning perception information, device status information, and device attribute information;

[0105] A distributed soft bus is obtained, and the distributed soft bus is used to network the source device and the plurality of target devices according to the device node information.

[0106] The step of obtaining a distributed soft bus and networking the source device and the plurality of target devices according to the distributed soft bus further includes:

[0107] When the source device and the plurality of target devices are networked and connected, the distributed soft bus generates a detection heartbeat packet at a preset interval;

[0108] If it is determined according to the detection heartbeat packet that the networking of the source device and the plurality of target devices is abnormal, the source device and the plurality of target devices are re-networked.

[0109] The step of determining a target screen projection device among the multiple target devices and obtaining the screen projection permission of the target screen projection device, and establishing a screen projection connection between the source device and the target screen projection device if the source device satisfies the screen projection permission, specifically includes:

[0110] When the source device receives a device screen projection instruction issued by the user, it searches the multiple target devices according to the device screen projection instruction to determine a target screen projection device among the multiple target devices;

[0111] Obtain the screen projection permission of the target screen projection device. If the screen projection permission allows the source device to project the screen and allows the source device to control the screen projection, establish a screen projection connection between the source device and the target screen projection device through the distributed soft bus.

[0112] The acquiring of the projection content and projection ratio of the source device, and synchronous projection display of the projection content on the target projection device according to the projection ratio, to obtain the target projection screen played on the target projection device, specifically includes:

[0113] Acquire the user's screen projection demand information and the media data of the source device, and select the media data according to the screen projection demand information to obtain the screen projection content;

[0114] Obtaining page ratio information of the target screen projection device, and determining the projection ratio of the projection content on the target screen projection device according to the page ratio information;

[0115] Encoding the projection content through the source device to obtain the encoded projection content, and sending the encoded projection content to the target projection device;

[0116] The encoded projection content is decoded by the target projection device to obtain a target projection picture, and the target projection picture is projected and displayed on the target projection device.

[0117] The step of obtaining the projection content and projection ratio of the source device, and synchronously projecting and displaying the projection content on the target projection device according to the projection ratio to obtain the target projection screen played on the target projection device, further includes:

[0118] Obtain the first clock information corresponding to the source device and the second clock information of the target projection device, and use the clock technology of the distributed soft bus to correct the second clock information according to the first clock information to control the source device and the target projection device to perform synchronous projection display.

[0119] The present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a screen projection control program based on a distributed soft bus, and when the screen projection control program based on a distributed soft bus is executed by a processor, the steps of the screen projection control method based on a distributed soft bus as described above are implemented.

[0120] In summary, the present invention provides a screen projection control method, system, terminal and computer-readable storage medium based on a distributed soft bus, the method comprising: obtaining the device communication protocol of the source device, and performing device discovery processing according to the device communication protocol to obtain multiple target devices within a preset signal range; obtaining a distributed soft bus, and networking the source device and multiple target devices according to the distributed soft bus; determining the target screen projection device among the multiple target devices, and obtaining the screen projection authority of the target screen projection device, if the source device satisfies the screen projection authority, then establishing a screen projection connection between the source device and the target screen projection device; obtaining the screen projection content and screen projection ratio of the source device, and synchronously projecting the screen projection content on the target screen projection device according to the screen projection ratio, and obtaining the target screen projection picture played on the target screen projection device. The present invention discovers each other between devices with different communication protocols, and uses a distributed soft bus to connect and network different devices. At the same time, based on the networking connection between devices, a screen projection connection between the source device and the target device can be established, and screen projection display between devices with different communication protocols can be effectively realized.

[0121] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or terminal including the element.

[0122] Of course, those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware (such as a processor, a controller, etc.) through a computer program, and the program can be stored in a computer-readable storage medium that can be read by a computer, and the program can include the processes of the above-mentioned method embodiments when executed. The computer-readable storage medium can be a memory, a disk, an optical disk, etc.

[0123] It should be understood that the application of the present invention is not limited to the above examples. For ordinary technicians in this field, improvements or changes can be made based on the above description. All these improvements and changes should fall within the scope of protection of the claims attached to the present invention.

Claims

1. A screen projection control method based on a distributed soft bus, characterized in that: The screen projection control method based on the distributed soft bus includes: Acquire a device communication protocol of a source device, and perform device discovery processing according to the device communication protocol to obtain a plurality of target devices within a preset signal range; Acquire a distributed soft bus, and network the source device and the plurality of target devices according to the distributed soft bus; Determine a target screen projection device among the multiple target devices, and obtain the screen projection permission of the target screen projection device, and if the source device satisfies the screen projection permission, establish a screen projection connection between the source device and the target screen projection device; The projection content and projection ratio of the source device are obtained, and the projection content is synchronously projected and displayed on the target projection device according to the projection ratio to obtain the target projection screen played on the target projection device.

2. The screen projection control method based on the distributed soft bus according to claim 1 is characterized in that: The acquiring of the device communication protocol of the source device and performing device discovery processing according to the device communication protocol to obtain a plurality of target devices within a preset signal range specifically includes: Acquire a device communication protocol of a source device, and set a device discovery strategy for the source device, wherein the device discovery strategy includes a device discovery frequency, a data reporting frequency, and a scanning period; Determine a preset signal range of the source device, send a request message in a broadcast manner within the preset signal range according to the device communication protocol and the device discovery strategy, and receive multiple returned message response information in real time; Performing verification processing on the plurality of message response information, and obtaining a plurality of target message response information that pass the verification from the plurality of message response information; A plurality of target devices corresponding to the plurality of target message response information are determined, and the plurality of target devices are determined to be networkable devices.

3. The screen projection control method based on the distributed soft bus according to claim 1 is characterized in that: The obtaining of a distributed soft bus and networking the source device and the plurality of target devices according to the distributed soft bus specifically includes: Acquire device node information of the source device and the plurality of target devices, wherein the device node information includes device scanning perception information, device status information, and device attribute information; A distributed soft bus is obtained, and the distributed soft bus is used to network the source device and the plurality of target devices according to the device node information.

4. The screen projection control method based on the distributed soft bus according to claim 1 is characterized in that: The step of obtaining a distributed soft bus and networking the source device and the plurality of target devices according to the distributed soft bus further includes: When the source device and the plurality of target devices are networked and connected, the distributed soft bus generates a detection heartbeat packet at a preset interval; If it is determined according to the detection heartbeat packet that the networking of the source device and the plurality of target devices is abnormal, the source device and the plurality of target devices are re-networked.

5. The screen projection control method based on the distributed soft bus according to claim 1, characterized in that: The determining a target screen projection device among the multiple target devices, and obtaining the screen projection permission of the target screen projection device, and if the source device satisfies the screen projection permission, establishing a screen projection connection between the source device and the target screen projection device, specifically includes: When the source device receives a device screen projection instruction issued by the user, it searches the multiple target devices according to the device screen projection instruction to determine a target screen projection device among the multiple target devices; Obtain the screen projection permission of the target screen projection device. If the screen projection permission allows the source device to project the screen and allows the source device to control the screen projection, establish a screen projection connection between the source device and the target screen projection device through the distributed soft bus.

6. The screen projection control method based on the distributed soft bus according to claim 1, characterized in that: The acquiring the projection content and projection ratio of the source device, and synchronously projecting and displaying the projection content on the target projection device according to the projection ratio, to obtain the target projection screen played on the target projection device, specifically includes: Acquire the user's screen projection demand information and the media data of the source device, and select the media data according to the screen projection demand information to obtain the screen projection content; Obtaining page ratio information of the target screen projection device, and determining the projection ratio of the projection content on the target screen projection device according to the page ratio information; Encoding the projection content through the source device to obtain the encoded projection content, and sending the encoded projection content to the target projection device; The encoded projection content is decoded by the target projection device to obtain a target projection picture, and the target projection picture is projected and displayed on the target projection device.

7. The screen projection control method based on the distributed soft bus according to claim 1, characterized in that: The step of obtaining the projection content and the projection ratio of the source device, and synchronously projecting and displaying the projection content on the target projection device according to the projection ratio to obtain the target projection screen played on the target projection device, further includes: Obtain the first clock information corresponding to the source device and the second clock information of the target projection device, and use the clock technology of the distributed soft bus to correct the second clock information according to the first clock information to control the source device and the target projection device to perform synchronous projection display.

8. A screen projection control system based on a distributed soft bus, characterized in that: The projection control system based on the distributed soft bus includes: A device discovery processing module is used to obtain a device communication protocol of a source device and perform device discovery processing according to the device communication protocol to obtain multiple target devices within a preset signal range; A device networking connection module, used for acquiring a distributed soft bus, and performing networking connection between the source device and the plurality of target devices according to the distributed soft bus; A device screen projection connection module is used to determine a target screen projection device among the multiple target devices and obtain the screen projection permission of the target screen projection device. If the source device satisfies the screen projection permission, a screen projection connection is established between the source device and the target screen projection device. The device screen projection display module is used to obtain the projection content and projection ratio of the source device, and synchronously project and display the projection content on the target screen projection device according to the projection ratio to obtain the target projection screen played on the target screen projection device.

9. A terminal, characterized in that: The terminal includes: a memory, a processor, and a screen projection control program based on a distributed soft bus stored in the memory and executable on the processor. When the screen projection control program based on the distributed soft bus is executed by the processor, the steps of the screen projection control method based on the distributed soft bus are implemented as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a screen projection control program based on a distributed soft bus. When the screen projection control program based on a distributed soft bus is executed by a processor, the steps of the screen projection control method based on a distributed soft bus are implemented as described in any one of claims 1-7.

Images