Screen projection method, system and device based on Android device
Through wireless scanning data integration and signal environment model screening equipment, automated pairing and network connection of Android devices are realized, solving the operational complexity problem when Android devices do not have a built-in display screen, and improving the efficiency and convenience of configuration and management.
Patent Information
- Application Number
- CN202411266223.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-11
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2044-09-11
AI Technical Summary
When Android devices do not have built-in displays, users have difficulty accessing the display interface during configuration and management, resulting in complex and inefficient operations and lack of effective alternatives to simplify the setup process.
By obtaining wireless scanning data of mobile communication devices, integrating BLE device broadcast signals, creating a digital model of the signal environment, filtering devices to be paired, formulating pairing strategies, automating device pairing and network connections, and realizing device images by touching interactive data mapping BLE instructions Screen projection and remote control.
Improves the operation efficiency and user experience of Android devices without a built-in display, simplifies the device configuration and management process, and enhances the accuracy and convenience of device pairing, network connection and remote control.
Smart Images

Figure CN118803341B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of image communication technology, and in particular to a screen projection method, system and device based on an Android device. Background Art
[0002] In today's digital age, the diversity and flexibility of Android devices make them the core of various application scenarios. However, with the advancement of technology and the changes in user needs, many Android devices (such as some types of smart boxes or streaming devices) no longer come with built-in displays. This design is intended to reduce production costs while supporting display functions through external displays (i.e., "external M screens"). However, this design has brought significant problems in practice, especially during device setup and management. When users need to configure or manage Android devices that do not have a built-in display, they often encounter the dilemma of not being able to access the display interface immediately. For example, when trying to connect to a WiFi network or enable the hotspot function, if there is no available display around, users will face operational difficulties. In this case, users cannot complete the setup through the device's graphical user interface (GUI), making the operation process complicated and inefficient. Existing technologies usually rely on physical displays to complete the initial setup, and lack effective alternatives to simplify this setup process. Summary of the invention
[0003] Based on this, it is necessary for the present invention to provide a screen projection method, system and device based on an Android device to solve at least one of the above technical problems.
[0004] To achieve the above purpose, a screen projection method based on an Android device includes the following steps:
[0005] Step S1: obtaining wireless scanning data of a mobile communication device, and integrating the distribution of BLE device broadcast signals according to the wireless scanning data of the mobile communication device, thereby obtaining the distribution data of BLE device broadcast signals; digitizing the signal environment of the mobile communication device according to the distribution data of the BLE device broadcast signals, thereby obtaining a digital model of the signal environment of the mobile communication device;
[0006] Step S2: performing Android device pairing screening on the Bluetooth scanning data of the mobile communication device through the digital model of the mobile communication device signal environment, thereby obtaining the data of the device to be paired; performing Bluetooth pairing strategy analysis on the device to be paired according to the data of the device to be paired, thereby obtaining the device Bluetooth pairing strategy, and transmitting it to the mobile communication device to execute the device Bluetooth pairing task;
[0007] Step S3: Screening wireless network connection nodes according to the wireless scanning data of the mobile communication device to obtain wireless network connection node data; associating the wireless network connection node data with a network connection node key to obtain the wireless network connection node key, and transmitting the key to the mobile communication device and the paired device to perform the network connection task;
[0008] Step S4: obtaining the compressed transmission data of the paired device, and decompressing the transmitted screen recording image of the paired device compressed transmission data, thereby obtaining the transmitted screen recording image of the paired device; selecting the screen projection parameters of the mobile communication device according to the transmitted screen recording image of the paired device, thereby obtaining the screen recording image projection parameter set, and transmitting it to the mobile communication device to perform the device image projection task;
[0009] Step S5: Acquire the touch interaction data of the mobile communication device, and perform touch interaction behavior analysis on the touch interaction data of the mobile communication device to obtain the touch interaction behavior data; perform BLE command mapping on the touch interaction behavior data to obtain the BLE command stream to be sent, and transmit it to the paired device to execute the paired device control task.
[0010] The present invention can more accurately obtain the BLE devices present in the surrounding environment by integrating the BLE device broadcast signal. This information can help the system determine which devices are nearby, so as to better locate and screen the devices that need to be paired. After the BLE device signal environment is digitized, the created digital model can provide data support for subsequent device pairing. The model helps to reduce the probability of mispairing and improve the accuracy and efficiency of pairing. By analyzing the Bluetooth scanning data of the mobile communication device, potential devices to be paired can be screened out and failures caused by device mismatch can be reduced. By analyzing the Bluetooth pairing strategy of the device to be paired, a more effective pairing strategy can be formulated to improve the pairing success rate and user experience. After the strategy is transmitted to the mobile communication device, the pairing process can be completed automatically. By screening the wireless network connection nodes and performing key association, the connection information can be automatically generated and transmitted to the device. This reduces the trouble of users manually entering network credentials and speeds up the network connection process. Through the key association process, the security of the wireless network connection can be ensured and the risk of unauthorized access can be avoided. By decompressing the transmission recording screen image of the paired device and selecting appropriate projection parameters, the interface content of the paired device can be projected to the mobile communication device in real time. This allows users to complete configuration and management tasks without a direct display screen. This screen projection function provides users with a more intuitive interface display and simplifies the operation process, especially during the first setup, which helps to improve the setup efficiency and accuracy. By parsing the touch interaction data of the mobile communication device, converting it into BLE instructions and sending it to the paired device, remote control of the paired device can be achieved. This allows users to operate through mobile devices without a physical interface, thereby improving the convenience of device management. This method supports the control of the device through touch screen operation, so that users can still smoothly configure and manage the device without a direct display. In summary, these steps improve the user's operating efficiency and experience when facing Android devices without built-in displays by digitizing, automating and optimizing the traditional device configuration and management process. The automation of the entire process reduces the complexity of manual operations, improves the accuracy and convenience of device pairing, network connection and remote control, and ultimately allows users to successfully complete device setup and management without relying on the built-in display.
[0011] Optionally, step S1 specifically includes:
[0012] Step S11: obtaining wireless scanning data of the mobile communication device, and performing Bluetooth scanning feature extraction on the wireless scanning data of the mobile communication device, thereby obtaining Bluetooth scanning data of the mobile communication device;
[0013] Step S12: extracting broadcast signal strength features from Bluetooth scanning data of the mobile communication device, thereby obtaining broadcast signal strength data of the scanning device;
[0014] Step S13: performing device distance estimation on the scanning device broadcast signal strength data, thereby obtaining the scanning device estimated distance data;
[0015] Step S14: performing signal distribution integration according to the broadcast signal strength data of the scanning device and the estimated distance data of the scanning device, thereby obtaining the broadcast signal distribution data of the BLE device;
[0016] Step S15: digitize the signal environment of the mobile communication device according to the BLE device broadcast signal distribution data, so as to obtain a digital model of the signal environment of the mobile communication device.
[0017] By acquiring wireless scanning data and extracting Bluetooth scanning features, the present invention can capture information about Bluetooth devices in the environment, which helps to understand the distribution and status of the devices. Extracting broadcast signal strength features helps to determine the signal strength of Bluetooth devices, thereby inferring the location and signal quality of the devices. Distance estimation of broadcast signal strength can provide an approximate distance between the device and the scanner, which helps with positioning and regional division. Signal distribution integration helps to build a signal coverage map for the device, which is important for optimizing network layout and device positioning. Digitizing the BLE device broadcast signal distribution data to form a signal environment model can achieve a comprehensive digital description of the distribution of devices and signals in the actual environment, which helps to further analyze and optimize the wireless network environment.
[0018] Optionally, step S2 specifically includes:
[0019] Step S21: extracting the MAC address of the scanning device from the Bluetooth scanning data of the mobile communication device, thereby obtaining the MAC address data of the scanning device;
[0020] Step S22: obtaining the MAC address data of the device to be paired through the mobile communication device, and filtering the MAC address data of the scanning device for pairing according to the MAC address data of the device to be paired, thereby obtaining the MAC address data of the filtering device;
[0021] Step S23: extracting the screening device scanning data from the Bluetooth scanning data of the mobile communication device according to the screening device MAC address data, thereby obtaining the screening device scanning data;
[0022] Step S24: using the digital model of the mobile communication device signal environment to remove the spoofed MAC address devices from the screening device scan data, thereby obtaining the data of the device to be paired;
[0023] Step S25: Analyze the Bluetooth pairing strategy of the device to be paired according to the data of the device to be paired, so as to obtain the device Bluetooth pairing strategy, and transmit it to the mobile communication device to execute the device Bluetooth pairing task.
[0024] The present invention extracts the MAC address data of the scanning device, which helps to identify the surrounding Bluetooth devices and establish a basic data set for subsequent processing. By screening the paired devices, it is ensured that only the scanning devices related to the target device are focused on, thereby improving the pertinence and efficiency of the pairing process. Screening device scanning data extraction further narrows the range of devices of concern, makes data analysis more accurate, and reduces interference from irrelevant data. Eliminating devices with disguised MAC addresses can improve the credibility of the data and the security of pairing, and prevent malicious devices from interfering with the pairing process. Analyzing and generating pairing strategies ensures the best practices of the Bluetooth pairing process, improves the success rate of pairing and the overall performance of the system.
[0025] Optionally, step S24 is specifically:
[0026] Step S241: classifying the low device broadcast signal strength of the screening device scanning data through the mobile communication device signal environment model, thereby obtaining low signal strength area data;
[0027] Step S242: performing scanning area device address change statistics on the screening device scanning data, thereby obtaining scanning area device address change data;
[0028] Step S243: dividing the scanning area device address change data into high-frequency device address change areas, thereby obtaining high-frequency device address change area data;
[0029] Step S244: performing a scan area intersection operation on the low signal strength area data and the high frequency device address change area data, thereby obtaining abnormal scan area data;
[0030] Step S245: performing scanning device association on the screening device scanning data according to the abnormal scanning area data, thereby obtaining the disguised MAC address device data;
[0031] Step S246: remove the fake MAC address devices from the screening device scanning data according to the fake MAC address device data, thereby obtaining the device data to be paired.
[0032] The present invention can identify those devices that may be at a long distance or subject to signal interference by classifying low signal strength areas. This helps to exclude devices with poor signal quality and reduce false or unreliable scanning results, thereby improving the accuracy and efficiency of the pairing process. By counting the changes in device addresses, the dynamic nature of devices in the scanning area can be identified. This statistics helps to find devices that frequently change addresses, prompting that the devices are constantly moving or changing their identifiers, thereby helping to identify potential disguised or temporary devices. By dividing the device address change frequency into regions, it is possible to highlight and identify those areas where the device addresses are frequently changed. This division helps to further analyze and identify abnormal device behaviors, improve the sensitivity to disguised devices, and optimize the screening process. Through intersection operations, scanning areas that are both in low signal strength areas and high-frequency device address change areas can be found. This process can effectively focus on those scanning areas with abnormalities, reduce interference, and improve the accuracy of detecting disguised devices. By associating abnormal scanning areas with device scanning data, devices active in these areas can be identified, which are disguised or have abnormal behaviors. This step helps to filter out disguised MAC address devices and improve the credibility of data. Devices with fake MAC addresses are eliminated based on their data to ensure that the final data of devices to be paired does not include fake devices. This step improves the security and accuracy of device pairing and reduces potential security risks and the possibility of mispairing.
[0033] Optionally, step S3 specifically includes:
[0034] Step S31: extracting Wi-Fi scanning features from the wireless scanning data of the mobile communication device, thereby obtaining the Wi-Fi scanning data of the mobile communication device;
[0035] Step S32: extracting network node SSID features and network node signal strength features from the Wi-Fi scan data of the mobile communication device, thereby obtaining scanned network node SSID data and scanned network node signal strength data;
[0036] Step S33: obtaining pre-connected Wi-Fi network node data, and performing pre-connected network node SSID feature extraction and pre-connected network node key feature extraction on the pre-connected Wi-Fi node data, thereby obtaining pre-connected network node SSID data and pre-connected network node key data;
[0037] Step S34: dividing nodes with high signal strength according to the scanned network node signal strength data, thereby obtaining high signal strength node data;
[0038] Step S35: performing SSID node screening on the scanned network node SSID data according to the pre-connected network node SSID data, thereby obtaining SSID-compliant node data;
[0039] Step S36: performing node intersection operation on the high signal strength node data and the SSID matching node data, thereby obtaining the wireless network connection node data;
[0040] Step S37: associate the wireless network connection node data with the network connection node key according to the pre-connection network node key data, thereby obtaining the wireless network connection node key, and transmitting it to the mobile communication device and the paired device to perform the network connection task.
[0041] The present invention can collect relevant information about surrounding Wi-Fi networks, including network names (SSIDs) and signal strengths, by wirelessly scanning mobile communication devices. This process provides basic data for subsequent network node analysis and screening. The extracted Wi-Fi scan data can help determine the location of the device and the wireless network environment around it, which helps to improve positioning services and enhance the environmental perception capabilities of the device. By extracting SSID and signal strength features respectively, the original scan data can be refined into two key data points. This helps to better analyze and understand the quality and availability of the surrounding networks. By obtaining the SSID and signal strength data of each network node, the availability and priority of each network node can be more effectively evaluated, laying the foundation for selecting the best connection network. Extracting the SSID and key data of the pre-connected Wi-Fi node enables the device to quickly identify and connect to the previously connected network, thereby improving the success rate and speed of the connection. The user device can remember and automatically connect to a familiar network, reducing the need for the user to manually enter a password and improving the convenience of use. By screening the signal strength, network nodes with higher signal strength can be given priority. This helps to select a network with better signal quality and more stable connection, and improves the reliability of network connection. Nodes with high signal strength generally provide more stable connections, reducing the impact of network interference and signal attenuation on connection quality. By filtering the scanned SSID data, only those network nodes that match the SSIDs of the pre-connected Wi-Fi nodes are considered. This can avoid trying to connect to irrelevant networks and improve the accuracy of the connection. Filtering out SSIDs that do not meet expectations helps prevent connections to potentially unsafe networks, thereby enhancing overall security. By performing an intersection operation on high signal strength nodes and SSID matching nodes, the best network nodes that meet all conditions can be obtained. This helps to further improve the quality and stability of network connections. The intersection operation can exclude network nodes that do not meet all conditions, reducing errors and uncertainties in the selection process. Key association is performed on wireless network connection nodes based on the keys of the pre-connected nodes, allowing devices to automatically complete the connection process without the need for users to manually enter passwords. By associating and managing network keys, it is ensured that the device is connected to the correct network, improving the security and protection of data transmission. Overall, this series of steps can effectively improve the success rate, stability and security of wireless network connections through refined network node analysis, screening and matching. For users, this means a faster and more reliable network connection experience, while reducing manual intervention in the connection process and improving convenience. For devices, this precise network selection and automatic connection capabilities can enhance the intelligence of the device and enhance user satisfaction.
[0042] Optionally, step S4 is specifically:
[0043] Step S41: obtaining the compressed transmission data of the paired device, and decompressing the compressed transmission data of the paired device, thereby obtaining the decompressed transmission data of the paired device;
[0044] Step S42: extracting the screen recording image by decompressing the transmission data of the paired device, thereby obtaining the screen recording image transmitted by the paired device;
[0045] Step S43: performing screen recording image analysis on the screen recording image transmitted by the paired device, thereby obtaining feature data of the screen recording image;
[0046] Step S44: obtaining a screen parameter set of the mobile communication device, and defining a screen projection simulation boundary condition according to the screen parameter set of the mobile communication device, thereby obtaining a screen projection simulation boundary condition;
[0047] Step S45: performing a screen projection simulation test on the recorded screen image feature data according to the screen projection simulation boundary conditions, thereby obtaining screen projection simulation test data;
[0048] Step S46: Select the optimal screen projection simulation parameters for the screen projection simulation test data to obtain a recorded screen image projection parameter set, and transmit it to the mobile communication device to execute the device image projection task.
[0049] The compressed data transmission of the present invention reduces the amount of data, reduces the bandwidth required for transmission, and improves the transmission speed. By decompressing the data, higher quality image data can be processed in subsequent steps to ensure the integrity and accuracy of the data. Supporting data transmission and decompression between multiple devices improves the versatility and compatibility of the system. The screen recording image is extracted from the decompressed data so that subsequent image processing and analysis can be based on real image data. In the screen recording image extraction stage, it is ensured that the extracted data has sufficient clarity and accuracy, providing high-quality input for subsequent image analysis. By parsing the screen recording image, key feature data such as color, shape, text, etc. are extracted, which helps to understand the image content. The parsed feature data can be used for further image processing, analysis and optimization, such as screen projection simulation testing. By obtaining and using the screen parameters of the mobile communication device, it is ensured that the boundary conditions of the screen projection simulation match the actual screen, providing a more accurate simulation effect. Defining the boundary conditions of the screen projection simulation helps reduce the distortion or mismatch problems that may occur during screen projection. Through the screen projection simulation test, it can be verified whether the screen projection effect of the screen recording image on the target device meets expectations. According to the test results, the screen projection parameters can be adjusted to ensure that the final screen projection effect is optimal and meets the needs of users. By selecting the optimal projection simulation parameters, the best image projection effect is ensured, avoiding possible quality degradation during the projection process. The optimized projection parameter set is transmitted to the mobile communication device to ensure the projection effect and smoothness of the image on the device. Finally, high-quality image projection tasks are achieved, improving the user's visual experience and satisfaction.
[0050] Optionally, step S5 specifically includes:
[0051] Step S51: acquiring touch interaction data of the mobile communication device, and performing interactive pressing feature extraction and interactive touch point feature extraction according to the touch interaction data of the mobile communication device, thereby obtaining interactive pressing data and interactive touch point data;
[0052] Step S52: performing short-time touch point displacement calculation on the interactive touch point data to obtain short-time touch point displacement data, and classifying and calculating the interactive touch point data according to the short-time touch point displacement data to obtain click interaction data and drag interaction data;
[0053] Step S53: performing pressing force statistics on the interactive pressing data, so as to obtain high pressing force interactive data and low pressing force interactive data;
[0054] Step S54: interactively correlating the high-pressure interaction data and the click interaction data to obtain heavy-click interaction data; interactively correlating the low-pressure interaction data and the click interaction data to obtain light-click interaction data;
[0055] Step S55: integrating the drag interaction data, the heavy click interaction data, and the light click interaction data, thereby obtaining touch interaction behavior data;
[0056] Step S56: Perform BLE command mapping on the touch interaction behavior data to obtain a BLE command stream to be sent, and transmit it to the paired device to execute the paired device control task.
[0057] The present invention can understand the user's operation behavior on the device in detail by acquiring the touch interaction data of the mobile communication device. This includes the touch position, pressing force, touch point, etc. Extracting interactive pressing features (such as pressing force) and interactive touch point features (such as touch point position) can provide a deeper basis for user behavior analysis and help design a more accurate interactive experience. The extracted interactive pressing data and touch point data provide high-quality basic data for subsequent data analysis and classification, which can improve the recognition accuracy of user operations. Calculating the displacement of short-term touch points can identify the user's operation intention, such as distinguishing between click and drag actions. Click actions usually involve smaller displacements, while drag actions involve larger displacements. Through classification calculation, touch interaction behaviors can be effectively divided into click interaction data and drag interaction data, which is convenient for subsequent processing and application. Classifying touch point displacement data can improve the ability to understand user operations and help make more accurate responses. By counting the pressing force, different pressures applied by the user during operation can be identified, thereby dividing them into high pressing force interaction data and low pressing force interaction data. This classification helps to understand the user's operating habits, such as distinguishing between light touch and hard press, which is of great significance for user interface design. Different responses or feedback based on the pressure applied by the user can improve the user experience and make the device more in line with the user's usage habits and needs. By associating high-pressure interaction data with click interaction data, "hard click" behavior can be identified, which may indicate that the user wants the device to perform more important operations or activate specific functions. By associating low-pressure interaction data with click interaction data, "light click" behavior can be identified, which is suitable for performing simple or routine operations. Through association analysis, the response to different types of click behaviors can be refined to provide more personalized operation feedback and control. Integrating the interaction data of drag, heavy click and light click can form comprehensive touch interaction behavior data. This integration can provide a complete user operation view for more complex application scenarios. The integration of touch interaction behavior data helps the system simulate user operations more accurately and improve user interfaces and interaction designs. By integrating multiple interaction data, user needs can be predicted and responded to more intelligently, thereby improving the operation convenience and user satisfaction of the device. Mapping touch interaction behavior data into a BLE command stream and transmitting it to the paired device can achieve remote control with the device. This allows users to directly control paired devices through touch operations, improving the convenience of operation. BLE (Bluetooth Low Energy) command mapping allows efficient communication between devices and supports low-power and stable remote control. Users can achieve more flexible device management and control.
[0058] Optionally, step S56 is specifically:
[0059] Step S561: obtaining predefined interaction instruction data, and performing interaction instruction association on the predefined interaction instruction data and the touch interaction behavior data, thereby obtaining interaction behavior instruction data;
[0060] Step S562: Acquire BLE protocol layer transmission data, and perform BLE command structure calculation on the BLE protocol layer transmission data, thereby obtaining BLE command structure data;
[0061] Step S563: mapping rules are formulated according to the interactive behavior instruction data and the BLE instruction structure data, thereby obtaining mapping rules;
[0062] Step S564: perform BLE command mapping on the touch interaction behavior data according to the mapping rule to obtain a BLE command set, and arrange the BLE command set by timestamp to obtain a BLE command stream to be sent.
[0063] The present invention can match the actual operation of the user with the predefined instruction by acquiring predefined interaction instruction data and touch interaction behavior data. This enables specific instructions to be executed according to the specific operation of the user (such as the duration and position of the touch, etc.), thereby improving the flexibility and personalization of user interaction. Associating the touch behavior data with the predefined instruction helps to accurately map the user operation to a specific function, thereby reducing misoperation and improving the response accuracy of the system. The predefined instruction set provides a standardized operation mode, so that the user does not need to remember complex operation processes during use, thereby simplifying the user experience. By calculating the instruction structure of the BLE protocol layer transmission data, it can be ensured that the generated BLE instruction complies with the specification of the BLE protocol, thereby ensuring the stability and reliability of communication. An accurate BLE instruction structure helps to optimize the packaging and transmission of data, improve transmission efficiency and reduce data loss or errors. Ensuring that the instruction structure complies with the requirements of the BLE protocol helps to communicate effectively with various BLE-supporting devices and increases compatibility. By formulating mapping rules, the user's interactive behavior can be accurately mapped to the BLE instruction. This mapping rule helps the system to better convert the user's intention into an actual BLE instruction, thereby improving integration and interaction effects. Establishing clear mapping rules can simplify the development and maintenance process, allowing developers to design and adjust interaction logic more efficiently. Clear mapping rules can reduce errors when converting between interaction behaviors and BLE commands, thereby improving stability and reliability. By mapping touch interaction behavior data to the BLE command set, the BLE command stream to be sent can be accurately generated to achieve precise control and response of the device. Arranging the timestamps of the BLE command set can ensure that the order and timing of command transmission are in line with expectations, thereby optimizing the timeliness and sequentiality of data transmission. Timely and accurate BLE command streams can improve the response speed and operation smoothness of the device and enhance the user experience, especially in application scenarios involving real-time interaction.
[0064] Optionally, the present invention further provides a screen projection system based on an Android device, which is used to execute the screen projection method based on an Android device as described above, and the screen projection system based on an Android device includes:
[0065] The signal environment digitization module is used to obtain the wireless scanning data of the mobile communication device, and integrate the BLE device broadcast signal distribution according to the wireless scanning data of the mobile communication device, so as to obtain the BLE device broadcast signal distribution data; digitize the signal environment of the mobile communication device according to the BLE device broadcast signal distribution data, so as to obtain the digital model of the mobile communication device signal environment;
[0066] The Bluetooth pairing module is used to perform Android device pairing screening on the Bluetooth scanning data of the mobile communication device through the digital model of the mobile communication device signal environment, so as to obtain the data of the device to be paired; perform Bluetooth pairing strategy analysis on the device to be paired according to the data of the device to be paired, so as to obtain the device Bluetooth pairing strategy, and transmit it to the mobile communication device to execute the device Bluetooth pairing task;
[0067] A wireless network connection module is used to screen wireless network connection nodes according to wireless scanning data of a mobile communication device, thereby obtaining wireless network connection node data; associate the wireless network connection node data with a network connection node key, thereby obtaining a wireless network connection node key, and transmit the key to the mobile communication device and a paired device to perform a network connection task;
[0068] The screen projection parameter selection module is used to obtain the compressed transmission data of the paired device, and decompress the transmitted screen recording image of the compressed transmission data of the paired device, so as to obtain the transmitted screen recording image of the paired device; select the screen projection parameters of the mobile communication device according to the transmitted screen recording image of the paired device, so as to obtain the screen recording image projection parameter set, and transmit it to the mobile communication device to perform the device image projection task;
[0069] The BLE command mapping module is used to obtain touch interaction data of the mobile communication device, and perform touch interaction behavior analysis on the touch interaction data of the mobile communication device to obtain touch interaction behavior data; perform BLE command mapping on the touch interaction behavior data to obtain the BLE command stream to be sent, and transmit it to the paired device to execute the paired device control task.
[0070] The screen projection system based on Android device of the present invention can implement any screen projection method based on Android device of the present invention, and is used to combine the operation and signal transmission medium between various modules to complete the screen projection method based on Android device. The internal modules of the system cooperate with each other to simplify the user operation process, enhance the convenience and flexibility of using Android device, and meet the actual needs of modern users in the configuration process of Android device.
[0071] Optionally, the present invention also provides a screen projection device, including a screen projection device main body, a power supply unit and an electrical control unit, the power supply unit is installed inside the screen projection device main body, the electrical control unit is electrically connected to the power supply unit, the electrical control unit is used to charge and control the screen projection device main body, and the electrical control unit is used to execute a screen projection method based on an Android device as described above. BRIEF DESCRIPTION OF THE DRAWINGS
[0072] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments thereof made with reference to the following drawings:
[0073] Figure 1 This is a schematic diagram of the steps of the screen projection method based on an Android device of the present invention;
[0074] Figure 2 Detailed step flow diagram of step S1 in the present invention;
[0075] Figure 3 Detailed step flow diagram of step S2 in the present invention;
[0076] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0077] The technical method of the present invention is described clearly and completely below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by technicians in this field without creative work are within the scope of protection of the present invention.
[0078] In addition, the accompanying drawings are only schematic illustrations of the present invention and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. The functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor methods and / or microcontroller methods.
[0079] It should be understood that, although the terms "first", "second", etc. may be used herein to describe various units, these units should not be limited by these terms. These terms are used only to distinguish one unit from another unit. For example, without departing from the scope of the exemplary embodiments, the first unit may be referred to as the second unit, and similarly the second unit may be referred to as the first unit. The term "and / or" used herein includes any and all combinations of one or more of the listed associated items.
[0080] To achieve this, please refer to Figures 1 to 3 The present invention provides a screen projection method based on an Android device, the method comprising the following steps:
[0081] Step S1: obtaining wireless scanning data of a mobile communication device, and integrating the distribution of BLE device broadcast signals according to the wireless scanning data of the mobile communication device, thereby obtaining the distribution data of BLE device broadcast signals; digitizing the signal environment of the mobile communication device according to the distribution data of the BLE device broadcast signals, thereby obtaining a digital model of the signal environment of the mobile communication device;
[0082] In this embodiment, the wireless scanning function of a mobile communication device (such as the BluetoothAdapter on an Android device) is used to scan surrounding BLE devices, and the broadcast signal of each BLE device is recorded, including the device MAC address, signal strength (RSSI), broadcast interval, etc. The scanned BLE broadcast signal data is integrated into a data structure, such as a data table or a database, which contains information such as the unique identifier (UUID), signal strength, and timestamp of each device. Based on the integrated data, an algorithm (such as cluster analysis or spatial interpolation) is used to build a BLE device broadcast signal distribution model. The model can reflect the signal strength distribution at different locations, such as creating a signal strength map in an indoor environment. You can use Android Studio to develop an application, use the startLeScan method of BluetoothAdapter to scan BLE devices, store the scan results in a SQLite database, use the K-means clustering algorithm to analyze the signal distribution, and create a signal strength heat map.
[0083] Step S2: performing Android device pairing screening on the Bluetooth scanning data of the mobile communication device through the digital model of the mobile communication device signal environment, thereby obtaining the data of the device to be paired; performing Bluetooth pairing strategy analysis on the device to be paired according to the data of the device to be paired, thereby obtaining the device Bluetooth pairing strategy, and transmitting it to the mobile communication device to execute the device Bluetooth pairing task;
[0084] In this embodiment, the obtained digital model of the signal environment of the mobile communication device is used to filter and pair according to the broadcast data of the BLE device, and select the device with the highest matching degree with the device. For example, the BLE device suitable for pairing is screened out based on the RSSI value and the device category. The device to be paired is analyzed, and the compatibility, security and user needs of the device are considered to generate a suitable Bluetooth pairing strategy. The strategy may include PIN code requirements for pairing, whether user confirmation is required, etc. The generated pairing strategy is sent to the mobile communication device, and the createBond method of the BluetoothDevice class of Android is used to perform the pairing task. The device scanning and screening function can be implemented in the application of the mobile communication device, matching devices based on RSSI and UUID, analyzing strategies such as security requirements and user confirmation processes, and finally calling the pairing method of BluetoothDevice.
[0085] Step S3: Screening wireless network connection nodes according to the wireless scanning data of the mobile communication device to obtain wireless network connection node data; associating the wireless network connection node data with a network connection node key to obtain the wireless network connection node key, and transmitting the key to the mobile communication device and the paired device to perform the network connection task;
[0086] In this embodiment, based on the wireless scanning data of the mobile communication device, the surrounding wireless network connection nodes (such as Wi-Fi hotspots) are identified, and their SSID, signal strength, frequency band and other information are recorded. The screened wireless network nodes are matched with the preset network connection keys to generate node keys. For example, the network with the SSID "HomeNetwork" is associated with the corresponding password. The obtained node key and connection information are transmitted to the mobile communication device and the paired device that has been paired with Bluetooth, and the network connection task is performed using the Wi-Fi connection API (such as Android's WifiManager). The getScanResults method of WifiManager can be used to obtain the network list, match it with a known key, and use the addNetwork method to configure the network connection, and then use methods such as Wi-Fi Direct or other device sharing methods to share the network with Bluetooth paired devices.
[0087] Step S4: obtaining the compressed transmission data of the paired device, and decompressing the transmitted screen recording image of the paired device compressed transmission data, thereby obtaining the transmitted screen recording image of the paired device; selecting the screen projection parameters of the mobile communication device according to the transmitted screen recording image of the paired device, thereby obtaining the screen recording image projection parameter set, and transmitting it to the mobile communication device to perform the device image projection task;
[0088] In this embodiment, compressed transmitted data (such as video screen recording data) is obtained from the paired device, and the screen recording image data is decompressed using a decompression algorithm (such as ZIP decompression). The screen recording image data is analyzed, appropriate screen projection parameters (such as resolution, frame rate) are selected, and a parameter set is generated. Ensure image clarity and smoothness. The selected screen projection parameter set is transmitted to the mobile communication device, and the screen projection API (such as Miracast or Chromecast API) is used to perform the image projection task. You can use a decompression library such as Zip4j, set the screen projection parameters and call the Miracast API to complete the image projection.
[0089] Step S5: Acquire the touch interaction data of the mobile communication device, and perform touch interaction behavior analysis on the touch interaction data of the mobile communication device to obtain the touch interaction behavior data; perform BLE command mapping on the touch interaction behavior data to obtain the BLE command stream to be sent, and transmit it to the paired device to execute the paired device control task.
[0090] In this embodiment, the user's touch interaction data (such as click position, sliding direction) is obtained from the mobile communication device, and the user's operation behavior is recorded. The touch interaction data is analyzed using a behavior analysis algorithm, for example, the click position is analyzed to determine the user's intention (such as launching an application or adjusting settings). The touch behavior data is mapped to a corresponding BLE command stream, for example, the click operation is mapped to a BLE control command, and sent to the paired device via BLE. The GestureDetector class can be used to process touch events, generate BLE commands after parsing user gestures, and use the BluetoothGatt class to send commands to the device.
[0091] Optionally, step S1 specifically includes:
[0092] Step S11: obtaining wireless scanning data of the mobile communication device, and performing Bluetooth scanning feature extraction on the wireless scanning data of the mobile communication device, thereby obtaining Bluetooth scanning data of the mobile communication device;
[0093] In this embodiment, the Bluetooth scanning function is used on the mobile communication device, and the scanning interval is set to 1 second. Each scan obtains the MAC address of the device, the content of the broadcast data packet and the RSSI value. The scanned data is stored in the local database, ensuring that the data record includes detailed information such as the scanning timestamp, the device unique identifier, the broadcast data and the signal strength. The Bluetooth scanning data contained in the local database is then extracted to obtain the Bluetooth scanning data of the mobile communication device.
[0094] Step S12: extracting broadcast signal strength features from Bluetooth scanning data of the mobile communication device, thereby obtaining broadcast signal strength data of the scanning device;
[0095] In this embodiment, the broadcast signal strength feature is extracted from the Bluetooth scanning data of the mobile communication device. The RSSI value is extracted by parsing the Bluetooth data packet. The RSSI value extraction threshold is set to -100 dBm to filter out broadcast data with too weak signal strength. The extracted RSSI value and the corresponding device identifier are stored in a structured data table for subsequent processing.
[0096] Step S13: performing device distance estimation on the scanning device broadcast signal strength data, thereby obtaining the scanning device estimated distance data;
[0097] In this embodiment, the RSSI value is used to calculate the distance between the device and the mobile communication device. A standard path loss model (e.g., Free Space Path Loss model) is used, where the path loss factor is set to 2, and the calculation formula is distance = 10^((RSSI - A) / (10 × n)), where A is the received signal strength and n is the path loss index. The device distance is estimated by this calculation method, and the estimated distance data of each device is recorded.
[0098] Step S14: performing signal distribution integration according to the broadcast signal strength data of the scanning device and the estimated distance data of the scanning device, thereby obtaining the broadcast signal distribution data of the BLE device;
[0099] In this embodiment, the broadcast signal strength data and the device distance estimation data are integrated. The signal strength of each device is combined with the estimated distance using a weighted average method to generate a signal distribution map. These data are input into the signal distribution integration algorithm to generate BLE broadcast signal distribution data including device location, signal strength and its changes.
[0100] Step S15: digitize the signal environment of the mobile communication device according to the BLE device broadcast signal distribution data, so as to obtain a digital model of the signal environment of the mobile communication device.
[0101] In this embodiment, a digital model of the signal environment is created based on the generated BLE device broadcast signal distribution data. Using 3D modeling software, the signal strength and device distribution data are input into the model to build an accurate digital model of the signal environment. This model can visualize the signal strength changes through software tools and provide it to the system for further analysis and optimization.
[0102] Optionally, step S2 specifically includes:
[0103] Step S21: extracting the MAC address of the scanning device from the Bluetooth scanning data of the mobile communication device, thereby obtaining the MAC address data of the scanning device;
[0104] In this embodiment, a Bluetooth scanning application is run on a mobile communication device (such as a smart phone or tablet). The application uses the Bluetooth module to scan surrounding devices and collect the Bluetooth broadcast data of all detectable devices. In the acquired broadcast data, the MAC address of each device is extracted to form a MAC address list. The list contains the unique identifiers of all devices within the scanning range. For example, if devices A, B, and C are scanned, their MAC addresses are "00:11:22:33:44:55", "66:77:88:99:AA:BB", and "CC:DD:EE:FF:00:11", respectively. These addresses will be stored and used for subsequent pairing screening.
[0105] Step S22: obtaining the MAC address data of the device to be paired through the mobile communication device, and filtering the MAC address data of the scanning device for pairing according to the MAC address data of the device to be paired, thereby obtaining the MAC address data of the filtering device;
[0106] In this embodiment, on the mobile communication device, the user enters the MAC address of the device to be paired or selects the name of the device to be paired through the Bluetooth setting interface. The MAC address of the device to be paired is compared with the MAC address list of the scanning device obtained in step S21. The matching process can use a simple matching algorithm or a more complex filtering mechanism, such as filtering based on device type. If the MAC address of the device to be paired is "66:77:88:99:AA:BB", the system filters out the matching address from the MAC address list of the scanning device to obtain the filtered device MAC address data. For example, if the list contains "66:77:88:99:AA:BB", this address will be retained for further processing.
[0107] Step S23: extracting the screening device scanning data from the Bluetooth scanning data of the mobile communication device according to the screening device MAC address data, thereby obtaining the screening device scanning data;
[0108] In this embodiment, on the mobile communication device, the filtered MAC address data is used to filter the Bluetooth scan results. The data that matches the MAC address of the filtered device is extracted from the scanned Bluetooth data. This involves parsing specific fields in the Bluetooth broadcast packet, such as the device name, signal strength, etc., to confirm whether it meets the filtering conditions. For example, if the device MAC address contained in the scan data is "66:77:88:99:AA:BB", the complete scan data related to this address, such as the device signal strength and signal quality, is extracted for further analysis.
[0109] Step S24: using the digital model of the mobile communication device signal environment to remove the spoofed MAC address devices from the screening device scan data, thereby obtaining the data of the device to be paired;
[0110] In this embodiment, the extracted device scan data is analyzed through the digital model of the signal environment of the mobile communication device. The digital model of the signal environment may include analysis of factors such as device location and signal strength fluctuations to identify and remove disguised MAC addresses. Machine learning models can be used to detect and remove disguised devices that do not match the signal characteristics of real devices. For example, if the signal strength of certain devices fluctuates too much or does not match the known device characteristics, they are marked as disguised devices and removed from the device data to be paired.
[0111] Step S25: Analyze the Bluetooth pairing strategy of the device to be paired according to the data of the device to be paired, so as to obtain the device Bluetooth pairing strategy, and transmit it to the mobile communication device to execute the device Bluetooth pairing task.
[0112] In this embodiment, after the data of the device to be paired is prepared, the mobile communication device performs a Bluetooth pairing strategy analysis. The analysis includes evaluating the security of device pairing, pairing mode (such as point-to-point pairing, PIN code pairing, etc.), and the communication encryption method during the pairing process. The system generates a suitable pairing strategy and transmits it to the mobile communication device to perform the actual pairing task. For example, if the device to be paired supports "secure pairing mode", the system will generate a corresponding pairing command and start the pairing process to ensure that the communication between the devices is secure.
[0113] Optionally, step S24 is specifically:
[0114] Step S241: classifying the low device broadcast signal strength of the screening device scanning data through the mobile communication device signal environment model, thereby obtaining low signal strength area data;
[0115] In this embodiment, in the mobile communication device signal environment model, the device signal strength data is collected and classified, for example, the area with a signal strength lower than -80dBm is marked as a low signal strength area. The implementation method includes setting a threshold and applying a signal strength filtering algorithm to classify all signal strength data lower than the threshold, thereby identifying the low signal strength area data for subsequent processing.
[0116] Step S242: performing scanning area device address change statistics on the screening device scanning data, thereby obtaining scanning area device address change data;
[0117] In this embodiment, the device address statistics are performed on the scan data by recording the changes of the device address in each scan cycle. For example, a time window (such as every 5 minutes) is used to count the frequency of device address changes and generate device address change data. Such data can help identify areas in the scan area where device addresses change frequently.
[0118] Step S243: dividing the scanning area device address change data into high-frequency device address change areas, thereby obtaining high-frequency device address change area data;
[0119] In this embodiment, a cluster analysis method (such as K-means or DBSCAN) is applied to divide the device address change data into high-frequency areas. For example, an area where the device address change frequency exceeds a certain threshold (such as more than 10 changes per hour) is defined as a high-frequency device address change area. Such an area usually indicates abnormal device activity or camouflage behavior.
[0120] Step S244: performing a scan area intersection operation on the low signal strength area data and the high frequency device address change area data, thereby obtaining abnormal scan area data;
[0121] In this embodiment, the intersection of low signal strength area data and high frequency device address change area data is calculated. The implementation method includes using spatial database technology to overlay the two types of data on a map, extracting overlapping areas, and identifying abnormal scanning area data. These areas show potential abnormal areas with poor signals and frequent device changes.
[0122] Step S245: performing scanning device association on the screening device scanning data according to the abnormal scanning area data, thereby obtaining the disguised MAC address device data;
[0123] In this embodiment, the selected scanning devices are analyzed for association based on the abnormal scanning area data. For example, the device scanning records in the abnormal area are used to find the selected devices that appear in multiple abnormal areas, and form the disguised MAC address device data. These data are used to identify and track the behavior patterns of the disguised devices.
[0124] Step S246: remove the fake MAC address devices from the screening device scanning data according to the fake MAC address device data, thereby obtaining the device data to be paired.
[0125] In this embodiment, in the screening of device scan data, the device data based on the fake MAC address is eliminated. For example, a matching algorithm is used to compare the fake MAC address data with the device scan record, and the matching fake devices are filtered, thereby cleaning the device data to be paired, ensuring that the data finally obtained is more accurate and reliable.
[0126] Optionally, step S3 specifically includes:
[0127] Step S31: extracting Wi-Fi scanning features from the wireless scanning data of the mobile communication device, thereby obtaining the Wi-Fi scanning data of the mobile communication device;
[0128] In this embodiment, the Wi-Fi module of the mobile communication device is used to start the scanning function to detect available wireless networks around. The device scan includes recording the SSID, signal strength (in dBm) and other available information (such as frequency band and security type) of each network. These data are stored in the local database of the device for subsequent analysis. For example, when a Wi-Fi scan is started on a smartphone, the device discovers and records 10 wireless networks around it. The scan data of each network includes the network name (SSID), signal strength (such as -65 dBm), channel number and encryption method.
[0129] Step S32: extracting network node SSID features and network node signal strength features from the Wi-Fi scan data of the mobile communication device, thereby obtaining scanned network node SSID data and scanned network node signal strength data;
[0130] In this embodiment, the SSID and signal strength of each network node are extracted from the obtained scan data. SSID feature extraction includes storing SSID data as a string, while signal strength feature extraction stores the signal strength value as a numerical value. These data are further sorted and classified for subsequent processing. SSIDs such as "HomeNetwork123" and "CafeWiFi" in the scan results are extracted as independent entries, and the corresponding signal strengths are recorded at the same time, for example, the signal strength of "HomeNetwork123" is -60 dBm, and the signal strength of "CafeWiFi" is -70 dBm.
[0131] Step S33: obtaining pre-connected Wi-Fi network node data, and performing pre-connected network node SSID feature extraction and pre-connected network node key feature extraction on the pre-connected Wi-Fi node data, thereby obtaining pre-connected network node SSID data and pre-connected network node key data;
[0132] In this embodiment, the SSID and encryption key of the pre-connected network are extracted from the saved Wi-Fi network configuration of the mobile communication device. The device checks the network information that the user has previously connected to or pre-stored, and extracts the SSID and encryption key (if any) of each network. This data is used to determine the network that the user may want to reconnect to. For example, the device finds the SSID of the network that the user has connected to before, such as "HomeNetwork123" and "OfficeWiFi", and extracts the corresponding encryption key. The key is stored in an encrypted format, such as the WPA2 key "7d0f2f9aB3".
[0133] Step S34: dividing nodes with high signal strength according to the scanned network node signal strength data, thereby obtaining high signal strength node data;
[0134] In this embodiment, the extracted signal strength data is processed to filter out network nodes with signal strengths higher than a predetermined threshold (e.g., signal strength greater than -65 dBm). These nodes are considered to have good connection stability and are therefore marked as high signal strength nodes. If the threshold is set to -65 dBm, network nodes with a signal strength of -60 dBm are filtered out, such as "HomeNetwork123", and these nodes are marked as high signal strength nodes.
[0135] Step S35: performing SSID node screening on the scanned network node SSID data according to the pre-connected network node SSID data, thereby obtaining SSID-compliant node data;
[0136] In this embodiment, the extracted pre-connected network SSID data is compared with the scanned SSID data to filter out matching SSIDs. These SSIDs are considered as candidate nodes that meet the user's connection requirements. Assuming that the pre-connected network SSIDs include "HomeNetwork123" and "OfficeWiFi", and "HomeNetwork123" is found in the scan results, "HomeNetwork123" is filtered as a matching node.
[0137] Step S36: performing node intersection operation on the high signal strength node data and the SSID matching node data, thereby obtaining the wireless network connection node data;
[0138] In this embodiment, the intersection operation is performed on the high signal strength node data and the node data that meets the SSID condition to obtain the wireless network nodes that meet both conditions. These nodes are the networks that are most likely to be successfully connected. If the high signal strength nodes include "HomeNetwork123" and "CafeWiFi", and the nodes that meet the SSID condition also include "HomeNetwork123", then "HomeNetwork123" becomes the final wireless network connection node data.
[0139] Step S37: associate the wireless network connection node data with the network connection node key according to the pre-connection network node key data, thereby obtaining the wireless network connection node key, and transmitting it to the mobile communication device and the paired device to perform the network connection task.
[0140] In this embodiment, the extracted pre-connection network key data is used to perform key association on the determined wireless network connection node. The key data is applied to the qualified network node to complete the connection setting, and the result is transmitted to the mobile communication device for the actual connection operation. The key association is performed on "HomeNetwork123", and the key "7d0f2f9aB3" extracted from the pre-connection network node key data is used to apply the key to the network connection setting. Then, the mobile communication device attempts to connect to the "HomeNetwork123" network to complete the connection process, and the mobile communication device then uses network sharing technology such as Wi-Fi Direct to allow the Bluetooth paired device to complete the network connection.
[0141] Optionally, step S4 is specifically:
[0142] Step S41: obtaining the compressed transmission data of the paired device, and decompressing the compressed transmission data of the paired device, thereby obtaining the decompressed transmission data of the paired device;
[0143] In this embodiment, a data file compressed by a compression algorithm (such as ZIP or RAR) is obtained from the data transmitted from the paired device (Android device) to the mobile communication device through the network. These files include compressed files of screen recording videos. After obtaining the compressed data, use the corresponding decompression software (such as WinRAR, 7-Zip) to decompress it. For example, if the compressed data uses the ZIP format, it will be decompressed by programming to generate the original screen recording video file. The decompressed data is the decompressed transmission data of the paired device, which is an uncompressed screen recording video file.
[0144] Step S42: extracting the screen recording image by decompressing the transmission data of the paired device, thereby obtaining the screen recording image transmitted by the paired device;
[0145] In this embodiment, in the decompressed screen recording video file, each frame of the image is extracted using video processing software (such as OpenCV library, FFmpeg tool). For example, if the screen recording video is an MP4 file, each frame of the image can be extracted through the FFmpeg command line tool or the corresponding API interface. These images are the screen recording images transmitted by the paired device. The extracted images will be saved as static image files in PNG or JPEG format.
[0146] Step S43: performing screen recording image analysis on the screen recording image transmitted by the paired device, thereby obtaining feature data of the screen recording image;
[0147] In this embodiment, image analysis technology (e.g., using a deep learning model such as a convolutional neural network) is applied to extract feature data from the obtained screen recording image. For example, elements in the image (e.g., text, icons, buttons, etc.) are analyzed through a trained image recognition model to obtain feature data of the screen recording image. These feature data include the position of objects in the image, color distribution, texture features, etc., and may be stored in vector form for subsequent analysis.
[0148] Step S44: obtaining a screen parameter set of the mobile communication device, and defining a screen projection simulation boundary condition according to the screen parameter set of the mobile communication device, thereby obtaining a screen projection simulation boundary condition;
[0149] In this embodiment, a screen parameter set is obtained from a mobile communication device (such as a smart phone), including screen resolution (such as 1080x2400 pixels), screen size (such as 6.5 inches), screen ratio (such as 16:9), etc. These parameters can be obtained through the system API of the device or the device manual. Then, the projection simulation boundary conditions are defined according to these screen parameters, such as the size and position of the simulation boundary box, to ensure that the projection content is displayed correctly on the target device. These boundary conditions can be used in a simulation environment to set parameters such as the aspect ratio and resolution adaptation of the display area.
[0150] Step S45: performing a screen projection simulation test on the recorded screen image feature data according to the screen projection simulation boundary conditions, thereby obtaining screen projection simulation test data;
[0151] In this embodiment, the projection simulation test is performed using the defined projection simulation boundary conditions. For example, the recorded screen image feature data is combined with the simulated boundary conditions to create a virtual projection environment to simulate the display effect of the image on the target device screen. This can be done through image processing software or a simulator, where the image is adjusted and scaled to adapt to different boundary conditions. The test data includes the adjusted image quality, position, and display effect under boundary conditions to verify whether it meets expectations.
[0152] Step S46: Select the optimal screen projection simulation parameters for the screen projection simulation test data to obtain a recorded screen image projection parameter set, and transmit it to the mobile communication device to execute the device image projection task.
[0153] In this embodiment, the screen projection simulation test data is analyzed to select the best screen projection simulation parameters, such as the most suitable image scaling ratio, position adjustment parameters, etc. By comparing the screen projection effects under different parameter combinations, a parameter set that can make the image present the best effect on the target device is selected. Finally, these parameter sets are transmitted to the mobile communication device through the network interface. After the device receives these parameters, it performs the image projection task according to the parameters to ensure that the image content can be accurately and clearly displayed on the device screen.
[0154] Optionally, step S5 specifically includes:
[0155] Step S51: acquiring touch interaction data of the mobile communication device, and performing interactive pressing feature extraction and interactive touch point feature extraction according to the touch interaction data of the mobile communication device, thereby obtaining interactive pressing data and interactive touch point data;
[0156] In this embodiment, the touch screen sensor of the mobile communication device is used to capture the user's touch interaction data. Specifically, the coordinates (x, y) of the touch point and the touch pressure can be obtained through the multi-touch sensor. The interactive pressing features (such as the size of the touch pressure) and the interactive touch point features (such as the coordinate position of the touch point and the touch time) are extracted from the original touch data.
[0157] Step S52: performing short-time touch point displacement calculation on the interactive touch point data to obtain short-time touch point displacement data, and classifying and calculating the interactive touch point data according to the short-time touch point displacement data to obtain click interaction data and drag interaction data;
[0158] In this embodiment, short-term touch point displacement data is obtained by calculating the position difference of consecutive touch points. A timestamp is used to mark the time of the touch event, so as to calculate the touch point movement distance in each time period. If the position of the touch point at time t1 is (x1, y1) and the position at time t2 is (x2, y2), the displacement is √((x2 - x1)² + (y2 - y1)²). According to the displacement data, the interactive touch point data is classified into click interaction (short-term small displacement) or drag interaction (long-term large displacement).
[0159] Step S53: performing pressing force statistics on the interactive pressing data, so as to obtain high pressing force interactive data and low pressing force interactive data;
[0160] In this embodiment, the pressure data recorded during the touch process is counted, and the data is divided into high-pressure interaction data and low-pressure interaction data according to the pressure value. The threshold of high pressure is set to ≥700, and the threshold of low pressure is set to <700. According to the pressure value, the touch data is divided into two categories: high pressure interaction data and low pressure interaction data. The pressure threshold can be adjusted according to the sensor sensitivity of the device, for example, the threshold range is set to 500-800.
[0161] Step S54: interactively correlating the high-pressure interaction data and the click interaction data to obtain heavy-click interaction data; interactively correlating the low-pressure interaction data and the click interaction data to obtain light-click interaction data;
[0162] In this embodiment, click interaction data with high pressure intensity is associated and marked as heavy click interaction data. Click interaction data with low pressure intensity is associated and marked as light click interaction data. The association rule is based on the time interval between touch pressure and click. For example, a click interaction with high pressure intensity within 200ms is considered a heavy click.
[0163] Step S55: integrating the drag interaction data, the heavy click interaction data, and the light click interaction data, thereby obtaining touch interaction behavior data;
[0164] In this embodiment, the drag interaction data, the heavy click interaction data, and the light click interaction data are integrated into the overall touch interaction behavior data. A comprehensive analysis is performed on a series of touch interactions of the user, such as when the user includes click, heavy click, and drag in one operation. The standard for behavior integration can be based on the operation sequence and time interval, for example, all interaction behaviors occurring within 5 seconds are considered as a complete touch interaction behavior.
[0165] Step S56: Perform BLE command mapping on the touch interaction behavior data to obtain a BLE command stream to be sent, and transmit it to the paired device to execute the paired device control task.
[0166] In this embodiment, the integrated touch interaction behavior data is mapped to BLE commands. Each touch behavior (such as click, drag) corresponds to a specific BLE command. A heavy click is mapped to the BLE command "0x01", and a drag is mapped to the BLE command "0x02". The generated BLE command stream is transmitted to the paired device to perform the corresponding control task. The format of the BLE command stream should comply with the BLE protocol specification, such as using GATT (Generic Attribute Profile) for data transmission.
[0167] Optionally, step S56 is specifically:
[0168] Step S561: obtaining predefined interaction instruction data, and performing interaction instruction association on the predefined interaction instruction data and the touch interaction behavior data, thereby obtaining interaction behavior instruction data;
[0169] In this embodiment, data of user interaction instructions are obtained from the device, such as different gestures and click behaviors of touching the screen. These data include sliding direction, click position, etc. Then, these data are matched with predefined interaction instructions. For example, sliding upward corresponds to a specific function, while clicking a button corresponds to another function. This association can be completed based on the classification of behavior patterns and the corresponding relationship of instructions, and finally a specific instruction for each touch behavior is obtained.
[0170] Step S562: Acquire BLE protocol layer transmission data, and perform BLE command structure calculation on the BLE protocol layer transmission data, thereby obtaining BLE command structure data;
[0171] In this embodiment, data of the BLE (Bluetooth Low Energy) protocol is obtained, such as data received from a sensor or other BLE device. Then, the structure of the BLE command is calculated by parsing this data. For example, the BLE protocol may define the header, payload, and tail of a data packet. This data is parsed and structured to extract the command and parameters, and finally obtain clear BLE command structure data.
[0172] Step S563: mapping rules are formulated according to the interactive behavior instruction data and the BLE instruction structure data, thereby obtaining mapping rules;
[0173] In this embodiment, mapping rules are formulated for the obtained interactive behavior instruction data and the obtained BLE instruction structure data. This includes formulating rules to map specific user touch behaviors to specific instructions in the BLE protocol. For example, the "slide" action is mapped to the "set mode" instruction in the BLE protocol. Assume that the "click" behavior corresponds to a function in the interactive data, and the "control command" in the BLE instruction structure contains the device operation type. Rules can be formulated to map "click" to the "turn on the light" command in the BLE instruction structure. The mapping rules should include specific details such as instruction type, parameter format, and instruction priority.
[0174] Step S564: perform BLE command mapping on the touch interaction behavior data according to the mapping rule to obtain a BLE command set, and arrange the BLE command set by timestamp to obtain a BLE command stream to be sent.
[0175] In this embodiment, the touch interaction behavior data is converted into BLE instructions according to the established mapping rules. For example, if the user slides his finger, it is converted into a specific BLE instruction. These instructions are arranged in chronological order to form a BLE instruction stream to be sent. This stream can be sent to the target device via BLE to achieve the function desired by the user.
[0176] Optionally, the present invention further provides a screen projection system based on an Android device, which is used to execute the screen projection method based on an Android device as described above, and the screen projection system based on an Android device includes:
[0177] The signal environment digitization module is used to obtain the wireless scanning data of the mobile communication device, and integrate the BLE device broadcast signal distribution according to the wireless scanning data of the mobile communication device, so as to obtain the BLE device broadcast signal distribution data; digitize the signal environment of the mobile communication device according to the BLE device broadcast signal distribution data, so as to obtain the digital model of the mobile communication device signal environment;
[0178] The Bluetooth pairing module is used to perform Android device pairing screening on the Bluetooth scanning data of the mobile communication device through the digital model of the mobile communication device signal environment, so as to obtain the data of the device to be paired; perform Bluetooth pairing strategy analysis on the device to be paired according to the data of the device to be paired, so as to obtain the device Bluetooth pairing strategy, and transmit it to the mobile communication device to execute the device Bluetooth pairing task;
[0179] A wireless network connection module is used to screen wireless network connection nodes according to wireless scanning data of a mobile communication device, thereby obtaining wireless network connection node data; associate the wireless network connection node data with a network connection node key, thereby obtaining a wireless network connection node key, and transmit the key to the mobile communication device and a paired device to perform a network connection task;
[0180] The screen projection parameter selection module is used to obtain the compressed transmission data of the paired device, and decompress the transmitted screen recording image of the compressed transmission data of the paired device, so as to obtain the transmitted screen recording image of the paired device; select the screen projection parameters of the mobile communication device according to the transmitted screen recording image of the paired device, so as to obtain the screen recording image projection parameter set, and transmit it to the mobile communication device to perform the device image projection task;
[0181] The BLE command mapping module is used to obtain touch interaction data of the mobile communication device, and perform touch interaction behavior analysis on the touch interaction data of the mobile communication device to obtain touch interaction behavior data; perform BLE command mapping on the touch interaction behavior data to obtain the BLE command stream to be sent, and transmit it to the paired device to execute the paired device control task.
[0182] The screen projection system based on Android device of the present invention can implement any screen projection method based on Android device of the present invention, and is used to combine the operation and signal transmission medium between various modules to complete the screen projection method based on Android device. The internal modules of the system cooperate with each other to simplify the user operation process, enhance the convenience and flexibility of using Android device, and meet the actual needs of modern users in the configuration process of Android device.
[0183] Optionally, the present invention also provides a screen projection device, including a screen projection device main body, a power supply unit and an electrical control unit, the power supply unit is installed inside the screen projection device main body, the electrical control unit is electrically connected to the power supply unit, the electrical control unit is used to charge and control the screen projection device main body, and the electrical control unit is used to execute a screen projection method based on an Android device as described above.
[0184] Therefore, the embodiments should be regarded as illustrative and non-restrictive from all points, and the scope of the present invention is limited by the appended claims rather than the above description, and it is therefore intended that all changes falling within the meaning and range of equivalent elements of the application documents are included in the present invention.
[0185] The above description is only a specific embodiment of the present invention, so that those skilled in the art can understand or implement the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but should conform to the widest scope consistent with the principles and novel features invented herein.
Claims
1. A screen projection method based on an Android device, characterized in that: The following steps are involved: Step S1: obtaining wireless scanning data of a mobile communication device, and integrating the distribution of BLE device broadcast signals according to the wireless scanning data of the mobile communication device, thereby obtaining the distribution data of BLE device broadcast signals; digitizing the signal environment of the mobile communication device according to the distribution data of the BLE device broadcast signals, thereby obtaining a digital model of the signal environment of the mobile communication device; Step S2: performing Android device pairing screening on the Bluetooth scanning data of the mobile communication device through the digital model of the mobile communication device signal environment, thereby obtaining the data of the device to be paired; The Bluetooth pairing strategy of the device to be paired is analyzed according to the data of the device to be paired, so as to obtain the device Bluetooth pairing strategy, and transmit it to the mobile communication device to execute the device Bluetooth pairing task. Step S2 is specifically as follows: Step S21: extracting the MAC address of the scanning device from the Bluetooth scanning data of the mobile communication device, thereby obtaining the MAC address data of the scanning device; Step S22: obtaining the MAC address data of the device to be paired through the mobile communication device, and filtering the MAC address data of the scanning device for pairing according to the MAC address data of the device to be paired, thereby obtaining the MAC address data of the filtering device; Step S23: extracting the screening device scanning data from the Bluetooth scanning data of the mobile communication device according to the screening device MAC address data, thereby obtaining the screening device scanning data; Step S24: Remove the MAC address devices from the screening device scan data through the digital model of the mobile communication device signal environment, so as to obtain the device data to be paired. Step S24 is specifically as follows: Step S241: classifying the low device broadcast signal strength of the screening device scanning data through the mobile communication device signal environment model, thereby obtaining low signal strength area data; Step S242: performing scanning area device address change statistics on the screening device scanning data, thereby obtaining scanning area device address change data; Step S243: dividing the scanning area device address change data into high-frequency device address change areas, thereby obtaining high-frequency device address change area data; Step S244: performing a scan area intersection operation on the low signal strength area data and the high frequency device address change area data, thereby obtaining abnormal scan area data; Step S245: performing scanning device association on the screening device scanning data according to the abnormal scanning area data, thereby obtaining the disguised MAC address device data; Step S246: removing the fake MAC address devices from the screening device scanning data according to the fake MAC address device data, thereby obtaining the device data to be paired; Step S25: analyzing the Bluetooth pairing strategy of the device to be paired according to the data of the device to be paired, thereby obtaining the device Bluetooth pairing strategy, and transmitting it to the mobile communication device to execute the device Bluetooth pairing task; Step S3: Screening wireless network connection nodes according to the wireless scanning data of the mobile communication device, thereby obtaining wireless network connection node data; Associating the wireless network connection node data with the network connection node key, thereby obtaining the wireless network connection node key, and transmitting the key to the mobile communication device and the paired device to perform the network connection task; Step S4: obtaining the compressed transmission data of the paired device, and decompressing the transmission screen recording image of the compressed transmission data of the paired device, thereby obtaining the transmission screen recording image of the paired device; Select the screen projection parameters of the mobile communication device according to the screen recording image transmitted by the paired device, so as to obtain the screen recording image projection parameter set, and transmit it to the mobile communication device to execute the device image projection task; Step S5: Acquire the touch interaction data of the mobile communication device, and perform touch interaction behavior analysis on the touch interaction data of the mobile communication device to obtain the touch interaction behavior data; perform BLE command mapping on the touch interaction behavior data to obtain the BLE command stream to be sent, and transmit it to the paired device to execute the paired device control task.
2. The screen projection method based on an Android device according to claim 1, characterized in that: Step S1 is specifically as follows: Step S11: obtaining wireless scanning data of the mobile communication device, and performing Bluetooth scanning feature extraction on the wireless scanning data of the mobile communication device, thereby obtaining Bluetooth scanning data of the mobile communication device; Step S12: extracting broadcast signal strength features from Bluetooth scanning data of the mobile communication device, thereby obtaining broadcast signal strength data of the scanning device; Step S13: performing device distance estimation on the scanning device broadcast signal strength data, thereby obtaining the scanning device estimated distance data; Step S14: performing signal distribution integration according to the broadcast signal strength data of the scanning device and the estimated distance data of the scanning device, thereby obtaining the broadcast signal distribution data of the BLE device; Step S15: digitize the signal environment of the mobile communication device according to the BLE device broadcast signal distribution data, so as to obtain a digital model of the signal environment of the mobile communication device.
3. The screen projection method based on an Android device according to claim 1, characterized in that: Step S3 is specifically as follows: Step S31: extracting Wi-Fi scanning features from the wireless scanning data of the mobile communication device, thereby obtaining the Wi-Fi scanning data of the mobile communication device; Step S32: extracting network node SSID features and network node signal strength features from the Wi-Fi scan data of the mobile communication device, thereby obtaining scanned network node SSID data and scanned network node signal strength data; Step S33: obtaining pre-connected Wi-Fi network node data, and performing pre-connected network node SSID feature extraction and pre-connected network node key feature extraction on the pre-connected Wi-Fi node data, thereby obtaining pre-connected network node SSID data and pre-connected network node key data; Step S34: dividing nodes with high signal strength according to the scanned network node signal strength data, thereby obtaining high signal strength node data; Step S35: performing SSID node screening on the scanned network node SSID data according to the pre-connected network node SSID data, thereby obtaining SSID-compliant node data; Step S36: performing node intersection operation on the high signal strength node data and the SSID matching node data, thereby obtaining the wireless network connection node data; Step S37: associate the wireless network connection node data with the network connection node key according to the pre-connection network node key data, thereby obtaining the wireless network connection node key, and transmitting it to the mobile communication device and the paired device to perform the network connection task.
4. The screen projection method based on an Android device according to claim 1, characterized in that: Step S4 is specifically as follows: Step S41: obtaining the compressed transmission data of the paired device, and decompressing the compressed transmission data of the paired device, thereby obtaining the decompressed transmission data of the paired device; Step S42: extracting the screen recording image by decompressing the transmission data of the paired device, thereby obtaining the screen recording image transmitted by the paired device; Step S43: performing screen recording image analysis on the screen recording image transmitted by the paired device, thereby obtaining feature data of the screen recording image; Step S44: obtaining a screen parameter set of the mobile communication device, and defining a screen projection simulation boundary condition according to the screen parameter set of the mobile communication device, thereby obtaining a screen projection simulation boundary condition; Step S45: performing a screen projection simulation test on the recorded screen image feature data according to the screen projection simulation boundary conditions, thereby obtaining screen projection simulation test data; Step S46: Select the optimal screen projection simulation parameters for the screen projection simulation test data to obtain a recorded screen image projection parameter set, and transmit it to the mobile communication device to execute the device image projection task.
5. The screen projection method based on an Android device according to claim 1, characterized in that: Step S5 is specifically as follows: Step S51: acquiring touch interaction data of the mobile communication device, and performing interactive pressing feature extraction and interactive touch point feature extraction according to the touch interaction data of the mobile communication device, thereby obtaining interactive pressing data and interactive touch point data; Step S52: performing short-time touch point displacement calculation on the interactive touch point data to obtain short-time touch point displacement data, and classifying and calculating the interactive touch point data according to the short-time touch point displacement data to obtain click interaction data and drag interaction data; Step S53: performing pressing force statistics on the interactive pressing data, so as to obtain high pressing force interactive data and low pressing force interactive data; Step S54: interactively correlating the high-pressure interaction data and the click interaction data to obtain heavy-click interaction data; interactively correlating the low-pressure interaction data and the click interaction data to obtain light-click interaction data; Step S55: integrating the drag interaction data, the heavy click interaction data, and the light click interaction data, thereby obtaining touch interaction behavior data; Step S56: Perform BLE command mapping on the touch interaction behavior data to obtain a BLE command stream to be sent, and transmit it to the paired device to execute the paired device control task.
6. The screen projection method based on an Android device according to claim 5, characterized in that: Step S56 is specifically as follows: Step S561: obtaining predefined interaction instruction data, and performing interaction instruction association on the predefined interaction instruction data and the touch interaction behavior data, thereby obtaining interaction behavior instruction data; Step S562: Acquire BLE protocol layer transmission data, and perform BLE command structure calculation on the BLE protocol layer transmission data, thereby obtaining BLE command structure data; Step S563: mapping rules are formulated according to the interactive behavior instruction data and the BLE instruction structure data, thereby obtaining mapping rules; Step S564: perform BLE command mapping on the touch interaction behavior data according to the mapping rule to obtain a BLE command set, and arrange the BLE command set by timestamp to obtain a BLE command stream to be sent.
7. A screen projection system based on an Android device, characterized in that: Used to execute the screen projection method based on an Android device as claimed in claim 1, the screen projection system based on an Android device comprises: The signal environment digitization module is used to obtain the wireless scanning data of the mobile communication device, and integrate the BLE device broadcast signal distribution according to the wireless scanning data of the mobile communication device, so as to obtain the BLE device broadcast signal distribution data; digitize the signal environment of the mobile communication device according to the BLE device broadcast signal distribution data, so as to obtain the digital model of the mobile communication device signal environment; The Bluetooth pairing module is used to perform Android device pairing screening on the Bluetooth scanning data of the mobile communication device through the digital model of the mobile communication device signal environment, so as to obtain the data of the device to be paired; perform Bluetooth pairing strategy analysis on the device to be paired according to the data of the device to be paired, so as to obtain the device Bluetooth pairing strategy, and transmit it to the mobile communication device to execute the device Bluetooth pairing task; A wireless network connection module is used to screen wireless network connection nodes according to wireless scanning data of a mobile communication device, thereby obtaining wireless network connection node data; associate the wireless network connection node data with a network connection node key, thereby obtaining a wireless network connection node key, and transmit the key to the mobile communication device and a paired device to perform a network connection task; The screen projection parameter selection module is used to obtain the compressed transmission data of the paired device, and decompress the transmitted screen recording image of the compressed transmission data of the paired device, so as to obtain the transmitted screen recording image of the paired device; select the screen projection parameters of the mobile communication device according to the transmitted screen recording image of the paired device, so as to obtain the screen recording image projection parameter set, and transmit it to the mobile communication device to perform the device image projection task; The BLE command mapping module is used to obtain touch interaction data of the mobile communication device, and perform touch interaction behavior analysis on the touch interaction data of the mobile communication device to obtain touch interaction behavior data; perform BLE command mapping on the touch interaction behavior data to obtain the BLE command stream to be sent, and transmit it to the paired device to execute the paired device control task.
8. A screen projection device, characterized in that: The screen projection device includes a screen projection device body, a power supply unit and an electrical control unit. The power supply unit is installed inside the screen projection device body. The electrical control unit is electrically connected to the power supply unit. The electrical control unit is used to charge and control the screen projection device body. The electrical control unit is used to execute the screen projection method based on an Android device as described in any one of claims 1-6.
